Row 88817
Content Data
This page contains data entry 88817 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
Hi all! I shared the tests below to my group and thought people here might be interested. Hope it's alright to share them here! 😁
All credit for the trials go to the fantastic YT channel "In Depth Tech Reviews". Here's his original video. [https://www.youtube.com/watch?v=wER-Xo9nK78](https://www.youtube.com/watch?v=wER-Xo9nK78)
--- Yesterday "In Depth Tech Reviews" posted a video directly comparing the *practical* capabilities of ChatGPT 4o vs Gemini 1.5 Pro - and the results are quite conclusive!
* ChatGPT 4o got **8 correct out of 8 trials** ✅, while * Gemini 1.5 Pro only got **2 correct out of 8 trials** ❌
I love this test because it doesn’t talk about Context length or F1 score (things the average person don’t really care about 😂), but instead puts the AI/LLMs into real-life use cases.
See below for the 8 practical trials that both AIs were tested against:
https://preview.redd.it/lzbnhbc3ug2d1.png?width=1292&format=png&auto=webp&s=410cc7190a20762a14aca639843451d8996f4507
**Test 1: Object identification** - What does this thing do?
* ChatGPT 4o - ✅ | Correctly identified the product and what it’s for * Gemini 1.5 - ❌ | Says it’s not possible to identify the product
https://preview.redd.it/ce0tlkd6ug2d1.png?width=1292&format=png&auto=webp&s=8ddcb1acbcd54a44aeada0560b00c2495219348e
**Test 2: Recommendation** - Which one is better and why?
* ChatGPT 4o - ✅ | Identified the car models and gave a recommendation * Gemini 1.5 - ❌ | Suggested to just watch the youtube video :(
https://preview.redd.it/yfbuyux6ug2d1.png?width=1292&format=png&auto=webp&s=5bd0cf81170df005b7f18772e9865914d8eb5c7d
**Test 3: Technical Assistance** - How to adjust \[this setting\] for this device?
* ChatGPT 4o - ✅ | Gave correct instructions * Gemini 1.5 - ✅ | Gave correct instructions
https://preview.redd.it/zl2a1ug7ug2d1.png?width=1292&format=png&auto=webp&s=02b2dfa6de91f85928b9edf8110cd64f3836c276
**Test 4: Logic** - Solve for the code based on the clues
* ChatGPT 4o - ✅ | Gave the right answer of “042” * Gemini 1.5 - ❌ | Gave an incorrect answer
https://preview.redd.it/p1vkk638ug2d1.png?width=1292&format=png&auto=webp&s=f563555e8ae8b8d7c646f52eb4cc525b4252728c
**Test 5: Math Problems** - Understand mathematical equations
* ChatGPT 4o - ✅ | Correctly explained why the two calculators are different * Gemini 1.5 - ❌ | Failed to read the image correctly in the first place :(
https://preview.redd.it/ululeeo8ug2d1.png?width=1292&format=png&auto=webp&s=35b09e8901c57359cf5bc9b745773968a170b534
**Test 6: Puns** - Understand what the objects in the image represent
* ChatGPT 4o - ✅ | Correctly said that it’s “Fanta-stick!” * Gemini 1.5 - ✅ | Correctly said that it’s “Fanta-stick!”
https://preview.redd.it/99qa17g9ug2d1.png?width=1292&format=png&auto=webp&s=049615f80e663e8490addf8c2165a281b809481b
**Test 7: Humor in images** - Understand the underlying scenario in this image
* ChatGPT 4o - ✅ | Correctly explained that it’s a humorous situation of when some drivers remove their shoe for better control * Gemini 1.5 - ❌ | Failed to identify the humor in the image
https://preview.redd.it/rb9h9x1aug2d1.png?width=1292&format=png&auto=webp&s=3807e10d33a30b50a1bca9c65bb87b6cb2858adb
**Test 8: Visual Interpretation** - Understand what’s happening in the image
* ChatGPT 4o - ✅ | Correctly identifies what’s in the picture and why it’s funny * Gemini 1.5 - ❌ | Described the image (-ish) but didn’t understand the humor behind the image
So there you go. And since both are free, I guess best to just use ChatGPT 4o once it rolls out for you.
---
If this has been in any way useful, I hope you can check out [RoboNuggets](https://robonuggets.beehiiv.com/) where I originally shared this and other AI-related practical knowledge! My goal is not "AI daily news" (too many of those already), but instead share useful knowledge for everyday people to take advantage of the new AI normal. Cheers! 🥚
| Field | Value |
|---|---|
| text | Hi all! I shared the tests below to my group and thought people here might be interested. Hope it's alright to share them here! 😁 All credit for the trials go to the fantastic YT channel "In Depth Tech Reviews". Here's his original video. [https://www.youtube.com/watch?v=wER-Xo9nK78](https://www.youtube.com/watch?v=wER-Xo9nK78) --- Yesterday "In Depth Tech Reviews" posted a video directly comparing the *practical* capabilities of ChatGPT 4o vs Gemini 1.5 Pro - and the results are quite … |
| label | r/chatgpt |
| dataType | post |
| communityName | r/ChatGPT |
| datetime | 2024-05-25 |
| username_encoded | Z0FBQUFBQm5Lak1xeDR3el9ocHZjNkJTaFk1ZThuRkZtd2JETjU2eHdQaG1WazZXaVFwZmZXYjhFRXhYemFnWjRxVUJaVUloTGs2dFBFZWVUMVQ3U1JMS3Y4VVEzRm00aVN1NUI2ZHFOX3lEY1ZSdTFZNVZqdlk9 |
| url_encoded | Z0FBQUFBQm5Lak83TVN0ZC1SWGxBTm5jNGxZek1tS3daczVoVV9oOTh0OEpJOW5rNFgxRVBLOHZQeXl3Nk91SXZpRnZkaHJpZDctOVRDNzFmalpmbWhfMzRLeXYxLUl5SWxFU1RaM0QxbzRHN2YxR2ttcVQ2N0QybmlUZlVqSnRsWXpVMjYwWnd0YkpEYnZiREFZU09IRGt6NFp1ZjFuWkNPbUJGY29CdzJPWWtPOXByZjBReXFqZTF0Y0xhVDNxbWlXMW1MYk1sNzFWQXRGbU11TkF1Z0NLUGwxOERyNGNtQT09 |
Raw Record
{
"text": "Hi all! I shared the tests below to my group and thought people here might be interested. Hope it's alright to share them here! 😁\n\nAll credit for the trials go to the fantastic YT channel \"In Depth Tech Reviews\". Here's his original video. [https://www.youtube.com/watch?v=wER-Xo9nK78](https://www.youtube.com/watch?v=wER-Xo9nK78) \n\n--- \n \nYesterday \"In Depth Tech Reviews\" posted a video directly comparing the *practical* capabilities of ChatGPT 4o vs Gemini 1.5 Pro - and the results are quite conclusive!\n\n* ChatGPT 4o got **8 correct out of 8 trials** ✅, while\n* Gemini 1.5 Pro only got **2 correct out of 8 trials** ❌\n\nI love this test because it doesn’t talk about Context length or F1 score (things the average person don’t really care about 😂), but instead puts the AI/LLMs into real-life use cases.\n\nSee below for the 8 practical trials that both AIs were tested against:\n\nhttps://preview.redd.it/lzbnhbc3ug2d1.png?width=1292&format=png&auto=webp&s=410cc7190a20762a14aca639843451d8996f4507\n\n**Test 1: Object identification** - What does this thing do?\n\n* ChatGPT 4o - ✅ | Correctly identified the product and what it’s for\n* Gemini 1.5 - ❌ | Says it’s not possible to identify the product\n\nhttps://preview.redd.it/ce0tlkd6ug2d1.png?width=1292&format=png&auto=webp&s=8ddcb1acbcd54a44aeada0560b00c2495219348e\n\n**Test 2: Recommendation** - Which one is better and why?\n\n* ChatGPT 4o - ✅ | Identified the car models and gave a recommendation\n* Gemini 1.5 - ❌ | Suggested to just watch the youtube video :(\n\nhttps://preview.redd.it/yfbuyux6ug2d1.png?width=1292&format=png&auto=webp&s=5bd0cf81170df005b7f18772e9865914d8eb5c7d\n\n**Test 3: Technical Assistance** - How to adjust \\[this setting\\] for this device?\n\n* ChatGPT 4o - ✅ | Gave correct instructions\n* Gemini 1.5 - ✅ | Gave correct instructions\n\nhttps://preview.redd.it/zl2a1ug7ug2d1.png?width=1292&format=png&auto=webp&s=02b2dfa6de91f85928b9edf8110cd64f3836c276\n\n**Test 4: Logic** - Solve for the code based on the clues\n\n* ChatGPT 4o - ✅ | Gave the right answer of “042”\n* Gemini 1.5 - ❌ | Gave an incorrect answer\n\nhttps://preview.redd.it/p1vkk638ug2d1.png?width=1292&format=png&auto=webp&s=f563555e8ae8b8d7c646f52eb4cc525b4252728c\n\n**Test 5: Math Problems** - Understand mathematical equations\n\n* ChatGPT 4o - ✅ | Correctly explained why the two calculators are different\n* Gemini 1.5 - ❌ | Failed to read the image correctly in the first place :(\n\nhttps://preview.redd.it/ululeeo8ug2d1.png?width=1292&format=png&auto=webp&s=35b09e8901c57359cf5bc9b745773968a170b534\n\n**Test 6: Puns** - Understand what the objects in the image represent\n\n* ChatGPT 4o - ✅ | Correctly said that it’s “Fanta-stick!”\n* Gemini 1.5 - ✅ | Correctly said that it’s “Fanta-stick!”\n\nhttps://preview.redd.it/99qa17g9ug2d1.png?width=1292&format=png&auto=webp&s=049615f80e663e8490addf8c2165a281b809481b\n\n**Test 7: Humor in images** - Understand the underlying scenario in this image\n\n* ChatGPT 4o - ✅ | Correctly explained that it’s a humorous situation of when some drivers remove their shoe for better control\n* Gemini 1.5 - ❌ | Failed to identify the humor in the image\n\nhttps://preview.redd.it/rb9h9x1aug2d1.png?width=1292&format=png&auto=webp&s=3807e10d33a30b50a1bca9c65bb87b6cb2858adb\n\n**Test 8: Visual Interpretation** - Understand what’s happening in the image\n\n* ChatGPT 4o - ✅ | Correctly identifies what’s in the picture and why it’s funny\n* Gemini 1.5 - ❌ | Described the image (-ish) but didn’t understand the humor behind the image\n\nSo there you go. And since both are free, I guess best to just use ChatGPT 4o once it rolls out for you.\n\n---\n\nIf this has been in any way useful, I hope you can check out [RoboNuggets](https://robonuggets.beehiiv.com/) where I originally shared this and other AI-related practical knowledge! My goal is not \"AI daily news\" (too many of those already), but instead share useful knowledge for everyday people to take advantage of the new AI normal. Cheers! 🥚",
"label": "r/chatgpt",
"dataType": "post",
"communityName": "r/ChatGPT",
"datetime": "2024-05-25",
"username_encoded": "Z0FBQUFBQm5Lak1xeDR3el9ocHZjNkJTaFk1ZThuRkZtd2JETjU2eHdQaG1WazZXaVFwZmZXYjhFRXhYemFnWjRxVUJaVUloTGs2dFBFZWVUMVQ3U1JMS3Y4VVEzRm00aVN1NUI2ZHFOX3lEY1ZSdTFZNVZqdlk9",
"url_encoded": "Z0FBQUFBQm5Lak83TVN0ZC1SWGxBTm5jNGxZek1tS3daczVoVV9oOTh0OEpJOW5rNFgxRVBLOHZQeXl3Nk91SXZpRnZkaHJpZDctOVRDNzFmalpmbWhfMzRLeXYxLUl5SWxFU1RaM0QxbzRHN2YxR2ttcVQ2N0QybmlUZlVqSnRsWXpVMjYwWnd0YkpEYnZiREFZU09IRGt6NFp1ZjFuWkNPbUJGY29CdzJPWWtPOXByZjBReXFqZTF0Y0xhVDNxbWlXMW1MYk1sNzFWQXRGbU11TkF1Z0NLUGwxOERyNGNtQT09"
}
Entry Information
- Entry ID: 88817
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000