Row 56355

Row ID: 56355 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 56355 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Jokes aside, I've seen people say (or at least pretend) that very thing.

People get really sloppy with the idea of what LLMs "understand". Even people who work directly on them end up fooling themselves about the capabilities of the thing they created.

And yet, ChatGPT and Sora routinely miss important details about the things they generate, making mistakes that demonstrate how they are following association paths, not demonstrating actual understanding.

In a previous thread, I demonstrated this by having ChatGPT generate a story set in Chicago and it proceeded to do a pretty decent job... up to the point where it had the villain fighting the heroes atop the Chicago Bean. And it did that because it didn't actually understand what the bean was or the context that it existed in or any of the other things in the area that would have been a better option. It just picked an iconic location without truly knowing what a dramatic setting would look like or what the Bean was.

(Bonus points: The villiain was a shadow monster, and there's some weird cognitive dissonance in a shadow creature picking a mirrored oblong shape as the place it was going to fight...)

FieldValue
text Jokes aside, I've seen people say (or at least pretend) that very thing. People get really sloppy with the idea of what LLMs "understand". Even people who work directly on them end up fooling themselves about the capabilities of the thing they created. And yet, ChatGPT and Sora routinely miss important details about the things they generate, making mistakes that demonstrate how they are following association paths, not demonstrating actual understanding. In a previous thread, I demonstrated t…
label r/technology
dataType comment
communityName r/technology
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1XSEZlQWFDMHdNU3Vmb09RaTRMcVZJcmlpMVA4eGpFLTgySU1DNXo4UUZUamZsZVZrUHpIREZfNk1fdTJQSWpNRk9xY0IyUEpoRklTQmJjMTFxQkJKNnc9PQ==
url_encoded Z0FBQUFBQm5Lak9tNUpEcUlpWDBRZEQ0VThOVFB5cnRNZ05jYjFWbWt3c2l0WHR6T2FxOUMtemRSMGk4dDhjdk04SHNLZ3l5VmpGMU5mQ3ZmMHc4eHdBMmg1Rkx2REhQbi1RWVFYU2MwS3ZFMmFxMW0xYms0dGVlZFVQQkktbUZCbWJuNGRldmhiWDQ4X2NQZDhlX3UzSUxsdDhPa3phWm9TTlZaRUhPUFpsSjY2VGJLcVRtM0JvY0t2OFhCbWVQRjBwNktUVC1MVUtQVlprNDZ6ZWZER3ZSZU9WX0x2NXNVZz09

Raw Record

{
  "text": "Jokes aside, I've seen people say (or at least pretend) that very thing.\n\nPeople get really sloppy with the idea of what LLMs \"understand\". Even people who work directly on them end up fooling themselves about the capabilities of the thing they created.\n\nAnd yet, ChatGPT and Sora routinely miss important details about the things they generate, making mistakes that demonstrate how they are following association paths, not demonstrating actual understanding.\n\nIn a previous thread, I demonstrated this by having ChatGPT generate a story set in Chicago and it proceeded to do a pretty decent job... up to the point where it had the villain fighting the heroes atop the Chicago Bean. And it did that because it didn't actually understand what the bean was or the context that it existed in or any of the other things in the area that would have been a better option. It just picked an iconic location without truly knowing what a dramatic setting would look like or what the Bean was.\n\n(Bonus points: The villiain was a shadow monster, and there's some weird cognitive dissonance in a shadow creature picking a mirrored oblong shape as the place it was going to fight...)",
  "label": "r/technology",
  "dataType": "comment",
  "communityName": "r/technology",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1XSEZlQWFDMHdNU3Vmb09RaTRMcVZJcmlpMVA4eGpFLTgySU1DNXo4UUZUamZsZVZrUHpIREZfNk1fdTJQSWpNRk9xY0IyUEpoRklTQmJjMTFxQkJKNnc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9tNUpEcUlpWDBRZEQ0VThOVFB5cnRNZ05jYjFWbWt3c2l0WHR6T2FxOUMtemRSMGk4dDhjdk04SHNLZ3l5VmpGMU5mQ3ZmMHc4eHdBMmg1Rkx2REhQbi1RWVFYU2MwS3ZFMmFxMW0xYms0dGVlZFVQQkktbUZCbWJuNGRldmhiWDQ4X2NQZDhlX3UzSUxsdDhPa3phWm9TTlZaRUhPUFpsSjY2VGJLcVRtM0JvY0t2OFhCbWVQRjBwNktUVC1MVUtQVlprNDZ6ZWZER3ZSZU9WX0x2NXNVZz09"
}
Explore Dataset Explore Row

Entry Information