Row 9679

Row ID: 9679 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 9679 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I was very excited for GPT-4o, I wanted it to be great, but after a few days I'll be honest and share my personal experience - it makes so many incoherent mistakes that I have to go back to older GPT-4 versions

To the people who get upset and don't believe me, or think I'm a paid hate bot, I usually don't complain about GPT updates, actually I've defended them in the past

---

There's a theory that maybe OpenAI is A/B testing us, because I've spent some time reading other people's comments, and it looks like \~50/50 have a better or worse experience with GPT-4o for coding - and IMO there's no way that the other 50% of you guys have the same GPT-4o version that we have. It's simply impossible, that's how bad our version is

I'm a software engineer and GPT-4o unfortunately can't write a relatively simple Rust QUIC server/client project without compilation errors (including some basic logging and config modules). I've pasted in plenty of documentation from the relevant GitHub QUIC project, into the chat, and it just keeps making incoherent code that fails and generates 5-10 compiler errors every single time. It deviates away from the documentation randomly. I've spent multiple hours trying and trying to make it write just a **functioning** project now, and after a long time I just have to give up. It can't fix its own compiler errors no matter how many times I feed the terminal output back to GPT-4o. I can just keep feeding it back error messages 100 times, and then it changes some code (seemingly randomly) and makes other errors or even more errors (or sometimes the exact same errors)

It also often ignores my instructions, for example I was showing GPT-4o 6 compilation errors from my terminal. Then in the same text bubble as the error lines, at the end of the message, I wrote:

I don't understand how we can get these errors when we follow the example files relatively close Q1) Does that mean that their code is wrong, or is something else going on? Q2) I'm developing on Mac right now by the way, but I don't think that should break anything here? Please answer these 2 questions comprehensively before you do anything else

I'm very clearly telling it to answer these 2 questions, but it ignores the questions completely, and it just immediately starts talking about the error messages, and then it starts writing more incorrect "solutions" that just generate more errors. This is concerning compared to GPT-4, which always understands when you tell it to "do X before you do anything else"

Please share your own experiences in this poll and by leaving a comment if you want to

[View Poll](https://www.reddit.com/poll/1cwec3g)

FieldValue
text I was very excited for GPT-4o, I wanted it to be great, but after a few days I'll be honest and share my personal experience - it makes so many incoherent mistakes that I have to go back to older GPT-4 versions To the people who get upset and don't believe me, or think I'm a paid hate bot, I usually don't complain about GPT updates, actually I've defended them in the past --- There's a theory that maybe OpenAI is A/B testing us, because I've spent some time reading other people's comments, an…
label r/openai
dataType post
communityName r/OpenAI
datetime 2024-05-20
username_encoded Z0FBQUFBQm5Lakw1X3JBM1I0NDRZVUptWkFrVUxBVzcwMmZMb1BjMm5Xb3NVMU1tZWVZbm5qQnlQUzNWcEItUE1pYUlFbC1UM195Y2wxc2lrX1UxeV82aDF1bHZ0Qzh5aGc9PQ==
url_encoded Z0FBQUFBQm5Lak9JT0lWdUg1YUViNjVFNEkzbjRRTW5SaTYtYm9YRTFJUWxZYTh1Y214d1NxaFo1YmF5cHJmTmM3U3JwV2FUUFZKZHk4cjdKTlg0TlV1QnZrM2c3cmg2dWMxMGVLbk43UXh2VmJJejlhZk5LWl92d0tjSDZVeGc0WmJXR3Y3OU5KbXlscnZKOEstMUE5Sm9Ra3hlM1FNNUlLbERoZUJFVTJQanljWk1RZnUyU3dyemRJSzRHSU9vRDdwbHkwN0JMbWk5

Raw Record

{
  "text": "I was very excited for GPT-4o, I wanted it to be great, but after a few days I'll be honest and share my personal experience - it makes so many incoherent mistakes that I have to go back to older GPT-4 versions\n\nTo the people who get upset and don't believe me, or think I'm a paid hate bot, I usually don't complain about GPT updates, actually I've defended them in the past\n\n---\n\nThere's a theory that maybe OpenAI is A/B testing us, because I've spent some time reading other people's comments, and it looks like \\~50/50 have a better or worse experience with GPT-4o for coding - and IMO there's no way that the other 50% of you guys have the same GPT-4o version that we have. It's simply impossible, that's how bad our version is\n\nI'm a software engineer and GPT-4o unfortunately can't write a relatively simple Rust QUIC server/client project without compilation errors (including some basic logging and config modules). I've pasted in plenty of documentation from the relevant GitHub QUIC project, into the chat, and it just keeps making incoherent code that fails and generates 5-10 compiler errors every single time. It deviates away from the documentation randomly. I've spent multiple hours trying and trying to make it write just a **functioning** project now, and after a long time I just have to give up. It can't fix its own compiler errors no matter how many times I feed the terminal output back to GPT-4o. I can just keep feeding it back error messages 100 times, and then it changes some code (seemingly randomly) and makes other errors or even more errors (or sometimes the exact same errors)\n\nIt also often ignores my instructions, for example I was showing GPT-4o 6 compilation errors from my terminal. Then in the same text bubble as the error lines, at the end of the message, I wrote:\n\n    I don't understand how we can get these errors when we follow the example files relatively close\n    Q1) Does that mean that their code is wrong, or is something else going on?\n    Q2) I'm developing on Mac right now by the way, but I don't think that should break anything here?\n    Please answer these 2 questions comprehensively before you do anything else\n\nI'm very clearly telling it to answer these 2 questions, but it ignores the questions completely, and it just immediately starts talking about the error messages, and then it starts writing more incorrect \"solutions\" that just generate more errors. This is concerning compared to GPT-4, which always understands when you tell it to \"do X before you do anything else\"\n\nPlease share your own experiences in this poll and by leaving a comment if you want to\n\n[View Poll](https://www.reddit.com/poll/1cwec3g)",
  "label": "r/openai",
  "dataType": "post",
  "communityName": "r/OpenAI",
  "datetime": "2024-05-20",
  "username_encoded": "Z0FBQUFBQm5Lakw1X3JBM1I0NDRZVUptWkFrVUxBVzcwMmZMb1BjMm5Xb3NVMU1tZWVZbm5qQnlQUzNWcEItUE1pYUlFbC1UM195Y2wxc2lrX1UxeV82aDF1bHZ0Qzh5aGc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9JT0lWdUg1YUViNjVFNEkzbjRRTW5SaTYtYm9YRTFJUWxZYTh1Y214d1NxaFo1YmF5cHJmTmM3U3JwV2FUUFZKZHk4cjdKTlg0TlV1QnZrM2c3cmg2dWMxMGVLbk43UXh2VmJJejlhZk5LWl92d0tjSDZVeGc0WmJXR3Y3OU5KbXlscnZKOEstMUE5Sm9Ra3hlM1FNNUlLbERoZUJFVTJQanljWk1RZnUyU3dyemRJSzRHSU9vRDdwbHkwN0JMbWk5"
}
Explore Dataset Explore Row

Entry Information