Row 19038

Row ID: 19038 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 19038 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Not really. I think that GPTs do NOT necessarily perform "auto regressive error amplification" Rather, the GPTs tend to drift back towards the familiar/correct despite any typo, word-omission, misspelling, or any false statement, within the original prompt or within the subsequently generated next-token sequence. Even very tiny GPT models I have seen can immediately recover to coherent text even after deletion of prior words in the prompt or previous next-token sequence (e.g., immediately ignoring the omission of previously included tokens or words)

FieldValue
text Not really. I think that GPTs do NOT necessarily perform "auto regressive error amplification" Rather, the GPTs tend to drift back towards the familiar/correct despite any typo, word-omission, misspelling, or any false statement, within the original prompt or within the subsequently generated next-token sequence. Even very tiny GPT models I have seen can immediately recover to coherent text even after deletion of prior words in the prompt or previous next-token sequence (e.g., immediately ign…
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-21
username_encoded Z0FBQUFBQm5LakwtUlFWUU0xVTlFX18wV01jdmlCRXYyMnRBSFhld1lpQ2c3QWtnNjg1eWpOemlNNnFqR0h6bnpsYVM2eVdYTExtM1RDWTBsSGhtQ2Rrb1hXdkxLSjFyeWc9PQ==
url_encoded Z0FBQUFBQm5Lak9PNzVUcGxrd0NXS2dKYlREM3Jnc1BhOVM1bktGNTRGQnZiaXA2Z3BfdHhfQ1d3WTROZHBjU1l2TkVfWjZfYXVZT1ZnUVpDM3dXaVIybmtRdWgyNW9lR0tRNXhHbW05MWtBX0hnaC1DSmFFZllQaXk1d3ROV0V1eG1fMW91eFc5V1ZWSVBzQWJmaElJWTNTVG9BdDZJVGpOVmFZNGI5QnVwRmotUEU3eXktMVdnTTZYdVNmekxtUFREbXJxUC1xNEFrMlRmWVNseHR0bkRHLWd2bGR6MnE1QTJNNC1JcTdRbGYwY09OZjBIX1lXaz0=

Raw Record

{
  "text": "Not really.  I think that GPTs do NOT necessarily perform \"auto regressive error amplification\"  Rather, the GPTs tend to drift back towards the familiar/correct despite any typo, word-omission, misspelling, or any false statement, within the original prompt or within the subsequently generated next-token sequence.  Even very tiny GPT models I have seen can immediately recover to coherent text even after deletion of prior words in the prompt or previous next-token sequence (e.g., immediately ignoring the omission of previously included tokens or words)",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-21",
  "username_encoded": "Z0FBQUFBQm5LakwtUlFWUU0xVTlFX18wV01jdmlCRXYyMnRBSFhld1lpQ2c3QWtnNjg1eWpOemlNNnFqR0h6bnpsYVM2eVdYTExtM1RDWTBsSGhtQ2Rrb1hXdkxLSjFyeWc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9PNzVUcGxrd0NXS2dKYlREM3Jnc1BhOVM1bktGNTRGQnZiaXA2Z3BfdHhfQ1d3WTROZHBjU1l2TkVfWjZfYXVZT1ZnUVpDM3dXaVIybmtRdWgyNW9lR0tRNXhHbW05MWtBX0hnaC1DSmFFZllQaXk1d3ROV0V1eG1fMW91eFc5V1ZWSVBzQWJmaElJWTNTVG9BdDZJVGpOVmFZNGI5QnVwRmotUEU3eXktMVdnTTZYdVNmekxtUFREbXJxUC1xNEFrMlRmWVNseHR0bkRHLWd2bGR6MnE1QTJNNC1JcTdRbGYwY09OZjBIX1lXaz0="
}
Explore Dataset Explore Row

Entry Information