Row 37677

Row ID: 37677 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 37677 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

How does an LLM provide individual tokens? It’s not that it’s unknowable, it’s just extremely costly, computationally, to keep track of. AI engineers don’t design things like source material tracking, or verifiably, not because it’s impossible, but because it’s many many orders of magnitude more expensive.

FieldValue
text How does an LLM provide individual tokens? It’s not that it’s unknowable, it’s just extremely costly, computationally, to keep track of. AI engineers don’t design things like source material tracking, or verifiably, not because it’s impossible, but because it’s many many orders of magnitude more expensive.
label r/tech
dataType comment
communityName r/tech
datetime 2024-05-21
username_encoded Z0FBQUFBQm5Lak1LTFV2dm9CTUM2RW5ZR2NQQXhOUW9Ed1BEYlMwa0xnTHJLc3hvc3dZZThHdGtFMGdXTXpKdmhsaGRpbEh1MHpZZVY4ejVkaWFQWFhTSnJkaTBhU1gyeEhwbnAxT3laeERjR0lob2h4bUNpSlE9
url_encoded Z0FBQUFBQm5Lak9acE90Q3NfRVpEbHJuVmYxQ3BZVk5vSk5BZjk1Y1EzeVZWVDZlb2xzbDZsZjNxMTNES1o2LVM5RXVQZVowQWFVVExsQXU5elNVVFB0S29tVklmYXBUQ2ZISGJwblRLOWtnVDJVc21OT2w3a1doMTYwWWVaSkFJTnZmaFBXMG9SOHo3NmhnLXRBUnhUSmZXbTBiUTZSc3p2eG50cGhxcG12aUxoWm1vZThEcHdxMnVVTDZFVjE4X1Y1ejJmeEFYbzdKUkRSQWpOVERtY2pDNThGWFNINHdaQT09

Raw Record

{
  "text": "How does an LLM provide individual tokens? It’s not that it’s unknowable, it’s just extremely costly, computationally, to keep track of. AI engineers don’t design things like source material tracking, or verifiably, not because it’s impossible, but because it’s many many orders of magnitude more expensive.",
  "label": "r/tech",
  "dataType": "comment",
  "communityName": "r/tech",
  "datetime": "2024-05-21",
  "username_encoded": "Z0FBQUFBQm5Lak1LTFV2dm9CTUM2RW5ZR2NQQXhOUW9Ed1BEYlMwa0xnTHJLc3hvc3dZZThHdGtFMGdXTXpKdmhsaGRpbEh1MHpZZVY4ejVkaWFQWFhTSnJkaTBhU1gyeEhwbnAxT3laeERjR0lob2h4bUNpSlE9",
  "url_encoded": "Z0FBQUFBQm5Lak9acE90Q3NfRVpEbHJuVmYxQ3BZVk5vSk5BZjk1Y1EzeVZWVDZlb2xzbDZsZjNxMTNES1o2LVM5RXVQZVowQWFVVExsQXU5elNVVFB0S29tVklmYXBUQ2ZISGJwblRLOWtnVDJVc21OT2w3a1doMTYwWWVaSkFJTnZmaFBXMG9SOHo3NmhnLXRBUnhUSmZXbTBiUTZSc3p2eG50cGhxcG12aUxoWm1vZThEcHdxMnVVTDZFVjE4X1Y1ejJmeEFYbzdKUkRSQWpOVERtY2pDNThGWFNINHdaQT09"
}
Explore Dataset Explore Row

Entry Information