Row 48966

Row ID: 48966 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 48966 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

On May 14, Tianle Cai, a PhD student at Princeton University studying inference efficiency in large language models like those that power such chatbots, accessed GPT-4o’s public token library and pulled a list of the 100 longest Chinese tokens the model uses to parse and compress Chinese prompts.

FieldValue
text On May 14, Tianle Cai, a PhD student at Princeton University studying inference efficiency in large language models like those that power such chatbots, accessed GPT-4o’s public token library and pulled a list of the 100 longest Chinese tokens the model uses to parse and compress Chinese prompts.
label r/artificial
dataType comment
communityName r/artificial
datetime 2024-05-22
username_encoded Z0FBQUFBQm5Lak1SVVVzRHV5ZVNfWGlGcDZ5RUlOMTI5X3VsRGRlX25xUEF4aVVkVnBSZU9LRU1CcHU1UEx5ZkVDeHl3bVRJNDh3YlpTQ2VybzRScS1FaWVKYzVKajNTaFE9PQ==
url_encoded Z0FBQUFBQm5Lak9obEFJaVNFRjdSRzlYWXU3b2dzbmpKdVZpcGZRUThVUUgtd09aT1ZJYTBqS1JKZHBRdjhxVDAxX0diV2NrUG1EbDZSSE45ZXdBd3g0dHNaRk9oaWVuX0F6Z3VPN3JINUhoZ2J1ZUlSamFpSGVCUV9Iblg5M29HZDlLdmZweTJBT0dPbGpRRHMtSFN2c2ZvbVgtVkFYYUZHdG1hZGh1N20yZkRuT0x5TTZMQmRpNGNPRTBFaGRZVXJGUmVLZXpjSjJOMkJzZUNFM19QN0E4b2E3NHBHTnBzdz09

Raw Record

{
  "text": "On May 14, Tianle Cai, a PhD student at Princeton University studying inference efficiency in large language models like those that power such chatbots, accessed GPT-4o’s public token library and pulled a list of the 100 longest Chinese tokens the model uses to parse and compress Chinese prompts.",
  "label": "r/artificial",
  "dataType": "comment",
  "communityName": "r/artificial",
  "datetime": "2024-05-22",
  "username_encoded": "Z0FBQUFBQm5Lak1SVVVzRHV5ZVNfWGlGcDZ5RUlOMTI5X3VsRGRlX25xUEF4aVVkVnBSZU9LRU1CcHU1UEx5ZkVDeHl3bVRJNDh3YlpTQ2VybzRScS1FaWVKYzVKajNTaFE9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9obEFJaVNFRjdSRzlYWXU3b2dzbmpKdVZpcGZRUThVUUgtd09aT1ZJYTBqS1JKZHBRdjhxVDAxX0diV2NrUG1EbDZSSE45ZXdBd3g0dHNaRk9oaWVuX0F6Z3VPN3JINUhoZ2J1ZUlSamFpSGVCUV9Iblg5M29HZDlLdmZweTJBT0dPbGpRRHMtSFN2c2ZvbVgtVkFYYUZHdG1hZGh1N20yZkRuT0x5TTZMQmRpNGNPRTBFaGRZVXJGUmVLZXpjSjJOMkJzZUNFM19QN0E4b2E3NHBHTnBzdz09"
}
Explore Dataset Explore Row

Entry Information