Row 31966
Content Data
This page contains data entry 31966 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
True - however - it would be interesting to see the jumps in revenue/cost that "tranding Prompts/Inferences have"
--
Lets say there isa trending inference/prompt and billions of requests come in for what is basically the same conculsion - but the prompting to arrive there is all unique - you just produced N tokens for way less than N prompt outcomes (I dont have the nomenclature correct, but the meaning is clear)
So - lets say a huge even occurs which will drive human curiosity to GPT the fuck out of it - what "pre-warming" could occur to save in the resultant infra spike?
Will there be such a thing?
Who is thinking about the cost-per-token in 5 years when the quantity of requests (what is the total convo string in a gpt chat called? How is that measured in any factor (from power, reach, cost, etc??)
(how study the actual economics of infering prompts?
| Field | Value |
|---|---|
| text | True - however - it would be interesting to see the jumps in revenue/cost that "tranding Prompts/Inferences have" -- Lets say there isa trending inference/prompt and billions of requests come in for what is basically the same conculsion - but the prompting to arrive there is all unique - you just produced N tokens for way less than N prompt outcomes (I dont have the nomenclature correct, but the meaning is clear) So - lets say a huge even occurs which will drive human curiosity to GPT the fuc… |
| label | r/openai |
| dataType | comment |
| communityName | r/OpenAI |
| datetime | 2024-05-21 |
| username_encoded | Z0FBQUFBQm5Lak1HSlBtWnRXMkhrZEl3c2lUWms4amROVDctMWNZbWZ4UkJocTB4UTZTUnZUUldSUDE3b1RaS19iaXE0X1B2YjRWWmJ6U1FEMlBzaXh5aDZ0dXNzN3BzZHc9PQ== |
| url_encoded | Z0FBQUFBQm5Lak9XcmpQYTkxVmZZRS14YjR4LTZCTkVzazRObktIaW92b2FhaEhqM2Rsa3haSU9XOHRDZ05pV08xWGcxUjNKUTNSNkhGeDNHYzQwOHR6LTRFelpZcVRfNW01ejFVc3dmZjhTTVVrVjBoeU1ZaVVzMXJRNC1tdzQ5d29DdU9EMlVHM25YQzlWMGJFZHdQLTZocWdyNmFaX1pSeHRyX1JmbkxrMzlSX2FrYXY3ZE53aVBQcXd2c3gycVlKRGtOUEcyNUlNejRha2RTR0J1c0NKQnJFSXJKb0NXdz09 |
Raw Record
{
"text": "True - however - it would be interesting to see the jumps in revenue/cost that \"tranding Prompts/Inferences have\"\n\n--\n\nLets say there isa trending inference/prompt and billions of requests come in for what is basically the same conculsion - but the prompting to arrive there is all unique - you just produced N tokens for way less than N prompt outcomes (I dont have the nomenclature correct, but the meaning is clear)\n\nSo - lets say a huge even occurs which will drive human curiosity to GPT the fuck out of it - what \"pre-warming\" could occur to save in the resultant infra spike?\n\nWill there be such a thing?\n\nWho is thinking about the cost-per-token in 5 years when the quantity of requests (what is the total convo string in a gpt chat called? How is that measured in any factor (from power, reach, cost, etc??)\n\n(how study the actual economics of infering prompts?",
"label": "r/openai",
"dataType": "comment",
"communityName": "r/OpenAI",
"datetime": "2024-05-21",
"username_encoded": "Z0FBQUFBQm5Lak1HSlBtWnRXMkhrZEl3c2lUWms4amROVDctMWNZbWZ4UkJocTB4UTZTUnZUUldSUDE3b1RaS19iaXE0X1B2YjRWWmJ6U1FEMlBzaXh5aDZ0dXNzN3BzZHc9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9XcmpQYTkxVmZZRS14YjR4LTZCTkVzazRObktIaW92b2FhaEhqM2Rsa3haSU9XOHRDZ05pV08xWGcxUjNKUTNSNkhGeDNHYzQwOHR6LTRFelpZcVRfNW01ejFVc3dmZjhTTVVrVjBoeU1ZaVVzMXJRNC1tdzQ5d29DdU9EMlVHM25YQzlWMGJFZHdQLTZocWdyNmFaX1pSeHRyX1JmbkxrMzlSX2FrYXY3ZE53aVBQcXd2c3gycVlKRGtOUEcyNUlNejRha2RTR0J1c0NKQnJFSXJKb0NXdz09"
}
Entry Information
- Entry ID: 31966
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000