Row 4470

Row ID: 4470 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 4470 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I just realized the incentive mechanism in Bittensor doesn't make any sense at all!

Bear with me. Say there's some subnet incentivizing a specific intelligence product, e.g., LLM text prompts. GPT-4 is the benchmark to beat and is what validators use to evaluate miner performance. Let's say Mistral's 8x22b is currently the state of the art model when it comes to open source, so everyone is using custom versions of that base model, or similar models.

Now let's say my team comes up with Zanar2002, a new, more performant model matching GPT-4. We're miles ahead of the competition, meaning that me and my team would scoop up 85+% of the TAO rewards on that subnet, right? So why on earth would we ever agree to open source our model?

Okay, you might say, well, there's no way for validators to run your model if it isn't open source, so you have to make your stuff publicly available if you want to participate in the network. Assuming that's the case and I NEED to show my hand and open source my model, then why would I bother doing R&D to come up with a new model in the first place? There's no incentive for me to innovate beyond fine-tuning EXISTING open source models, and I feel that greatly detracts from the purpose of Bittensor.

Not just are we pretty much always playing catch up with OpenAI and Anthropic, but also, the incentive just isn't there for the development of innovative open source models. All we're doing here is have everyone run the same base model with minor tweaks, and I'm not sure that's a great value proposition, to be honest with you.

FieldValue
text I just realized the incentive mechanism in Bittensor doesn't make any sense at all! Bear with me. Say there's some subnet incentivizing a specific intelligence product, e.g., LLM text prompts. GPT-4 is the benchmark to beat and is what validators use to evaluate miner performance. Let's say Mistral's 8x22b is currently the state of the art model when it comes to open source, so everyone is using custom versions of that base model, or similar models. Now let's say my team comes up with Zanar200…
label r/bittensor_
dataType post
communityName r/bittensor_
datetime 2024-04-13
username_encoded Z0FBQUFBQm5LakwxWUZYalcycGlOSmZhdDZlSzN5R0pTN0NaeEhpWUxIVkdXWkdMZmxzaFhlTXlJWmpXZ3UzRG9YWDNnZ0t6Mm5DRWJzTlEzUnBMcFY1TS16VTkwNWdBZ2c9PQ==
url_encoded Z0FBQUFBQm5Lak9GcTFMbkN1ekVsMVdZR1FsdEVKNWI3SU5XY2JKZGZhQVhmVnhaS2pUaUhoZW1iSG9zVUJBUGNtVGdGZG5ZRTdSTnBfSnFfODNVazAwbVhrbmxCTmdDX2otcXRzWXJYTkRILTlvMXV0SnhUWlE5UVBScUpfVTRRMllIQ3d0bTB3Mk4wSmxjYnd6V01yRXdNNm5PZTFSaFVXVUJ2UUtNMTA2ZldHb3BwZEI4MEJ1M3RSZTRvT3JaRWtMQV9xQTRlaDdUV1pNZDdyeWFVb3Y2eUpScGUwcDM1Zz09

Raw Record

{
  "text": "I just realized the incentive mechanism in Bittensor doesn't make any sense at all!\n\nBear with me. Say there's some subnet incentivizing a specific intelligence product, e.g., LLM text prompts. GPT-4 is the benchmark to beat and is what validators use to evaluate miner performance. Let's say Mistral's 8x22b is currently the state of the art model when it comes to open source, so everyone is using custom versions of that base model, or similar models.\n\nNow let's say my team comes up with Zanar2002, a new, more performant model matching GPT-4. We're miles ahead of the competition, meaning that me and my team would scoop up 85+% of the TAO rewards on that subnet, right? So why on earth would we ever agree to open source our model?\n\nOkay, you might say, well, there's no way for validators to run your model if it isn't open source, so you have to make your stuff publicly available if you want to participate in the network. Assuming that's the case and I NEED to show my hand and open source my model, then why would I bother doing R&D to come up with a new model in the first place? There's no incentive for me to innovate beyond fine-tuning EXISTING open source models, and I feel that greatly detracts from the purpose of Bittensor.\n\nNot just are we pretty much always playing catch up with OpenAI and Anthropic, but also, the incentive just isn't there for the development of innovative open source models. All we're doing here is have everyone run the same base model with minor tweaks, and I'm not sure that's a great value proposition, to be honest with you.",
  "label": "r/bittensor_",
  "dataType": "post",
  "communityName": "r/bittensor_",
  "datetime": "2024-04-13",
  "username_encoded": "Z0FBQUFBQm5LakwxWUZYalcycGlOSmZhdDZlSzN5R0pTN0NaeEhpWUxIVkdXWkdMZmxzaFhlTXlJWmpXZ3UzRG9YWDNnZ0t6Mm5DRWJzTlEzUnBMcFY1TS16VTkwNWdBZ2c9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9GcTFMbkN1ekVsMVdZR1FsdEVKNWI3SU5XY2JKZGZhQVhmVnhaS2pUaUhoZW1iSG9zVUJBUGNtVGdGZG5ZRTdSTnBfSnFfODNVazAwbVhrbmxCTmdDX2otcXRzWXJYTkRILTlvMXV0SnhUWlE5UVBScUpfVTRRMllIQ3d0bTB3Mk4wSmxjYnd6V01yRXdNNm5PZTFSaFVXVUJ2UUtNMTA2ZldHb3BwZEI4MEJ1M3RSZTRvT3JaRWtMQV9xQTRlaDdUV1pNZDdyeWFVb3Y2eUpScGUwcDM1Zz09"
}
Explore Dataset Explore Row

Entry Information