Row 7114
Content Data
This page contains data entry 7114 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
Wanted to get an idea of how people are using open source LLMs in production. Some of the questions I'd like to see answers to are:
- Would love to get an idea of how you're using smaller models, how you're deploying them, anything else here people might not think of - Do you see any performance/cost gains using fine tuned open source? - How tough is it to train and set up your own fine tuning pipelines? Do you use full training or PEFT methods like LoRA? - Anything else that might be relevant to using your own LLMs
I'm an engineer trying to figure out the best way to upskill and see if my company could do more with open source models, and this would be very helpful for that. Thanks!
| Field | Value |
|---|---|
| text | Wanted to get an idea of how people are using open source LLMs in production. Some of the questions I'd like to see answers to are: - Would love to get an idea of how you're using smaller models, how you're deploying them, anything else here people might not think of - Do you see any performance/cost gains using fine tuned open source? - How tough is it to train and set up your own fine tuning pipelines? Do you use full training or PEFT methods like LoRA? - Anything else that might be relevant… |
| label | r/machinelearning |
| dataType | post |
| communityName | r/MachineLearning |
| datetime | 2024-05-15 |
| username_encoded | Z0FBQUFBQm5LakwzVFdOdkFDWTMzQ3BSYnZ5U0ZnM0FweHlNcEM1eTZwMlFNS2p4aFlGaUt6NWJrSkNTSmNKajdJRGM2R3FKM0luMjFLV2syWDNkS0ZVcG9yaGs1NTU0T1daUEpHeWplNUxWcDF6QWtnVWtKYUE9 |
| url_encoded | Z0FBQUFBQm5Lak9HZ3lHQ0JnVFFUMVdib2tKUmhYa1dpZU1NVU9kTFVoOW9MWXUybzFhaGVZbW9ucjc4NlhXVlpobzN4NTB1ZktWM21mSWt4T0ZFMzIzUHQ4OFhIMVFNbXU4UVNOZkp6NUQ0RG9ZZ0hyYWtXZUg3cXBNem9QNHU1Y01vZnA3MFg3QVF6ZVQ2bGkxR1Jyc2c1ME0tTGowQjdCeEpycmwtclhTR190N1Nvd3BEMjRaUzU2SzZ1MWt1LUhDRkFNbGJtSWVWVWJVZS1nanZEeWxjd0dEMU9MaExLdz09 |
Raw Record
{
"text": "Wanted to get an idea of how people are using open source LLMs in production. Some of the questions I'd like to see answers to are: \n\n- Would love to get an idea of how you're using smaller models, how you're deploying them, anything else here people might not think of\n- Do you see any performance/cost gains using fine tuned open source?\n- How tough is it to train and set up your own fine tuning pipelines? Do you use full training or PEFT methods like LoRA?\n- Anything else that might be relevant to using your own LLMs\n\nI'm an engineer trying to figure out the best way to upskill and see if my company could do more with open source models, and this would be very helpful for that. Thanks!",
"label": "r/machinelearning",
"dataType": "post",
"communityName": "r/MachineLearning",
"datetime": "2024-05-15",
"username_encoded": "Z0FBQUFBQm5LakwzVFdOdkFDWTMzQ3BSYnZ5U0ZnM0FweHlNcEM1eTZwMlFNS2p4aFlGaUt6NWJrSkNTSmNKajdJRGM2R3FKM0luMjFLV2syWDNkS0ZVcG9yaGs1NTU0T1daUEpHeWplNUxWcDF6QWtnVWtKYUE9",
"url_encoded": "Z0FBQUFBQm5Lak9HZ3lHQ0JnVFFUMVdib2tKUmhYa1dpZU1NVU9kTFVoOW9MWXUybzFhaGVZbW9ucjc4NlhXVlpobzN4NTB1ZktWM21mSWt4T0ZFMzIzUHQ4OFhIMVFNbXU4UVNOZkp6NUQ0RG9ZZ0hyYWtXZUg3cXBNem9QNHU1Y01vZnA3MFg3QVF6ZVQ2bGkxR1Jyc2c1ME0tTGowQjdCeEpycmwtclhTR190N1Nvd3BEMjRaUzU2SzZ1MWt1LUhDRkFNbGJtSWVWVWJVZS1nanZEeWxjd0dEMU9MaExLdz09"
}
Entry Information
- Entry ID: 7114
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000