Row 38804
Content Data
This page contains data entry 38804 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
Question: You seem to have a really robust understanding of LLMs. Why not go local?
It seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier).
[https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670)
Otherwise I agree with you. I don't think there are any good ones other than just using GPT.
| Field | Value |
|---|---|
| text | Question: You seem to have a really robust understanding of LLMs. Why not go local? It seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier). [https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/a… |
| label | r/openai |
| dataType | comment |
| communityName | r/OpenAI |
| datetime | 2024-05-22 |
| username_encoded | Z0FBQUFBQm5Lak1MVkdGc1pwc282WkJ1U2diSUMxMmtxYVgtRVVNSVVYSUNQT3dBanBnemNoV0dqajRIbk8xSl82R2JHc21WdkRNeG1VMkt6Qk5pM2NBUnpYQ3FNLVpiUEE9PQ== |
| url_encoded | Z0FBQUFBQm5Lak9hOXZDOVFfOXZMZEhudkk0clpqZ19qVFZNNW8yZ1VpNnd0VmZIUnNxajB0blZqbDBFQjlkYkhSRjFBYk44Y2k3WmtpcGJ3SU1zQTFFN0hfQ29VVWtOVVZOWjRPaGtheXQyZnRkeVJWSTRlemRtQnRWRldYbS0yT0dyZGxHbGlGeTJ4TjRJU2kyLVlnWHdwQVd6VTUwSzI4b3k2cFd4V1dOMUdZVC0tRVlvWXliWjZScjVwVnd4cnpTRG9wUTNFYlM3LUhVckhFeENGdHNKaTE2ZG5IMXU3QT09 |
Raw Record
{
"text": "Question: You seem to have a really robust understanding of LLMs. Why not go local?\n\nIt seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier).\n\n[https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670)\n\nOtherwise I agree with you. I don't think there are any good ones other than just using GPT.",
"label": "r/openai",
"dataType": "comment",
"communityName": "r/OpenAI",
"datetime": "2024-05-22",
"username_encoded": "Z0FBQUFBQm5Lak1MVkdGc1pwc282WkJ1U2diSUMxMmtxYVgtRVVNSVVYSUNQT3dBanBnemNoV0dqajRIbk8xSl82R2JHc21WdkRNeG1VMkt6Qk5pM2NBUnpYQ3FNLVpiUEE9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9hOXZDOVFfOXZMZEhudkk0clpqZ19qVFZNNW8yZ1VpNnd0VmZIUnNxajB0blZqbDBFQjlkYkhSRjFBYk44Y2k3WmtpcGJ3SU1zQTFFN0hfQ29VVWtOVVZOWjRPaGtheXQyZnRkeVJWSTRlemRtQnRWRldYbS0yT0dyZGxHbGlGeTJ4TjRJU2kyLVlnWHdwQVd6VTUwSzI4b3k2cFd4V1dOMUdZVC0tRVlvWXliWjZScjVwVnd4cnpTRG9wUTNFYlM3LUhVckhFeENGdHNKaTE2ZG5IMXU3QT09"
}
Entry Information
- Entry ID: 38804
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000