Row 38804

Row ID: 38804 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 38804 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Question: You seem to have a really robust understanding of LLMs. Why not go local?

It seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier).

[https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670)

Otherwise I agree with you. I don't think there are any good ones other than just using GPT.

FieldValue
text Question: You seem to have a really robust understanding of LLMs. Why not go local? It seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier). [https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/a…
label r/openai
dataType comment
communityName r/OpenAI
datetime 2024-05-22
username_encoded Z0FBQUFBQm5Lak1MVkdGc1pwc282WkJ1U2diSUMxMmtxYVgtRVVNSVVYSUNQT3dBanBnemNoV0dqajRIbk8xSl82R2JHc21WdkRNeG1VMkt6Qk5pM2NBUnpYQ3FNLVpiUEE9PQ==
url_encoded Z0FBQUFBQm5Lak9hOXZDOVFfOXZMZEhudkk0clpqZ19qVFZNNW8yZ1VpNnd0VmZIUnNxajB0blZqbDBFQjlkYkhSRjFBYk44Y2k3WmtpcGJ3SU1zQTFFN0hfQ29VVWtOVVZOWjRPaGtheXQyZnRkeVJWSTRlemRtQnRWRldYbS0yT0dyZGxHbGlGeTJ4TjRJU2kyLVlnWHdwQVd6VTUwSzI4b3k2cFd4V1dOMUdZVC0tRVlvWXliWjZScjVwVnd4cnpTRG9wUTNFYlM3LUhVckhFeENGdHNKaTE2ZG5IMXU3QT09

Raw Record

{
  "text": "Question: You seem to have a really robust understanding of LLMs. Why not go local?\n\nIt seems what you want is a local LLM that has some type of RAG implementation. TinyTavern just dropped 12.1 which has basic RAG support and you can get LM Studio to use RAG support with just some simple steps (here's an example with AMD but Nvidia should be even easier).\n\n[https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670](https://community.amd.com/t5/ai/how-to-enable-rag-retrieval-augmented-generation-on-an-amd-ryzen/ba-p/670670)\n\nOtherwise I agree with you. I don't think there are any good ones other than just using GPT.",
  "label": "r/openai",
  "dataType": "comment",
  "communityName": "r/OpenAI",
  "datetime": "2024-05-22",
  "username_encoded": "Z0FBQUFBQm5Lak1MVkdGc1pwc282WkJ1U2diSUMxMmtxYVgtRVVNSVVYSUNQT3dBanBnemNoV0dqajRIbk8xSl82R2JHc21WdkRNeG1VMkt6Qk5pM2NBUnpYQ3FNLVpiUEE9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9hOXZDOVFfOXZMZEhudkk0clpqZ19qVFZNNW8yZ1VpNnd0VmZIUnNxajB0blZqbDBFQjlkYkhSRjFBYk44Y2k3WmtpcGJ3SU1zQTFFN0hfQ29VVWtOVVZOWjRPaGtheXQyZnRkeVJWSTRlemRtQnRWRldYbS0yT0dyZGxHbGlGeTJ4TjRJU2kyLVlnWHdwQVd6VTUwSzI4b3k2cFd4V1dOMUdZVC0tRVlvWXliWjZScjVwVnd4cnpTRG9wUTNFYlM3LUhVckhFeENGdHNKaTE2ZG5IMXU3QT09"
}

Entry Information