Row 48274

Row ID: 48274 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 48274 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I agree! I may have some insight here.

I'm working on getting generative AI running on a UM790 locally and on a battery pack. The UM790 has a ryzen 7940HS containing a 10 TOPs NPU.

Pros: It *works.* I can run models as large as \~20gb. It's not exactly M1/M2 performance *but* running on only 65 watts and overall costing under 1k for parts. It's a competitive answer to people who don't need advanced data analysis but instead need it to work without internet, a *subscription* (my biggest complaint)*,* or a power outlet.

Cons: Its slow, like 10 tok/s slow. I have to build the UI/UX myself but the NPU requires *conda 3.9 set to path,* and its being a pain. I'm making good progress but this model is definitely *difficult* for me lol.

Overall: I agree that I would wait on an NPU/TPU unless you *really* want to experiment with local low wattage low perplexity LMs. However, if you have the talent you might find yourself well at home with an 8000 series or waiting a few more years.

FieldValue
text I agree! I may have some insight here. I'm working on getting generative AI running on a UM790 locally and on a battery pack. The UM790 has a ryzen 7940HS containing a 10 TOPs NPU. Pros: It *works.* I can run models as large as \~20gb. It's not exactly M1/M2 performance *but* running on only 65 watts and overall costing under 1k for parts. It's a competitive answer to people who don't need advanced data analysis but instead need it to work without internet, a *subscription* (my biggest compla…
label r/openai
dataType comment
communityName r/OpenAI
datetime 2024-05-22
username_encoded Z0FBQUFBQm5Lak1SdkNBQlA0cHJLRGxtVC15bnJVNGNUWnNQdUxWdzg2bUpveXp1TnNmaklSZ1F6R0laeVF0b2hZeks2MkFpeXNYUUpBSGJlR0k5blFFb3owUjlVaE9PQXc9PQ==
url_encoded Z0FBQUFBQm5Lak9nU29wbkZvbmhGd3FlbWh3eEcyOExpcHc4NF9tUWpybnhaOU82SXVPYzFKZnV6T2tOZ1pvZElhVElVU2piRWlVajVad1BMdG1tMkFIc3h3b0dXYVQ3UE9BQ3o5TE5neDB5Tkp5am5WaU85YnJ4bEI5eVcyUGQtTXpDZFJiV3R3RkZvbFNrNDQ0UlpqdS1CM2p6Z2xlQkpQVFF6cDR4M0lQandNRTliYkZEM1VWbldScDJPOVplVzhKU0VGQlJkaVFuRWoyX0dJa3Z1bEdJYTlna2I1LVNQZz09

Raw Record

{
  "text": "I agree! I may have some insight here.\n\nI'm working on getting generative AI running on a UM790 locally and on a battery pack. The UM790 has a ryzen 7940HS containing a 10 TOPs NPU. \n\nPros: It *works.* I can run models as large as \\~20gb. It's not exactly M1/M2 performance *but* running on only 65 watts and overall costing under 1k for parts. It's a competitive answer to people who don't need advanced data analysis but instead need it to work without internet, a *subscription* (my biggest complaint)*,* or a power outlet.\n\nCons: Its slow, like 10 tok/s slow. I have to build the UI/UX myself but the NPU requires *conda 3.9 set to path,* and its being a pain. I'm making good progress but this model is definitely *difficult* for me lol.\n\nOverall: I agree that I would wait on an NPU/TPU unless you *really* want to experiment with local low wattage low perplexity LMs. However, if you have the talent you might find yourself well at home with an 8000 series or waiting a few more years.",
  "label": "r/openai",
  "dataType": "comment",
  "communityName": "r/OpenAI",
  "datetime": "2024-05-22",
  "username_encoded": "Z0FBQUFBQm5Lak1SdkNBQlA0cHJLRGxtVC15bnJVNGNUWnNQdUxWdzg2bUpveXp1TnNmaklSZ1F6R0laeVF0b2hZeks2MkFpeXNYUUpBSGJlR0k5blFFb3owUjlVaE9PQXc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9nU29wbkZvbmhGd3FlbWh3eEcyOExpcHc4NF9tUWpybnhaOU82SXVPYzFKZnV6T2tOZ1pvZElhVElVU2piRWlVajVad1BMdG1tMkFIc3h3b0dXYVQ3UE9BQ3o5TE5neDB5Tkp5am5WaU85YnJ4bEI5eVcyUGQtTXpDZFJiV3R3RkZvbFNrNDQ0UlpqdS1CM2p6Z2xlQkpQVFF6cDR4M0lQandNRTliYkZEM1VWbldScDJPOVplVzhKU0VGQlJkaVFuRWoyX0dJa3Z1bEdJYTlna2I1LVNQZz09"
}
Explore Dataset Explore Row

Entry Information