Row 4684

Row ID: 4684 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 4684 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I am newbie to AI, want to run local LLMs, greedy to try LLama 3, but my old laptop is 8 GB RAM, I think in built Intel GPU.

What would be system requirement to comfortably run Llama 3 with decent 20 to 30 tokes per second at least? RAM, GPU, CPU, motherboard?

A formula if could be derived can help a lot (so I could plugin 7B or 70B LLM size, and out it comes, the sys requirements)..

Thank you in advance for your kind help...

FieldValue
text I am newbie to AI, want to run local LLMs, greedy to try LLama 3, but my old laptop is 8 GB RAM, I think in built Intel GPU. What would be system requirement to comfortably run Llama 3 with decent 20 to 30 tokes per second at least? RAM, GPU, CPU, motherboard? A formula if could be derived can help a lot (so I could plugin 7B or 70B LLM size, and out it comes, the sys requirements).. Thank you in advance for your kind help...
label r/deeplearning
dataType post
communityName r/deeplearning
datetime 2024-04-20
username_encoded Z0FBQUFBQm5LakwxeS00Z2dLZEVTREF2cW14OHYyUVlWbmQwbmt1VHJnbVFBUm5xVGRoc09lNG1QM1pFZjRkMmdQWjhoVEc2MGYwMU1uRDE3UVR5ZUV2Y3VHVU9kSDNXT2c9PQ==
url_encoded Z0FBQUFBQm5Lak9GVVE3cHlCcjZ4d2wyZTloVDNhR0RycTJRTFJGX1FTc1lJM0RCZTEtVEs3SWI3eFYzZGNrdHc3VjlsV2NOLWRDUlFHamxaTW5GMjNsYkI0SnBoRmhESVBIaUNFUmV1Zm9sRjhscFRVeldfbE5Gc2tNWTBfamZHMHFuMXkwMjNYQ3lnRWRDdWU4amx1a0FFSk41Y1RoX05xV0xQWkxacnVSRHByUFREa3J5cnVBPQ==

Raw Record

{
  "text": "I am newbie to AI, want to run local LLMs, greedy to try LLama 3, but my old laptop is 8 GB RAM, I think in built Intel GPU.  \n\nWhat would be system requirement to comfortably run Llama 3 with decent 20 to 30 tokes per second at least?  RAM, GPU, CPU, motherboard?  \n\nA formula if could be derived can help a lot (so I could plugin 7B or 70B LLM size, and out it comes, the sys requirements).. \n\nThank you in advance for your kind help...\n",
  "label": "r/deeplearning",
  "dataType": "post",
  "communityName": "r/deeplearning",
  "datetime": "2024-04-20",
  "username_encoded": "Z0FBQUFBQm5LakwxeS00Z2dLZEVTREF2cW14OHYyUVlWbmQwbmt1VHJnbVFBUm5xVGRoc09lNG1QM1pFZjRkMmdQWjhoVEc2MGYwMU1uRDE3UVR5ZUV2Y3VHVU9kSDNXT2c9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9GVVE3cHlCcjZ4d2wyZTloVDNhR0RycTJRTFJGX1FTc1lJM0RCZTEtVEs3SWI3eFYzZGNrdHc3VjlsV2NOLWRDUlFHamxaTW5GMjNsYkI0SnBoRmhESVBIaUNFUmV1Zm9sRjhscFRVeldfbE5Gc2tNWTBfamZHMHFuMXkwMjNYQ3lnRWRDdWU4amx1a0FFSk41Y1RoX05xV0xQWkxacnVSRHByUFREa3J5cnVBPQ=="
}
Explore Dataset Explore Row

Entry Information