Row 5418

Row ID: 5418 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 5418 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I am trying to add additional training data i.e pretrain Mistral 7b and save it to Hugging Face hub, I am loading it in 32 bit as default, it gave me cuda out of memory error, also the reason for that is 79.2 gb of memory has been allocated to pytorch and additional space was required but not left. So, I tried load it in fp 16 bit, again i encountered the same error. Any suggestions ?

FieldValue
text I am trying to add additional training data i.e pretrain Mistral 7b and save it to Hugging Face hub, I am loading it in 32 bit as default, it gave me cuda out of memory error, also the reason for that is 79.2 gb of memory has been allocated to pytorch and additional space was required but not left. So, I tried load it in fp 16 bit, again i encountered the same error. Any suggestions ?
label r/pytorch
dataType post
communityName r/pytorch
datetime 2024-04-29
username_encoded Z0FBQUFBQm5LakwycXVBejhTNG92Zm5ZNDZXYlNoOC02WGJ2bkFpM1JXMHVreGN2Q3BZQ29pdGt2MXNCdXRabkR2OUZpQ25kMS1wb1dzSlo5TEFQT0t4UTQxX09PZmtXOEN0a3d0bVdBeXhHLWVaOHY5Q0JtUVE9
url_encoded Z0FBQUFBQm5Lak9GRlVqc0lWX2ltU2ExTnJvOElKZlBEbkFnSlc1Q1U3cnRDZG5GNG5JV0FTanBDU2xvVzNYUFdKVzhZbEl3eDAxX3ZWazc4SmJmb3FFajgtMUdKU3pQQnVmY0dkX09zdHFKaWFjbV9NcGFQbndXcDVBOE94VXR4QXpYTjJFZjRxSFdZVmpEMzJWRnBFcVVod3NpaGpxeVRzRTd6OGxjN0ZoQkFyMzhRbjNWajZYZTJobVE0Q3FmTHA0UUpMeHN6eTdoRGdCaWZOdmRiaklLTmxmSHAxNDVPUT09

Raw Record

{
  "text": "I am trying to add additional training data i.e pretrain Mistral 7b and save it to Hugging Face hub, I am loading it in 32 bit as default, it gave me cuda out of memory error, also the reason for that is 79.2 gb of memory has been allocated to pytorch and additional space was required but not left.\nSo, I  tried load it in fp 16 bit, again i encountered the same error. \nAny suggestions ?",
  "label": "r/pytorch",
  "dataType": "post",
  "communityName": "r/pytorch",
  "datetime": "2024-04-29",
  "username_encoded": "Z0FBQUFBQm5LakwycXVBejhTNG92Zm5ZNDZXYlNoOC02WGJ2bkFpM1JXMHVreGN2Q3BZQ29pdGt2MXNCdXRabkR2OUZpQ25kMS1wb1dzSlo5TEFQT0t4UTQxX09PZmtXOEN0a3d0bVdBeXhHLWVaOHY5Q0JtUVE9",
  "url_encoded": "Z0FBQUFBQm5Lak9GRlVqc0lWX2ltU2ExTnJvOElKZlBEbkFnSlc1Q1U3cnRDZG5GNG5JV0FTanBDU2xvVzNYUFdKVzhZbEl3eDAxX3ZWazc4SmJmb3FFajgtMUdKU3pQQnVmY0dkX09zdHFKaWFjbV9NcGFQbndXcDVBOE94VXR4QXpYTjJFZjRxSFdZVmpEMzJWRnBFcVVod3NpaGpxeVRzRTd6OGxjN0ZoQkFyMzhRbjNWajZYZTJobVE0Q3FmTHA0UUpMeHN6eTdoRGdCaWZOdmRiaklLTmxmSHAxNDVPUT09"
}
Explore Dataset Explore Row

Entry Information