Row 86640

Row ID: 86640 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 86640 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

You should have a fixed layout for layers to devices. Don't move layers around during forward. Move input tensors instead. This is called CPU offloading. Try to figure which layers are most memory heavy, and move them to CPU during model initialization before first forward pass.

Once you have a good forward run, the autograd engine will know how to move the data in the backward.

FieldValue
text You should have a fixed layout for layers to devices. Don't move layers around during forward. Move input tensors instead. This is called CPU offloading. Try to figure which layers are most memory heavy, and move them to CPU during model initialization before first forward pass. Once you have a good forward run, the autograd engine will know how to move the data in the backward.
label r/pytorch
dataType comment
communityName r/pytorch
datetime 2024-05-24
username_encoded Z0FBQUFBQm5Lak1wRHJTRlhZemdHeUFiQ1dpclBRZ0FIWmV2TXBjTUlzM3dwckdKZzh6NktFSXdPSzZqZGFGV0NleTNBTDJYSlkxTUVOa2JFanctREV4SzJ2RkM3ZktxN2c9PQ==
url_encoded Z0FBQUFBQm5Lak82NU51WWpMWTBMZmtOazFoUGNqUExOY2ZjZnZmZWhNaUhIWG9wa0IwUkxmakhfYmg2NG1KOGFRbWxpT3VwN1pENHM3X3pSRVk2SThkbXg2TDVQTDdLQXBxUW02TnV5MTlQbFpSNmcyNDI3QTVXbFBlUWxoRjF2bi1fM1lxNjJMYXBFcWw2QV9ib1ZyTkhKU3dibDYtZjZoV2NweXZjcUptc1lISUpRVU1icENMWkJhQ0VPeHJ1N09sLUUyaGY3dUxkVmQxLW0zNlpxNVBOVWU0QlZsMFJDUT09

Raw Record

{
  "text": "You should have a fixed layout for layers to devices. \nDon't move layers around during forward. Move input tensors instead. This is called CPU offloading. Try to figure which layers are most memory heavy, and move them to CPU during model initialization before first forward pass. \n\nOnce you have a good forward run, the autograd engine will know how to move the data in the backward.",
  "label": "r/pytorch",
  "dataType": "comment",
  "communityName": "r/pytorch",
  "datetime": "2024-05-24",
  "username_encoded": "Z0FBQUFBQm5Lak1wRHJTRlhZemdHeUFiQ1dpclBRZ0FIWmV2TXBjTUlzM3dwckdKZzh6NktFSXdPSzZqZGFGV0NleTNBTDJYSlkxTUVOa2JFanctREV4SzJ2RkM3ZktxN2c9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak82NU51WWpMWTBMZmtOazFoUGNqUExOY2ZjZnZmZWhNaUhIWG9wa0IwUkxmakhfYmg2NG1KOGFRbWxpT3VwN1pENHM3X3pSRVk2SThkbXg2TDVQTDdLQXBxUW02TnV5MTlQbFpSNmcyNDI3QTVXbFBlUWxoRjF2bi1fM1lxNjJMYXBFcWw2QV9ib1ZyTkhKU3dibDYtZjZoV2NweXZjcUptc1lISUpRVU1icENMWkJhQ0VPeHJ1N09sLUUyaGY3dUxkVmQxLW0zNlpxNVBOVWU0QlZsMFJDUT09"
}
Explore Dataset Explore Row

Entry Information