Row 4141

Row ID: 4141 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 4141 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Why does no deeplearning framework support model larger than gpu memory to be run on the gpu? Basically something like a gpu „mmap“.

For my understanding cuda support async memory copies so it shoudnt be impossible to do a forward pass that pages in the layers on demand and pages out older layers that are no longer needed.

So why isn’t this done at all?

FieldValue
text Why does no deeplearning framework support model larger than gpu memory to be run on the gpu? Basically something like a gpu „mmap“. For my understanding cuda support async memory copies so it shoudnt be impossible to do a forward pass that pages in the layers on demand and pages out older layers that are no longer needed. So why isn’t this done at all?
label r/pytorch
dataType post
communityName r/pytorch
datetime 2024-04-03
username_encoded Z0FBQUFBQm5LakwxMlNXbmNWOFlfWVZOaG5BcVkwdi1YdmdlckxlNERrbGlNSkdHXzhyVTVLdW9YakZ6SEtxalRfbjhiZGdZNVpJaGRlOFBuSGd2TFRyWGxBUGlJOWRBb3c9PQ==
url_encoded Z0FBQUFBQm5Lak9GVC1ZVGk1QzdKSUNob0lPSEZ0c0tQVnR4UkVlWDlvLXBWWEtkbC1fY3dCZ1ZnRDVXUUx3dFgyc0gxdTNOS1Jvd24yZ2FIdEsxV203dUZKdXdnLVVjYU9Kek5VYTRZMmFDVmtBWXphYndZWnB5R01mWjlmeUtDX2hBb3lSOUhBUUlpZ0ZDU1lkdzYxNHF0YWc5TURkWmVsLWx3VGJLNjVDVTU2RWh2WUpqdlhjPQ==

Raw Record

{
  "text": "Why does no deeplearning framework support model larger than gpu memory to be run on the gpu? Basically something like a gpu „mmap“. \n\nFor my understanding cuda support async memory copies so it shoudnt be impossible to do a forward pass that pages in the layers on demand and pages out older layers that are no longer needed. \n\nSo why isn’t this done at all? ",
  "label": "r/pytorch",
  "dataType": "post",
  "communityName": "r/pytorch",
  "datetime": "2024-04-03",
  "username_encoded": "Z0FBQUFBQm5LakwxMlNXbmNWOFlfWVZOaG5BcVkwdi1YdmdlckxlNERrbGlNSkdHXzhyVTVLdW9YakZ6SEtxalRfbjhiZGdZNVpJaGRlOFBuSGd2TFRyWGxBUGlJOWRBb3c9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9GVC1ZVGk1QzdKSUNob0lPSEZ0c0tQVnR4UkVlWDlvLXBWWEtkbC1fY3dCZ1ZnRDVXUUx3dFgyc0gxdTNOS1Jvd24yZ2FIdEsxV203dUZKdXdnLVVjYU9Kek5VYTRZMmFDVmtBWXphYndZWnB5R01mWjlmeUtDX2hBb3lSOUhBUUlpZ0ZDU1lkdzYxNHF0YWc5TURkWmVsLWx3VGJLNjVDVTU2RWh2WUpqdlhjPQ=="
}
Explore Dataset Explore Row

Entry Information