Row 6239

Row ID: 6239 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 6239 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hi, I am struggling to find an efficient way to get the diagonal of the Hessian. Let's say i have a model M, i want to get d\^2Loss/dw\^2 for every weight in the model instead of calculating the whole H matrix. Is there an efficient way to do that (an approximate value would be acceptable) or am I going to have to calculate the whole matrix anyway? I found a few posts about that but none offering a clear answer, and most of them a few years old so I figured I'd try my luck here.

FieldValue
text Hi, I am struggling to find an efficient way to get the diagonal of the Hessian. Let's say i have a model M, i want to get d\^2Loss/dw\^2 for every weight in the model instead of calculating the whole H matrix. Is there an efficient way to do that (an approximate value would be acceptable) or am I going to have to calculate the whole matrix anyway? I found a few posts about that but none offering a clear answer, and most of them a few years old so I figured I'd try my luck here.
label r/pytorch
dataType post
communityName r/pytorch
datetime 2024-05-08
username_encoded Z0FBQUFBQm5LakwySklFak5KN1NJdFpWNjkwWmhMeUJfRVNXWmdQeVM3enhJN3NOOUlSdHVfcW9ZXzZmS3VRNExXTHpmT1c5X3doZVFUbTZCcWhGQlpud3NaWHJ2a3BHRXc9PQ==
url_encoded Z0FBQUFBQm5Lak9HSHRHY0xqOFNxdnlDUTNMdzFWTXFlN0ZpWk5EN1ZvRUN5M2V5cmNsb2RjRTFXNTBKM1hrUWtqZUU2YlduVUs0Vks5Q1BPbnZod0hxcVdNWElxY0x0emlBNDIxQm9KbG1JRjU0RGJTQlBkVmxDZDJ3c3pwRktSTkp4VU5fT3IxZVlqYjExbHQtVFpiUWl1UUljdEdreEhLWGhkUG16V1QtQUtSWktFRUE3c1QyUmx4Q2lNbGxtLVFmd3ZHVDdTYU9PUGMyZkJmdjNpa2NYLW5NSUJsZkN5dz09

Raw Record

{
  "text": "Hi, I am struggling to find an efficient way to get the diagonal of the Hessian. Let's say i have a model M, i want to get d\\^2Loss/dw\\^2 for every weight in the model instead of calculating the whole H matrix. Is there an efficient way to do that (an approximate value would be acceptable) or am I going to have to calculate the whole matrix anyway?  \n  \nI found a few posts about that but none offering a clear answer, and most of them a few years old so I figured I'd try my luck here.",
  "label": "r/pytorch",
  "dataType": "post",
  "communityName": "r/pytorch",
  "datetime": "2024-05-08",
  "username_encoded": "Z0FBQUFBQm5LakwySklFak5KN1NJdFpWNjkwWmhMeUJfRVNXWmdQeVM3enhJN3NOOUlSdHVfcW9ZXzZmS3VRNExXTHpmT1c5X3doZVFUbTZCcWhGQlpud3NaWHJ2a3BHRXc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9HSHRHY0xqOFNxdnlDUTNMdzFWTXFlN0ZpWk5EN1ZvRUN5M2V5cmNsb2RjRTFXNTBKM1hrUWtqZUU2YlduVUs0Vks5Q1BPbnZod0hxcVdNWElxY0x0emlBNDIxQm9KbG1JRjU0RGJTQlBkVmxDZDJ3c3pwRktSTkp4VU5fT3IxZVlqYjExbHQtVFpiUWl1UUljdEdreEhLWGhkUG16V1QtQUtSWktFRUE3c1QyUmx4Q2lNbGxtLVFmd3ZHVDdTYU9PUGMyZkJmdjNpa2NYLW5NSUJsZkN5dz09"
}
Explore Dataset Explore Row

Entry Information