Row 66626

Row ID: 66626 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 66626 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I am not sure if there is a formal way to prove it. You can probably come up with contrived examples where the predictive has lower entropy for the inclusive KL minimizer. But in general, we do observe the inclusive KL to have higher predictive uncertainty. There are pros and cos though.

Also MSC is not very stable. There are some follow up works that make it stable with experiments on BNNs, but none of these scale to larger datasets.

FieldValue
text I am not sure if there is a formal way to prove it. You can probably come up with contrived examples where the predictive has lower entropy for the inclusive KL minimizer. But in general, we do observe the inclusive KL to have higher predictive uncertainty. There are pros and cos though. Also MSC is not very stable. There are some follow up works that make it stable with experiments on BNNs, but none of these scale to larger datasets.
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1jdmUzYmtVN28xU0hzMlhGMlNJYVNvOG1IZnJiUGNnZmMyNW05cW80WXEyUzc0Sm5fay0tcXhzQWpSczdRb1lob2l4X2hVU204TGd1SFVzVmRLVGV0S0E9PQ==
url_encoded Z0FBQUFBQm5Lak90QkpEOVVTc0tVempBV3NGR2tkQUpSUUdKQzJSaXEwdDZpQkJsaTBrZk9mQXlKLTgtNHV3eVVPcEZRWE1YTXA5RlNZcVpnRlF0MEFJczQ4MFdYZVFfNDlQYlU2OWs1ekVBVFJFbFJTMUdLc0FEU1dCN2Y0a1paQm1sZmtzZnB6VV9TRFllT29BSDhLcmctN011LXkzUGVRZXpnZWs0TS13NnFrbHlzNEQ1NkZkVFpoa3hLM2JaWV90QnU4elV3aVFFM2JPbndsVmJ2LXdiWWRMa1oydWkyVHFtS2ktQ1ZMUktCTHVsQ0dDaW9hYz0=

Raw Record

{
  "text": "I am not sure if there is a formal way to prove it. You can probably come up with contrived examples where the predictive has lower entropy for the inclusive KL minimizer. But in general, we do observe the inclusive KL to have higher predictive uncertainty. There are pros and cos though.\n\nAlso MSC is not very stable. There are some follow up works that make it stable with experiments on BNNs, but none of these scale to larger datasets.",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1jdmUzYmtVN28xU0hzMlhGMlNJYVNvOG1IZnJiUGNnZmMyNW05cW80WXEyUzc0Sm5fay0tcXhzQWpSczdRb1lob2l4X2hVU204TGd1SFVzVmRLVGV0S0E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak90QkpEOVVTc0tVempBV3NGR2tkQUpSUUdKQzJSaXEwdDZpQkJsaTBrZk9mQXlKLTgtNHV3eVVPcEZRWE1YTXA5RlNZcVpnRlF0MEFJczQ4MFdYZVFfNDlQYlU2OWs1ekVBVFJFbFJTMUdLc0FEU1dCN2Y0a1paQm1sZmtzZnB6VV9TRFllT29BSDhLcmctN011LXkzUGVRZXpnZWs0TS13NnFrbHlzNEQ1NkZkVFpoa3hLM2JaWV90QnU4elV3aVFFM2JPbndsVmJ2LXdiWWRMa1oydWkyVHFtS2ktQ1ZMUktCTHVsQ0dDaW9hYz0="
}
Explore Dataset Explore Row

Entry Information