Row 67474

Row ID: 67474 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 67474 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. There are alternatives that do work with minibatching such as alpha divergence minimization, but these were recently [shown](https://arxiv.org/abs/2010.09541) not to work. So there are some interesting questions left open.

FieldValue
text Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. The…
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1kN3l0NTVDVVVSV3FYVFVqbXdiSGZ4M3JxZ05fRXUyRllRRWRZeWwzbzVvVGYxWWVONUhCRHRaUWVYXzc3WTc0d0w2anRIandhSUotNjl0NUJRYzNCekE9PQ==
url_encoded Z0FBQUFBQm5Lak90T0tWeFk4eTBzaC1tNmt5SlJ3TV9QYzZ4ak5WR1ZiRF93RWJZSHBreS1ab0hvV2hHdDBEbzFQeFlsLXlnZ2hCVEVPR1BtOWlOUEFGQm9DVGlfNTUteEtDaFo2MkRrS3lHZlpxM3JwWmVLb3Q5R0dPbnVOZkVVZ21lWWpUMWg4YzNGUHFrMzh6RlJ4QklybTJUak5ocnhMd0dndV9nNVhKNEdzNENRQ0M3amRQazlLSkdhRzAtOTBxSkJwVWpwTWpSbWdMLXNsRUhZUVNDMTlwTEE1OER5UVk3a0dnYUgyOS1UQTY2SENJdlBKOD0=

Raw Record

{
  "text": "Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. There are alternatives that do work with minibatching such as alpha divergence minimization, but these were recently [shown](https://arxiv.org/abs/2010.09541) not to work. So there are some interesting questions left open.",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1kN3l0NTVDVVVSV3FYVFVqbXdiSGZ4M3JxZ05fRXUyRllRRWRZeWwzbzVvVGYxWWVONUhCRHRaUWVYXzc3WTc0d0w2anRIandhSUotNjl0NUJRYzNCekE9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak90T0tWeFk4eTBzaC1tNmt5SlJ3TV9QYzZ4ak5WR1ZiRF93RWJZSHBreS1ab0hvV2hHdDBEbzFQeFlsLXlnZ2hCVEVPR1BtOWlOUEFGQm9DVGlfNTUteEtDaFo2MkRrS3lHZlpxM3JwWmVLb3Q5R0dPbnVOZkVVZ21lWWpUMWg4YzNGUHFrMzh6RlJ4QklybTJUak5ocnhMd0dndV9nNVhKNEdzNENRQ0M3amRQazlLSkdhRzAtOTBxSkJwVWpwTWpSbWdMLXNsRUhZUVNDMTlwTEE1OER5UVk3a0dnYUgyOS1UQTY2SENJdlBKOD0="
}

Entry Information