Row 67474
Content Data
This page contains data entry 67474 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. There are alternatives that do work with minibatching such as alpha divergence minimization, but these were recently [shown](https://arxiv.org/abs/2010.09541) not to work. So there are some interesting questions left open.
| Field | Value |
|---|---|
| text | Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. The… |
| label | r/machinelearning |
| dataType | comment |
| communityName | r/MachineLearning |
| datetime | 2024-05-23 |
| username_encoded | Z0FBQUFBQm5Lak1kN3l0NTVDVVVSV3FYVFVqbXdiSGZ4M3JxZ05fRXUyRllRRWRZeWwzbzVvVGYxWWVONUhCRHRaUWVYXzc3WTc0d0w2anRIandhSUotNjl0NUJRYzNCekE9PQ== |
| url_encoded | Z0FBQUFBQm5Lak90T0tWeFk4eTBzaC1tNmt5SlJ3TV9QYzZ4ak5WR1ZiRF93RWJZSHBreS1ab0hvV2hHdDBEbzFQeFlsLXlnZ2hCVEVPR1BtOWlOUEFGQm9DVGlfNTUteEtDaFo2MkRrS3lHZlpxM3JwWmVLb3Q5R0dPbnVOZkVVZ21lWWpUMWg4YzNGUHFrMzh6RlJ4QklybTJUak5ocnhMd0dndV9nNVhKNEdzNENRQ0M3amRQazlLSkdhRzAtOTBxSkJwVWpwTWpSbWdMLXNsRUhZUVNDMTlwTEE1OER5UVk3a0dnYUgyOS1UQTY2SENJdlBKOD0= |
Raw Record
{
"text": "Frankly speaking, the inclusive KL will eventually [fail](https://arxiv.org/abs/2103.01085) in high dimensions due to mode mismatch. In low dimensions, it could get you better calibration, but often at the cost of accuracy. A weird exception is BNNs. There, the exclusive KL is known to be [bad](https://arxiv.org/abs/2202.11670), but the inclusive KL appears to be [less](https://arxiv.org/abs/2206.06295) pathologic. But again, the problem is that MSC-type methods don't work with minibatching. There are alternatives that do work with minibatching such as alpha divergence minimization, but these were recently [shown](https://arxiv.org/abs/2010.09541) not to work. So there are some interesting questions left open.",
"label": "r/machinelearning",
"dataType": "comment",
"communityName": "r/MachineLearning",
"datetime": "2024-05-23",
"username_encoded": "Z0FBQUFBQm5Lak1kN3l0NTVDVVVSV3FYVFVqbXdiSGZ4M3JxZ05fRXUyRllRRWRZeWwzbzVvVGYxWWVONUhCRHRaUWVYXzc3WTc0d0w2anRIandhSUotNjl0NUJRYzNCekE9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak90T0tWeFk4eTBzaC1tNmt5SlJ3TV9QYzZ4ak5WR1ZiRF93RWJZSHBreS1ab0hvV2hHdDBEbzFQeFlsLXlnZ2hCVEVPR1BtOWlOUEFGQm9DVGlfNTUteEtDaFo2MkRrS3lHZlpxM3JwWmVLb3Q5R0dPbnVOZkVVZ21lWWpUMWg4YzNGUHFrMzh6RlJ4QklybTJUak5ocnhMd0dndV9nNVhKNEdzNENRQ0M3amRQazlLSkdhRzAtOTBxSkJwVWpwTWpSbWdMLXNsRUhZUVNDMTlwTEE1OER5UVk3a0dnYUgyOS1UQTY2SENJdlBKOD0="
}
Entry Information
- Entry ID: 67474
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000