Row 6419
Content Data
This page contains data entry 6419 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
What is there to "discretize"? Isn't the signal / sequence already "discrete" in the form of tokens? Please don't send me over to wikipedia article about "Discretization of linear state space models ", because I cannot draw any connection to LLMs. It seems to me that Mamba at its core is just EMA with dynamic alpha parameter that is calculated from the current token at time t for each channel. Don't quite understand what is the benefit of "discretization" and what it actually does to the data.
| Field | Value |
|---|---|
| text | What is there to "discretize"? Isn't the signal / sequence already "discrete" in the form of tokens? Please don't send me over to wikipedia article about "Discretization of linear state space models ", because I cannot draw any connection to LLMs. It seems to me that Mamba at its core is just EMA with dynamic alpha parameter that is calculated from the current token at time t for each channel. Don't quite understand what is the benefit of "discretization" and what it actually does to the data. |
| label | r/machinelearning |
| dataType | post |
| communityName | r/MachineLearning |
| datetime | 2024-05-10 |
| username_encoded | Z0FBQUFBQm5LakwyX21YeUNBSGVrZk9zU1dFY19PT1k2M3RCVmZpSk1CcXFXVW5MS0ZYdDNEVUVnaHR4ZWFHSlBsaVppdlNNYW1NNlh5M1ZZdnpPUUJEeUtfWkJZbkZXYVE9PQ== |
| url_encoded | Z0FBQUFBQm5Lak9HdDdpMVBWU2FNU21QN29QZ21RdEowcDd1MzZ4VlU5X1pDY1ZLaExKQmhtamNwNGYwR1YxVlZMQ29RZUo2aGZCMUUxd2Q5SW03VGJMaFBaZUdtRGdjQUVaVHlrbW5ROVlUNmJMSHV1Tl9hVUFVZGlnc1dRLUI4U3FuckYxRlJ5alE1RDZIT2VJeEtkNE1WOUV6am9FMGpwV2dJSkVGTXo4Sk95UW5tX1NzSGtXOV9TMl9nYlNaYVpEYklzM0Qyc0s4a2RrNzhUYXlGZEVNM3BGelVNYUdxdz09 |
Raw Record
{
"text": "What is there to \"discretize\"? Isn't the signal / sequence already \"discrete\" in the form of tokens? Please don't send me over to wikipedia article about \"Discretization of linear state space models \", because I cannot draw any connection to LLMs. It seems to me that Mamba at its core is just EMA with dynamic alpha parameter that is calculated from the current token at time t for each channel. Don't quite understand what is the benefit of \"discretization\" and what it actually does to the data.",
"label": "r/machinelearning",
"dataType": "post",
"communityName": "r/MachineLearning",
"datetime": "2024-05-10",
"username_encoded": "Z0FBQUFBQm5LakwyX21YeUNBSGVrZk9zU1dFY19PT1k2M3RCVmZpSk1CcXFXVW5MS0ZYdDNEVUVnaHR4ZWFHSlBsaVppdlNNYW1NNlh5M1ZZdnpPUUJEeUtfWkJZbkZXYVE9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9HdDdpMVBWU2FNU21QN29QZ21RdEowcDd1MzZ4VlU5X1pDY1ZLaExKQmhtamNwNGYwR1YxVlZMQ29RZUo2aGZCMUUxd2Q5SW03VGJMaFBaZUdtRGdjQUVaVHlrbW5ROVlUNmJMSHV1Tl9hVUFVZGlnc1dRLUI4U3FuckYxRlJ5alE1RDZIT2VJeEtkNE1WOUV6am9FMGpwV2dJSkVGTXo4Sk95UW5tX1NzSGtXOV9TMl9nYlNaYVpEYklzM0Qyc0s4a2RrNzhUYXlGZEVNM3BGelVNYUdxdz09"
}
Entry Information
- Entry ID: 6419
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000