Row 99080

Row ID: 99080 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 99080 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

yeah making q,k,v at the same time is easy, but efficiently doing the attention operations is the tricky part because the naive implementation is memory bandwidth bound. there’s great custom cuda kernels for this now though, see neighborhood attention:

https://github.com/SHI-Labs/NATTEN

and the associated paper:

https://arxiv.org/abs/2403.04690

FieldValue
text yeah making q,k,v at the same time is easy, but efficiently doing the attention operations is the tricky part because the naive implementation is memory bandwidth bound. there’s great custom cuda kernels for this now though, see neighborhood attention: https://github.com/SHI-Labs/NATTEN and the associated paper: https://arxiv.org/abs/2403.04690
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-25
username_encoded Z0FBQUFBQm5Lak13cWlsdmVkSlZQaDhrTTU0c3BpeUpHQURJd05VUU9xUTdITUFWTWRFLXZTQ3FvbnBmcGZoQTE0MTlscmN2Qklxb212cHM0WDBEaVZ5SG5jRjFHS1N5b2c9PQ==
url_encoded Z0FBQUFBQm5LalBDS2xuZ05sNm43azBoMVlpY21CTWlSZmF5bVh6d2RMTUQ1NWFJOEFfVGRvendoM3BVWngwQzZOWElCUURSem9BV3dOdWdHRmp5cnNIYXRPa1RRUVItWU1ZdUhybkc0eTd1ekpKNzQydU10VWdPcTczZEJtZnE1T2tETS1aU3BFOTVDbDVhaWU4MndCdV9uMzdodkx0THJMbzhPTXVLSTFxSGRwaV9yOEdhM2hlSzk3UmJfWlZ4QkNSRG1Jc2RHU2ZnUVJFWm1RcUI5MnVTY2ZsdDh3RkJUdz09

Raw Record

{
  "text": "yeah making q,k,v at the same time is easy, but efficiently doing the attention operations is the tricky part because the naive implementation is memory bandwidth bound. there’s great custom cuda kernels for this now though, see neighborhood attention:\n\nhttps://github.com/SHI-Labs/NATTEN\n\nand the associated paper:\n\nhttps://arxiv.org/abs/2403.04690",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-25",
  "username_encoded": "Z0FBQUFBQm5Lak13cWlsdmVkSlZQaDhrTTU0c3BpeUpHQURJd05VUU9xUTdITUFWTWRFLXZTQ3FvbnBmcGZoQTE0MTlscmN2Qklxb212cHM0WDBEaVZ5SG5jRjFHS1N5b2c9PQ==",
  "url_encoded": "Z0FBQUFBQm5LalBDS2xuZ05sNm43azBoMVlpY21CTWlSZmF5bVh6d2RMTUQ1NWFJOEFfVGRvendoM3BVWngwQzZOWElCUURSem9BV3dOdWdHRmp5cnNIYXRPa1RRUVItWU1ZdUhybkc0eTd1ekpKNzQydU10VWdPcTczZEJtZnE1T2tETS1aU3BFOTVDbDVhaWU4MndCdV9uMzdodkx0THJMbzhPTXVLSTFxSGRwaV9yOEdhM2hlSzk3UmJfWlZ4QkNSRG1Jc2RHU2ZnUVJFWm1RcUI5MnVTY2ZsdDh3RkJUdz09"
}
Explore Dataset Explore Row

Entry Information