Row 67856

Row ID: 67856 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 67856 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

This is kinda like the attention version of the idea behind DenseNets. DenseNets never really took off because in practice this is kinda overkill. I think there is power behind both ideas, but i think the really future viability of N-way attention and dense skip connections is as a starting point/viable limit, and then using some sort of architecture search to prune the connections/heads

FieldValue
text This is kinda like the attention version of the idea behind DenseNets. DenseNets never really took off because in practice this is kinda overkill. I think there is power behind both ideas, but i think the really future viability of N-way attention and dense skip connections is as a starting point/viable limit, and then using some sort of architecture search to prune the connections/heads
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1kckc4eTgweDNjX0NiQmFXZ0dfRFVrRVdjd0VBeUdRc0QwWC1VMkcxQ2dvcXg1NEp3blJjUTNkeEU4bDVKT3Q1RGlzdkF1dVIzMmt4SzVSWVRmNUY1Zmc9PQ==
url_encoded Z0FBQUFBQm5Lak91U2QwT3ZUV1M0MnczbVFDWnNUZ29FRTJ5bTNLVGZvM2h0eUEtYUtHdDlVVXl0ekI4aVRMbmphYTdjY3pVNjRzbTl3THU2SVBYR2wtVThhaFpIMVp5TWFCVzJheEY2TVY1SGxyc1R2TVd6T0RlTGNMdy1sTTZPQnJ4VnQtMzZLZ3IyS25zYWtYVlFyWmZjMTdDNnk0a3dYWDFjSXNSdWwyTE1CRmpjTnRtM252aXFwbnhsWEs0RnNVNlZMQ2t3dTdy

Raw Record

{
  "text": "This is kinda like the attention version of the idea behind DenseNets. DenseNets never really took off because in practice this is kinda overkill. I think there is power behind both ideas, but i think the really future viability of N-way attention and dense skip connections is as a starting point/viable limit, and then using some sort of architecture search to prune the connections/heads",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1kckc4eTgweDNjX0NiQmFXZ0dfRFVrRVdjd0VBeUdRc0QwWC1VMkcxQ2dvcXg1NEp3blJjUTNkeEU4bDVKT3Q1RGlzdkF1dVIzMmt4SzVSWVRmNUY1Zmc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak91U2QwT3ZUV1M0MnczbVFDWnNUZ29FRTJ5bTNLVGZvM2h0eUEtYUtHdDlVVXl0ekI4aVRMbmphYTdjY3pVNjRzbTl3THU2SVBYR2wtVThhaFpIMVp5TWFCVzJheEY2TVY1SGxyc1R2TVd6T0RlTGNMdy1sTTZPQnJ4VnQtMzZLZ3IyS25zYWtYVlFyWmZjMTdDNnk0a3dYWDFjSXNSdWwyTE1CRmpjTnRtM252aXFwbnhsWEs0RnNVNlZMQ2t3dTdy"
}

Entry Information