Row 9645

Row ID: 9645 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 9645 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hi all,

I am learning cross attention recently and I know how it works, with query and key/values from different embeddings. But I want to know how to understand this intuitively and in a high-level context, because when I design a network architecture, it's difficult for me to know which one should be key and which one should be queries or values, who's attending to who and why. Some tips from this perspective would be very useful! Thanks in advance

FieldValue
text Hi all, I am learning cross attention recently and I know how it works, with query and key/values from different embeddings. But I want to know how to understand this intuitively and in a high-level context, because when I design a network architecture, it's difficult for me to know which one should be key and which one should be queries or values, who's attending to who and why. Some tips from this perspective would be very useful! Thanks in advance
label r/deeplearning
dataType post
communityName r/deeplearning
datetime 2024-05-20
username_encoded Z0FBQUFBQm5Lakw1YmJ1eFFPV3NacFdFX1lvUEpqckV1N2hFbTIwbzdhYTFTSTZVbE16OGhzd3lEZl9uejNKbldHYm9mMnVwNk0ybTRsZjVmSlRRRkc0NUJtTGxtUlpRcy1KVVlua2EwS2FBMHJFbElHZkI2SWM9
url_encoded Z0FBQUFBQm5Lak9JeksyWHVuVWdWaExRNnRmbmVYRzJYTkVqZEpyWjljc1BzdzR3bTcxY2NBcjBJZkczaHdlY3JqZFhkUEpfS0NnMlJMSmhjbkh6aDZVSHNERG9YVkoySVJybThEeFRwYW1aeS1VSVhNdkgwam9hbTZoX2thS0gxQTM1X3ZNQkQ2eVpCeUNFNHFJY0VoUzAtNUtyNm5GSGlGb09HbzRtV0VDWC1lc3BRb1hDdGEwMXNqREVvMkxzc3ZPSDljTzNNR3Z1RmctQU0yU21yaTVXNWctbW5WbzV3Zz09

Raw Record

{
  "text": "Hi all,\n\nI am learning cross attention recently and I know how it works, with query and key/values from different embeddings. But I want to know how to understand this intuitively and in a high-level context, because when I design a network architecture, it's difficult for me to know which one should be key and which one should be queries or values, who's attending to who and why.  Some tips from this perspective would be very useful! Thanks in advance",
  "label": "r/deeplearning",
  "dataType": "post",
  "communityName": "r/deeplearning",
  "datetime": "2024-05-20",
  "username_encoded": "Z0FBQUFBQm5Lakw1YmJ1eFFPV3NacFdFX1lvUEpqckV1N2hFbTIwbzdhYTFTSTZVbE16OGhzd3lEZl9uejNKbldHYm9mMnVwNk0ybTRsZjVmSlRRRkc0NUJtTGxtUlpRcy1KVVlua2EwS2FBMHJFbElHZkI2SWM9",
  "url_encoded": "Z0FBQUFBQm5Lak9JeksyWHVuVWdWaExRNnRmbmVYRzJYTkVqZEpyWjljc1BzdzR3bTcxY2NBcjBJZkczaHdlY3JqZFhkUEpfS0NnMlJMSmhjbkh6aDZVSHNERG9YVkoySVJybThEeFRwYW1aeS1VSVhNdkgwam9hbTZoX2thS0gxQTM1X3ZNQkQ2eVpCeUNFNHFJY0VoUzAtNUtyNm5GSGlGb09HbzRtV0VDWC1lc3BRb1hDdGEwMXNqREVvMkxzc3ZPSDljTzNNR3Z1RmctQU0yU21yaTVXNWctbW5WbzV3Zz09"
}
Explore Dataset Explore Row

Entry Information