Row 27766

Row ID: 27766 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 27766 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

On a related note, I wonder how much these models differentiate the positional encoding component of embeddings from the rest of the embedding? Does the positional enoding ever get updated/transformed in same way as rest of the embedding?

I assume image embeddings, representing parts of the image, also contain (2-D) positional encodings to allow the model to reason about relative positions ?

FieldValue
text On a related note, I wonder how much these models differentiate the positional encoding component of embeddings from the rest of the embedding? Does the positional enoding ever get updated/transformed in same way as rest of the embedding? I assume image embeddings, representing parts of the image, also contain (2-D) positional encodings to allow the model to reason about relative positions ?
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-21
username_encoded Z0FBQUFBQm5Lak1FODdWM3J4MjhIdE1VVFFaUjU0dXQ0VjBiQVlQWmFQdVhWQlRkMTRteEdlakVHZzRZVFJWUm80akk5NmZXMk04elNWVnVXODNuS2lMQnlBOVFHWU53RXc9PQ==
url_encoded Z0FBQUFBQm5Lak9UZnkwSmR6LTk4aVRqbF81TmV3c2Z6bnpoeFBXVjFzd3puZnNrR2s2ZU44WjlaMWdKTVdGbS1Zb3pYQWN6Rl93UmtsNnB3YmRZZVYtR3VoVWduelBQM3VWWW1SdFhDb1NGMDVNdXF5U1YwR1dHQ1FEMElzdjdsQzB0YXVPTWxfZUdTMkZmU045REt6ZzVWYVYwa2NrTEx4dlQ5cXRxeVpIckMtdFVOWFo5LWJxaDJlMTFzcE90V2FRa2JHaUktb0VrazlEQTItcEREUGhJYWk3V1A4RkFJbU12NU52UlpwdjlPTGNhVVlXMS1lcz0=

Raw Record

{
  "text": "On a related note, I wonder how much these models differentiate the positional encoding component of embeddings from the rest of the embedding? Does the positional enoding ever get updated/transformed in same way as rest of the embedding?\n\nI assume image embeddings, representing parts of the image, also contain (2-D) positional encodings to allow the model to reason about relative positions ?",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-21",
  "username_encoded": "Z0FBQUFBQm5Lak1FODdWM3J4MjhIdE1VVFFaUjU0dXQ0VjBiQVlQWmFQdVhWQlRkMTRteEdlakVHZzRZVFJWUm80akk5NmZXMk04elNWVnVXODNuS2lMQnlBOVFHWU53RXc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9UZnkwSmR6LTk4aVRqbF81TmV3c2Z6bnpoeFBXVjFzd3puZnNrR2s2ZU44WjlaMWdKTVdGbS1Zb3pYQWN6Rl93UmtsNnB3YmRZZVYtR3VoVWduelBQM3VWWW1SdFhDb1NGMDVNdXF5U1YwR1dHQ1FEMElzdjdsQzB0YXVPTWxfZUdTMkZmU045REt6ZzVWYVYwa2NrTEx4dlQ5cXRxeVpIckMtdFVOWFo5LWJxaDJlMTFzcE90V2FRa2JHaUktb0VrazlEQTItcEREUGhJYWk3V1A4RkFJbU12NU52UlpwdjlPTGNhVVlXMS1lcz0="
}
Explore Dataset Explore Row

Entry Information