Row 49143

Row ID: 49143 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 49143 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Does the batch-norm in a casually masked transformer cause information to leak backwards? If you normalize the whole layer at once won't the early tokens be able to glean information from later tokens?

FieldValue
text Does the batch-norm in a casually masked transformer cause information to leak backwards? If you normalize the whole layer at once won't the early tokens be able to glean information from later tokens?
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-22
username_encoded Z0FBQUFBQm5Lak1SMk4xS0VnSzRWNzhaYlhtbnh0M2xXVUJNUEVISVpVNkNQWVU4ZWhYOTZIdW11YzJ0dEFFclBoYjFPUHQybzEtd21yYzlYb082Skk2MWNsaGtZMmc4V3c9PQ==
url_encoded Z0FBQUFBQm5Lak9oVXVUMW84dm1nYjlmUzItZ3V2enMyMHRSRDVWeGFnekhOa3JYQS1mcXJYeEZMR2wycnhzMEtDa2hjdS1xNGwzbmxfV2lzOWpadWZqa1hRY2JBSXhSSmRlaDBnUURQREZQVnBQVUd6dFVkSFIxV0FCczVMSlp6S2hISDlTWmR0alBNVWtaSW8xeFkxY2hFT1VBYkNFTDExel9ibVlBNVhiaDhrZTMxLXJITXRxRUVpcmdPMU8tdlVlamV6VWZaNmVj

Raw Record

{
  "text": "Does the batch-norm in a casually masked transformer cause information to leak backwards? If you normalize the whole layer at once won't the early tokens be able to glean information from later tokens?",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-22",
  "username_encoded": "Z0FBQUFBQm5Lak1SMk4xS0VnSzRWNzhaYlhtbnh0M2xXVUJNUEVISVpVNkNQWVU4ZWhYOTZIdW11YzJ0dEFFclBoYjFPUHQybzEtd21yYzlYb082Skk2MWNsaGtZMmc4V3c9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9oVXVUMW84dm1nYjlmUzItZ3V2enMyMHRSRDVWeGFnekhOa3JYQS1mcXJYeEZMR2wycnhzMEtDa2hjdS1xNGwzbmxfV2lzOWpadWZqa1hRY2JBSXhSSmRlaDBnUURQREZQVnBQVUd6dFVkSFIxV0FCczVMSlp6S2hISDlTWmR0alBNVWtaSW8xeFkxY2hFT1VBYkNFTDExel9ibVlBNVhiaDhrZTMxLXJITXRxRUVpcmdPMU8tdlVlamV6VWZaNmVj"
}
Explore Dataset Explore Row

Entry Information