Row 8067

Row ID: 8067 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 8067 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

**Paper**: [https://arxiv.org/abs/2402.10588](https://arxiv.org/abs/2402.10588)

**Code**: [https://github.com/epfl-dlab/llm-latent-language](https://github.com/epfl-dlab/llm-latent-language)

**Dataset**: [https://huggingface.co/datasets/wendlerc/llm-latent-language](https://huggingface.co/datasets/wendlerc/llm-latent-language)

**Colab links**:

**(1)** [https://colab.research.google.com/drive/1l6qN-hmCV4TbTcRZB5o6rUk\_QPHBZb7K?usp=sharing](https://colab.research.google.com/drive/1l6qN-hmCV4TbTcRZB5o6rUk_QPHBZb7K?usp=sharing)

**(2)** [https://colab.research.google.com/drive/1EhCk3\_CZ\_nSfxxpaDrjTvM-0oHfN9m2n?usp=sharing](https://colab.research.google.com/drive/1EhCk3_CZ_nSfxxpaDrjTvM-0oHfN9m2n?usp=sharing)

**Abstract**:

>We ask whether multilingual language models trained on unbalanced, English-dominated corpora use English as an internal pivot language -- a question of key importance for understanding how language models function and the origins of linguistic bias. Focusing on the Llama-2 family of transformer models, our study uses carefully constructed non-English prompts with a unique correct single-token continuation. From layer to layer, transformers gradually map an input embedding of the final prompt token to an output embedding from which next-token probabilities are computed. Tracking intermediate embeddings through their high-dimensional space reveals three distinct phases, whereby intermediate embeddings (1) start far away from output token embeddings; (2) already allow for decoding a semantically correct next token in the middle layers, but give higher probability to its version in English than in the input language; (3) finally move into an input-language-specific region of the embedding space. We cast these results into a conceptual model where the three phases operate in "input space", "concept space", and "output space", respectively. Crucially, our evidence suggests that the abstract "concept space" lies closer to English than to other languages, which may have important consequences regarding the biases held by multilingual language models.

FieldValue
text **Paper**: [https://arxiv.org/abs/2402.10588](https://arxiv.org/abs/2402.10588) **Code**: [https://github.com/epfl-dlab/llm-latent-language](https://github.com/epfl-dlab/llm-latent-language) **Dataset**: [https://huggingface.co/datasets/wendlerc/llm-latent-language](https://huggingface.co/datasets/wendlerc/llm-latent-language) **Colab links**: **(1)** [https://colab.research.google.com/drive/1l6qN-hmCV4TbTcRZB5o6rUk\_QPHBZb7K?usp=sharing](https://colab.research.google.com/drive/1l6qN-hmCV4Tb…
label r/machinelearning
dataType post
communityName r/MachineLearning
datetime 2024-05-18
username_encoded Z0FBQUFBQm5LakwzTEtLeGlpbHQ4UUhBZXpoYnl3Y2MzUmZFUkdaLVNrbjQ5QWxCWGNQTWNneUpjMjludlc3ZlJ5bFlUZXd5WEFRSDNpUWs2VkFQbW41YndnSm0tZEFpN0E9PQ==
url_encoded Z0FBQUFBQm5Lak9IY01CQ3N1aG5ZNDRSY0MySUphOTQweTlYVXdNaEJFV2MwdjlHbzh4MWhXaTFhSk9UM3B0UWlkbnFNYUlIdk52V3BjcWF5YVFZTnlJN3NVZUx2RExvWnVDX05CdG44RndYT1hDcmR0QlJhdjBsWHRoMFFwczJZdzlxbTFYdFZwRC1QbEZiOE5vcENHV3V3bDRvRkF2WlNpWmV1SUpwNDNzbW5GLS1YWFY3R0FfX01kLVdrQkc3YmRKTFJoa2oxX1VOR0xqYWlld2dWN3A1S1AyczhKU2RKZz09

Raw Record

{
  "text": "**Paper**: [https://arxiv.org/abs/2402.10588](https://arxiv.org/abs/2402.10588)\n\n**Code**: [https://github.com/epfl-dlab/llm-latent-language](https://github.com/epfl-dlab/llm-latent-language)\n\n**Dataset**: [https://huggingface.co/datasets/wendlerc/llm-latent-language](https://huggingface.co/datasets/wendlerc/llm-latent-language)\n\n**Colab links**:\n\n**(1)** [https://colab.research.google.com/drive/1l6qN-hmCV4TbTcRZB5o6rUk\\_QPHBZb7K?usp=sharing](https://colab.research.google.com/drive/1l6qN-hmCV4TbTcRZB5o6rUk_QPHBZb7K?usp=sharing)\n\n**(2)** [https://colab.research.google.com/drive/1EhCk3\\_CZ\\_nSfxxpaDrjTvM-0oHfN9m2n?usp=sharing](https://colab.research.google.com/drive/1EhCk3_CZ_nSfxxpaDrjTvM-0oHfN9m2n?usp=sharing)\n\n**Abstract**:\n\n>We ask whether multilingual language models trained on unbalanced, English-dominated corpora use English as an internal pivot language -- a question of key importance for understanding how language models function and the origins of linguistic bias. Focusing on the Llama-2 family of transformer models, our study uses carefully constructed non-English prompts with a unique correct single-token continuation. From layer to layer, transformers gradually map an input embedding of the final prompt token to an output embedding from which next-token probabilities are computed. Tracking intermediate embeddings through their high-dimensional space reveals three distinct phases, whereby intermediate embeddings (1) start far away from output token embeddings; (2) already allow for decoding a semantically correct next token in the middle layers, but give higher probability to its version in English than in the input language; (3) finally move into an input-language-specific region of the embedding space. We cast these results into a conceptual model where the three phases operate in \"input space\", \"concept space\", and \"output space\", respectively. Crucially, our evidence suggests that the abstract \"concept space\" lies closer to English than to other languages, which may have important consequences regarding the biases held by multilingual language models.",
  "label": "r/machinelearning",
  "dataType": "post",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-18",
  "username_encoded": "Z0FBQUFBQm5LakwzTEtLeGlpbHQ4UUhBZXpoYnl3Y2MzUmZFUkdaLVNrbjQ5QWxCWGNQTWNneUpjMjludlc3ZlJ5bFlUZXd5WEFRSDNpUWs2VkFQbW41YndnSm0tZEFpN0E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9IY01CQ3N1aG5ZNDRSY0MySUphOTQweTlYVXdNaEJFV2MwdjlHbzh4MWhXaTFhSk9UM3B0UWlkbnFNYUlIdk52V3BjcWF5YVFZTnlJN3NVZUx2RExvWnVDX05CdG44RndYT1hDcmR0QlJhdjBsWHRoMFFwczJZdzlxbTFYdFZwRC1QbEZiOE5vcENHV3V3bDRvRkF2WlNpWmV1SUpwNDNzbW5GLS1YWFY3R0FfX01kLVdrQkc3YmRKTFJoa2oxX1VOR0xqYWlld2dWN3A1S1AyczhKU2RKZz09"
}
Explore Dataset Explore Row

Entry Information