Row 5903

Row ID: 5903 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 5903 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hello guys. I am trying to train a language model and I want to use Fairscale for parallelism which its used in Llama (ColumnParallelLinear and RowParallelLinear) but I cannot find anything about it. Is there any implementation that I am missing? I think fairscale documentation is really poor of information.

FieldValue
text Hello guys. I am trying to train a language model and I want to use Fairscale for parallelism which its used in Llama (ColumnParallelLinear and RowParallelLinear) but I cannot find anything about it. Is there any implementation that I am missing? I think fairscale documentation is really poor of information.
label r/deeplearning
dataType post
communityName r/deeplearning
datetime 2024-05-05
username_encoded Z0FBQUFBQm5LakwyXzQwVmt1ODRjdUdScUZOekd6VWhLem5MSGNIaUFVNWcyQ21VZlJkNXFXT3JVMm0wZ2dka3VUOG1GcVUwc3RtdzU2ZlhXNld5ZElTaWpNMzdQSmFZaXc9PQ==
url_encoded Z0FBQUFBQm5Lak9HZWU0cGNTRzlIdUV6WTljUFFjOHp1ZFY2VTZrR3NHUG5lZWtsSVdLMnM2ckJwc3RsbjkyODl2OEdvMEtuVGVqU2UxQ0pQUTdiNDY1UnBUX25jUjFZbzRLV0NJSkVpWnE0dlpXd0Y4bmdpLWI3eEM5VXpQcm9YY2dnN2gwZUZoWWlWeWxvSFhpb1RuaTZRcFlUa05GQm5RQ2cxSUh6UG9ENERRR1lTNnU4S1ZjPQ==

Raw Record

{
  "text": "Hello guys. I am trying to train a language model and I want to use Fairscale for parallelism which its used in Llama (ColumnParallelLinear and RowParallelLinear) but I cannot find anything about it. Is there any implementation that I am missing? I think fairscale documentation is really poor of information. ",
  "label": "r/deeplearning",
  "dataType": "post",
  "communityName": "r/deeplearning",
  "datetime": "2024-05-05",
  "username_encoded": "Z0FBQUFBQm5LakwyXzQwVmt1ODRjdUdScUZOekd6VWhLem5MSGNIaUFVNWcyQ21VZlJkNXFXT3JVMm0wZ2dka3VUOG1GcVUwc3RtdzU2ZlhXNld5ZElTaWpNMzdQSmFZaXc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9HZWU0cGNTRzlIdUV6WTljUFFjOHp1ZFY2VTZrR3NHUG5lZWtsSVdLMnM2ckJwc3RsbjkyODl2OEdvMEtuVGVqU2UxQ0pQUTdiNDY1UnBUX25jUjFZbzRLV0NJSkVpWnE0dlpXd0Y4bmdpLWI3eEM5VXpQcm9YY2dnN2gwZUZoWWlWeWxvSFhpb1RuaTZRcFlUa05GQm5RQ2cxSUh6UG9ENERRR1lTNnU4S1ZjPQ=="
}
Explore Dataset Explore Row

Entry Information