Row 4691

Row ID: 4691 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 4691 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hi All,

Can someone help me in understanding the Router that is desgined for MOE. And how to implement it in pytorch?

I've been racking my head on it since long cannot seem to understand how the gate is to be designed so it activates only the corresponding layer for the input.

FieldValue
text Hi All, Can someone help me in understanding the Router that is desgined for MOE. And how to implement it in pytorch? I've been racking my head on it since long cannot seem to understand how the gate is to be designed so it activates only the corresponding layer for the input.
label r/deeplearning
dataType post
communityName r/deeplearning
datetime 2024-04-20
username_encoded Z0FBQUFBQm5LakwxdktoYkItSVlGYVh4bVZ1ZE1iRVhYQTBVMGFXNVRlVUs0bDU5eFRtcUxnQUxLQzhjOUxpMFNtTU5PYkltaXpPOVFZaEU1VWNuMG9rZGJhUEs2Zm5WQ0E9PQ==
url_encoded Z0FBQUFBQm5Lak9GY0ZyWHlZT2ZSRXlXWnF2NWM3SlI0WjJONGZ6bzNUd094c1NkVGRhNmZjVE9ZLUtyNFpQZzRIVzN6bXdkRG04aXczVU9mTDBhSHVZNDFKSmprX2EzRnpEcTQ0dl8zeW0tUnZzOEFYeFRXQTctYjM5RWtLbEV3ZDNpOWJqRnNfVTdlS2ZFNXlKTElWOUJGb0lyTUVOZnZEbGJNaVJqTmdHOEVOVE5YaDJWN3h5VnpDZGUxTWxZQWphWkR2S3Y3eVNo

Raw Record

{
  "text": "Hi All,\n\nCan someone help me in understanding the Router that is desgined for MOE. And how to implement it in pytorch?\n\nI've been racking my head on it since long cannot seem to understand how the gate is to be designed so it activates only the corresponding layer for the input.",
  "label": "r/deeplearning",
  "dataType": "post",
  "communityName": "r/deeplearning",
  "datetime": "2024-04-20",
  "username_encoded": "Z0FBQUFBQm5LakwxdktoYkItSVlGYVh4bVZ1ZE1iRVhYQTBVMGFXNVRlVUs0bDU5eFRtcUxnQUxLQzhjOUxpMFNtTU5PYkltaXpPOVFZaEU1VWNuMG9rZGJhUEs2Zm5WQ0E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9GY0ZyWHlZT2ZSRXlXWnF2NWM3SlI0WjJONGZ6bzNUd094c1NkVGRhNmZjVE9ZLUtyNFpQZzRIVzN6bXdkRG04aXczVU9mTDBhSHVZNDFKSmprX2EzRnpEcTQ0dl8zeW0tUnZzOEFYeFRXQTctYjM5RWtLbEV3ZDNpOWJqRnNfVTdlS2ZFNXlKTElWOUJGb0lyTUVOZnZEbGJNaVJqTmdHOEVOVE5YaDJWN3h5VnpDZGUxTWxZQWphWkR2S3Y3eVNo"
}
Explore Dataset Explore Row

Entry Information