Row 3832

Row ID: 3832 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 3832 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I’d like to attempt to train a loRA module which doesn’t use its LinearLayer sibling’s input rather an input from the root level of the network.

My current plan is to create a wrapper around the original model in order to parse my extra input. But I do not know how to access the root level of a network from a sub module. The dirty solution would be to use a global variable or maybe initialize the LinearWithLoraCustom(nn.module) with a reference to the root level model before applying it to the existing network. Anyone have suggestions on how they’d approach this?

For my problem in context I’d begin with training some network to speak in english or spanish depending on if the extra input is 0/1 then continue from there.

I’ve been surprised to not have found much looking under “auxiliary networks” so if this is already an explored topic i’d love some guidance on where to look.

FieldValue
text I’d like to attempt to train a loRA module which doesn’t use its LinearLayer sibling’s input rather an input from the root level of the network. My current plan is to create a wrapper around the original model in order to parse my extra input. But I do not know how to access the root level of a network from a sub module. The dirty solution would be to use a global variable or maybe initialize the LinearWithLoraCustom(nn.module) with a reference to the root level model before applying it to the…
label r/pytorch
dataType post
communityName r/pytorch
datetime 2024-03-25
username_encoded Z0FBQUFBQm5LakwxZ2kwUlU4RVlsUUhUc1R3UUtrYUl1TFNudEUyU2FWZmtlZTBZbk1xSVYzN3BsU0Q2bjN6LVViYkx4Q2lVWmdjTGlNVm5fNHVfa0pXbG4zT0JqY3ZiS1E9PQ==
url_encoded Z0FBQUFBQm5Lak9Falcwa1VBT0tDbWlmTWw4aWVpNmQzbUUxTjZsenlSUzIzZUNOMTVwal9RUExKMVVsNk5fV1FRRFFTTl90X1JBbFljTm05LWR5ZXFsUXQ0dTA0RGktMWdHdzdzdEpqZGp3eHJYTnFwVGZ6SS1TTC1LVGVsV0hrS25WblZyOVZiQWV6MWhsWlljYkw0bE1sSF96di1kNWRySkFuRkpOYUM5cWZwcWs2dFY5ZldCcFY2b3U1VUpxVlpJUDlwaUpSYVE5bDJ1b1JMTWthV296QzVhNFVNOWluZz09

Raw Record

{
  "text": "I’d like to attempt to train a loRA module which doesn’t use its LinearLayer sibling’s input rather an input from the root level of the network. \n\nMy current plan is to create a wrapper around the original model in order to parse my extra input. But I do not know how to access the root level of a network from a sub module. The dirty solution would be to use a global variable or maybe initialize the LinearWithLoraCustom(nn.module) with a reference to the root level model before applying it to the existing network. Anyone have suggestions on how they’d approach this?\n\nFor my problem in context I’d begin with training some network to speak in english or spanish depending on if the extra input is 0/1 then continue from there.\n\nI’ve been surprised to not have found much \nlooking under “auxiliary networks” so if this is already an explored topic i’d love some guidance on where to look.",
  "label": "r/pytorch",
  "dataType": "post",
  "communityName": "r/pytorch",
  "datetime": "2024-03-25",
  "username_encoded": "Z0FBQUFBQm5LakwxZ2kwUlU4RVlsUUhUc1R3UUtrYUl1TFNudEUyU2FWZmtlZTBZbk1xSVYzN3BsU0Q2bjN6LVViYkx4Q2lVWmdjTGlNVm5fNHVfa0pXbG4zT0JqY3ZiS1E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9Falcwa1VBT0tDbWlmTWw4aWVpNmQzbUUxTjZsenlSUzIzZUNOMTVwal9RUExKMVVsNk5fV1FRRFFTTl90X1JBbFljTm05LWR5ZXFsUXQ0dTA0RGktMWdHdzdzdEpqZGp3eHJYTnFwVGZ6SS1TTC1LVGVsV0hrS25WblZyOVZiQWV6MWhsWlljYkw0bE1sSF96di1kNWRySkFuRkpOYUM5cWZwcWs2dFY5ZldCcFY2b3U1VUpxVlpJUDlwaUpSYVE5bDJ1b1JMTWthV296QzVhNFVNOWluZz09"
}
Explore Dataset Explore Row

Entry Information