Row 8551

Row ID: 8551 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 8551 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs.

I don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs.

By LM weights, I assume it means the weights of the last layers of the transformer model. When they describe optimizers, they say "DSPy introduces new optimizers, which are LM-driven algorithms that can tune the prompts and/or the weights of your LM calls, given a metric you want to maximize."

Am I misunderstanding what they mean by LM weights?

I'm sorry if this is a stupid question, but I just can't seem to find any information about this. Thanks in advance!

FieldValue
text I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs. I don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs. By LM weights, I assume it means the weights of the last layers of the transformer model. When th…
label r/machinelearning
dataType post
communityName r/MachineLearning
datetime 2024-05-19
username_encoded Z0FBQUFBQm5Lakw0YjJWdEJ6TWI2cmx1R1ZKUVc0dzlEM0VzZjZ1NEpTVTJPakpYcnJWcW5rRE5GbzN0ZW5MS1ZOcmFfUjVoTENLQlJocW4wdVN5cTkwLTVNbmZqUko1YkE9PQ==
url_encoded Z0FBQUFBQm5Lak9ITG5zVGZ2dUZwMTkzRW9MMGc5SjZDOWVZY2g5YjBpdjNvdjJUWGM0OV9qWWlXY0p0ZzZ0VE5reWQtNU9venZhOUx1aUw0Q3J3VGxfZDVScHRhQVRGa1lLcjZmSUVETFBCcXlBbWRSbTExYXBVWFFYdjJibXRxMmVnQnZEbER1R1BlMldHR1lZYnpMTW1FZUY2WmNHaHI3MVpBckphY2M0czJaaWppLUxqOTF2OVNacmxLQWZJb0hVRlptbmh0ZzJEbmVQLWxMbW9WZHMxelNNcUtienpoQT09

Raw Record

{
  "text": "I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs.\n\nI don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs. \n\nBy LM weights, I assume it means the weights of the last layers of the transformer model. When they describe optimizers, they say \"DSPy introduces new optimizers, which are LM-driven algorithms that can tune the prompts and/or the weights of your LM calls, given a metric you want to maximize.\"\n\nAm I misunderstanding what they mean by LM weights?\n\nI'm sorry if this is a stupid question, but I just can't seem to find any information about this. Thanks in advance!",
  "label": "r/machinelearning",
  "dataType": "post",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-19",
  "username_encoded": "Z0FBQUFBQm5Lakw0YjJWdEJ6TWI2cmx1R1ZKUVc0dzlEM0VzZjZ1NEpTVTJPakpYcnJWcW5rRE5GbzN0ZW5MS1ZOcmFfUjVoTENLQlJocW4wdVN5cTkwLTVNbmZqUko1YkE9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9ITG5zVGZ2dUZwMTkzRW9MMGc5SjZDOWVZY2g5YjBpdjNvdjJUWGM0OV9qWWlXY0p0ZzZ0VE5reWQtNU9venZhOUx1aUw0Q3J3VGxfZDVScHRhQVRGa1lLcjZmSUVETFBCcXlBbWRSbTExYXBVWFFYdjJibXRxMmVnQnZEbER1R1BlMldHR1lZYnpMTW1FZUY2WmNHaHI3MVpBckphY2M0czJaaWppLUxqOTF2OVNacmxLQWZJb0hVRlptbmh0ZzJEbmVQLWxMbW9WZHMxelNNcUtienpoQT09"
}

Entry Information