Row 8551
Content Data
This page contains data entry 8551 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs.
I don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs.
By LM weights, I assume it means the weights of the last layers of the transformer model. When they describe optimizers, they say "DSPy introduces new optimizers, which are LM-driven algorithms that can tune the prompts and/or the weights of your LM calls, given a metric you want to maximize."
Am I misunderstanding what they mean by LM weights?
I'm sorry if this is a stupid question, but I just can't seem to find any information about this. Thanks in advance!
| Field | Value |
|---|---|
| text | I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs. I don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs. By LM weights, I assume it means the weights of the last layers of the transformer model. When th… |
| label | r/machinelearning |
| dataType | post |
| communityName | r/MachineLearning |
| datetime | 2024-05-19 |
| username_encoded | Z0FBQUFBQm5Lakw0YjJWdEJ6TWI2cmx1R1ZKUVc0dzlEM0VzZjZ1NEpTVTJPakpYcnJWcW5rRE5GbzN0ZW5MS1ZOcmFfUjVoTENLQlJocW4wdVN5cTkwLTVNbmZqUko1YkE9PQ== |
| url_encoded | Z0FBQUFBQm5Lak9ITG5zVGZ2dUZwMTkzRW9MMGc5SjZDOWVZY2g5YjBpdjNvdjJUWGM0OV9qWWlXY0p0ZzZ0VE5reWQtNU9venZhOUx1aUw0Q3J3VGxfZDVScHRhQVRGa1lLcjZmSUVETFBCcXlBbWRSbTExYXBVWFFYdjJibXRxMmVnQnZEbER1R1BlMldHR1lZYnpMTW1FZUY2WmNHaHI3MVpBckphY2M0czJaaWppLUxqOTF2OVNacmxLQWZJb0hVRlptbmh0ZzJEbmVQLWxMbW9WZHMxelNNcUtienpoQT09 |
Raw Record
{
"text": "I always thought it's essentially glorified and structured prompt engineering (very useful still IMO), but it also claims in the docs that it fine-tunes and changes LM weights, and then absolutely refuses to elaborate on this in any of the sections in their docs.\n\nI don't even understand how it can change the actual parameters of the LM, especially if we're using third party API calls for the LMs. \n\nBy LM weights, I assume it means the weights of the last layers of the transformer model. When they describe optimizers, they say \"DSPy introduces new optimizers, which are LM-driven algorithms that can tune the prompts and/or the weights of your LM calls, given a metric you want to maximize.\"\n\nAm I misunderstanding what they mean by LM weights?\n\nI'm sorry if this is a stupid question, but I just can't seem to find any information about this. Thanks in advance!",
"label": "r/machinelearning",
"dataType": "post",
"communityName": "r/MachineLearning",
"datetime": "2024-05-19",
"username_encoded": "Z0FBQUFBQm5Lakw0YjJWdEJ6TWI2cmx1R1ZKUVc0dzlEM0VzZjZ1NEpTVTJPakpYcnJWcW5rRE5GbzN0ZW5MS1ZOcmFfUjVoTENLQlJocW4wdVN5cTkwLTVNbmZqUko1YkE9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9ITG5zVGZ2dUZwMTkzRW9MMGc5SjZDOWVZY2g5YjBpdjNvdjJUWGM0OV9qWWlXY0p0ZzZ0VE5reWQtNU9venZhOUx1aUw0Q3J3VGxfZDVScHRhQVRGa1lLcjZmSUVETFBCcXlBbWRSbTExYXBVWFFYdjJibXRxMmVnQnZEbER1R1BlMldHR1lZYnpMTW1FZUY2WmNHaHI3MVpBckphY2M0czJaaWppLUxqOTF2OVNacmxLQWZJb0hVRlptbmh0ZzJEbmVQLWxMbW9WZHMxelNNcUtienpoQT09"
}
Entry Information
- Entry ID: 8551
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000