Row 7220
Content Data
This page contains data entry 7220 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
Hey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out:
1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification? 2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: "write out your reasoning step-by-step to be sure you get the right answers!", is there any explanation why it does help? we are using a classification head instead of the decoder one so it's not auto regressive.
| Field | Value |
|---|---|
| text | Hey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out: 1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification? 2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: "write out your reasoning step-by-step to be su… |
| label | r/machinelearning |
| dataType | post |
| communityName | r/MachineLearning |
| datetime | 2024-05-15 |
| username_encoded | Z0FBQUFBQm5LakwzR0ZfU1pNYk80dHU2TVJPX0lGY21VNkpaM01fNHdYUkxxMTRwN1dMR0RLaHN2X21QSTJOLUJlQmZtblRXQlBGTVBwdHBUeENJalZiQWpfY01rVW9idXc9PQ== |
| url_encoded | Z0FBQUFBQm5Lak9IUHNqQ0ZMZEhERGVqNW4xb20xNnR0czdDZ3pzazM5VURZYUFTZ3gzTzctWktickpRVE5oOUdZcWxzNFNuQS1JVzVzMU1DUllxYVhncExKbWdlMkhPZXpHWmJxTHBxeEFNS3BRbWFyRm9LUGMwekg5YTFCSTFETUdMcmdpbExGSTlRdEZ2SWs4WVlkQ2x6MElYTXFxZjkwZ0RKYjJlQUxvYUhjamZGQWs4VERieW1uQ1BrQmQ0SEd4N1VtQ1RHTUJ4 |
Raw Record
{
"text": " \nHey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out:\n\n1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification?\n2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: \"write out your reasoning step-by-step to be sure you get the right answers!\", is there any explanation why it does help? we are using a classification head instead of the decoder one so it's not auto regressive.",
"label": "r/machinelearning",
"dataType": "post",
"communityName": "r/MachineLearning",
"datetime": "2024-05-15",
"username_encoded": "Z0FBQUFBQm5LakwzR0ZfU1pNYk80dHU2TVJPX0lGY21VNkpaM01fNHdYUkxxMTRwN1dMR0RLaHN2X21QSTJOLUJlQmZtblRXQlBGTVBwdHBUeENJalZiQWpfY01rVW9idXc9PQ==",
"url_encoded": "Z0FBQUFBQm5Lak9IUHNqQ0ZMZEhERGVqNW4xb20xNnR0czdDZ3pzazM5VURZYUFTZ3gzTzctWktickpRVE5oOUdZcWxzNFNuQS1JVzVzMU1DUllxYVhncExKbWdlMkhPZXpHWmJxTHBxeEFNS3BRbWFyRm9LUGMwekg5YTFCSTFETUdMcmdpbExGSTlRdEZ2SWs4WVlkQ2x6MElYTXFxZjkwZ0RKYjJlQUxvYUhjamZGQWs4VERieW1uQ1BrQmQ0SEd4N1VtQ1RHTUJ4"
}
Entry Information
- Entry ID: 7220
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000