Row 7220

Row ID: 7220 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 7220 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out:

1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification? 2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: "write out your reasoning step-by-step to be sure you get the right answers!", is there any explanation why it does help? we are using a classification head instead of the decoder one so it's not auto regressive.

FieldValue
text Hey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out: 1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification? 2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: "write out your reasoning step-by-step to be su…
label r/machinelearning
dataType post
communityName r/MachineLearning
datetime 2024-05-15
username_encoded Z0FBQUFBQm5LakwzR0ZfU1pNYk80dHU2TVJPX0lGY21VNkpaM01fNHdYUkxxMTRwN1dMR0RLaHN2X21QSTJOLUJlQmZtblRXQlBGTVBwdHBUeENJalZiQWpfY01rVW9idXc9PQ==
url_encoded Z0FBQUFBQm5Lak9IUHNqQ0ZMZEhERGVqNW4xb20xNnR0czdDZ3pzazM5VURZYUFTZ3gzTzctWktickpRVE5oOUdZcWxzNFNuQS1JVzVzMU1DUllxYVhncExKbWdlMkhPZXpHWmJxTHBxeEFNS3BRbWFyRm9LUGMwekg5YTFCSTFETUdMcmdpbExGSTlRdEZ2SWs4WVlkQ2x6MElYTXFxZjkwZ0RKYjJlQUxvYUhjamZGQWs4VERieW1uQ1BrQmQ0SEd4N1VtQ1RHTUJ4

Raw Record

{
  "text": "  \nHey! as part of my thesis I have seen good results on using AutoModelForSequenceClassification for large texts with llm's (mistral) instead of bert but I have some questions I am trying to figure out:\n\n1. is there a point for having a coherent, understandable prompt with task definition and targets while using AutoModelForSequenceClassification?\n2. I have seen an improvement for the model using cot (chain of thought) prompting, when I asked him to: \"write out your reasoning step-by-step to be sure you get the right answers!\", is there any explanation why it does help? we are using a classification head instead of the decoder one so it's not auto regressive.",
  "label": "r/machinelearning",
  "dataType": "post",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-15",
  "username_encoded": "Z0FBQUFBQm5LakwzR0ZfU1pNYk80dHU2TVJPX0lGY21VNkpaM01fNHdYUkxxMTRwN1dMR0RLaHN2X21QSTJOLUJlQmZtblRXQlBGTVBwdHBUeENJalZiQWpfY01rVW9idXc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9IUHNqQ0ZMZEhERGVqNW4xb20xNnR0czdDZ3pzazM5VURZYUFTZ3gzTzctWktickpRVE5oOUdZcWxzNFNuQS1JVzVzMU1DUllxYVhncExKbWdlMkhPZXpHWmJxTHBxeEFNS3BRbWFyRm9LUGMwekg5YTFCSTFETUdMcmdpbExGSTlRdEZ2SWs4WVlkQ2x6MElYTXFxZjkwZ0RKYjJlQUxvYUhjamZGQWs4VERieW1uQ1BrQmQ0SEd4N1VtQ1RHTUJ4"
}

Entry Information