Row 93455

Row ID: 93455 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 93455 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

The ability to use reasoning to correctly perform tasks it has never seen before during its training phase is called 0 shot generalisation. Current 0 shot generalisation performance from even the most cutting edge models is extremely poor, and recent research has shown that even by infinitely increasing model size, this cannot increase 0 shot generalisation performance. Realistically, the only way to solve for this core feature of any ‘AGIentic’ system is to produce a transformer architecture that so radically new it has nothing in common with any current approach.

For OpenAI to have reached AGI, they would have to have created this architecture, which, has 0 known or theoretical approaches across scientific literature to achieve. This is highly unlikely to have happened as this area of study is so new. The ‘true’ solving of this problem (ie a pseudo solution not powered by agentic workflows) is likely decades away, and I think will coincide with research on how we understand the human brain.

FieldValue
text The ability to use reasoning to correctly perform tasks it has never seen before during its training phase is called 0 shot generalisation. Current 0 shot generalisation performance from even the most cutting edge models is extremely poor, and recent research has shown that even by infinitely increasing model size, this cannot increase 0 shot generalisation performance. Realistically, the only way to solve for this core feature of any ‘AGIentic’ system is to produce a transformer architecture th…
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-25
username_encoded Z0FBQUFBQm5Lak10blFmUklmWkVVdm9BTVlzX21XYWlYQnZ1T1FfbjBWVVB5OEZtZTR5b01NbmF5ekQtU3dmS09tNExyeENCUm5UbWg3b1VtNlFnN0RoMzQ0T0dlalpQZmc9PQ==
url_encoded Z0FBQUFBQm5Lak9fbHh5ZUN5eXVUWTBoRnlqOFdUWUhnUHl4Z3c2dEY5U3hxSUROZm8wNkRCN3N4SHROWFRmRV9wWDlRYnhNdDA5S09HZEgxTnVibTNaZlRSV095TUNuaGg3LWtFOGZyc2huc2d4MWd5NXlqcFdjTjdrSjBOajhzT2U5RTMwLTN1TTNZQURlVmUxOGJyQkhiZzBEcTNJQWgxai1TSm5DRXJmSGFfSEtIR29FSWFRdXBzaDhVNkNiRDVKYkFsVjZfb0RIV052MTZYQWJaY0kyc2J6UXF0VWNmUFc0d0xRX2c3dy11UHJiMVctaWJJTT0=

Raw Record

{
  "text": "The ability to use reasoning to correctly perform tasks it has never seen before during its training phase is called 0 shot generalisation. Current 0 shot generalisation performance from even the most cutting edge models is extremely poor, and recent research has shown that even by infinitely increasing model size, this cannot increase 0 shot generalisation performance. Realistically, the only way to solve for this core feature of any ‘AGIentic’ system is to produce a transformer architecture that so radically new it has nothing in common with any current approach.\n\nFor OpenAI to have reached AGI, they would have to have created this architecture, which, has 0 known or theoretical approaches across scientific literature to achieve. This is highly unlikely to have happened as this area of study is so new. The ‘true’ solving of this problem (ie a pseudo solution not powered by agentic workflows) is likely decades away, and I think will coincide with research on how we understand the human brain.",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-25",
  "username_encoded": "Z0FBQUFBQm5Lak10blFmUklmWkVVdm9BTVlzX21XYWlYQnZ1T1FfbjBWVVB5OEZtZTR5b01NbmF5ekQtU3dmS09tNExyeENCUm5UbWg3b1VtNlFnN0RoMzQ0T0dlalpQZmc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9fbHh5ZUN5eXVUWTBoRnlqOFdUWUhnUHl4Z3c2dEY5U3hxSUROZm8wNkRCN3N4SHROWFRmRV9wWDlRYnhNdDA5S09HZEgxTnVibTNaZlRSV095TUNuaGg3LWtFOGZyc2huc2d4MWd5NXlqcFdjTjdrSjBOajhzT2U5RTMwLTN1TTNZQURlVmUxOGJyQkhiZzBEcTNJQWgxai1TSm5DRXJmSGFfSEtIR29FSWFRdXBzaDhVNkNiRDVKYkFsVjZfb0RIV052MTZYQWJaY0kyc2J6UXF0VWNmUFc0d0xRX2c3dy11UHJiMVctaWJJTT0="
}

Entry Information