Row 68868

Row ID: 68868 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 68868 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

It is not maintained properly at all. The major problem for me is that they only report raw performance metric, with no regard for actual experimental procedure. In graph learning, you can take 5 papers and get 10 different testing procotols (no joke, there are papers with 2-3 different evaluation approaches). So just reporting "a number" is meaningless. In particular, they mix papers with no test set (reporting only validation set results, totally overoptimistic) with those with proper testing.

FieldValue
text It is not maintained properly at all. The major problem for me is that they only report raw performance metric, with no regard for actual experimental procedure. In graph learning, you can take 5 papers and get 10 different testing procotols (no joke, there are papers with 2-3 different evaluation approaches). So just reporting "a number" is meaningless. In particular, they mix papers with no test set (reporting only validation set results, totally overoptimistic) with those with proper testing.
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1lclZtZWYySEN1SlhWLUgyaDUzWkhaYUc0blJvbWNmNGxyLTZ0eHloUlhLSzhvOFdHRnE5bk11REpuQkQzdXNJSXF2MzNwUmFCc1hXSDNxRDFqN1R3RGc9PQ==
url_encoded Z0FBQUFBQm5Lak91UEhDTkVmUkFnTmZZUFh2M0pEQmZWQnN6UExGcjVwOUlWTVkzSURrVzRTUUNRdGNRTGFLV1hiaVEwSzY3UVhjQjRPOW5weWwxSlhFYmlUYTFCVWszUy1KbDhMVW9Mc0FTUWpPUVFIemNfSVNEVzIzVjR0N0p1UU9RZnhfaERjLWp3NHI4WHRiNGtWcHBDSGc2VzJBTzRjWUhqUU4yV3lUVjVEai1pTWpmb0pUMElkWEdFNDBreGxsTWVWellUSE1N

Raw Record

{
  "text": "It is not maintained properly at all. The major problem for me is that they only report raw performance metric, with no regard for actual experimental procedure. In graph learning, you can take 5 papers and get 10 different testing procotols (no joke, there are papers with 2-3 different evaluation approaches). So just reporting \"a number\" is meaningless. In particular, they mix papers with no test set (reporting only validation set results, totally overoptimistic) with those with proper testing.",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1lclZtZWYySEN1SlhWLUgyaDUzWkhaYUc0blJvbWNmNGxyLTZ0eHloUlhLSzhvOFdHRnE5bk11REpuQkQzdXNJSXF2MzNwUmFCc1hXSDNxRDFqN1R3RGc9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak91UEhDTkVmUkFnTmZZUFh2M0pEQmZWQnN6UExGcjVwOUlWTVkzSURrVzRTUUNRdGNRTGFLV1hiaVEwSzY3UVhjQjRPOW5weWwxSlhFYmlUYTFCVWszUy1KbDhMVW9Mc0FTUWpPUVFIemNfSVNEVzIzVjR0N0p1UU9RZnhfaERjLWp3NHI4WHRiNGtWcHBDSGc2VzJBTzRjWUhqUU4yV3lUVjVEai1pTWpmb0pUMElkWEdFNDBreGxsTWVWellUSE1N"
}

Entry Information