Audit benchmark labels with explicit rules
Do compact balance-scale and tic-tac-toe labels agree with their declared arithmetic and board rules?
Make this plan your own ↓Read, edit and export without an account. This is preparation; no run or result is claimed.
Make the question your own.
3 sources · Exact preparation context
- Balance Scale →
Attribute the supplied creators and UCI dataset DOI/source. Preserve license links and identify changes before any permitted data reuse.
Record revision: 7a2fb797287ac760ab52e63f696edd94e735249a6cea213aa44ec83c5bbde911
- Tic-Tac-Toe Endgame →
Attribute the supplied creators and UCI dataset DOI/source. Preserve license links and identify changes before any permitted data reuse.
Record revision: 2dc9974b8ece8b70e5cf81e9bf7bdf2f1793983a061f162b84d1a7f246bdbad5
- Hypothesis →
Preserve the upstream project name, version, repository link, applicable notices, and contributor attribution when preparing an artifact for reuse.
Record revision: b391cd8285f077d9e64ab0add10edbf759da980506401721e52bce5c299c8ac7
Source links open the current listing. This plan retains the revisions above; listing review does not grant permission to copy or adapt source files.
Before carrying out this plan
- Fetch/pin the selected licensed payload as opaque bytes and inspect it only through qualified ingestion.
- Review file-specific attribution and freeze a standard-library checker; the present catalog only inspected metadata.
- Hypothesis itself needs a separately qualified package environment.
Limits to keep in view
- This is an unrun protocol proposal, not a claim that labels are erroneous.
- Dataset-page row counts and sizes remain source assertions until ingestion.
Edit freely. Export a copy before reloading or leaving. Your text stays in this tab until you choose to copy, download or save it privately.
What to compare
For balance scale compare weight-distance products; for tic-tac-toe enumerate winning lines and state the legal-board assumptions. Freeze rule interpretation before judging labels.
Useful outputs
- Qualified-ingestion byte digests and the observed input schema.
- An arithmetic/board-rule checker written from the declared rules.
- Every mismatch with its row identity and explanation; no silently dropped cases.
Inputs and prerequisites
- Fetch/pin the selected licensed payload as opaque bytes and inspect it only through qualified ingestion.
- Review file-specific attribution and freeze a standard-library checker; the present catalog only inspected metadata.
- Hypothesis itself needs a separately qualified package environment.
What this work would not establish
- This is an unrun protocol proposal, not a claim that labels are erroneous.
- Dataset-page row counts and sizes remain source assertions until ingestion.
Start with these sources.
Balance Scale
UCI Machine Learning Repository
A rule-generated balance problem that separates memorization from learning a physical decision rule.
Investigate Can a learner recover balance outcomes on held-out weight-distance combinations?
Tic-Tac-Toe Endgame
UCI Machine Learning Repository
Completed board states for testing learned combinatorial concepts against inspectable rules.
Investigate Can a tic-tac-toe classifier generalize when symmetry-equivalent boards remain in the same split?
Hypothesis
Upstream project repository
Property-based testing tools that generate and simplify test inputs.
Investigate Can a fixed property-based test expose a specified floating-point overclaim within a bounded search protocol?