Audit benchmark labels with explicit rules
Do compact balance-scale and tic-tac-toe labels agree with their declared arithmetic and board rules?
Make this plan your own ↓Read, edit and export without an account. This is preparation; no run or result is claimed.
What to compare
For balance scale compare weight-distance products; for tic-tac-toe enumerate winning lines and state the legal-board assumptions. Freeze rule interpretation before judging labels.
Useful outputs
- Qualified-ingestion byte digests and the observed input schema.
- An arithmetic/board-rule checker written from the declared rules.
- Every mismatch with its row identity and explanation; no silently dropped cases.
Inputs and prerequisites
- Fetch/pin the selected licensed payload as opaque bytes and inspect it only through qualified ingestion.
- Review file-specific attribution and freeze a standard-library checker; the present catalog only inspected metadata.
- Hypothesis itself needs a separately qualified package environment.
What this work would not establish
- This is an unrun protocol proposal, not a claim that labels are erroneous.
- Dataset-page row counts and sizes remain source assertions until ingestion.
Start with these sources.
Balance Scale
A rule-generated balance problem that separates memorization from learning a physical decision rule.
Tic-Tac-Toe Endgame
Completed board states for testing learned combinatorial concepts against inspectable rules.
Hypothesis
Property-based testing tools that generate and simplify test inputs.
Make the question your own.
Edit freely. Export a copy before reloading or leaving. Your text stays in this tab until you choose to copy, download or save it privately.