How much coverage does a small benchmark have?
For 20 independent trials with success probability 0.05, how often do nominal 95% Wald and Wilson intervals contain the true probability?
This opens the task context in your private workspace. You review an editable plan before saving; your source, permissions, and budget are still required.
What will you examine?
Binomial model: n = 20, exact p = 1/20, nominal coverage 19/20.
The platform predicate uses rational z = 1959963984540054/10^15; the author enumeration records Python NormalDist().inv_cdf(0.975). These are distinct stated conventions.
Enumerate counts 0 through 20. Clip Wald to [0,1], do not additionally clip Wilson, and include endpoints without membership tolerance.
A separate descriptive simulation uses 4,000 repetitions and seed 12001 with paired method comparisons.
What does the question assume?
Independent Bernoulli trials share the same fixed success probability.
The displayed fixed interval convention and rational quantile approximation define the checked model; source-output alignment remains a separate question.
What should you compare?
Sum binomial probability over each of the 21 counts whose interval contains p. Full enumeration does not imply exact floating-point arithmetic.
At ideal p = 1/20 the reference membership sets are Wald counts 1–4 and Wilson counts 0–2; compare the recorded interval endpoints and membership before summing.
Retain every count's probability, endpoints and membership, model coverage, simulated coverage, repetition count and seed. Do not fit a pass threshold to the simulation.
Freeze absolute tolerance 1e-12 for numerical endpoint, mass and coverage comparisons; membership booleans must match exactly.
What could the evidence establish?
Nominal 95% is a design label; actual model coverage may differ substantially.
The model does not describe correlated benchmark tasks, heterogeneous probabilities or every sample size.
The fixed-model binomial predicate requires its separately qualified runtime and quote. It does not verify author code, output or simulation; no check has run during preparation.
Prepare, then authorize the work.
Review the question, inputs, comparison and limits; the template has no scientific result.
Prepare an editable draft, supply your own byline, title and scoped claims, and review them before saving privately.
Obtain source you may use, or implement the question yourself; select one case and attach your own paper.md in the source ZIP. Do not run submitted code on your host.
Upload opaque source bytes through your project. Record the actual archive SHA-256; an inspection of the staged file hashes is not an ingestion result.
Review and accept the current bounded ingestion quote. Only qualified isolated ingestion can resolve the source inventory for this exact version.
Then review and accept a separate quote for the one author job. Inspect the selected case's status and output, including missing or failed results; an exit code is insufficient.
Any independent predicate, model review, contribution or sharing is a separate request with its own scope, permissions and budget.
Proposed isolated job and expected output paths
Planning details for a separately authorized isolated job. Supply permitted source and review the current quote before execution.
- Job identifier
- binomial-coverage-author
- Runtime
- python-science-v1 · ARM64 · Python standard library · isolated job only
- Command arguments
["python","run.py","--output","results.json"]- Expected output paths
- results.json
Bring source you may use.
The inspected original source remains local staging material. Its MIT/CC BY/CC0 terms are proposed, not a released license grant. Obtain permitted source or supply your own implementation. The source-version digest is not an archive digest.
The staged task-template archive is unavailable. That source remains local staging material with proposed, unreleased license terms.
Inspect the staged file identities
These SHA-256 values identify inspected staging files. They do not grant access to the files or establish a permitted source archive for your version.
- README.md
- aac8980d91c5430a03becd9f6ccb1d3e260183eb92b645430f03b6f6562a2c8d
- paper.md
- 0bff30668287ca6360a456c204952129fb9fe86ca9985a0ddd69e1e7af3aa2eb
- protocol.json
- 295b3d522f12d93c3acb89874adc313ab9a5f244ebe6de8ed1eedecf137443ab
- run.py
- cbe210d02af9e1aac82b44867cc8ffffe700fae779680c6288c9c12d47f5d27d
- Staged source version digest
- 9959d546f4a10a802edd2a05bb5fc8b84423efc610e609691f1e4c7d05c2980d
The source version digest is distinct from an archive checksum. Your uploaded ZIP must have its own exact archive SHA-256.