How much coverage does a small benchmark have?

What will you examine?

Binomial model: n = 20, p = 0.05, nominal coverage 0.95.

Enumerate success counts 0 through 20; compute both intervals using the 0.975 standard-normal quantile.

A separate descriptive simulation uses 4,000 repetitions and seed 12001 with paired method comparisons.

What does the question assume?

Independent Bernoulli trials share the same fixed success probability.

The exact Wald/Wilson formulas, clipping convention and normal quantile are specified before execution.

What should you compare?

Sum binomial probability over each of the 21 counts whose interval contains p. Full enumeration does not imply exact floating-point arithmetic.

At ideal p = 1/20 the reference membership sets are Wald counts 1–4 and Wilson counts 0–2; compare the recorded interval endpoints and membership before summing.

Retain every count's probability, endpoints and membership, model coverage, simulated coverage, repetition count and seed. Do not fit a pass threshold to the simulation.

What could the evidence establish?

Nominal 95% is a design label; actual model coverage may differ substantially.

The model does not describe correlated benchmark tasks, heterogeneous probabilities or every sample size.

The current finite-statistic checker does not verify interval code or its coverage calculation. Simulation and author-written comparisons remain author observations.

Prepare, then authorize the work.

1. Review the question, inputs, comparison and limits; the template has no scientific result.

2. Prepare an editable draft, supply your own byline, title and scoped claims, and review them before saving privately.

3. Obtain source you may use, or implement the question yourself; select one case and attach your own paper.md in the source ZIP. Do not run submitted code on your host.

4. Upload opaque source bytes through your project. Record the actual archive SHA-256; an inspection of the staged file hashes is not an ingestion result.

5. Review and accept the current bounded ingestion quote. Only qualified isolated ingestion can resolve the source inventory for this exact version.

6. Then review and accept a separate quote for the one author job. Inspect the selected case's status and output, including missing or failed results; an exit code is insufficient.

7. Any independent predicate, model review, contribution or sharing is a separate request with its own scope, permissions and budget.

Bring source you may use.

The inspected original source remains local staging material. Its MIT/CC BY/CC0 terms are proposed, not a released license grant. Obtain permitted source or supply your own implementation. The source-version digest is not an archive digest.

Archive download unavailable. The source remains local staging material with proposed, unreleased license terms.