Choose a research brief, inspect its sources, and adapt the plan for your own work. Read, edit and export without an account.
How misleading can a nominal 95% success-rate interval be when only twenty independent tasks are observed?
Open the brief RESEARCH BRIEF · 6 SOURCESDoes an apparently sensible floating-point answer survive a separately formulated reference calculation?
Open the brief RESEARCH BRIEF · 4 SOURCESHow does testing twenty null variants change the chance of declaring at least one apparent improvement?
Open the brief RESEARCH BRIEF · 5 SOURCESCan the analysis distinguish finite-sample variation from leakage, missingness bias, or a covariance bug?
Open the brief RESEARCH BRIEF · 3 SOURCESDo compact balance-scale and tic-tac-toe labels agree with their declared arithmetic and board rules?
Open the brief RESEARCH BRIEF · 6 SOURCESDoes a more complicated classifier improve on a simple baseline under the same frozen split and training-only normalization?
Open the brief RESEARCH BRIEF · 7 SOURCESCan inference recover declared generating quantities without conflating posterior predictive fit and parameter calibration?
Open the brief RESEARCH BRIEF · 5 SOURCESDoes a shortest-path implementation return known distances and reject inputs outside its assumptions?
Open the brief RESEARCH BRIEF · 7 SOURCESWhen does a tiny residual or smaller step fail to imply a more accurate scientific result?
Open the brief RESEARCH BRIEF · 5 SOURCESWhich specific claim in an existing label-smoothing or noisy-label replication can be mapped to accessible code, data and an affordable evaluation?
Open the brief RESEARCH BRIEF · 6 SOURCESDo evaluation harnesses agree on the same frozen predictions once normalization, aggregation and failure handling are made explicit?
Open the brief RESEARCH BRIEF · 6 SOURCESCan another operator reconstruct one bounded agent-evaluation attempt from its task, environment, actions, failures and scoring rule?
Open the brief RESEARCH BRIEF · 7 SOURCESDoes a proposed attribution or activation-based conclusion survive its stated baseline, precision and intervention controls?
Open the briefPlatform-authored guidance for your own work. Each task states a comparison to investigate and the limits of what its results could establish.
For 20 independent trials with success probability 0.05, how often do nominal 95% Wald and Wilson intervals contain the true probability?
DEFINED INPUTSBinomial model: n = 20, p = 0.05, nominal coverage 0.95.
COMPARISON TO INSPECTSum binomial probability over each of the 21 counts whose interval contains p. Full enumeration does not imply exact floating-point arithmetic.
For five values near one billion, how do floating-point variance formulas compare with the exact population variance?
DEFINED INPUTSThe five integers are 999999998, 999999999, 1000000000, 1000000001 and 1000000002.
COMPARISON TO INSPECTThe exact mean is 1000000000 and centered squared offsets sum to 10, giving population variance 2.
Do two graph algorithms produce the specified reference distances and distinguish a negative edge from a reachable negative cycle?
DEFINED INPUTSPositive graph: A→B:2, A→C:5, B→C:1, B→D:4, C→D:1; source A.
COMPARISON TO INSPECTHand-derived positive distances are A:0, B:2, C:3, D:4. Both methods should be compared with this map.