An open library for your next question. Public pilot
Executable Science
Log inCreate account
← Back to the library
FROM A SOURCE TO YOUR QUESTION

Build a plan from this source.

Language Model Evaluation Harness is included below. Adapt the question and comparison, then copy or download your plan.

YOUR WORKING PLAN

Make the question your own.

Working copy · In this tab
1 source · Exact preparation context
  • Language Model Evaluation Harness →

    Preserve the upstream project name, repository, exact source commit and applicable contributor/notices; resolve upstream citation guidance for any later formal use.

    Record revision: a2c1fada2bde773d2a536dc4593216155a84ba7d2ce5e72478638a9e4f676fd4

Source links open the current listing. This plan retains the revisions above; listing review does not grant permission to copy or adapt source files.

Before carrying out this plan

  • Python, task-specific packages and local model or API backends; benchmark data and model access are separate rights and cost questions.
  • A separately qualified isolated runtime with a reviewed, pinned dependency and input closure.

Limits to keep in view

  • No source program, example, build hook, package, dataset, model or generated research code has been executed or downloaded as a payload.
  • The documented self-contained Python 3.13, 90-second pilot does not establish support for this package, its compiled dependencies, GPUs, services or agent sandboxes.
  • Installation success, scientific outcomes, runtime compatibility, latency, memory use, API costs and security properties are unmeasured.

Edit freely. Export a copy before reloading or leaving. Your text stays in this tab until you choose to copy, download or save it privately.

Need a starting point with sources? Explore the research briefs →