Runner

Get ready to run

One path: account, runner, first benchmark.

Show full local path

Build Week submission · v0.3.39 · Hub compatible Download submission

Overview

Find the setup to run next, then inspect the evidence behind it.

Start with Choose for an answer-first setup choice. Compare public evidence or queue a benchmark when you already know what you want to inspect.

How evidence works

Evidence and setup status Checking evidence and runner readiness.

Active runs

—

syncing

Verified results

—

usable in decisions

Open blockers

—

checking

Account attached

Pair a runner

Local execution ready

Choose evidence

Recommendation ready

Run or compare

Next action

Choose

Which setup should I run?

Recent runs

Tracked execution

More tools

Community

View contributor activity See who is expanding the public evidence corpus.

Top contributors

Community evidence stays cumulative and inspectable.

Overview

What should I run?

Choose your machine and task

InferGrade ranks model + quant setups that fit.

My machine Task

Already running a local model? Paste one localhost OpenAI-compatible URL. InferGrade runs a short check, then tells you what to verify next.

More evidence and candidates Candidate table, caveats, source notes, and the next benchmark. Evidence details ready Open for the complete candidate and proof trail.

Advanced filters Runtime, trust, family, quant, axes, and evidence scope.

Use case Machine profile Hardware class Runtime Trust

Execution Hardware model Usable memory budget X-axis Y-axis Target TTFT Max cost Family Parameters Quant Capability Sort

Compare

Compare local models

Capability, speed, memory, and evidence—scoped to practical local setups.

Evidence browser

Recent benchmark evidence

Model	Time / task	Hardware	Capability	Trust

Compare

Choose between families, variants, and quants

Preset views

Start from a useful model-choice stance, then refine the exact variants or inspect individual runs.

Machine Left family Left variant Right family Right variant

Individual run comparison

Result

Family comparison

Branches, quants, and nearby matches

Run

Plan a benchmark run

Why run this benchmark

Run the benchmark that would change the answer.

Start from Choose when possible; otherwise select a model and benchmark goal below.

1 Model 2 Benchmarks 3 Queue

Model

Choose the benchmark goal, then use a suggested model or paste your own.

Model Name Backend Hugging Face reference Artifact choice

Use public artifacts without connecting Hugging Face.

Benchmark scope

Choose the evidence this run should produce.

Customize benchmark checks

Benchmark groups

Adjust related checks together.

Individual checks

Exact checks for this run.

Run details

Optional context for history.

Description Created by Tags

Advanced overrides

Artifact and runtime

Only adjust these if you need an override.

Artifact URI Artifact filename Artifact SHA256 Artifact revision Backend image Artifact cache dir Hourly rate (USD) Notes

Ontology hints

Most users should keep the inferred values.

Family name Checkpoint name Upstream revision Training stage Quantization family Quantization scheme Weight bits

Execute this run

Start a tracked local or cloud run directly from the Hub.

Publish completed results Recommended. The run stays private while executing; accepted evidence becomes shareable when it finishes. Turn this off for sensitive prompts, gated/internal models, or embargoed work.

Run locally

Pair a machine once, keep it listening, and queue tracked runs.

No local run has been created for this plan yet.

Start a runner

InferGrade will highlight the one next action that matters for this plan.

Runner recovery commands

Start listener

Use this if the paired app or listener is not running.

Run immediately

Run this once on the current machine.

Run in cloud

Create a managed cloud run when this Hub has a provider configured.

Make this run count as evidence

These steps help the result join the comparable evidence pool instead of staying sample-only.

Use a real run, not a dry run, so timing measurements are recorded.
Keep the artifact pinned so others can reproduce the same bundle.
Let the run finish and upload so its evidence label is applied automatically.

Advanced recovery commands

Preflight only

Check local readiness before starting a run.

Execute only

Run directly if Hub queueing is unavailable.

Upload only

Publish a completed result if automatic upload did not run.

Run plan JSON Inspect or export the prepared plan.

No run plan prepared yet.

Which setup should I run?

Loading workspace state

Get ready to run

Which setup should I run?

Tracked execution

Community

Top contributors

What should I run?

Choose your machine and task

Compare local models

Recent benchmark evidence

Choose between families, variants, and quants

Preset views

Result

Branches, quants, and nearby matches

Plan a benchmark run

Run the benchmark that would change the answer.

Execute this run

Run locally

Start a runner

Start listener

Run immediately

Run in cloud

Make this run count as evidence

Preflight only

Execute only

Upload only

Active and recent runs

Recent runs

Live timeline

Reusable runs

Contributor activity