01 · Benchmark
The benchmark library
Find the right test for enterprise work, architecture and CAD.
Public directory
The Delta Grounds
Where training
data proves
itself.
One model. A fixed recipe. An unseen exam.
Measure what your data changes.
PUBLIC BENCHMARKS · PRIVATE WORKSPACE
EXPLORE THE GROUNDS
Find your starting point.
Start with the public specifications,
or enter your private workspace.
02 · Environment
Task packages
A goal, a working state and a verifier. See how a task is defined.
Open specification
03 · CAD
The editing exam
Make a precise revision. Keep every protected feature intact.
6 synthetic dev tasks
04 · Arena
The Delta Grounds
Enter the private workspace and inspect the grader on each attempt.
Invite access
05 · Evidence
Show the difference
Compare a trained model with a control on unseen work.
Recorded procurement checkpoint
06 · Workflow
From data to a test
Follow the research workflow, from a collection to its evidence report.
Workflow guide
01The measure
Δ =trained on your work−trained on a control
Fix the model, recipe and exam. Change the training data. Measure the difference in what the model can do.
See our recorded procurement checkpoint →02The evidence criteria
- L1Runs
Does every task build and reset the same way each time?
- L2Valid
Is each task solvable, and is doing nothing worth zero?
- L3Hack-resistant
Does high reward mean the task was really solved?
- L4Calibrated
Is there something left for the model to learn?
- L5Learns
Does reward climb during training?
- L6Transfers
Is the model better at held-out work than a control?
03A working environment
The task, the edit and the grade.
Our live CAD development exam asks for a precise revision to a generated mounting plate. Here is the first task, checked by the same grader used in the workspace.
bore-01 / PUBLIC CAD DEVELOPMENT TASK
Enlarge one bore
Increase H1 to an 8 mm diameter. Preserve the plate and every other hole, including all centers. All holes must retain at least 2 mm of edge and inter-hole clearance.
Starting H1 diameter6 mm
Requested H1 diameter8 mm
Protected geometryEverything else
| Grader check | Unchanged | Correct edit |
|---|---|---|
| Feature identity | Pass | Pass |
| Requested edit | Fail | Pass |
| Protected geometry | Pass | Pass |
| Analytical validity | Pass | Pass |
Reward0.0 → 1.0