stock-adjustment
0 design-system1 qualityIncompletenvidia/nemotron-3.5-lightning-free · genui-spec · all runs of stock-adjustment · Nov 10, 16:07
Run
- Run
- 8379241b
- Cost
- $0.0000 (gateway $0.0000)
- Duration
- 24.4 s
- Steps
- 1 of 20 allowed, ended with tool-calls
- Tokens
- 4,014 in (0 cached), 3,543 out
- Page
- Rendered
Batch
Runs from different design-system versions should not be compared.
- Label
- behaviour-v3
- Commit
- 802950f
- Design system
The page
A screenshot in each theme, as the benchmark took it.
page.tsx
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";Violations
1 counted, under 1 rule. “Not counted” marks a compiler error that restates a design-system violation, “Ignored” one the agent silenced with a comment.
- page.tsx:1:1Typing a new quantity shows the difference from the current one, with its sign. Not done: "+4" is not on screen.
Steps
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: The view is accepted. Stop here. | 4,014 | 3,543 | $0.0000 |