nvidia/nemotron-3.5-lightning-free · genui-spec-domain · all runs of stock-levels · Nov 10, 15:38
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[2].children[1].props.changeTone: Invalid option: expected one of "neutral"|"success"|"danger" - $.children[4].props.title: Invalid input: expected string, received undefined | 1,271 | 2,332 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. | 1,594 | 1,656 |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Milano Nord DC" } }, { "type": "Text", "props": { "text": "Last counted 2026-11-10", "tone": "muted", "size": "sm" } }, { "type": "Stack", "props": { "direction": "row", "gap": "4" }, "children": [ { "type": "Stat", "props": { "label": "Total items", "value": 8, "format": "number" } }, { "type": "Stat", "props": { "label": "Needs reorder", "value": 4, "format": "number", "changeTone": "danger" } } ] }, { "type": "StockTable", "props": { "caption": "Inventory items", "items": [ { "sku": "PAL-EUR-1200", "name": "Euro pallet 1200 × 800", "location": "A-01-01", "onHand": 240, "reserved": 60, "unit": "pcs", "reorderPoint": 100 }, { "sku": "BOX-40-30-20", "name": "Carton box 40 × 30 × 20 cm", "location": "A-02-03", "onHand": 1850, "reserved": 400, "unit": "pcs", "reorderPoint": 1000 }, { "sku": "STR-23-500", "name": "Stretch film 23 µm, 500 m", "location": "C-04-01", "onHand": 36, "reserved": 12, "unit": "rolls", "reorderPoint": 40 }, { "sku": "TAPE-PP-50", "name": "Packing tape 50 mm, brown", "location": "B-01-02", "onHand": 410, "reserved": 0, "unit": "rolls", "reorderPoint": 150 }, { "sku": "LBL-A6-500", "name": "Shipping labels A6, 500 per roll", "location": "B-03-05", "onHand": 18, "reserved": 6, "unit": "rolls", "reorderPoint": 25 }, { "sku": "BAG-ZIP-15", "name": "Zip bags 15 × 20 cm", "location": "B-02-01", "onHand": 5200, "reserved": 1200, "unit": "pcs", "reorderPoint": 2000 }, { "sku": "GLV-NIT-L", "name": "Nitrile gloves, size L", "location": "D-01-04", "onHand": 60, "reserved": 0, "unit": "boxes", "reorderPoint": 60 }, { "sku": "STRAP-PET-16", "name": "PET strapping 16 mm, 1500 m", "location": "C-02-02", "onHand": 9, "reserved": 4, "unit": "coils", "reorderPoint": 6 } ] } } ]}| $0.0000 |