reflection/beam-free · genui-spec · all runs of goods-receipt · Nov 10, 15:14
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[2].children[3].props.options.0: Invalid input: expected object, received string - $.children[2].children[3].props.options.1: Invalid input: expected object, received string - $.children[2].children[3].props.options.2: Invalid input: expected object, received string - $.children[2].children[3].props.options.3: Invalid input: expected object, received string - $.children[3].type: Put each Checkbox inside a Form. - $.children[4].type: Put each TextField inside a Form. | 3,646 | 4,579 | $0.0000 |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Receive delivery" } }, { "type": "Card", "props": { "title": "Purchase order" }, "children": [ { "type": "DataList", "props": { "items": [ { "label": "Purchase order number", "value": "PO-2026-0457" }, { "label": "Supplier", "value": "Imballaggi Veneti SpA" }, { "label": "Expected delivery date", "value": "2026-11-10" } ], "orientation": "vertical" } } ] }, { "type": "Form", "props": { "submit": "Confirm receipt" }, "children": [ { "type": "Card", "props": { "title": "Carton box 40 × 30 × 20 cm" }, "children": [ { "type": "Text", "props": { "text": "SKU: BOX-40-30-20", "tone": "muted", "size": "sm" } }, { "type": "Text", "props": { "text": "Ordered: 2000 pcs" } }, { "type": "TextField", "props": { "label": "Received", "hint": "Between 0 and 2000 pcs", "required": true, "kind": "number", "value": "2000", "minLength": 1 } } ] }, { "type": "Card", "props": { "title": "Packing tape 50 mm, brown" }, "children": [ { "type": "Text", "props": { "text": "SKU: TAPE-PP-50", "tone": "muted", "size": "sm" } }, { "type": "Text", "props": { "text": "Ordered: 300 rolls" } }, { "type": "TextField", "props": { "label": "Received", "hint": "Between 0 and 300 rolls", "required": true, "kind": "number", "value": "300", "minLength": 1 } } ] }, { "type": "Card", "props": { "title": "Stretch film 23 µm, 500 m" }, "children": [ { "type": "Text", "props": { "text": "SKU: STR-23-500", "tone": "muted", "size": "sm" } }, { "type": "Text", "props": { "text": "Ordered: 80 rolls" } }, { "type": "TextField", "props": { "label": "Received", "hint": "Between 0 and 80 rolls", "required": true, "kind": "number", "value": "80", "minLength": 1 } } ] }, { "type": "ChoiceField", "props": { "label": "Dock", "required": true, "options": [ { "label": "Dock 1" }, { "label": "Dock 2" }, { "label": "Dock 3" }, { "label": "Dock 4" } ] } }, { "type": "Checkbox", "props": { "label": "Some goods arrived damaged", "checked": false } }, { "type": "TextField", "props": { "label": "Damage note", "hint": "Describe what was damaged, if any", "kind": "long" } } ] } ]}| 1 |
| submit_view submit_view: The view is accepted. Stop here. |
| 8,551 |
| 820 |
| $0.0000 |