reflection/beam-free · genui-spec · all runs of kyc-form · Nov 10, 14:27
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[1].children[0].children[1].props.options.0: Invalid input: expected string, received array - $.children[1].children[0].children[2].props.options.0: Invalid input: expected string, received array - $: A page needs one Heading of level 1, its title, before any other heading. | 3,738 | 6,719 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Identity verification" } }, { "type": "Card", "props": { "description": "Already known and cannot be edited here.", "title": "Your details" }, "children": [ { "type": "DataList", "props": { "items": [ { "label": "Full name", "value": { "$data": [ "/customer/firstName", "/customer/lastName" ] } }, { "label": "Email", "value": { "$data": "/customer/email" } } ] } }, { "type": "Text", "props": { "size": "sm", "text": "These details are already on file and cannot be edited here.", "tone": "muted" } } ] }, { "type": "Card", "props": { "accent": true, "title": "Identity verification" }, "children": [ { "type": "Form", "props": { "submit": "Submit" }, "children": [ { "type": "TextField", "props": { "kind": "date", "label": "Date of birth", "required": true } }, { "type": "SelectField", "props": { "label": "Nationality", "options": { "$data": "/countries", "pick": "name" }, "placeholder": "Select a country", "required": true } }, { "type": "SelectField", "props": { "label": "Country of residence", "options": { "$data": "/countries", "pick": "name" }, "placeholder": "Select a country", "required": true } }, { "type": "TextField", "props": { "label": "Tax identification number", "required": true } }, { "type": "ChoiceField", "props": { "label": "Type of identity document", "options": [ { "label": { "$data": "/documentTypes/0/label" } }, { "label": { "$data": "/documentTypes/1/label" } }, { "label": { "$data": "/documentTypes/2/label" } } ], "required": true } }, { "type": "TextField", "props": { "label": "Document number", "required": true } }, { "type": "ChoiceField", "props": { "label": "Are you a politically exposed person?", "options": [ { "label": "Yes" }, { "label": "No" } ], "required": true } } ] } ] } ]}| 6,863 |
| 815 |
| $0.0000 |