AIZOYA / LAB Open-source hackathon prototypeHow it works ↗

PRACTICE STORE · OPEN SOURCE · NOT AN ACCESSIBILITY AUDIT

Can customers
finish checkout?

Run the same sample checkout twice: once with a mouse and once using only keys such as Tab and Space. See where a keyboard attempt stops, check the correction, and keep the evidence.

For frontend teams: check a keyboard-only task and keep a reviewable CI artifact before shipping.

01 Check checkout02 See the obstacle03 Check the correction

VERIFIED META MODEL API EVIDENCE

Muse Spark recovered after the interface changed.

Verified run · Nov 3 · 7:59 PM PT

Muse selected Sand. The application then made Sand unavailable and reported that Blue was the remaining valid option. Muse observed the new state, moved to Blue, selected it, and completed the task. Playwright executed six permitted keys, deterministic store code verified completion, and replay reproduced the result without another model request.

  1. 1ObserveStructured focus and control state
  2. 2ChooseMuse Spark returns one allowed key
  3. 3ExecutePlaywright presses that key
  4. 4VerifyStore receipt decides completion
Verified adaptive traceTab → Enter → inventory changes → Tab → Enter → Tab → Enter

SAME ADAPTIVE FIXTURE · VERIFIED COUNTERFACTUAL

A saved route stopped. Muse recovered from fresh state.

The previously successful five-key saved route was replayed unchanged with zero inference. After Sand became unavailable, its remaining keys missed Blue and the task stayed incomplete. On the same fixture, Muse consumed each new observation, selected Blue and completed.

  1. 1BeforeSand and Blue enabled; incomplete
  2. 2ChangeSand disabled; status names Blue
  3. 3Saved routeStopped incomplete · 0 model calls
  4. 4Muse routeSelected Blue; receipt complete · 6 calls

Claim boundary: this shows one saved sequence becoming stale. It does not prove that every deterministic policy fails or that the model generalizes beyond this owned fixture.

Permanent proof: Meta Model API configured for muse-spark-1.3 · source commit 7db6aec · workflow run 41770415998 · artifact SHA-256 75a5d81e…fe24f. Scope: one owned adaptive fixture. Six requests, no retry; replay used zero requests. Screenshots document the run and were not sent to the model. The interactive examples below are scripted and make no AI request.

Final adaptive Muse step · recovered and completed
Final frame from the adaptive Muse Spark run after recovery
Zero-request replay · same completion
Final frame from the adaptive saved-action replay

PRECOMMITTED OBSTACLE CHECK · NOV 3

Bounded run did not complete; the focus cycle is recorded.

In a separate owned fixture, the completion button stayed outside the Tab cycle. Muse selected Blue. Focus then alternated between Sand and Blue; the eighth reserved request returned an incomplete response, with completion still false. The exact result is published without tuning or a retry.

Observed focus traceBODY → Sand → Blue → Blue selected → Sand ↔ Blue

Reporting limitation: the raw runner labeled the terminal meta_incomplete condition as infrastructure_error. The recorded states still establish bounded noncompletion on this one fixture; they do not prove that no keyboard route exists or certify accessibility.

Final captured frame · Blue selected, completion unreachable in the recorded Tab cycle
Final frame from the precommitted obstacle run with Blue selected
Inspect the exact obstacle JSON

This is the unmodified source result, including its terminal classification limitation.

{
  "status": "failed",
  "scope": "one_owned_trap_fixture_keyboard_only",
  "evaluation": "precommitted_obstacle_v2",
  "mouse_comparison": "not_tested",
  "other_variants": "not_tested",
  "public_deployment": "AI remains disabled",
  "requests_reserved": 8,
  "max_requests": 8,
  "retried": false,
  "keyboard_completed": false,
  "runner_status": "infrastructure_error",
  "error": "meta_incomplete",
  "saved_action_replay_completed": false,
  "replay_made_no_model_calls": true,
  "actions": [
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Space"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Tab"
    }
  ],
  "elapsed_ms": 22721,
  "steps": [
    {
      "index": 0,
      "action": null,
      "state": {
        "focus": {
          "target": null,
          "tag": "BODY",
          "role": null,
          "text": "\nCOMMON GOODSPractice store · no purchase\nMade for a little more order.DESK ESSENTIALSThe everyday o"
        },
        "selected": "No color selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": true
          }
        ]
      }
    },
    {
      "index": 1,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "sand",
          "tag": "BUTTON",
          "role": null,
          "text": "Sand"
        },
        "selected": "No color selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": true
          }
        ]
      }
    },
    {
      "index": 2,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "blue",
          "tag": "BUTTON",
          "role": null,
          "text": "Blue"
        },
        "selected": "No color selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": true
          }
        ]
      }
    },
    {
      "index": 3,
      "action": {
        "kind": "press",
        "key": "Space"
      },
      "state": {
        "focus": {
          "target": "blue",
          "tag": "BUTTON",
          "role": null,
          "text": "Blue"
        },
        "selected": "Blue selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 4,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "sand",
          "tag": "BUTTON",
          "role": null,
          "text": "Sand"
        },
        "selected": "Blue selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 5,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "blue",
          "tag": "BUTTON",
          "role": null,
          "text": "Blue"
        },
        "selected": "Blue selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 6,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "sand",
          "tag": "BUTTON",
          "role": null,
          "text": "Sand"
        },
        "selected": "Blue selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 7,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "blue",
          "tag": "BUTTON",
          "role": null,
          "text": "Blue"
        },
        "selected": "Blue selected",
        "complete": false,
        "outcome": "Your practice kit is empty.",
        "controls": [
          {
            "target": "sand",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "blue",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    }
  ]
}
Inspect the exact held-out JSON and screenshots

The full result and precommitted plan are mirrored on this domain so mobile judges and automated reviewers do not depend on GitHub rendering.

Final Muse Spark step · task completed
Final captured frame from the precommitted held-out Muse Spark run
Zero-request replay · task completed
Final captured frame from the fresh replay using the saved actions

Permanent raw result

{
  "status": "passed",
  "scope": "one_owned_heldout_fixture_keyboard_only",
  "evaluation": "precommitted_heldout_v3",
  "mouse_comparison": "not_tested",
  "other_variants": "not_tested",
  "public_deployment": "AI remains disabled",
  "requests_reserved": 5,
  "max_requests": 8,
  "retried": false,
  "keyboard_completed": true,
  "runner_status": "observed",
  "error": null,
  "saved_action_replay_completed": true,
  "replay_made_no_model_calls": true,
  "actions": [
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Space"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Tab"
    },
    {
      "kind": "press",
      "key": "Space"
    }
  ],
  "elapsed_ms": 11282,
  "steps": [
    {
      "index": 0,
      "action": null,
      "state": {
        "focus": {
          "target": null,
          "tag": "BODY",
          "role": null,
          "text": "\nCOMMON GOODSPractice store · no purchase\nMade for a little more order.DESK ESSENTIALSThe everyday o"
        },
        "selected": "No finish selected",
        "complete": false,
        "outcome": "Your demo kit is empty.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": true
          }
        ]
      }
    },
    {
      "index": 1,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "option-a",
          "tag": "BUTTON",
          "role": null,
          "text": "Ocean"
        },
        "selected": "No finish selected",
        "complete": false,
        "outcome": "Your demo kit is empty.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": true
          }
        ]
      }
    },
    {
      "index": 2,
      "action": {
        "kind": "press",
        "key": "Space"
      },
      "state": {
        "focus": {
          "target": "option-a",
          "tag": "BUTTON",
          "role": null,
          "text": "Ocean"
        },
        "selected": "Ocean selected",
        "complete": false,
        "outcome": "Your demo kit is empty.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 3,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "option-b",
          "tag": "BUTTON",
          "role": null,
          "text": "Dune"
        },
        "selected": "Ocean selected",
        "complete": false,
        "outcome": "Your demo kit is empty.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 4,
      "action": {
        "kind": "press",
        "key": "Tab"
      },
      "state": {
        "focus": {
          "target": "finish",
          "tag": "BUTTON",
          "role": null,
          "text": "Place in demo kit"
        },
        "selected": "Ocean selected",
        "complete": false,
        "outcome": "Your demo kit is empty.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    },
    {
      "index": 5,
      "action": {
        "kind": "press",
        "key": "Space"
      },
      "state": {
        "focus": {
          "target": "finish",
          "tag": "BUTTON",
          "role": null,
          "text": "Place in demo kit"
        },
        "selected": "Ocean selected",
        "complete": true,
        "outcome": "Ocean finish placed. Demo task complete.",
        "controls": [
          {
            "target": "option-a",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "option-b",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          },
          {
            "target": "finish",
            "tag": "BUTTON",
            "role": null,
            "tabIndex": 0,
            "disabled": false
          }
        ]
      }
    }
  ]
}

YOUR WORKSPACE

Check a sample checkout.

Fictional task · no payment

The task: choose the Blue item and add it to a practice kit. We run both attempts for you. You can start from your phone; you do not need a mouse or a physical keyboard.

Tests mouse and keyboard operation on a desktop browser. It does not test mobile touch, screen readers or your own website.

You are on a touch device. Start the automated check above; manual keyboard practice is intended for a desktop with a physical keyboard.

Choose another example or runner

Checking runtime…

Try the practice store yourself (desktop keyboard)
Try it yourself

Choose Blue and add it to your practice kit. To test the keyboard, focus the store and use Tab, arrow keys, Space and Enter.

FOR PRODUCT AND ENGINEERING TEAMS

Put a keyboard journey
on every pull request.

A team runs its own app on loopback in GitHub Actions, marks the important controls with four stable data attributes, and receives a bounded JSON evidence artifact. Muse Spark chooses only allowlisted keys. Playwright executes them. The customer app alone reports completion.

See the exact integration contract

journey.config.json

{
  "schema_version": 1,
  "name": "customer-checkout",
  "url": "http://127.0.0.1:3000/checkout",
  "task": "Choose Blue, then add it to the cart"
}

Four stable attributes in the customer app

data-journey-target="blue"
data-journey-selected="Blue selected"
data-journey-complete="true"
data-journey-outcome="Blue added to cart"

Then run npm run journey:run -- --config=journey.config.json. The Meta key stays in the CI secret store; it is never part of this file.

  1. 1Run your app locallySame-origin loopback only. Remote URLs and embedded credentials are rejected; use an owned test app with no real accounts or purchases.
  2. 2Expose a small contractTarget, selection, completion and outcome stay deterministic.
  3. 3Review the artifactActions, states, request count and limitations attach to the pull request.

Implemented scope: reusable customer-owned local targets, keyboard lane, eight requests maximum, no automatic retry. Contract and browser acceptance are automated; no customer production benchmark is claimed.

EVIDENCE BEFORE A VERDICT

Make the journey
inspectable.

Each automated route uses a separate browser context. The keyboard executor accepts only a short list of key presses. It cannot click, directly fill a control, or move focus through script.

Completion comes from the target app’s recorded outcome. The model cannot award itself a pass. Replay repeats saved actions in a new context.

Current scope: owned practice fixtures and a reusable loopback CI contract. No arbitrary public websites, accounts or purchases. Fixture replay is scripted. Bounded Muse Spark runs are verified; public live AI stays off.