ajx.

Agent usability testing

Your next user
is an agent.

Test how agents use your website, CLI, SDK, API, or developer tool.

AJX records an agent trying a task, checks the result, and reports where your product caused confusion—with the evidence to help you fix it.

Run your first testSee the product ↓
RUN 01 / EXPORT CSVFictional example
An agent finds its way through a task The agent starts an export, takes a wrong turn, gets stuck on an invalid flag, then retries and reaches a verified CSV. Use the six steps below to inspect the journey.
100 records exported. Detours recorded.

AJX checks the CSV and reports what to improve, even though the task succeeded.

Get started

Make the first step
feel like second nature.

Open your project in a skill-capable agent and paste this prompt. Your agent installs AJX, checks the setup, and helps you prepare one small test.

  • 1
    Bring a project and a task.

    For example: use this CLI to export 100 records as CSV. Define how to check the result.

  • 2
    Check the prerequisites.

    macOS or Linux, Bash, and curl. A real test also needs an authenticated worker and reporter. Your agent checks these before starting.

  • 3
    Review, run, and read the report.

    Confirm the task, access, and model costs. After the attempt, open the outcome, product asks, and journey.

Paste this into your agent 
Set up AJX and help me test how a fresh agent experiences this project.
Follow https://raw.githubusercontent.com/royosherove/ajx/main/docs/AGENT-QUICKSTART.md
to install the latest stable CLI and skill, then continue with the installed skill.

Use the project in this folder. Help me choose one small user task if needed.
Handle installation and setup checks; ask only for missing details or sign-in.
Show me the task, success check, access, and costs before running one attempt.
Then open the report and visual journey, and explain the top product
improvements with supporting evidence.
Works from your project folder.CLI + skill installed together
Prefer a terminal? Install the CLI + skill yourself. 
bash -o pipefail -c 'curl -fsSL https://github.com/royosherove/ajx/releases/latest/download/install.sh | bash' && export PATH="$HOME/.local/bin:$PATH"

macOS or Linux. The installer includes the skill. Your agent can read it directly; start a fresh session if the host needs one to discover /ajx. No GitHub login required.

Existing skill? Get the complete replacement command.

The installer includes the native CLI and matching Agent Skill. No Go toolchain or GitHub login required. Try the simulated demo without model calls.

A completed task can
still be hard to use.

An agent may recover from a wrong example or an unclear error and still finish. That success hides extra attempts, time, and model calls. AJX records the detours so your team can improve the product instead of relying on the agent to work around it.

  1. 1

    Set the task and a check.

    Use a fresh worker and an observable success check. This separates a verified result from an agent saying it is done.

  2. 2

    Follow the attempt.

    The local console shows stages, available events, and output files. The journey records where the worker changed course or got stuck.

  3. 3

    Fix one thing and test again.

    Each product ask includes evidence and a way to check the change. Use a fresh attempt with comparable conditions to see whether it helped.

The console and reports.

These are screenshots of AJX itself. The console was captured during its simulated demo; the reports use fictional example data. Open any screenshot at full size.

Review the task, checks, and environment.

The plan puts the worker and its access in one place before you start.

Actual AJX Console Plan tab showing the task, success checks, reporter, local execution environment, and demo worker.

See what the worker is doing.

The live view shows the current stage, available worker events, files, verification, and cleanup. Event detail depends on the harness.

Actual AJX Console during a running simulated attempt, showing the worker feed, its workspace files, and pending verification and cleanup.

Read the product asks.

The report connects each proposed change to the events that support it.

Actual generated AJX report with the verified task outcome and evidence-backed product asks from a fictional export CLI example. Open the browsable report ↗

Follow the journey.

The timeline shows forks, blocks, waits, and recoveries in the order they happened.

Actual AJX visual journey showing a fictional agent's route through a command ambiguity, failed flag, wait, and successful CSV export. Open the browsable journey ↗
Explore the example asks across three configurations
Demo Export CLIFictional example
What your team can improve

3 product asks

✓ Task verified
01Roadblock

Make the quick-start export command executable.

The documented --out flag failed. Command help showed --output, which worked.

Product change

Use the supported --output flag in the quick start, with a copyable CSV example.

Evidence and success check +

The first attempt failed and required a help lookup before retrying.

Verify the fix: Run the documented command in a fresh workspace; it must produce a 100-row CSV.

E-003 → E-004 → E-005 Follow the journey ↗
02Wait

Expose progress while a CSV export is running.

Only start and completion messages appeared during the 47-second export.

Product change

Emit bounded progress on stderr and a final structured completion result.

Evidence and success check +

The agent could not distinguish productive work from a stalled command.

Verify the fix: Run a delayed export; progress must remain separate from CSV stdout.

E-005 → E-006 Follow the journey ↗
03Fork

Explain when to choose export instead of dump.

Both commands were described as writing records; the required CSV path was unclear.

Product change

State the output formats and intended use of both commands in top-level help.

Evidence and success check +

The agent had to choose without a selection signal.

Verify the fix: A user reading only top-level help can identify the CSV command.

E-001 → E-002 Follow the journey ↗
Invented events and outcomes, used to demonstrate the report.Open the full report ↗

Open the full example matrix ↗ Compare product versions, harnesses, asks, and verified outcomes.

Compare the conditions
your users depend on.

The same task can go differently with another harness, model, or environment. Keep the task and success criteria consistent so the comparison tells you something useful.

CodexClaude CodeKiro CLI

Control the environment.

Use local or Docker execution and select the worker's skills. Record its filesystem and network access. A fresh local folder is not a sandbox.

Run the same checks in CI.

For an already briefed trial, ajx ci runs without an interview, applies acceptance rules, and writes JSON and JUnit results. Worker authentication must already be configured.

Instructions for agents.

Use the quickstart for exact commands, installation recovery, and the path to a first report. The text versions need no JavaScript or browser automation.

/agents/Setup guide↗/index.mdThis website as Markdown↗/llms.txtDocumentation index↗/llms-full.txtWebsite and quickstart in one file↗