Public Sample

60 Tasks · Every One Benchmarked On-Device

The full public benchmark sample (AndroidLife_public_v2.json, exported from public.md) - every task has a recorded agent trajectory. Pick a model ยท date run to filter to that exact session's pass/fail and steps, then narrow to Pass or Fail to see just the tasks that model got right or wrong, or to Easy, Medium or Hard to slice the list by difficulty; click any task for the step-by-step trace and screen replay.

Public Tasks

Run
Outcome
Difficulty