Terminology
The table below provides a list of terms used to describe various components of WONDERBREAD:
| Term | Definition | File Format |
|---|---|---|
| Task | One of the 6 evaluation tasks in the WONDERBREAD benchmark. | – |
| Workflow | A sequence of actions taken to complete a specific business goal. Also referred to as a process. A single workflow can have multiple demonstrations. | – |
| Demonstration | A single execution of a workflow. Each demonstration contains an Intent, Recording, Action Trace, Key Frames, and SOP. | Folder |
| Intent | A brief natural language specification of a workflow’s goal, e.g. “Cancel my last order”. | .txt |
| Recording | A video containing a full recording of the user’s screen. | .mp4 |
| Action Trace | A log of all click, keystroke, and scroll actions (including associated elements and coordinates). | .json |
| Key Frames | Images taken from a Recording that are synced to events in the Action Trace. | .png(s) |
| SOP | A “Standard Operating Procedure” detailing (in writing) all of the steps taken in a demonstration. | .txt |
Prev
Task Definitions