Human Workflow

The Human Workflow view lets you create, configure, activate, and monitor human annotation campaigns.

Creating a Workflow

Go to Human Workflow in the project sidebar and click New workflow. Fill in:

• Name — a descriptive label for the workflow
• Annotation form — the form annotators will see (created in Annotation Builder)
• Scope — the corpus or partition to annotate
• Assignment mode — Overlap or Split
• Annotators — one or more users to assign

Scope

A workflow can cover an entire corpus or be scoped to a single partition.

• Corpus scope — tasks are created for all documents in the corpus
• Partition scope — tasks are created only for documents in the selected partition

Assignment Modes

Mode	How tasks are distributed
Overlap	Every annotator receives a task for every document — useful for measuring agreement
Split	Documents are divided among annotators (round-robin) — each document is annotated by exactly one person

Activating a Workflow

A workflow must be activated before annotators can see tasks. Click Activate to generate annotation tasks. The system creates one task per document per assigned annotator (overlap mode) or one task per document distributed across annotators (split mode).

Once activated, annotators can log in and start working through their task queues.

Monitoring Progress

The workflow card on the project dashboard and the workflow detail view both show:

• Total tasks and how many are annotated
• Per-annotator progress (tasks completed / total assigned)
• Whether all tasks are done (workflow is complete)

Adding Annotators to an Active Workflow

You can add more annotators to a workflow after activation. Click Add annotator on the workflow detail page. If the workflow is already active, the new annotator immediately receives the same set of document tasks.

Deactivating a Workflow

Click Deactivate to delete all pending tasks. Already-submitted annotation values are preserved. You can reactivate the workflow later to regenerate tasks for unannotated documents.

Viewing Annotations

After annotators have submitted values, use the Analysis view to inspect per-document and per-annotator results. You can also export the corpus with annotation columns via the Corpus export.

Workflow Lifecycle and Add Rows

When new documents are added to a corpus or partition that has an active workflow, the system automatically creates new annotation tasks for those documents. The workflow's state reverts from complete to in progress. Researchers are warned of this before the upload is confirmed.

If the add-rows upload contains annotation:{variable} columns, the corresponding tasks are created in annotated state with the uploaded values — so the existing completion status is not affected.