tp annotate

tp annotate status
tp annotate push run-4f2a91 run-8b1c02 --limit 200
tp annotate pull tuneplane-run-4f2a91-vs-run-8b1c02 --into qa-preference

Two run ids, because preference annotation asks which of A and B is better. The walkthrough is collecting preference annotations.

Worked examples

tp annotate status                                        # is Argilla configured at all
tp annotate push run-4f2a91 run-8b1c02 --limit 200
tp annotate push run-4f2a91 run-8b1c02 -d q3-writing      # name the Argilla dataset yourself

tp annotate pull tuneplane-run-4f2a91-vs-run-8b1c02                          # statistics only
tp annotate pull tuneplane-run-4f2a91-vs-run-8b1c02 --into qa-preference
tp annotate pull tuneplane-run-4f2a91-vs-run-8b1c02 --into qa-preference -v 20260912

pull takes the Argilla dataset name as its argument; --into names the platform dataset the preferences land in, as a new version. Without --into it only prints the statistics. Start with tp annotate status. Everything else fails confusingly on a deployment with no Argilla instance wired up.

`tp annotate`

Manage preference annotation

tp annotate <subcommand>

Command	Description
`tp annotate pull`	Pull annotations back as a dataset
`tp annotate push`	Send answers out for annotation
`tp annotate status`	Check the Argilla integration

`tp annotate pull`

Pull annotations back as a dataset

tp annotate pull <DATASET> [options]

Argument	Description
`DATASET`	Argilla dataset name (required)

Option	Description
`--into`	Land them as a new version of this platform dataset; omit to only print the statistics
`--version`, `-v`	Dataset version; defaults to the date

`tp annotate push`

Send answers out for annotation

tp annotate push <RUN_A> <RUN_B> [options]

Argument	Description
`RUN_A`	Run id of the first training run (required)
`RUN_B`	Run id of the second training run (required)

Option	Description
`--dataset`, `-d`	Argilla dataset name; synthesised when empty
`--limit` `<int range>`	How many pairs to push at most (default `200`)

`tp annotate status`

Check the Argilla integration

tp annotate status

No options beyond --help.

CLI reference

Set up

Experiments

Train

Artifacts and evaluation

Resources

Administration

Worked examples

`tp annotate`

`tp annotate pull`

`tp annotate push`

`tp annotate status`

​Worked examples

​tp annotate

​tp annotate pull

​tp annotate push

​tp annotate status

Worked examples

`tp annotate`

`tp annotate pull`

`tp annotate push`

`tp annotate status`