Skip to main content
Six variants, submitted one by one. -g declares a grid axis and is repeatable; several axes take the Cartesian product. -s is a fixed override every variant shares. Each variant goes through the ordinary submit path: local validation, quota, queue. There is no batch channel that skips a gate.

​
Preview the grid first

Prints the variant list with each one’s full override set, and submits nothing. Do this before a grid you have not counted.

​
Track the group

Every variant carries one sweep_id, formed as sweep-<experiment>-<timestamp>. The console’s Jobs page badges sweep members, and Projects puts their curves on one chart.
Quota counts per variant. Six variants at four GPUs is 24 concurrent GPUs of demand, so variants over quota wait in QUEUED rather than failing — which also means they do not all start at the same moment.

​
Cut the hopeless variants early

The platform compares variants at step rungs, stops the ones at the bottom, and lets the rest continue. A stopped variant’s job page says at which step, against how many variants, and at what rank. Four rules the comparison follows, which are worth knowing before you read a result:
  • Judging happens only at a rung, never continuously, so a variant in a normal dip survives.
  • Only variants that reached the same rung are compared.
  • Fewer than four variants at a rung means no decision.
  • At least one variant always survives, whatever --keep says.
An administrator can turn the whole feature off with TUNEPLANE_SWEEP_EARLY_STOP_ENABLED=false, without editing any sweep.

​
How to spend less

Sweep the learning rate across orders of magnitude first — 1e-6, 1e-5, 1e-4 — then run a finer sweep inside the magnitude that won. Lower grpo.max_num_steps to the smallest number that shows a trend, pick the top two, and train those at full length.

​
Check it worked

tp sweep prints the sweep_id and how many variants were submitted or queued. tp job ls shows them, and the console’s Jobs page badges them as one group.

​
Next

Submitting a job · Comparing runs · Pipelines