Capture catalogue · capture brief
Video RLHF Policy Annotations
This brief is scoped on demand. What that means, and what every brief includes.
What the brief covers
The brief specifies pairwise preference judgements over VLA policy rollouts: two rollout clips, watched as a pair and ranked. Each pair is judged on three axes: whether the task was completed, whether a safety violation occurred, and how smooth the motion was. Every pair carries a written rationale, so a lab can audit why one rollout ranked above the other, not only which one did. Where a rollout fails, the rationale says how.
The specification
| Capture device | Human Feedback Portal |
|---|---|
| Camera | Set by the Commissioning lab's rollouts |
| Spatial tracks | Reward score, preference rankings, and failure rationales |
| Annotation | Tier 1 · Tier 2 |
| Availability | Scoped on demand |
What a delivery carries
Per pair, the delivery carries the preference ranking, a reward score and the written rationale. The rollouts arrive at whatever resolution the lab's own pipeline produces, and nothing is recorded for this brief.
How the judgements are made
No one is filmed for this brief, so the consent ledger that covers recorded footage has no entry to write here. The terms under which the lab's rollouts are handled are settled in the engagement, as the terms of every delivery are.
What to know before you commission this
- The Commissioning lab supplies the rollouts, and we return rankings and written rationales.
- The fields shown are the proposed delivery shape for this brief.
Sample
Published sample: none