Capture catalogue · capture brief

Agriculture & Outdoor Tasks

This brief is scoped on demand. What that means, and what every brief includes.

What the brief covers

The brief specifies egocentric capture of hand work on farms in southern India: harvesting crops, weeding with a hand tool, and preparing soil. It is specified under outdoor light that varies from one hour, and one day, to the next. Depth on this rig gives scale rather than fine geometry, and it is weakest on thin, dark or glossy objects: a stem, a wet leaf, a blade. A Clip with more than 5% of its frames dropped or corrupted can be turned down.

The specification

Set in the brief before anything is recorded.
Capture deviceiPhone LiDAR
Camera1920x1080 @ 30 FPS
Spatial tracksLiDAR depth map (Apple's fused 256×192)
AnnotationTier 1 · Tier 2 · Tier 3
AvailabilityScoped on demand

What a delivery carries

All three tiers apply, so each hand is tracked on sampled frames alongside the Clip and segment records. Tier 3's keypoints carry x and y as fractions of the frame's width and height, and z relative to the wrist, so none of the three is a distance. The phone's depth map is a stream of its own, not an FH-Ego v1 field: every field in the schema is read from the RGB video. Zarr v2 in the layout UMI and diffusion-policy code read is written on request, beside the standard LeRobot v2.1, HDF5 and FH-Ego v1 containers.

Recording it

Farm work is shared, and other people working the field can walk into frame; each face the detector finds is blurred before anyone here opens the footage. The iPhone is worn on a head mount, so the view follows the head down the row. Each Recording's consent receipt is chained into a SHA-256 ledger, and the check recomputes every link from the first entry rather than trusting a stored flag.

What to know before you commission this

  • An iPhone delivers Apple's fused 256×192 depth map at up to 60 Hz. A brief needing raw point data is specified on a different sensor.
  • The depth sensor is active infrared, so capture is planned around direct sunlight and the sensor's working range.

Sample

Published sample: none

Other briefs in the catalogue

Commission this brief