dataset & benchmark · 49 actions · 4 LiDARs · RGB-D-IR

Four LiDARs watch one action.

The same human actions recorded simultaneously by four LiDAR scanning principles and a depth camera: a controlled benchmark for cross-sensor action recognition on laser range data.

velodyne · spinning · 360°
livox · prism · rosette
cepton · micro-motion
blickfeld · MEMS raster
The dataset in 90 seconds.
2,341sequences
49action classes
9subjects
4 + 1LiDARs + RGB-D-IR
3.1 hsynchronized recording
2D + 3Dposes included

The same action, six sensors

Velodyne HDL-32E (spinning), Livox MID-100 (prism rosette), Cepton Vista-P60 (micro-motion), Blickfeld Cube 1 (MEMS raster) and an Orbbec Astra Pro (RGB, depth, IR) on one static rig, one clock, one calibrated frame.

One action seen by RGB, depth, and four LiDAR point clouds
One take, all modalities. Point clouds colored by distance.
Samples per action class, stacked by subject
49 classes: daily activities, traffic gestures, safety-critical events (falling, stumbling, lying), object and person-person interactions. Colored by subject.

Explore the sensors

All four LiDARs and the depth camera, synchronized. Drag to orbit (cameras are linked), pick an action, scrub the timeline. The Blickfeld keeps a known offset of about half a metre that no registration method could remove; details in the datasheet.

loading …

Protocols

Four official protocols; splits ship with the data.

cross-subject

Split by person: 5 train, 4 test.

cross-take

The last take of every session × action is held out.

cross-sensor

Train on one sensor, test on another. The scan pattern is the only variable.

one-shot

10 novel classes, one exemplar each, nearest neighbour. Chance 10%.

Results

Top-1 accuracy in percent over 49 classes (2.0% chance), best reproducible baseline per sensor.

SensorModelCross-subjectCross-take
Velodyne HDL-32EPointNet24.1 ± 1.033.2 ± 0.9
Cepton Vista-P60PointNet21.1 ± 0.626.0 ± 0.8
Livox MID-100PointNet15.6 ± 1.121.6 ± 0.7
Blickfeld Cube 1SparseConv14.7 ± 0.520.6 ± 1.9
RGB-D (depth)PointNet / P4Transformer11.5 ± 0.318.2 ± 0.3
2D pose (from RGB)Pose-GRU35.3 ± 1.346.6 ± 0.9

Isolating the actor with the shipped person crops lifts the LiDARs by 14 points on average; the best LiDAR then matches the pose stream.

Sensors do not transfer

Train on one sensor, test on another (cross-subject, PointNet).

train \ testVelodyneLivoxCeptonBlickfelddepth
Velodyne24.14.710.12.03.2
Livox6.315.65.21.96.3
Cepton10.93.021.12.92.3
Blickfeld3.02.04.210.02.5
RGB-D (depth)4.92.62.73.211.5

Off the diagonal, accuracy collapses towards chance. The scan pattern, not point density, is the barrier: resampling along the target's rays closes 76% of the gap, and five labeled takes per class of the target recover 85% of full-data accuracy.

Camera-free is not automatically anonymous

Person re-identification from the same clips, cross-action, nine enrolled subjects (11.1% chance).

SensorPerson re-IDHeight only
Livox MID-10064.8 ± 1.111.8
RGB-D (depth)60.7 ± 0.711.1
Cepton Vista-P6047.0 ± 1.314.4
Velodyne HDL-32E46.6 ± 0.817.5
Blickfeld Cube 141.0 ± 1.115.7

Body geometry, not the face, identifies people, and it survives a change of clothing. No tier of this dataset should be treated as anonymous data.

Pose estimation from LiDAR

17 COCO joints from person-cropped points alone, supervised by the shipped depth-lifted 3D skeletons (cross-subject).

SensorMPJPE [cm]PCK@20 cm
Velodyne HDL-32E15.576.5%
Livox MID-10016.673.1%
Cepton Vista-P6020.560.1%
Blickfeld Cube 128.041.1%
mean pose (learns nothing)23.050.1%

Full tables, ablations, few-shot adaptation and the anonymisation trade-off are in the paper.

Leaderboard

Community results on the official protocols. Submit yours through the contact form; entries are verified against the shipped splits.

loading …

Download

One archive per modality. laseract_core.tar holds labels, splits and calibration and is always needed. Interim mirror; the release moves to Hugging Face and these links will redirect. Cite by name and version (v1.1).

ArchiveContentsSize
laseract_core.tar labels, splits, calibration, per-take meta.json, datasheet, license7.3 MB
laseract_velodyne.tar.00, .01 Velodyne HDL-32E point clouds79 GB
laseract_cepton.tar Cepton Vista-P60 point clouds31 GB
laseract_livox.tar Livox MID-100 point clouds21 GB
laseract_blickfeld.tar Blickfeld Cube 1 point clouds2.6 GB
laseract_depth.tar registered 16-bit depth + timestamps25 GB
laseract_person.tar person-cropped LiDAR streams with tracked actor ids4.6 GB
laseract_poses.tar 2D COCO-17 poses, 3D lift and refinements357 MB
laseract_previews_facefree.tar per-sequence preview videos, no RGB tile10 GB
checkpoints/ 270 trained models behind the tables, with run records and a README886 MB
SHA256SUMS checksums for every archive above793 B

Browse everything at /data/. Verify, then reassemble the split Velodyne pack:

sha256sum -c SHA256SUMS
cat laseract_velodyne.tar.* > laseract_velodyne.tar
tar xf laseract_velodyne.tar

RGB and IR show faces and are released for research use on request. Everything above is face-free and carries the CC BY-NC 4.0 licence. A numpy-only loader with an optional PyTorch wrapper ships in the companion toolkit.

Ethics. Adult subjects gave written informed consent and signed a GDPR release under our institution's data-protection procedure. All subjects are pseudonymized and faces are blurred in every published preview and figure.

BibTeX

@inproceedings{laseract,
  title     = {LaserAct: A Multi-LiDAR Dataset for Human
               Action Recognition Across Scanning Principles},
  author    = {Anonymous},
  booktitle = {under review},
  year      = {2026}
}

Contact: laseract@mailbox.org or the contact form.