Radar-only perception · arXiv 2026

If It Moves,
Radar Knows.

A Physics-Aware Radar Transformer for
Class-Agnostic Moving-Object Detection

Yinghao Sun  ·  Shuguang Li*  ·  Jinliang Shao  ·  Tieshan Li

School of Automation Engineering, University of Electronic Science and Technology of China

Overview

Detect motion beyond the training taxonomy.

Closed-set detectors can overlook rare moving objects simply because they were never assigned a familiar category. PART uses radar's direct Doppler measurements as category-independent physical evidence: it asks whether an object is moving, not whether it looks like a class seen during training.

Operating directly on temporally aggregated sparse radar points, PART predicts an existence confidence, representative surface point, and ground-plane velocity for every moving-object hypothesis.

Main results on nuScenes

Compact model, motion-first output.

1.1M

Parameters

0.8827

Class-agnostic AP

0.3188 m

Surface translation error

0.8084 m/s

Velocity error

0.9203

Recall on rare objects

Method

Physics guides every association.

Architecture of PART, from radar-point encoding and Doppler-aware query initialization to physics-guided cross-attention and prediction heads.
PART encodes temporally aggregated radar points, initializes scene-dependent queries with DAQI, and refines them with a fully sparse transformer decoder using PGCA.
01

Doppler-Aware Query Initialization

Forms input-dependent object queries by grouping radar returns that agree in position and velocity.

02

Physics-Guided Cross-Attention

Uses radial-Doppler consistency and radar cross section to associate queries with meaningful returns.

03

Uncertainty-Aware Supervision

Avoids treating plausible radar-supported hypotheses as hard negatives when annotations are incomplete.

In the wild

Motion evidence persists where appearance does not.

Adverse illuminationNight-time driving scene with headlight glare.
Text description of this demonstration

A forward-driving sequence is shown at night, where sparse street lighting and headlight glare make visual appearance unreliable. Across the frames, teal markers denote moving radar returns. Blue surface markers and arrows show PART's predicted moving-object location and ground-plane velocity. The sequence illustrates that radar motion evidence remains available as the illuminated vehicle moves through the dark and glare-affected scene.

Rare moving objectPowered wheelchair detection beyond the usual taxonomy.
Text description of this demonstration

A powered wheelchair user moves through a road scene. This category is uncommon in closed-set driving taxonomies, yet the radar observations form a coherent moving pattern. Teal markers identify moving radar returns, while blue surface markers and arrows indicate PART's predicted surface location and ground-plane velocity. The demonstration highlights class-agnostic detection driven by physical motion rather than a familiar object label.

Qualitative results

From rare objects to incomplete labels.

special-category objects   moving ground truth   PART prediction

Quantitative results

Compact, robust, and class-agnostic.

All values below are reproduced from the current manuscript. Scroll horizontally to inspect wide benchmark tables.

Table 1Overall comparison with existing 3D detectors.
MethodParams.Mod.CA-AP ↑mASTE ↓mAVE ↓mATE ↓
CenterPoint23ML0.87460.49880.70970.4542
VoxelNeXT31ML0.88010.44980.61660.4172
TransFusion-L32ML0.88650.36170.86000.2790
FCOS3D55MC0.52541.22742.69081.2818
PGD56MC0.54231.47962.70071.3143
PETR83MC0.65532.98332.30700.9340
BEVFusion157MLC0.88770.35940.81380.2772
LiRaFusion23MLR0.88650.52820.75560.4792
CRTFusion81MRC0.86120.66990.77110.6206
DAQI ProposalsN/AR0.67760.58841.57581.7806
PillarNet-R16MR0.74920.95860.87020.8919
RadarDistill41MR(L)0.76840.77640.74990.7587
PART1.1MR0.88270.31880.80841.4846

Best value in bold; next two best distinct values are underlined. L: lidar; C: camera; R: radar. DAQI Proposals use DBSCAN cluster centroids and mean velocities directly. RadarDistill uses a lidar teacher during training but radar input at inference.

Table 2Robustness comparison under challenging conditions.
MethodMod.NightRainyNight + Rainy
CA-AP ↑mASTE ↓mAVE ↓CA-AP ↑mASTE ↓mAVE ↓CA-AP ↑mASTE ↓mAVE ↓
CenterPointL0.82970.33980.77950.85280.56710.67290.81070.34100.7752
VoxelNeXTL0.83610.36020.69680.86060.45030.57760.78610.49300.6652
TransFusion-LL0.85840.25300.68250.86620.36990.86490.85200.31220.6785
FCOS3DC0.51970.67532.06070.52031.37342.68230.49730.64292.3148
PGDC0.60350.69512.63140.51141.21242.55290.57040.56341.9414
PETRC0.68551.66952.39240.69783.20892.06860.72571.43012.5327
BEVFusionLC0.86650.25330.76340.87540.41370.87320.87680.32780.7924
LiRaFusionLR0.88160.33820.74990.88640.57560.80660.87930.30070.5332
CRTFusionCR0.86830.47300.88210.84800.70551.00370.88630.38641.0296
DAQI ProposalsR0.70260.41041.23250.67890.71481.64980.68890.48651.2728
PillarNet-RR0.80840.66020.92460.77111.04021.08740.82660.63340.6675
RadarDistillR(L)0.81620.37630.81750.79960.85280.78770.81640.43602.0693
PARTR0.89300.25850.46510.89160.28110.75900.88920.20340.2994
Table 3Comparison on rare and safety-relevant object categories.
MethodMod.Police Vehicles
NGT = 70
Wheelchair
NGT = 260
Personal Mobility
NGT = 102
Animal
NGT = 13
Recall ↑ASTE ↓AVE ↓Recall ↑ASTE ↓AVE ↓Recall ↑ASTE ↓AVE ↓Recall ↑ASTE ↓AVE ↓
CenterPointL0.82860.26330.55650.03460.40320.35740.18630.23310.46170.15380.09790.2048
VoxelNeXTL0.85710.28720.69120.01150.36140.49530.17650.19230.33280.0000N/AN/A
TransFusion-LL0.58570.20380.66450.00380.48300.14310.01960.16210.43920.0000N/AN/A
FCOS3DC0.52860.53573.99040.0000N/AN/A0.05880.20533.36210.0000N/AN/A
PGDC0.61430.43903.87580.00380.20991.52790.03920.15533.14490.0000N/AN/A
PETRC0.0000N/AN/A0.0000N/AN/A0.0000N/AN/A0.0000N/AN/A
BEVFusionLC0.60000.30380.65580.0000N/AN/A0.0000N/AN/A0.0000N/AN/A
LiRaFusionLR0.51430.27230.70730.00770.17150.21470.0000N/AN/A0.0000N/AN/A
CRTFusionCR0.62860.55820.70850.01920.26660.48430.14710.15461.63080.0000N/AN/A
DAQI ProposalsR0.85710.59752.35290.88080.30430.37350.47060.13311.38840.61540.13050.1662
PillarNet-RR0.55880.45060.94240.01150.16330.28110.0000N/AN/A0.0000N/AN/A
RadarDistillR(L)0.76470.37950.78770.01540.23400.40150.0000N/AN/A0.0000N/AN/A
PARTR0.95710.29311.00030.95770.11420.21610.80390.10630.60480.92310.22660.1838

NGT is the number of eligible ground-truth boxes. Gray cells indicate zero recall despite ground-truth instances; N/A denotes an undefined error because no true positive is available.

Table 4Component ablation.
Exp.CA-AP ↑mASTE ↓mAVE ↓Special Recall ↑
w/o DAQI0.61980.67771.30480.6646
w/o PGCA0.88150.33000.83480.8931
w/o UAS0.79480.31490.82920.3899
w/o PWSH0.88270.36070.83250.9182
FULL0.88270.31880.80840.9203

The w/o DAQI variant is reported at a fixed score threshold of 0.2 because it produces no valid detections at the standard 0.5 threshold; CA-AP uses the full confidence sweep. UAS: Uncertainty-Aware Supervision. PWSH: Point-Wise Surface Head. Special recall is evaluated over rare and safety-relevant categories.

Citation

PART

If this work is useful to you, please consider citing our paper.

@article{sun2026part,
  title   = {If It Moves, Radar Knows: A Physics-Aware Radar Transformer for Class-Agnostic Moving-Object Detection},
  author  = {Sun, Yinghao and Li, Shuguang and Shao, Jinliang and Li, Tieshan},
  journal = {arXiv preprint arXiv:2609.02289},
  year    = {2026}
}