Chapter 3
Formal Preliminaries
4 sections · about 5 minutes
3.1 The visuomotor imitation problem
Let the robot's state be , its observation where is one or more camera images and is proprioception, and its action . A demonstration dataset is
Behaviour cloning fits by maximum likelihood. The classical result is that the compounding-error penalty of BC is quadratic in horizon: if the learned policy has per-step error under the expert's state distribution, its expected cost can degrade as relative to the expert, because errors move the policy off the training distribution.
Two architectural families dominate current practice and both address this by predicting sequences rather than steps.
Action chunking (ACT). Zhao, Kumar, Levine & Finn (RSS 2023) [arXiv:2304.13705] predict jointly, reducing the effective horizon by a factor . Their ablation is striking: success rises from 1% at to 44% at on a simulated human-demonstration task. Temporal ensembling averages overlapping chunk predictions with exponential weights , adding a further ~3.3%. Crucially, removing the CVAE latent — the component that absorbs demonstrator stochasticity — costs 33.3% on human data and approximately nothing on scripted data. This is the cleanest isolation in the literature of the specific damage done by human demonstration noise.
Diffusion policy. Chi, Feng, Du, Xu, Cousineau, Burchfiel & Song (RSS 2023) [arXiv:2303.04137] model as a conditional denoising process, reporting +46.9% average improvement across 12 tasks and 4 benchmarks. Their stated motivation for sequence prediction is directly relevant here: it prevents "jittery actions that alternate between the two valid trajectories" when a demonstrator solves a task multiple ways.
Both families converge on the same fix from opposite modelling philosophies. That convergence tells us something about the failure mode they are both patching: single-step regression is brittle precisely when the demonstrator's action is not a deterministic function of the observed state. Hold that thought; §4.8 argues that EMG teleoperation manufactures exactly that condition.
3.2 Demonstration quality, formally
Belkhale, Cui & Sadigh, Data Quality in Imitation Learning (NeurIPS 2023) [arXiv:2306.02437] provide the framework this review uses throughout. They identify two axes:
- Action divergence — , the divergence between learner and expert action distributions at a state, driven in practice by the entropy of the expert's own actions at similar states.
- Transition diversity — the spread of successor states, .
Their Theorem 4.1 bounds the distribution shift:
Two consequences matter for us. The weighting means early-episode errors are penalised far more than late ones. And appears explicitly, so slow, hesitant demonstrations are penalised twice — once through longer horizons and once through whatever inconsistency produced the hesitation.
Their empirical practice is decisive. Diversity arising from system noise (environment stochasticity) helps, because it teaches recovery; diversity arising from policy noise (an inconsistent operator) hurts. In their controlled injection study on the Square task, at 1,000 episodes the gap is modest (82.0% system noise vs 80.7% policy noise), but at 50 episodes it widens to 69.7% vs 48.3%. Operator inconsistency is most corrosive exactly in the low-data regime any EMG study will occupy.
A caution the authors themselves raise: their metrics are incomplete and not monotone. On robomimic Square, the MH-Worse subset has the lowest action variance (0.061) and the worst success (2%), with the residual attributed to horizon length.
3.3 The empirical anchor: robomimic
Mandlekar et al. (CoRL 2021) [arXiv:2108.03298] constructed proficient-human (PH: 1 operator, 200 trajectories) and multi-human (MH: 6 operators, 50 each = 300 trajectories, binned "worse"/"okay"/"better") datasets per task. MH has 50% more data than PH and performs substantially worse — BC-RNN on Transport drops from 72% (PH) to 42% (MH). Offline RL collapses specifically on mixed human data: on Can (MH), BC-RNN reaches 100% while BCQ manages 62.7% and CQL 22.0%, despite both performing acceptably on machine-generated data.
The MH-specific architectural finding is equally important: history-dependent models (BC-RNN, HBC) gain ~25% on Square (MH) versus only ~5% on Square (PH). Architecture partially substitutes for data quality, and the value of the substitution scales with how bad the data is.
We found no paper contradicting the PH > MH ordering. Belkhale et al. independently reproduce it on the same subsets (Square: PH 58%, Better 36%, Okay 12%, Worse 2%).
3.4 Smoothness metrics
Because §4 argues that EMG artifacts manifest as non-smoothness, we need the metrics. Balasubramanian, Melendez-Calderon, Roby-Brami & Burdet (2015), J. NeuroEngineering and Rehabilitation 12:112 [DOI] is the definitive comparative treatment.
Spectral Arc Length (SPARC):
where is the Fourier magnitude spectrum of the speed profile. Normalising by makes it amplitude-invariant; the modified SPARC uses an adaptive cutoff to make it duration-invariant too.
Log dimensionless jerk (LDLJ):
The 2015 paper is explicit that DLJ "lacks sensitivity in the physiological range" and that LDLJ has "poor reliability" under measurement noise — a serious caveat for teleoperation data, where jerk requires double-differentiating noisy pose estimates. The practical ranking is SPARC > LDLJ > number-of-peaks.
These are not idle formalisms. Kulkarni, Dhar & Cui (2026), RINSE [arXiv:2604.23000] [C] use spectral arc length directly as a demonstration-filtering criterion, reporting +16% success on RoboMimic Transport using one-sixth of the data and +20% on a real push-block task using half the data. Critically for this review, both of their metrics rank kinesthetic teaching above teleoperation, matching downstream policy performance. Smoothness is not merely correlated with quality; it is usable as a filter.