Ornstein-Uhlenbeck noise vs Gaussian noise for continuous control.
mediumAnswer
- OU: temporally correlated noise: dt + σ → mean-reverting Brownian.
- Used in original DDPG for exploration on physical control tasks — smooth trajectories match physical inertia.
- Later work (TD3, SAC) uses simple Gaussian action noise with equal performance.
- Modern default: Gaussian noise; OU is historical / niche.
Check yourself — multiple choice
- Same thing
- OU: temporally correlated mean-reverting Brownian, smooth trajectories match physical inertia (DDPG); modern TD3/SAC use simple Gaussian noise with equal performance
- Random
- Not real
OU: correlated Brownian, DDPG-era; modern Gaussian action noise sufficient.
#exploration#actor-critic
Practise Reinforcement Learning
214 interview questions in this topic.