EasyDeepLearn

Meta-RL — learning to learn.

hard

Answer

  • Train agent across a distribution of related tasks so it adapts to new tasks quickly.
  • Approaches: (1) Recurrent meta-RL (RL2)(\mathrm{RL}^{2}): LSTM policy learns adaptation from context.
  • (2) MAML for RL: gradient-based meta-learning that produces initialization enabling few-step adaptation.
  • (3) PEARL: context-conditioned policy with latent task variable.
  • Applications: fast robot adaptation, personalized recommenders.
  • Modern LLM in-context learning is analogous.
Check yourself — multiple choice
  • Random
  • Train across task distribution → fast adaptation to new task; RL2\mathrm{RL}^{2} (LSTM context) / MAML (gradient-based) / PEARL (latent task variable); LLM in-context learning is analog
  • Same as SL
  • Not real

Meta-RL: fast adaptation across tasks; RL2  /  MAML  /  PEARL\mathrm{RL}^{2}\; / \;\mathrm{MAML}\; / \;\mathrm{PEARL}.

#theory

Practise Reinforcement Learning

214 interview questions in this topic.

Related questions