All writing

Smart Note · Series

Reinforcement Learning & Simulation

Reinforcement learning methods, applications in robotics and language models, and physics simulation.

7 articles

Let's Talk About Sim, Part I: The Robot Simulator Ecosystem
Reinforcement Learning & Simulation

Let's Talk About Sim, Part I: The Robot Simulator Ecosystem

A full guide to general-purpose robot simulators, physics engines, household simulation environments and specialized tools.

2024-01-23 · 16 min read
Talking Simulation, Part 2: An Interview with the Simulately Contributors
Reinforcement Learning & Simulation

Talking Simulation, Part 2: An Interview with the Simulately Contributors

Yuzhe Qin and Haoran Geng discuss the robotics simulation ecosystem, sim-to-real transfer, reinforcement and imitation learning, and the challenges of building useful simulators.

2024-01-24 · 14 min read
A Conversation with Jianlan Luo: Reinforcement Learning Can Work Directly on Real Robots
Reinforcement Learning & Simulation

A Conversation with Jianlan Luo: Reinforcement Learning Can Work Directly on Real Robots

Jianlan Luo on SERL and HIL-SERL, sample-efficient real-world reinforcement learning, human interventions, precise manipulation and the limits of simulation.

2024-11-11 · 18 min read
Reinforcement Learning & Simulation

Podcast: RL + Control—Bringing Robot Reliability Closer to 99.9x%

Jianlan Luo, Guanya Shi, Zongqing Lu, and Qiuguo Zhu discuss reinforcement learning, control, real-world manipulation, and the gap between benchmark success and product reliability.

2024-12-14 · 43 min read
Genesis Released: Could a New Physics Engine Transform Robot Simulation?
Reinforcement Learning & Simulation

Genesis Released: Could a New Physics Engine Transform Robot Simulation?

The Genesis launch, differentiable physics, realistic rendering, generative data and the relationship between simulation and real-world learning.

2024-12-19 · 23 min read
Reinforcement Learning for Robotics: An In-depth Introduction
Reinforcement Learning & Simulation

Reinforcement Learning for Robotics: An In-depth Introduction

Conversations with Weinan Zhang and Yunlong Song on RL algorithms, manipulation, locomotion, drone control, and sim-to-real transfer.

2025-01-15 · 33 min read
How Reinforcement Learning Improves Large Language Models
Reinforcement Learning & Simulation

How Reinforcement Learning Improves Large Language Models

Kimi reinforcement learning researcher Whisper discusses post-training, verifiable rewards, inference-time scaling and the methods behind Kimi k1.5.

2025-01-22 · 12 min read