Hysteresis-Based RL: Robustifying Reinforcement Learning-based Control Policies via Hybrid Control
Jan de Priester, Ricardo G. Sanfelice, Nathan van de Wouw
Abstract
Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN) algorithms may lack robustness guarantees. Motivated by these issues, we propose a new hybrid algorithm, which we call Hysteresis-Based RL (HyRL), augmenting an existing RL algorithm with hysteresis switching and two stages of learning. We illustrate its properties in two examples for which PPO and DQN fail.
Create a lesson
Related papers
Evaluating Compositional Generalization in Transformers: The Role of Composition Equivalence and Module Coverage
Purva Pruthi, Andrew Yuan, Alexander D'Amour et al.
Sharp Sample Complexity of KL-Regularized Reinforcement Learning
Andrew Liu
Leveraging Psychophysical Attentional Distribution for Gaze-Augmented Reward Modeling
Chaeho Lee, Junyup Kim, Wansoo Kim et al.
Deep Personalization: Continuous Context Observation for Local Proactive Agents
Yijia Shao, Song Bian, Junxian Guo et al.
SLIC: Reinforcement Fine-Tuning Small LMs for Multi-Turn Analog Circuit Optimization
Yan Xu, Zhengqi Gao, Ching-Yun Ko et al.
Fermat ProbCover: Coverage-Based Active Learning on Fermat Distance Graphs
Gokul Bhusal, Delanna Do, Kevin Miller et al.