ADAPTER-RL: Adaptation of Any Agent using Reinforcement Learning

Yizhao Jin, Gregory Slabaugh, Simon Lucas

Keywords: adapter, reinforcement learning, human expertise

Abstract: Deep Reinforcement Learning (DRL) agents frequently face challenges in adapting to tasks outside their training distribution, facing issues with over-fitting, catastrophic forgetting and sample inefficiency. Although the application of adapters has proven effective in supervised learning contexts such as natural language processing and computer vision, their potential within the DRL domain remains largely unexplored. This paper delves into the integration of adapters in reinforcement learning, presenting an innovative adaptation strategy that demonstrates enhanced training efficiency and imporvement of the base-agent, experimentally in the nanoRTS environment, a real-time strategy game simulation. Our proposed universal approach is not only compatible with pre-trained neural networks but also with rule-based agents, offering a means to integrate human expertise.

Primary Area: reinforcement learning

Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.

Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2024/AuthorGuide.

Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors' identity.

No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.

Submission Number: 3431