Demonstrating ChemGymRL: An Interactive Framework for Reinforcement Learning for Digital Chemistry

Published: 27 Oct 2023, Last Modified: 11 Dec 2023AI4Mat-2023 PosterEveryoneRevisionsBibTeX
Submission Track: Tutorials
Submission Category: AI-Guided Design + Automated Chemical Synthesis
Keywords: reinforcement learning, chemistry, gym environment, materials design, chemical synthesis
Supplementary Material: zip
TL;DR: We provide a tutorial on ChemGymRL, an interactive framework for training reinforcement learning agents to learn novel pathways to target materials
Abstract: This tutorial describes a simulated laboratory for making use of reinforcement learning (RL) for chemical discovery. A key advantage of the simulated environment is that it enables RL agents to be trained safely and efficiently. In addition, it offer an excellent test-bed for RL in general, with challenges which are uncommon in existing RL benchmarks. The simulated laboratory, denoted ChemGymRL, is open-source, implemented according to the standard Gymnasium API, and is highly customizable. It supports a series of interconnected virtual chemical \emph{benches} where RL agents can operate and train. Within this tutorial introduce the environment, demonstrate how to train off-the-shelf RL algorithms on the benches, and how to modify the benches by adding additional reactions and other capabilities. In addition, we discuss future directions for ChemGymRL benches and RL for laboratory automation and the discovery of novel synthesis pathways. The software, documentation and tutorials are available here:
Submission Number: 30