Energy-Free Guidance of Geometric Diffusion Models for 3D Molecule Inverse Design

Published: 17 Jun 2024, Last Modified: 22 Jul 2024ML4LMS PosterEveryoneRevisionsBibTeXCC BY 4.0
Keywords: Inverse Molecular Design, Geometric Diffusion Models, SE(3) Equivariance, Molecular Generation, Classifier-Free Guidance
TL;DR: Propose a novel energy-free guidance method for inverse molecular design, which achieves SOTA results on 4 out of 6 QM9 properties.
Abstract: Molecule inverse design is of critical significance in drug discovery which requires molecules to be generated based on certain chemical properties or structural compositions. Generative models, most popularly diffusion models, have shown great promise in performing inverse design through conditioning techniques and/or explicit energy guidance during sampling. In this work, we propose a novel guidance framework, Energy-Free Guidance for Geometric Diffusion Models, that effectively boosts the utility of molecule inverse design without any auxiliary energy head for guidance. The key innovation lies in the joint training strategy for the conditional and unconditional score models via random masking, which are then composed during sampling in an SE(3)-equivariant fashion, ensuring the critical physical symmetry of the geometric distribution. This feature alleviates practitioners from needing additional efforts in training energy prediction heads and avoids the adversarial gradient coming from them. We conduct experiments on a diverse range of inverse design tasks on QM9, showing that our approach achieves state-of-the-art on 4 out of 6 design targets without leveraging any external energy gradients.
Submission Number: 80
Loading