Incorporating Symmetry into Deep Dynamics Models for Improved GeneralizationDownload PDF

Sep 28, 2020 (edited Mar 15, 2021)ICLR 2021 PosterReaders: Everyone
  • Keywords: deep sequence model, equivariant neural network, physics-guided deep learning, AI for earth science
  • Abstract: Recent work has shown deep learning can accelerate the prediction of physical dynamics relative to numerical solvers. However, limited physical accuracy and an inability to generalize under distributional shift limit its applicability to the real world. We propose to improve accuracy and generalization by incorporating symmetries into convolutional neural networks. Specifically, we employ a variety of methods each tailored to enforce a different symmetry. Our models are both theoretically and experimentally robust to distributional shift by symmetry group transformations and enjoy favorable sample complexity. We demonstrate the advantage of our approach on a variety of physical dynamics including Rayleigh–Bénard convection and real-world ocean currents and temperatures. Compare with image or text applications, our work is a significant step towards applying equivariant neural networks to high-dimensional systems with complex dynamics.
  • Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics
  • One-sentence Summary: Integrate various symmetris into deep sequence models for forecasting turbulence and ocean currents with improved accuracy and physical consistency.
  • Supplementary Material: zip
14 Replies