Coordinate Transform Fourier Neural Operators for Symmetries in Physical Modelings

TMLR Paper2504 Authors

10 Apr 2024 (modified: 02 Jun 2024)Under review for TMLREveryoneRevisionsBibTeXCC BY-SA 4.0
Abstract: Symmetries often arise in many natural sciences; rather than relying on data augmentation or regularization for learning these symmetries, incorporating these inherent symmetries directly into the neural network architecture simplifies the learning process and enhances model performance. The laws of physics, including partial differential equations (PDEs), remain unchanged regardless of the coordinate system employed to depict them, and symmetries sometimes can be natural to illuminate in other coordinate systems. Moreover, symmetries often are associated with the underlying domain shapes. In this work, we consider physical modelings with neural operators (NOs), and we propose an approach based on coordinate transforms (CT) to work on different domain shapes and symmetries. Canonical coordinate transforms are applied to convert both the domain shape and symmetries. For example, a sphere can be naturally converted to a square with periodicities across its edges. The resulting CT-FNO scheme barely increases computational complexity and can be applied to different domain shapes while respecting the symmetries.
Submission Length: Regular submission (no more than 12 pages of main content)
Changes Since Last Submission: Changes made based on reviewers' comments, including clearer writting and added experiments. The details can be found in our responses. A sentence describing change in distribution after rotations is included as the reviewer suggested.
Assigned Action Editor: ~Alejandro_Francisco_Queiruga1
Submission Number: 2504
Loading