Data and Modeling Assumptions in Physics-Informed Operator Learning

Martin Hofmann-Wellenhof, Alexander Fuchs, Bernhard C Geiger, Franz Pernkopf

Keywords: physics-informed, Deep Operator Network, surrogate model, modeling assumptions, operator learning, physics-informed machine learning, hybrid training

TL;DR: We analyze how different amounts of labeled data and model architectures influence the training and performance of operator learning methods under data-driven, physics-informed, and hybrid settings.

Abstract:

Operator networks have emerged as promising surrogate models, replacing computationally expensive numerical solvers for differential equations. Beyond achieving competitive accuracy with traditional solvers, the practical viability of this approach greatly depends on its training cost, which is comprised of ground truth data acquisition and network optimization. Physics-informed machine learning seeks to reduce reliance on labeled data by embedding the governing differential equations into the loss function; however, such models are often very challenging to train using physics constraints alone.

In this paper, we study how varying amounts of labeled data and architectural choices affect convergence and final performance in operator learning. Specifically, we compare an architecture developed for operator learning, i.e., Deep Operator Network, with a simpler MLP baseline across three training regimes: purely data-driven, purely physics-informed with no labeled data, and hybrid approaches that leverage both data and physics information.
Our experiments on the double-mass-spring-damper system indicate that the physics-informed Deep Operator Network converges faster to the same performance if small amounts of labeled data are used. For the MLP architecture, which is not as well-tailored to the underlying dynamics, a purely physics-informed approach fails. In this case, incorporating labeled data mitigates architectural deficiencies and always substantially improves convergence and performance.

Email Sharing: We authorize the sharing of all author emails with Program Chairs.

Data Release: We authorize the release of our submission and author names to the public in the event of acceptance.

Submission Number: 51