Transfer Learning for Control Systems via Neural Simulation Relations
Keywords: Transfer Learning; Conrol Systems; Neural Simulation Relations
TL;DR: Framework to formally transfer any controller, regardless of its design property, from one discrete time system to another.
Abstract: Transfer learning is an umbrella term for machine learning approaches that leverage knowledge gained from solving one problem (the source domain) to improve speed, efficiency, and data requirements in solving a different but related problem (the target domain).
The performance of the transferred model in the target domain is typically measured via some notion of loss function in the target domain.
This paper focuses on effectively transferring control logic from a source control system to a target control system while providing approximately similar behavioral guarantees in both domains.
However, in the absence of a complete characterization of behavioral specifications, this problem cannot be captured in terms of loss functions.
To overcome this challenge, we use (approximate) simulation relations to characterize observational equivalence between the behaviors of two systems.
Simulation relations ensure that the outputs of both systems, equipped with their corresponding controllers, remain close to each other over time, and their closeness can be quantified a priori.
By parameterizing simulation relations with neural networks, we introduce the notion of neural simulation relations, which provides a data-driven approach to transfer any synthesized controller, regardless of the specification of interest, along with its proof of correctness.
Compared with prior approaches, our method eliminates the need for a closed-loop mathematical model and specific requirements for both the source and target systems.
We also introduce validity conditions that, when satisfied, guarantee the closeness of the outputs of two systems equipped with their corresponding controllers, thus eliminating the need for post-facto verification.
We demonstrate the effectiveness of our approach through case studies involving a vehicle and a double inverted pendulum.
Supplementary Material: zip
Primary Area: transfer learning, meta learning, and lifelong learning
Code Of Ethics: I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Submission Guidelines: I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Anonymous Url: I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
No Acknowledgement Section: I certify that there is no acknowledgement section in this submission for double blind review.
Submission Number: 8309
Loading