SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks

John Anticev, Ali Aghdaei, Wuxinlin Cheng, Zhuo Feng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

SGM-PINN is a graph-based importance sampling framework to improve the training efficacy of Physics-Informed Neural Networks (PINNs) on parameterized problems. By applying a graph decomposition scheme to an undirected Probabilistic Graphical Model (PGM) built from the training dataset, our method generates node clusters encoding conditional dependence between training samples. Biasing sampling towards more important clusters allows smaller mini-batches and training datasets, improving training speed and accuracy. We additionally fuse an efficient robustness metric with residual losses to determine regions requiring additional sampling. Experiments demonstrate the advantages of the proposed framework, achieving 3× faster convergence compared to prior state-of-the-art sampling methods.

Original languageEnglish
Title of host publicationProceedings of the 61st ACM/IEEE Design Automation Conference, DAC 2024
ISBN (Electronic)9798400706011
DOIs
StatePublished - 7 Nov 2024
Event61st ACM/IEEE Design Automation Conference, DAC 2024 - San Francisco, United States
Duration: 23 Jun 202427 Jun 2024

Publication series

NameProceedings - Design Automation Conference
ISSN (Print)0738-100X

Conference

Conference61st ACM/IEEE Design Automation Conference, DAC 2024
Country/TerritoryUnited States
CitySan Francisco
Period23/06/2427/06/24

Fingerprint

Dive into the research topics of 'SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks'. Together they form a unique fingerprint.

Cite this