Can we build a single large model for a wide range of PDE-related scientific learning tasks? We propose in-context operator learning framework with corresponding model In-Context Operator Network (ICON). A singe ICON model can act as a few-shot operator learner for a diversified type of differential equation problems, including forward and inverse problems of ODEs, PDEs, and mean-field control problems.
Liu Yang, Siting Liu, Tingwei Meng, Stanley J. Osher
We present a detailed methodology for solving time-evolving PDE problems with ICON, and show how a single ICON model can make forward and reverse predictions for different equations with different strides. An ICON model trained on conservation laws with cubic flux functions can generalize well to some other flux functions of more general forms, without fine-tuning. We also show prompt engineer techniques to broaden the range of problems that an ICON model can address.
Liu Yang, Stanley J. Osher
Journal of Computational Physics, Jan 2024
In-Context Operator Learning with Data Prompts for Differential Equation Problems
Liu Yang, Siting Liu, Tingwei Meng, Stanley J. Osher
PNAS, Sep 2023
Fine-Tune Language Models as Multi- Modal Differential Equation Solvers
Liu Yang, Siting Liu, and Stanley J. Osher
arXiv, Aug 2023
PDE Generalization of In-Context Operator Networks: A Study on 1D Scalar Nonlinear Conservation Laws
Liu Yang, Stanley J. Osher
Journal of Computational Physics, Jan 2024