- Title Information
- Title
- Theory, Algorithms, and Software for Physics-Informed Deep Learning
- Name:
Personal
- Name Part
- Lu, Lu
- Role
- Role Term:
Text
- creator
- Name:
Personal
- Name Part
- Karniadakis, George
- Role
- Role Term:
Text
- Advisor
- Name:
Personal
- Name Part
- Harrison, Matthew
- Role
- Role Term:
Text
- Reader
- Name:
Personal
- Name Part
- Stinis, Panos
- Role
- Role Term:
Text
- Reader
- Name:
Corporate
- Name Part
- Brown University. Department of Applied Mathematics
- Role
- Role Term:
Text
- sponsor
- Origin Information
- Copyright Date
- 2020
- Physical Description
- Extent
- , None p.
- digitalOrigin
- born digital
- Note:
thesis
- Thesis (Ph. D.)--Brown University, 2020
- Genre (aat)
- theses
- Abstract
- This dissertation is centered around the broad topic of physics-informed deep learning (DL). Specifically, it covers the following three fronts:
Algorithms. Recent developments of DL, i.e., deep neural networks (NNs), provide us with opportunities that cannot be tackled solely through traditional methods for scientific applications. Specifically, I have developed three new algorithms to incorporate physics into DL. 1. Multi-fidelity NNs. Instrumented indentation has been developed to extract mechanical properties of materials. I present multi-fidelity approaches for solving the inverse indentation problem, hence significantly reducing the number of expensive high-fidelity datasets required to achieve a given level of accuracy. 2. Physics-informed NNs (PINNs). I further develop PINNs, which embed partial differential equations (PDEs) into NNs. The PINN algorithm can be applied to different types of PDEs, including fractional PDEs and stochastic PDEs. I propose a new residual-based adaptive refinement method to improve the training efficiency. 3. Learning nonlinear operators. I propose the deep operator network (DeepONet) to learn operators accurately and efficiently. I demonstrate that DeepONet significantly reduces the generalization error. I observe high-order error convergence, and even exponential convergence with respect to the dataset size.
Theory. Building the mathematical foundations of DL is especially vital to establishing assurance and thus realizing the potential of DL for science. I theoretically address the question of assurance. 1. Dying ReLU. The dying ReLU refers to the problem when ReLU neurons become inactive. I prove that a deep ReLU network will eventually die in probability as the depth goes to infinite. I also propose a new initialization procedure, which effectively prevents the dying ReLU. 2. Generalization. I study the generalization error of NNs for classification problems. I introduce the cover complexity to measure the difficulty of learning a dataset and the inverse of the modulus of continuity to quantify NN smoothness. A quantitative bound for expected accuracy is also derived.
Open-source software. I present a Python library for PINNs, DeepXDE, which is designed to serve both as an education tool to be used in the classroom as well as a research tool for solving general problems in computational science and engineering.
- Subject (fast)
(authorityURI="http://id.worldcat.org/fast", valueURI="http://id.worldcat.org/fast/00893484")
- Topic
- Differential equations, Partial
- Subject
- Topic
- Deep Learning
- Subject
- Topic
- computational physics
- Language
- Language Term (ISO639-2B)
- English
- Record Information
- Record Content Source (marcorg)
- RPB
- Record Creation Date
(encoding="iso8601")
- 20200720
- Access Condition:
rights statement
(href="http://rightsstatements.org/vocab/InC/1.0/")
- In Copyright
- Access Condition:
restriction on access
- Collection is open for research.
- Identifier:
DOI
- 10.26300/mpz0-gr82
- Type of Resource (primo)
- dissertations