# American Institute of Mathematical Sciences

doi: 10.3934/krm.2021044
Online First

Online First articles are published articles within a journal that have not yet been assigned to a formal issue. This means they do not yet have a volume number, issue number, or page numbers assigned to them, however, they can still be found and cited using their DOI (Digital Object Identifier). Online First publication benefits the research community by making new scientific discoveries known as quickly as possible.

Readers can access Online First articles via the “Online First” tab for the selected journal.

## A neural network closure for the Euler-Poisson system based on kinetic simulations

 1 Institut de Recherche Mathématique Avancée, UMR 7501, Université de Strasbourg et CNRS, 7 rue René Descartes, 67000 Strasbourg, France 2 INRIA Nancy-Grand Est, TONUS Project, Strasbourg, France

Received  October 2020 Revised  August 2021 Early access December 2021

This work deals with the modeling of plasmas, which are ionized gases. Thanks to machine learning, we construct a closure for the one-dimensional Euler-Poisson system valid for a wide range of collisional regimes. This closure, based on a fully convolutional neural network called V-net, takes as input the whole spatial density, mean velocity and temperature and predicts as output the whole heat flux. It is learned from data coming from kinetic simulations of the Vlasov-Poisson equations. Data generation and preprocessings are designed to ensure an almost uniform accuracy over the chosen range of Knudsen numbers (which parametrize collisional regimes). Finally, several numerical tests are carried out to assess validity and flexibility of the whole pipeline.

Citation: Léo Bois, Emmanuel Franck, Laurent Navoret, Vincent Vigon. A neural network closure for the Euler-Poisson system based on kinetic simulations. Kinetic & Related Models, doi: 10.3934/krm.2021044
##### References:

show all references

##### References:
Graph of the composition of the closure. The different operations are (Re)-(Re') resampling, (P) pre-processing, (Sl) slicing, ($\text{NN}_\theta$) neural network, (R) reconstruction, (P') post-processing and (Sm) smoothing
Visual representation of the three operations involved in the non-locality: the (Sm) smoothing, the (R) reconstruction and (Sl) slicing mechanism, and the ($\text{NN}_\theta$) neural network. Highlighted in gray is the part of the data used to compute the output value whose position is indicated by the red line. For better readability, only one of the four vectors of the input $X$, and only the three windows involved, are represented. These examples use the redundancy parameter $r = 2$. Two scenarios are illustrated: on the left, each output value of the neural network depends on relatively few input values, while on the right it depends on relatively many. Also, the position of the output value considered is not the same
Graph of a 1D V-Net with a window of size $N = 512$, a depth $k = 2$ and $\ell = 3$ levels
Scheme of the data generation process for one simulation with the kinetic model. With one Knudsen number and one initial condition, we produce 20 entries in the dataset
Possible functions $\rho$, $u$ and $T$ generated with the process described in Section 4.2
Scheme of the whole data processing for the training and the prediction processes respectivily. The different operations are (S) standardization, (Sl) slicing, (N) normalization, (I) inverse normalization, (R) reconstruction and (Sm) smoothing
Slicing of a 1D signal into overlapping windows with different redundancy parameters $r$. The original signal is represented vertically on the left, and the windows are on the right. The hatched parts of each window are the margins that are ignored when reconstructing the signal. The windows that exceed the span of the original signal are completed by periodicity
Kernel used for the reconstruction of an entire signal from the windows predicted by the neural network, with the redundancy parameter $r = 3$
Three examples of predictions. Note the different scales of the y-axis: the amplitude of the heat flux tends to increase with the Knudsen number
Distribution of the relative errors of the neural network and the Navier-Stokes estimation over the test dataset ($10, 000$ predictions)
Error of the Navier-Stokes estimations and of the network on the test dataset, depending on the Knudsen number and the $L^2$ norm of the real heat flux. Each dot corresponds to one entry in the test dataset. For better clarity, only one $31^{\text{th}}$ of the data is shown here
Relative error of the Navier-Stokes estimations and of the network on the test dataset, depending on the Knudsen number. The line represents the median of the error over the 100 entries of the test dataset for each epsilon, and the coloured area the interquartile interval
Norm of the real heat flux and relative errors of the predicted heat flux and the Navier-Stokes estimation throughout simulations. Median and interquartile interval over 50 simulations
Median relative error and number of learnable parameters for V-Nets with different hyper-parameters : ($\ell$) number of levels, ($d$) depth, and ($p$) size of the kernels. Points sharing the same color represent networks that differ by only one hyper-parameter
Example of the evolution of the density, mean velocity, temperature and heat flux during the first time unit with a randomly generated initial condition and $\varepsilon = 0.1$, obtained with the kinetic model
Comparison of the four models on the density and heat flux at $t = 1$ with a randomly generated initial condition and $\varepsilon = 0.1$
Examples of the evolution of the electric energy with different initial conditions and different Knudsen numbers
Distributions over 200 simulations of the relative errors of the three fluid models compared to the kinetic model, measured on the logarithm of the electric energy from $t = 0$ to $t = 8$. For better readability, the x-axis in in logarithmic scale
$L^2$ relative errors of the fluid models over the kinetic model depending on the Knudsen number. The first plot shows the raw data and the second shows the median and interquartile interval for 20 uniform classes of Knudsen numbers between $0.01$ and $1$
Example of a heat flux predicted by the neural network, with and without smoothing. The smoothing here uses $\sigma\simeq0.05$
Relative errors of the predictions over the test dataset depending on the quantity $\sigma$ of smoothing
Proportion of simulations of the fluid model reaching $t = 3$ out of 30 simulations, depending on the quantity $\sigma$ of smoothing
Relative errors of the fluid+network model on five different quantities depending on the resolution used. Each point is an average of 10 simulations with always the same 10 different initial conditions and $\varepsilon = 0.1$. The network used was trained with data generated with $N_x = 1\, 024$. To adapt to different resolutions, option 1 relies on the slicing mechanism to adapt to the different input sizes, while option 2 uses the resampling of the input to $N_x = 1\, 024$ and the resampling of the output back to the original resolution. For all resolutions, the errors are computed relative to kinetic simulations with a high resolution ($N_x = 2\, 048$, $N_v = 141$)
Example of convergence of the fluid+network model with option 2, towards what seems to be a slightly different solution than the kinetic model
, which seems to indicate that the fluid+network model is not affected much by the initial discontinuities">Figure 25.  Distributions over 100 simulations of the relative errors of the three fluid models compared to the kinetic model, measured on the logarithm of the electric energy from $t = 0$ to $t = 8$, with discontinuous initial conditions. For better readability, the x-axis in in logarithmic scale. It looks a lot like figure 18, which seems to indicate that the fluid+network model is not affected much by the initial discontinuities
Example of the evolution of the density and temperature up to $t = 0.5$ with a randomly generated discontinuous initial condition and $\varepsilon = 0.1$, obtained with the kinetic model. The initial discontinuities are quickly smoothed out by the dynamic of the system
Hyper-parameters of the reference neural network
 Hyper-parameter Value size of the input window ($N$) 512 number of levels ($\ell$) 5 depth ($d$) 4 size of the kernels ($p$) 11 activation function softplus
 Hyper-parameter Value size of the input window ($N$) 512 number of levels ($\ell$) 5 depth ($d$) 4 size of the kernels ($p$) 11 activation function softplus
 [1] Silvia Caprino, Guido Cavallaro, Carlo Marchioro. Time evolution of a Vlasov-Poisson plasma with magnetic confinement. Kinetic & Related Models, 2012, 5 (4) : 729-742. doi: 10.3934/krm.2012.5.729 [2] Gang Li, Xianwen Zhang. A Vlasov-Poisson plasma of infinite mass with a point charge. Kinetic & Related Models, 2018, 11 (2) : 303-336. doi: 10.3934/krm.2018015 [3] Yulia O. Belyaeva, Björn Gebhard, Alexander L. Skubachevskii. A general way to confined stationary Vlasov-Poisson plasma configurations. Kinetic & Related Models, 2021, 14 (2) : 257-282. doi: 10.3934/krm.2021004 [4] Silvia Caprino, Guido Cavallaro, Carlo Marchioro. A Vlasov-Poisson plasma with unbounded mass and velocities confined in a cylinder by a magnetic mirror. Kinetic & Related Models, 2016, 9 (4) : 657-686. doi: 10.3934/krm.2016011 [5] Katherine Zhiyuan Zhang. Focusing solutions of the Vlasov-Poisson system. Kinetic & Related Models, 2019, 12 (6) : 1313-1327. doi: 10.3934/krm.2019051 [6] Blanca Ayuso, José A. Carrillo, Chi-Wang Shu. Discontinuous Galerkin methods for the one-dimensional Vlasov-Poisson system. Kinetic & Related Models, 2011, 4 (4) : 955-989. doi: 10.3934/krm.2011.4.955 [7] Jack Schaeffer. Global existence for the Vlasov-Poisson system with steady spatial asymptotic behavior. Kinetic & Related Models, 2012, 5 (1) : 129-153. doi: 10.3934/krm.2012.5.129 [8] Gianluca Crippa, Silvia Ligabue, Chiara Saffirio. Lagrangian solutions to the Vlasov-Poisson system with a point charge. Kinetic & Related Models, 2018, 11 (6) : 1277-1299. doi: 10.3934/krm.2018050 [9] Zili Chen, Xiuting Li, Xianwen Zhang. The two dimensional Vlasov-Poisson system with steady spatial asymptotics. Kinetic & Related Models, 2017, 10 (4) : 977-1009. doi: 10.3934/krm.2017039 [10] Meixia Xiao, Xianwen Zhang. On global solutions to the Vlasov-Poisson system with radiation damping. Kinetic & Related Models, 2018, 11 (5) : 1183-1209. doi: 10.3934/krm.2018046 [11] Jean Dolbeault. An introduction to kinetic equations: the Vlasov-Poisson system and the Boltzmann equation. Discrete & Continuous Dynamical Systems, 2002, 8 (2) : 361-380. doi: 10.3934/dcds.2002.8.361 [12] Jack Schaeffer. On time decay for the spherically symmetric Vlasov-Poisson system. Kinetic & Related Models, , () : -. doi: 10.3934/krm.2021021 [13] Gerhard Rein, Christopher Straub. On the transport operators arising from linearizing the Vlasov-Poisson or Einstein-Vlasov system about isotropic steady states. Kinetic & Related Models, 2020, 13 (5) : 933-949. doi: 10.3934/krm.2020032 [14] Xianglong Duan. Sharp decay estimates for the Vlasov-Poisson and Vlasov-Yukawa systems with small data. Kinetic & Related Models, , () : -. doi: 10.3934/krm.2021049 [15] Shigeru Takata, Hitoshi Funagane, Kazuo Aoki. Fluid modeling for the Knudsen compressor: Case of polyatomic gases. Kinetic & Related Models, 2010, 3 (2) : 353-372. doi: 10.3934/krm.2010.3.353 [16] Joackim Bernier, Michel Mehrenberger. Long-time behavior of second order linearized Vlasov-Poisson equations near a homogeneous equilibrium. Kinetic & Related Models, 2020, 13 (1) : 129-168. doi: 10.3934/krm.2020005 [17] Hyung Ju Hwang, Jaewoo Jung, Juan J. L. Velázquez. On global existence of classical solutions for the Vlasov-Poisson system in convex bounded domains. Discrete & Continuous Dynamical Systems, 2013, 33 (2) : 723-737. doi: 10.3934/dcds.2013.33.723 [18] Francis Filbet, Roland Duclous, Bruno Dubroca. Analysis of a high order finite volume scheme for the 1D Vlasov-Poisson system. Discrete & Continuous Dynamical Systems - S, 2012, 5 (2) : 283-305. doi: 10.3934/dcdss.2012.5.283 [19] Dongming Wei. 1D Vlasov-Poisson equations with electron sheet initial data. Kinetic & Related Models, 2010, 3 (4) : 729-754. doi: 10.3934/krm.2010.3.729 [20] Mihaï Bostan. Asymptotic behavior for the Vlasov-Poisson equations with strong uniform magnetic field and general initial conditions. Kinetic & Related Models, 2020, 13 (3) : 531-548. doi: 10.3934/krm.2020018

2020 Impact Factor: 1.432

## Tools

Article outline

Figures and Tables