TY - JOUR A1 - Leung, Tsz Yan A1 - Leutbecher, Martin A1 - Reich, Sebastian A1 - Shepherd, Theodore G. T1 - Atmospheric Predictability: Revisiting the Inherent Finite-Time Barrier JF - Journal of the atmospheric sciences N2 - The accepted idea that there exists an inherent finite-time barrier in deterministically predicting atmospheric flows originates from Edward N. Lorenz’s 1969 work based on two-dimensional (2D) turbulence. Yet, known analytic results on the 2D Navier–Stokes (N-S) equations suggest that one can skillfully predict the 2D N-S system indefinitely far ahead should the initial-condition error become sufficiently small, thereby presenting a potential conflict with Lorenz’s theory. Aided by numerical simulations, the present work reexamines Lorenz’s model and reviews both sides of the argument, paying particular attention to the roles played by the slope of the kinetic energy spectrum. It is found that when this slope is shallower than −3, the Lipschitz continuity of analytic solutions (with respect to initial conditions) breaks down as the model resolution increases, unless the viscous range of the real system is resolved—which remains practically impossible. This breakdown leads to the inherent finite-time limit. If, on the other hand, the spectral slope is steeper than −3, then the breakdown does not occur. In this way, the apparent contradiction between the analytic results and Lorenz’s theory is reconciled. KW - Atmosphere KW - Turbulence KW - Error analysis KW - Spectral analysis KW - models KW - distribution KW - Numerical weather prediction KW - forecasting Y1 - 2019 U6 - https://doi.org/10.1175/JAS-D-19-0057.1 SN - 0022-4928 SN - 1520-0469 VL - 76 IS - 12 SP - 3883 EP - 3892 PB - American Meteorological Soc. CY - Boston ER - TY - JOUR A1 - Staniforth, Andrew A1 - Wood, Nigel A1 - Reich, Sebastian T1 - A time-staggered semi-Lagrangian discretization of the rotating shallow-water equations JF - Quarterly journal of the Royal Meteorological Society N2 - A time-staggered semi-Lagrangian discretization of the rotating shallow-water equations is proposed and analysed. Application of regularization to the geopotential field used in the momentum equations leads to an unconditionally stable scheme. The analysis, together with a fully nonlinear example application, suggests that this approach is a promising, efficient, and accurate alternative to traditional schemes. KW - regularization KW - temporal discretization Y1 - 2006 U6 - https://doi.org/10.1256/qj.06.30 SN - 0035-9009 VL - 132 IS - 621C SP - 3107 EP - 3116 PB - Wiley CY - Weinheim ER - TY - JOUR A1 - Reich, Sebastian T1 - Linearly implicit time stepping methods for numerical weather prediction JF - BIT : numerical mathematics ; the leading applied mathematics journal for all computational mathematicians N2 - The efficient time integration of the dynamic core equations for numerical weather prediction (NWP) remains a key challenge. One of the most popular methods is currently provided by implementations of the semi-implicit semi-Lagrangian (SISL) method, originally proposed by Robert (J. Meteorol. Soc. Jpn., 1982). Practical implementations of the SISL method are, however, not without certain shortcomings with regard to accuracy, conservation properties and stability. Based on recent work by Gottwald, Frank and Reich (LNCSE, Springer, 2002), Frank, Reich, Staniforth, White and Wood (Atm. Sci. Lett., 2005) and Wood, Staniforth and Reich (Atm. Sci. Lett., 2006) we propose an alternative semi-Lagrangian implementation based on a set of regularized equations and the popular Stormer-Verlet time stepping method in the context of the shallow-water equations (SWEs). Ultimately, the goal is to develop practical implementations for the 3D Euler equations that overcome some or all shortcomings of current SISL implementations. KW - numerical weather prediction KW - linearly implicit time stepping methods KW - semi-Lagrangian method KW - Stormer-Verlet method KW - shallow-water equations Y1 - 2006 U6 - https://doi.org/10.1007/s10543-006-0065-0 SN - 0006-3835 VL - 46 SP - 607 EP - 616 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Somogyvári, Márk A1 - Reich, Sebastian T1 - Convergence tests for transdimensional Markov chains in geoscience imaging JF - Mathematical geosciences : the official journal of the International Association for Mathematical Geosciences N2 - Classic inversion methods adjust a model with a predefined number of parameters to the observed data. With transdimensional inversion algorithms such as the reversible-jump Markov chain Monte Carlo (rjMCMC), it is possible to vary this number during the inversion and to interpret the observations in a more flexible way. Geoscience imaging applications use this behaviour to automatically adjust model resolution to the inhomogeneities of the investigated system, while keeping the model parameters on an optimal level. The rjMCMC algorithm produces an ensemble as result, a set of model realizations, which together represent the posterior probability distribution of the investigated problem. The realizations are evolved via sequential updates from a randomly chosen initial solution and converge toward the target posterior distribution of the inverse problem. Up to a point in the chain, the realizations may be strongly biased by the initial model, and must be discarded from the final ensemble. With convergence assessment techniques, this point in the chain can be identified. Transdimensional MCMC methods produce ensembles that are not suitable for classic convergence assessment techniques because of the changes in parameter numbers. To overcome this hurdle, three solutions are introduced to convert model realizations to a common dimensionality while maintaining the statistical characteristics of the ensemble. A scalar, a vector and a matrix representation for models is presented, inferred from tomographic subsurface investigations, and three classic convergence assessment techniques are applied on them. It is shown that appropriately chosen scalar conversions of the models could retain similar statistical ensemble properties as geologic projections created by rasterization. KW - transdimensional inversion KW - MCMC modelling KW - convergence assessment Y1 - 2019 U6 - https://doi.org/10.1007/s11004-019-09811-x SN - 1874-8961 SN - 1874-8953 VL - 52 IS - 5 SP - 651 EP - 668 PB - Springer CY - Heidelberg ER - TY - JOUR A1 - Taghvaei, Amirhossein A1 - de Wiljes, Jana A1 - Mehta, Prashant G. A1 - Reich, Sebastian T1 - Kalman filter and its modern extensions for the continuous-time nonlinear filtering problem JF - Journal of dynamic systems measurement and control N2 - This paper is concerned with the filtering problem in continuous time. Three algorithmic solution approaches for this problem are reviewed: (i) the classical Kalman-Bucy filter, which provides an exact solution for the linear Gaussian problem; (ii) the ensemble Kalman-Bucy filter (EnKBF), which is an approximate filter and represents an extension of the Kalman-Bucy filter to nonlinear problems; and (iii) the feedback particle filter (FPF), which represents an extension of the EnKBF and furthermore provides for a consistent solution in the general nonlinear, non-Gaussian case. The common feature of the three algorithms is the gain times error formula to implement the update step (to account for conditioning due to the observations) in the filter. In contrast to the commonly used sequential Monte Carlo methods, the EnKBF and FPF avoid the resampling of the particles in the importance sampling update step. Moreover, the feedback control structure provides for error correction potentially leading to smaller simulation variance and improved stability properties. The paper also discusses the issue of nonuniqueness of the filter update formula and formulates a novel approximation algorithm based on ideas from optimal transport and coupling of measures. Performance of this and other algorithms is illustrated for a numerical example. Y1 - 2017 U6 - https://doi.org/10.1115/1.4037780 SN - 0022-0434 SN - 1528-9028 VL - 140 IS - 3 PB - ASME CY - New York ER - TY - JOUR A1 - de Wiljes, Jana A1 - Reich, Sebastian A1 - Stannat, Wilhelm T1 - Long-Time stability and accuracy of the ensemble Kalman-Bucy Filter for fully observed processes and small measurement noise JF - SIAM Journal on Applied Dynamical Systems N2 - The ensemble Kalman filter has become a popular data assimilation technique in the geosciences. However, little is known theoretically about its long term stability and accuracy. In this paper, we investigate the behavior of an ensemble Kalman-Bucy filter applied to continuous-time filtering problems. We derive mean field limiting equations as the ensemble size goes to infinity as well as uniform-in-time accuracy and stability results for finite ensemble sizes. The later results require that the process is fully observed and that the measurement noise is small. We also demonstrate that our ensemble Kalman-Bucy filter is consistent with the classic Kalman-Bucy filter for linear systems and Gaussian processes. We finally verify our theoretical findings for the Lorenz-63 system. KW - data assimilation KW - Kalman Bucy filter KW - ensemble Kalman filter KW - stability KW - accuracy KW - asymptotic behavior Y1 - 2018 U6 - https://doi.org/10.1137/17M1119056 SN - 1536-0040 VL - 17 IS - 2 SP - 1152 EP - 1181 PB - Society for Industrial and Applied Mathematics CY - Philadelphia ER - TY - JOUR A1 - Acevedo, Walter A1 - De Wiljes, Jana A1 - Reich, Sebastian T1 - Second-order accurate ensemble transform particle filters JF - SIAM journal on scientific computing N2 - Particle filters (also called sequential Monte Carlo methods) are widely used for state and parameter estimation problems in the context of nonlinear evolution equations. The recently proposed ensemble transform particle filter (ETPF) [S. Reich, SIAM T. Sci. Comput., 35, (2013), pp. A2013-A2014[ replaces the resampling step of a standard particle filter by a linear transformation which allows for a hybridization of particle filters with ensemble Kalman filters and renders the resulting hybrid filters applicable to spatially extended systems. However, the linear transformation step is computationally expensive and leads to an underestimation of the ensemble spread for small and moderate ensemble sizes. Here we address both of these shortcomings by developing second order accurate extensions of the ETPF. These extensions allow one in particular to replace the exact solution of a linear transport problem by its Sinkhorn approximation. It is also demonstrated that the nonlinear ensemble transform filter arises as a special case of our general framework. We illustrate the performance of the second-order accurate filters for the chaotic Lorenz-63 and Lorenz-96 models and a dynamic scene-viewing model. The numerical results for the Lorenz-63 and Lorenz-96 models demonstrate that significant accuracy improvements can be achieved in comparison to a standard ensemble Kalman filter and the ETPF for small to moderate ensemble sizes. The numerical results for the scene-viewing model reveal, on the other hand, that second-order corrections can lead to statistically inconsistent samples from the posterior parameter distribution. KW - Bayesian inference KW - data assimilation KW - particle filter KW - ensemble Kalman filter KW - Sinkhorn approximation Y1 - 2017 U6 - https://doi.org/10.1137/16M1095184 SN - 1064-8275 SN - 1095-7197 SN - 2168-3417 VL - 39 IS - 5 SP - A1834 EP - A1850 PB - Society for Industrial and Applied Mathematics CY - Philadelphia ER - TY - JOUR A1 - Frank, Jason A1 - Moore, Brian E. A1 - Reich, Sebastian T1 - Linear PDEs and numerical methods that preserve a multisymplectic conservation law N2 - Multisymplectic methods have recently been proposed as a generalization of symplectic ODE methods to the case of Hamiltonian PDEs. Their excellent long time behavior for a variety of Hamiltonian wave equations has been demonstrated in a number of numerical studies. A theoretical investigation and justification of multisymplectic methods is still largely missing. In this paper, we study linear multisymplectic PDEs and their discretization by means of numerical dispersion relations. It is found that multisymplectic methods in the sense of Bridges and Reich [Phys. Lett. A, 284 ( 2001), pp. 184-193] and Reich [J. Comput. Phys., 157 (2000), pp. 473-499], such as Gauss-Legendre Runge-Kutta methods, possess a number of desirable properties such as nonexistence of spurious roots and conservation of the sign of the group velocity. A certain CFL-type restriction on Delta t/Delta x might be required for methods higher than second order in time. It is also demonstrated by means of the explicit midpoint method that multistep methods may exhibit spurious roots in the numerical dispersion relation for any value of Delta t/Delta x despite being multisymplectic in the sense of discrete variational mechanics [J. E. Marsden, G. P. Patrick, and S. Shkoller, Commun. Math. Phys., 199 (1999), pp. 351-395] Y1 - 2006 UR - http://epubs.siam.org/sisc/ U6 - https://doi.org/10.1137/050628271 SN - 1064-8275 ER - TY - JOUR A1 - Shin, Seoleun A1 - Sommer, Matthias A1 - Reich, Sebastian A1 - Névir, Peter T1 - Evaluation of three spatial discretization schemes with the Galewsky et al. test N2 - We evaluate the Hamiltonian particle methods (HPM) and the Nambu discretization applied to shallow-water equations on the sphere using the test suggested by Galewsky et al. (2004). Both simulations show excellent conservation of energy and are stable in long-term simulation. We repeat the test also using the ICOSWP scheme to compare with the two conservative spatial discretization schemes. The HPM simulation captures the main features of the reference solution, but wave 5 pattern is dominant in the simulations applied on the ICON grid with relatively low spatial resolutions. Nevertheless, agreement in statistics between the three schemes indicates their qualitatively similar behaviors in the long-term integration. Y1 - 2010 UR - http://www3.interscience.wiley.com/cgi-bin/jhome/106562719 U6 - https://doi.org/10.1002/Asl.279 SN - 1530-261X ER - TY - GEN A1 - Ascher, Uri M. A1 - Chin, Hongsheng A1 - Reich, Sebastian T1 - Stabilization of DAEs and invariant manifolds N2 - Many methods have been proposed for the stabilization of higher index differential-algebraic equations (DAEs). Such methods often involve constraint differentiation and problem stabilization, thus obtaining a stabilized index reduction. A popular method is Baumgarte stabilization, but the choice of parameters to make it robust is unclear in practice. Here we explain why the Baumgarte method may run into trouble. We then show how to improve it. We further develop a unifying theory for stabilization methods which includes many of the various techniques proposed in the literature. Our approach is to (i) consider stabilization of ODEs with invariants, (ii) discretize the stabilizing term in a simple way, generally different from the ODE discretization, and (iii) use orthogonal projections whenever possible. The best methods thus obtained are related to methods of coordinate projection. We discuss them and make concrete algorithmic suggestions. T3 - Zweitveröffentlichungen der Universität Potsdam : Mathematisch-Naturwissenschaftliche Reihe - paper 030 Y1 - 1994 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-15625 ER -