Refine
Year of publication
Document Type
- Article (56)
- Postprint (14)
- Monograph/Edited Volume (1)
- Review (1)
Keywords
- ensemble Kalman filter (8)
- data assimilation (7)
- Bayesian inference (6)
- Data assimilation (3)
- GNSS Reflectometry (3)
- gradient flow (3)
- localization (3)
- wind speed (3)
- DDM simulation (2)
- Ensemble Kalman filter (2)
- Fokker-Planck equation (2)
- continuous-time data assimilation (2)
- correlated noise (2)
- eye movements (2)
- multi-scale diffusion processes (2)
- multiplicative noise (2)
- nonlinear filtering (2)
- optimal transport (2)
- parameter estimation (2)
- rain attenuation (2)
- rain effect (2)
- sequential data assimilation (2)
- Advanced scatterometer (ASCAT) (1)
- Atmosphere (1)
- Bayesian inverse problems (1)
- COVID-19 (1)
- CRPS (1)
- Data augmentation (1)
- Data-driven modelling (1)
- Dynamical systems (1)
- Earthquake modeling (1)
- Ensemble Kalman (1)
- Ensemble Kalman Filter (1)
- Error analysis (1)
- European Centre for Medium-Range Weather Forecasts (ECMWF) (1)
- Force splitting (1)
- Fuzzy logic (1)
- GNSS forward scatterometry (1)
- GNSS reflectometry (1)
- Gaussian kernel estimators (1)
- Gaussian mixtures (1)
- Gaussian process (1)
- Generalized hybrid Monte Carlo (1)
- Hamiltonian dynamics (1)
- Hawkes process (1)
- Kalman Bucy filter (1)
- Kalman filter (1)
- Kalman-Bucy Filter (1)
- Lagrangian modeling (1)
- Lagrangian modelling (1)
- Lagrangian-averaged equations (1)
- Langevin dynamics (1)
- MCMC (1)
- MCMC modelling (1)
- McKean-Vlasov (1)
- Modified Hamiltonians (1)
- Molecular dynamics (1)
- Mollification (1)
- Monte Carlo method (1)
- Multigrid (1)
- Multiple time stepping (1)
- NWP (1)
- Nonlinear filters (1)
- Numerical weather prediction (1)
- Optimal transportation (1)
- Paleoclimate reconstruction (1)
- Poincare inequality (1)
- Proxy forward modeling (1)
- RMSE (1)
- Random feature maps (1)
- Sampling (1)
- Self-exciting point process (1)
- Sequential data assimilation (1)
- Sinkhorn approximation (1)
- Sinkhorn problem (1)
- Spatio-temporal ETAS model (1)
- Spectral analysis (1)
- Stochastic epidemic model (1)
- Stormer-Verlet method (1)
- Strike-slip fault model (1)
- TDS-1 (1)
- TechDemoSat-1 (TDS-1) (1)
- Turbulence (1)
- accuracy (1)
- adaptive (1)
- affine (1)
- affine invariance (1)
- asymptotic behavior (1)
- balanced dynamics (1)
- canonical discretization schemes (1)
- chemistry (1)
- climate reconstructions (1)
- co-limitation (1)
- conservative discretization (1)
- constrained Hamiltonian systems (1)
- convergence assessment (1)
- derivative-free optimization (1)
- differential-algebraic equations (1)
- diffusion maps (1)
- distribution (1)
- dynamical model (1)
- dynamical models (1)
- electromagnetic scattering (1)
- ensemble (1)
- ensembles (1)
- feedback particle filter (1)
- filter (1)
- fluid mechanics (1)
- forecasting (1)
- framework (1)
- fuzzy logic (1)
- geophysics (1)
- gradient-free (1)
- gradient-free sampling methods (1)
- graph Laplacian (1)
- high resolution paleoclimatology (1)
- highly (1)
- holonomic constraints (1)
- hybrids (1)
- hydrostatic atmosphere (1)
- idealised turbulence (1)
- interacting particle system (1)
- interacting particle systems (1)
- interacting particles (1)
- interindividual differences (1)
- invariance (1)
- inverse problem (1)
- kernel methods (1)
- likelihood (1)
- likelihood function (1)
- limiting factors (1)
- linear programming (1)
- linearly implicit time stepping methods (1)
- mean-field dynamical system (1)
- mean-field equations (1)
- mesoscale forecasting (1)
- model comparison (1)
- model fitting (1)
- models (1)
- multilevel Monte Carlo (1)
- non-dissipative regularisations (1)
- nonlinear data assimilation (1)
- numerical analysis/modeling (1)
- numerical weather prediction (1)
- numerical weather prediction/forecasting (1)
- ocean surface (1)
- oscillatory systems (1)
- paleoclimate reconstruction (1)
- particle filter (1)
- particle filters (1)
- proposal densities (1)
- proxy forward modeling (1)
- rain detection (1)
- rain splash (1)
- reading (1)
- reanalysis (1)
- regularization (1)
- resampling (1)
- saccades (1)
- semi-Lagrangian method (1)
- shallow-water equations (1)
- short-range prediction (1)
- smoother (1)
- sparse proxy data (1)
- spread correction (1)
- stability (1)
- stiff ODE (1)
- stochastic differential equations (1)
- stochastic systems (1)
- symplectic methods (1)
- temporal discretization (1)
- transdimensional inversion (1)
- transformations (1)
- uncertainty quantification (1)
- variability (1)
- verification (1)
- weight-based formulations (1)
- well-posedness (1)
Institute
Towards the assimilation of tree-ring-width records using ensemble Kalman filtering techniques
(2015)
This paper investigates the applicability of the Vaganov–Shashkin–Lite (VSL) forward model for tree-ring-width chronologies as observation operator within a proxy data assimilation (DA) setting. Based on the principle of limiting factors, VSL combines temperature and moisture time series in a nonlinear fashion to obtain simulated TRW chronologies. When used as observation operator, this modelling approach implies three compounding, challenging features: (1) time averaging, (2) “switching recording” of 2 variables and (3) bounded response windows leading to “thresholded response”. We generate pseudo-TRW observations from a chaotic 2-scale dynamical system, used as a cartoon of the atmosphere-land system, and attempt to assimilate them via ensemble Kalman filtering techniques. Results within our simplified setting reveal that VSL’s nonlinearities may lead to considerable loss of assimilation skill, as compared to the utilization of a time-averaged (TA) linear observation operator. In order to understand this undesired effect, we embed VSL’s formulation into the framework of fuzzy logic (FL) theory, which thereby exposes multiple representations of the principle of limiting factors. DA experiments employing three alternative growth rate functions disclose a strong link between the lack of smoothness of the growth rate function and the loss of optimality in the estimate of the TA state. Accordingly, VSL’s performance as observation operator can be enhanced by resorting to smoother FL representations of the principle of limiting factors. This finding fosters new interpretations of tree-ring-growth limitation processes.
Towards the assimilation of tree-ring-width records using ensemble Kalman filtering techniques
(2016)
This paper investigates the applicability of the Vaganov–Shashkin–Lite (VSL) forward model for tree-ring-width chronologies as observation operator within a proxy data assimilation (DA) setting. Based on the principle of limiting factors, VSL combines temperature and moisture time series in a nonlinear fashion to obtain simulated TRW chronologies. When used as observation operator, this modelling approach implies three compounding, challenging features: (1) time averaging, (2) “switching recording” of 2 variables and (3) bounded response windows leading to “thresholded response”. We generate pseudo-TRW observations from a chaotic 2-scale dynamical system, used as a cartoon of the atmosphere-land system, and attempt to assimilate them via ensemble Kalman filtering techniques. Results within our simplified setting reveal that VSL’s nonlinearities may lead to considerable loss of assimilation skill, as compared to the utilization of a time-averaged (TA) linear observation operator. In order to understand this undesired effect, we embed VSL’s formulation into the framework of fuzzy logic (FL) theory, which thereby exposes multiple representations of the principle of limiting factors. DA experiments employing three alternative growth rate functions disclose a strong link between the lack of smoothness of the growth rate function and the loss of optimality in the estimate of the TA state. Accordingly, VSL’s performance as observation operator can be enhanced by resorting to smoother FL representations of the principle of limiting factors. This finding fosters new interpretations of tree-ring-growth limitation processes.
TDS-1 GNSS Reflectometry
(2018)
This study presents the development and a systematic evaluation study of GNSS reflectometry wind speeds. After establishing a wind speed retrieval algorithm, UK TechDemoSat-1 (TDS-1) derived winds, from May 2015 to July 2017, are compared to the Advanced Scatterometer (ASCAT). ERA-Interim wind fields of the European Centre for Medium-range Weather Forecasts (ECMWF) and in situ observation from Tropical Atmosphere Ocean buoy array in the Pacific are taken as reference. One-year averaged TDS-1 global winds demonstrate small differences with ECMWF in a majority of areas as well as discuss under- and overestimations. The pioneering TDS-1 winds demonstrate a root-mean-squared error (RMSE) and bias of 2.77 and -0.33 m/s, which are comparable to the RMSE and bias derived by ASCAT winds, as large as 2.31 and 0.25 m/s, respectively. Using buoys measurements as reference, RMSE and bias of 2.23 and -0.03 m/s for TDS-1 as well as 1.40 and -0.68 m/s for ASCAT are obtained. Utilizing rain microwave-infrared estimates of the Tropical Rainfall Measuring Mission, rain-affected observation of both ASCAT and TDS-1 are collected and evaluated. Although ASCAT winds show a significant performance degradation resulting in an RMSE and bias of 3.16 and 1.03 m/s, respectively, during rain condition, TDS-1 shows a more reliable performance with an RMSE and bias of 2.94 and -0.21 m/s, respectively, which indicates the promising capability of GNSS forward scattering for wind retrievals during rain. A decrease in TDS-1-derived bistatic radar cross sections during rain events, at weak winds, is also demonstrated.
A Hamiltonian system in potential form (formula in the original abstract) subject to smooth constraints on q can be viewed as a Hamiltonian system on a manifold, but numerical computations must be performed in Rn. In this paper methods which reduce "Hamiltonian differential algebraic equations" to ODEs in Euclidean space are examined. The authors study the construction of canonical parameterizations or local charts as well as methods based on the construction of ODE systems in the space in which the constraint manifold is embedded which preserve the constraint manifold as an invariant manifold. In each case, a Hamiltonian system of ordinary differential equations is produced. The stability of the constraint invariants and the behavior of the original Hamiltonian along solutions are investigated both numerically and analytically.
Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of research data-assimilation has been successfully used to optimally combine forecast models and their inherent uncertainty with incoming noisy observations. The key idea in our work here is to achieve increased forecast capabilities by judiciously combining machine-learning algorithms and data assimilation. We combine the physics-agnostic data -driven approach of random feature maps as a forecast model within an ensemble Kalman filter data assimilation procedure. The machine-learning model is learned sequentially by incorporating incoming noisy observations. We show that the obtained forecast model has remarkably good forecast skill while being computationally cheap once trained. Going beyond the task of forecasting, we show that our method can be used to generate reliable ensembles for probabilistic forecasting as well as to learn effective model closure in multi-scale systems. (C) 2021 Elsevier B.V. All rights reserved.
The success of the ensemble Kalman filter has triggered a strong interest in expanding its scope beyond classical state estimation problems. In this paper, we focus on continuous-time data assimilation where the model and measurement errors are correlated and both states and parameters need to be identified. Such scenarios arise from noisy and partial observations of Lagrangian particles which move under a stochastic velocity field involving unknown parameters. We take an appropriate class of McKean–Vlasov equations as the starting point to derive ensemble Kalman–Bucy filter algorithms for combined state and parameter estimation. We demonstrate their performance through a series of increasingly complex multi-scale model systems.
The success of the ensemble Kalman filter has triggered a strong interest in expanding its scope beyond classical state estimation problems. In this paper, we focus on continuous-time data assimilation where the model and measurement errors are correlated and both states and parameters need to be identified. Such scenarios arise from noisy and partial observations of Lagrangian particles which move under a stochastic velocity field involving unknown parameters. We take an appropriate class of McKean-Vlasov equations as the starting point to derive ensemble Kalman-Bucy filter algorithms for combined state and parameter estimation. We demonstrate their performance through a series of increasingly complex multi-scale model systems.
Many methods have been proposed for the stabilization of higher index differential-algebraic equations (DAEs). Such methods often involve constraint differentiation and problem stabilization, thus obtaining a stabilized index reduction. A popular method is Baumgarte stabilization, but the choice of parameters to make it robust is unclear in practice. Here we explain why the Baumgarte method may run into trouble. We then show how to improve it. We further develop a unifying theory for stabilization methods which includes many of the various techniques proposed in the literature. Our approach is to (i) consider stabilization of ODEs with invariants, (ii) discretize the stabilizing term in a simple way, generally different from the ODE discretization, and (iii) use orthogonal projections whenever possible. The best methods thus obtained are related to methods of coordinate projection. We discuss them and make concrete algorithmic suggestions.
Many methods have been proposed for the simulation of constrained mechanical systems. The most obvious of these have mild instabilities and drift problems. Consequently, stabilization techniques have been proposed A popular stabilization method is Baumgarte's technique, but the choice of parameters to make it robust has been unclear in practice. Some of the simulation methods that have been proposed and used in computations are reviewed here, from a stability point of view. This involves concepts of differential-algebraic equation (DAE) and ordinary differential equation (ODE) invariants. An explanation of the difficulties that may be encountered using Baumgarte's method is given, and a discussion of why a further quest for better parameter values for this method will always remain frustrating is presented. It is then shown how Baumgarte's method can be improved. An efficient stabilization technique is proposed, which may employ explicit ODE solvers in case of nonstiff or highly oscillatory problems and which relates to coordinate projection methods. Examples of a two-link planar robotic arm and a squeezing mechanism illustrate the effectiveness of this new stabilization method.
Diffusion maps is a manifold learning algorithm widely used for dimensionality reduction. Using a sample from a distribution, it approximates the eigenvalues and eigenfunctions of associated Laplace-Beltrami operators. Theoretical bounds on the approximation error are, however, generally much weaker than the rates that are seen in practice. This paper uses new approaches to improve the error bounds in the model case where the distribution is supported on a hypertorus. For the data sampling (variance) component of the error we make spatially localized compact embedding estimates on certain Hardy spaces; we study the deterministic (bias) component as a perturbation of the Laplace-Beltrami operator's associated PDE and apply relevant spectral stability results. Using these approaches, we match long-standing pointwise error bounds for both the spectral data and the norm convergence of the operator discretization. We also introduce an alternative normalization for diffusion maps based on Sinkhorn weights. This normalization approximates a Langevin diffusion on the sample and yields a symmetric operator approximation. We prove that it has better convergence compared with the standard normalization on flat domains, and we present a highly efficient rigorous algorithm to compute the Sinkhorn weights.