TY - JOUR A1 - Thapa, Samudrajit A1 - Park, Seongyu A1 - Kim, Yeongjin A1 - Jeon, Jae-Hyung A1 - Metzler, Ralf A1 - Lomholt, Michael A. T1 - Bayesian inference of scaled versus fractional Brownian motion JF - Journal of physics : A, mathematical and theoretical N2 - We present a Bayesian inference scheme for scaled Brownian motion, and investigate its performance on synthetic data for parameter estimation and model selection in a combined inference with fractional Brownian motion. We include the possibility of measurement noise in both models. We find that for trajectories of a few hundred time points the procedure is able to resolve well the true model and parameters. Using the prior of the synthetic data generation process also for the inference, the approach is optimal based on decision theory. We include a comparison with inference using a prior different from the data generating one. KW - Bayesian inference KW - scaled Brownian motion KW - single particle tracking Y1 - 2022 U6 - https://doi.org/10.1088/1751-8121/ac60e7 SN - 1751-8113 SN - 1751-8121 VL - 55 IS - 19 PB - IOP Publ. Ltd. CY - Bristol ER - TY - JOUR A1 - Malem-Shinitski, Noa A1 - Ojeda, Cesar A1 - Opper, Manfred T1 - Variational bayesian inference for nonlinear hawkes process with gaussian process self-effects JF - Entropy N2 - Traditionally, Hawkes processes are used to model time-continuous point processes with history dependence. Here, we propose an extended model where the self-effects are of both excitatory and inhibitory types and follow a Gaussian Process. Whereas previous work either relies on a less flexible parameterization of the model, or requires a large amount of data, our formulation allows for both a flexible model and learning when data are scarce. We continue the line of work of Bayesian inference for Hawkes processes, and derive an inference algorithm by performing inference on an aggregated sum of Gaussian Processes. Approximate Bayesian inference is achieved via data augmentation, and we describe a mean-field variational inference approach to learn the model parameters. To demonstrate the flexibility of the model we apply our methodology on data from different domains and compare it to previously reported results. KW - Bayesian inference KW - point process KW - Gaussian process Y1 - 2022 U6 - https://doi.org/10.3390/e24030356 SN - 1099-4300 VL - 24 IS - 3 PB - MDPI CY - Basel ER - TY - JOUR A1 - Schad, Daniel A1 - Vasishth, Shravan T1 - The posterior probability of a null hypothesis given a statistically significant result JF - The quantitative methods for psychology N2 - When researchers carry out a null hypothesis significance test, it is tempting to assume that a statistically significant result lowers Prob(H0), the probability of the null hypothesis being true. Technically, such a statement is meaningless for various reasons: e.g., the null hypothesis does not have a probability associated with it. However, it is possible to relax certain assumptions to compute the posterior probability Prob(H0) under repeated sampling. We show in a step-by-step guide that the intuitively appealing belief, that Prob(H0) is low when significant results have been obtained under repeated sampling, is in general incorrect and depends greatly on: (a) the prior probability of the null being true; (b) type-I error rate, (c) type-II error rate, and (d) replication of a result. Through step-by-step simulations using open-source code in the R System of Statistical Computing, we show that uncertainty about the null hypothesis being true often remains high despite a significant result. To help the reader develop intuitions about this common misconception, we provide a Shiny app (https://danielschad.shinyapps.io/probnull/). We expect that this tutorial will help researchers better understand and judge results from null hypothesis significance tests. KW - Null hypothesis significance testing KW - Bayesian inference KW - statistical KW - power Y1 - 2022 U6 - https://doi.org/10.20982/tqmp.18.2.p011 SN - 1913-4126 SN - 2292-1354 VL - 18 IS - 2 SP - 130 EP - 141 PB - University of Montreal, Department of Psychology CY - Montreal ER - TY - JOUR A1 - Berner, Nadine A1 - Trauth, Martin H. A1 - Holschneider, Matthias T1 - Bayesian inference about Plio-Pleistocene climate transitions in Africa JF - Quaternary science reviews : the international multidisciplinary research and review journal N2 - During the last 5 Ma the Earth's ocean-atmosphere system passed through several major transitions, many of which are discussed as possible triggers for human evolution. A classic in this context is the possible influence of the closure of the Panama Strait, the intensification of Northern Hemisphere Glaciation, a stepwise increase in aridity in Africa, and the first appearance of the genus Homo about 2.5 - 2.7 Ma ago. Apart from the fact that the correlation between these events does not necessarily imply causality, many attempts to establish a relationship between climate and evolution fail due to the challenge of precisely localizing an a priori unknown number of changes potentially underlying complex climate records. The kernel-based Bayesian inference approach applied here allows inferring the location, generic shape, and temporal scale of multiple transitions in established records of Plio-Pleistocene African climate. By defining a transparent probabilistic analysis strategy, we are able to identify conjoint changes occurring across the investigated terrigenous dust records from Ocean Drilling Programme (ODP) sites in the Atlantic Ocean (ODP 659), Arabian (ODP 721/722) and Mediterranean Sea (ODP 967). The study indicates a two-step transition in the African climate proxy records at (2.35-2.10) Ma and (1.70 - 1.50) Ma, that may be associated with the reorganization of the Hadley-Walker Circulation. . KW - Plio-Pleistocene KW - Hadley-Walker Circulation KW - climate transition KW - Bayesian inference KW - time series analysis KW - ODP 659 KW - ODP 721/722 KW - ODP 967 Y1 - 2022 U6 - https://doi.org/10.1016/j.quascirev.2021.107287 SN - 0277-3791 SN - 1873-457X VL - 277 PB - Elsevier CY - Oxford ER - TY - JOUR A1 - Seelig, Stefan A. A1 - Rabe, Maximilian Michael A1 - Malem-Shinitski, Noa A1 - Risse, Sarah A1 - Reich, Sebastian A1 - Engbert, Ralf T1 - Bayesian parameter estimation for the SWIFT model of eye-movement control during reading JF - Journal of mathematical psychology N2 - Process-oriented theories of cognition must be evaluated against time-ordered observations. Here we present a representative example for data assimilation of the SWIFT model, a dynamical model of the control of fixation positions and fixation durations during natural reading of single sentences. First, we develop and test an approximate likelihood function of the model, which is a combination of a spatial, pseudo-marginal likelihood and a temporal likelihood obtained by probability density approximation Second, we implement a Bayesian approach to parameter inference using an adaptive Markov chain Monte Carlo procedure. Our results indicate that model parameters can be estimated reliably for individual subjects. We conclude that approximative Bayesian inference represents a considerable step forward for computational models of eye-movement control, where modeling of individual data on the basis of process-based dynamic models has not been possible so far. KW - dynamical models KW - reading KW - eye movements KW - saccades KW - likelihood function KW - Bayesian inference KW - MCMC KW - interindividual differences Y1 - 2020 U6 - https://doi.org/10.1016/j.jmp.2019.102313 SN - 0022-2496 SN - 1096-0880 VL - 95 PB - Elsevier CY - San Diego ER - TY - JOUR A1 - Acevedo, Walter A1 - De Wiljes, Jana A1 - Reich, Sebastian T1 - Second-order accurate ensemble transform particle filters JF - SIAM journal on scientific computing N2 - Particle filters (also called sequential Monte Carlo methods) are widely used for state and parameter estimation problems in the context of nonlinear evolution equations. The recently proposed ensemble transform particle filter (ETPF) [S. Reich, SIAM T. Sci. Comput., 35, (2013), pp. A2013-A2014[ replaces the resampling step of a standard particle filter by a linear transformation which allows for a hybridization of particle filters with ensemble Kalman filters and renders the resulting hybrid filters applicable to spatially extended systems. However, the linear transformation step is computationally expensive and leads to an underestimation of the ensemble spread for small and moderate ensemble sizes. Here we address both of these shortcomings by developing second order accurate extensions of the ETPF. These extensions allow one in particular to replace the exact solution of a linear transport problem by its Sinkhorn approximation. It is also demonstrated that the nonlinear ensemble transform filter arises as a special case of our general framework. We illustrate the performance of the second-order accurate filters for the chaotic Lorenz-63 and Lorenz-96 models and a dynamic scene-viewing model. The numerical results for the Lorenz-63 and Lorenz-96 models demonstrate that significant accuracy improvements can be achieved in comparison to a standard ensemble Kalman filter and the ETPF for small to moderate ensemble sizes. The numerical results for the scene-viewing model reveal, on the other hand, that second-order corrections can lead to statistically inconsistent samples from the posterior parameter distribution. KW - Bayesian inference KW - data assimilation KW - particle filter KW - ensemble Kalman filter KW - Sinkhorn approximation Y1 - 2017 U6 - https://doi.org/10.1137/16M1095184 SN - 1064-8275 SN - 1095-7197 SN - 2168-3417 VL - 39 IS - 5 SP - A1834 EP - A1850 PB - Society for Industrial and Applied Mathematics CY - Philadelphia ER - TY - JOUR A1 - Garbuno-Inigo, Alfredo A1 - Nüsken, Nikolas A1 - Reich, Sebastian T1 - Affine invariant interacting Langevin dynamics for Bayesian inference JF - SIAM journal on applied dynamical systems N2 - We propose a computational method (with acronym ALDI) for sampling from a given target distribution based on first-order (overdamped) Langevin dynamics which satisfies the property of affine invariance. The central idea of ALDI is to run an ensemble of particles with their empirical covariance serving as a preconditioner for their underlying Langevin dynamics. ALDI does not require taking the inverse or square root of the empirical covariance matrix, which enables application to high-dimensional sampling problems. The theoretical properties of ALDI are studied in terms of nondegeneracy and ergodicity. Furthermore, we study its connections to diffusion on Riemannian manifolds and Wasserstein gradient flows. Bayesian inference serves as a main application area for ALDI. In case of a forward problem with additive Gaussian measurement errors, ALDI allows for a gradient-free approximation in the spirit of the ensemble Kalman filter. A computational comparison between gradient-free and gradient-based ALDI is provided for a PDE constrained Bayesian inverse problem. KW - Langevin dynamics KW - interacting particle systems KW - Bayesian inference KW - gradient flow KW - multiplicative noise KW - affine invariance KW - gradient-free Y1 - 2020 U6 - https://doi.org/10.1137/19M1304891 SN - 1536-0040 VL - 19 IS - 3 SP - 1633 EP - 1658 PB - Society for Industrial and Applied Mathematics CY - Philadelphia ER - TY - JOUR A1 - Rabe, Maximilian Michael A1 - Chandra, Johan A1 - Krügel, André A1 - Seelig, Stefan A. A1 - Vasishth, Shravan A1 - Engbert, Ralf T1 - A bayesian approach to dynamical modeling of eye-movement control in reading of normal, mirrored, and scrambled texts JF - Psychological Review N2 - In eye-movement control during reading, advanced process-oriented models have been developed to reproduce behavioral data. So far, model complexity and large numbers of model parameters prevented rigorous statistical inference and modeling of interindividual differences. Here we propose a Bayesian approach to both problems for one representative computational model of sentence reading (SWIFT; Engbert et al., Psychological Review, 112, 2005, pp. 777-813). We used experimental data from 36 subjects who read the text in a normal and one of four manipulated text layouts (e.g., mirrored and scrambled letters). The SWIFT model was fitted to subjects and experimental conditions individually to investigate between- subject variability. Based on posterior distributions of model parameters, fixation probabilities and durations are reliably recovered from simulated data and reproduced for withheld empirical data, at both the experimental condition and subject levels. A subsequent statistical analysis of model parameters across reading conditions generates model-driven explanations for observable effects between conditions. KW - reading eye movements KW - dynamical models KW - Bayesian inference KW - oculomotor KW - control KW - individual differences Y1 - 2021 U6 - https://doi.org/10.1037/rev0000268 SN - 0033-295X SN - 1939-1471 VL - 128 IS - 5 SP - 803 EP - 823 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Rosenbaum, Benjamin A1 - Raatz, Michael A1 - Weithoff, Guntram A1 - Fussmann, Gregor F. A1 - Gaedke, Ursula T1 - Estimating parameters from multiple time series of population dynamics using bayesian inference JF - Frontiers in ecology and evolution N2 - Empirical time series of interacting entities, e.g., species abundances, are highly useful to study ecological mechanisms. Mathematical models are valuable tools to further elucidate those mechanisms and underlying processes. However, obtaining an agreement between model predictions and experimental observations remains a demanding task. As models always abstract from reality one parameter often summarizes several properties. Parameter measurements are performed in additional experiments independent of the ones delivering the time series. Transferring these parameter values to different settings may result in incorrect parametrizations. On top of that, the properties of organisms and thus the respective parameter values may vary considerably. These issues limit the use of a priori model parametrizations. In this study, we present a method suited for a direct estimation of model parameters and their variability from experimental time series data. We combine numerical simulations of a continuous-time dynamical population model with Bayesian inference, using a hierarchical framework that allows for variability of individual parameters. The method is applied to a comprehensive set of time series from a laboratory predator-prey system that features both steady states and cyclic population dynamics. Our model predictions are able to reproduce both steady states and cyclic dynamics of the data. Additionally to the direct estimates of the parameter values, the Bayesian approach also provides their uncertainties. We found that fitting cyclic population dynamics, which contain more information on the process rates than steady states, yields more precise parameter estimates. We detected significant variability among parameters of different time series and identified the variation in the maximum growth rate of the prey as a source for the transition from steady states to cyclic dynamics. By lending more flexibility to the model, our approach facilitates parametrizations and shows more easily which patterns in time series can be explained also by simple models. Applying Bayesian inference and dynamical population models in conjunction may help to quantify the profound variability in organismal properties in nature. KW - Bayesian inference KW - chemostat experiments KW - ordinary differential equation KW - parameter estimation KW - population dynamics KW - predator prey KW - time series analysis KW - trait variability Y1 - 2019 U6 - https://doi.org/10.3389/fevo.2018.00234 SN - 2296-701X VL - 6 PB - Frontiers Research Foundation CY - Lausanne ER - TY - JOUR A1 - Savoy, Heather A1 - Heße, Falk T1 - Dimension reduction for integrating data series in Bayesian inversion of geostatistical models JF - Stochastic environmental research and risk assessment N2 - This study explores methods with which multidimensional data, e.g. time series, can be effectively incorporated into a Bayesian framework for inferring geostatistical parameters. Such series are difficult to use directly in the likelihood estimation procedure due to their high dimensionality; thus, a dimension reduction approach is taken to utilize these measurements in the inference. Two synthetic scenarios from hydrology are explored in which pumping drawdown and concentration breakthrough curves are used to infer the global mean of a log-normally distributed hydraulic conductivity field. Both cases pursue the use of a parametric model to represent the shape of the observed time series with physically-interpretable parameters (e.g. the time and magnitude of a concentration peak), which is compared to subsets of the observations with similar dimensionality. The results from both scenarios highlight the effectiveness for the shape-matching models to reduce dimensionality from 100+ dimensions down to less than five. The models outperform the alternative subset method, especially when the observations are noisy. This approach to incorporating time series observations in the Bayesian framework for inferring geostatistical parameters allows for high-dimensional observations to be faithfully represented in lower-dimensional space for the non-parametric likelihood estimation procedure, which increases the applicability of the framework to more observation types. Although the scenarios are both from hydrogeology, the methodology is general in that no assumptions are made about the subject domain. Any application that requires the inference of geostatistical parameters using series in either time of space can use the approach described in this paper. KW - Geostatistics KW - Stochastic hydrogeology KW - Dimension reduction KW - Bayesian inference Y1 - 2019 U6 - https://doi.org/10.1007/s00477-019-01697-9 SN - 1436-3240 SN - 1436-3259 VL - 33 IS - 7 SP - 1327 EP - 1344 PB - Springer CY - New York ER -