Refine
Document Type
- Article (14)
- Doctoral Thesis (1)
- Other (1)
- Postprint (1)
Language
- English (17)
Is part of the Bibliography
- yes (17)
Keywords
- radiation belts (3)
- Kalman filter (2)
- geomagnetic observatory data (2)
- geomagnetic storm drivers (2)
- historical geomagnetic storms (2)
- machine learning (2)
- neural networks (2)
- plasma density (2)
- supervised machine learning (2)
- 7924 (1)
Institute
Abstract
In recent years, feedforward neural networks (NNs) have been successfully applied to reconstruct global plasmasphere dynamics in the equatorial plane. These neural network‐based models capture the large‐scale dynamics of the plasmasphere, such as plume formation and erosion of the plasmasphere on the nightside. However, their performance depends strongly on the availability of training data. When the data coverage is limited or non‐existent, as occurs during geomagnetic storms, the performance of NNs significantly decreases, as networks inherently cannot learn from the limited number of examples. This limitation can be overcome by employing physics‐based modeling during strong geomagnetic storms. Physics‐based models show a stable performance during periods of disturbed geomagnetic activity if they are correctly initialized and configured. In this study, we illustrate how to combine the neural network‐ and physics‐based models of the plasmasphere in an optimal way by using data assimilation. The proposed approach utilizes advantages of both neural network‐ and physics‐based modeling and produces global plasma density reconstructions for both quiet and disturbed geomagnetic activity, including extreme geomagnetic storms. We validate the models quantitatively by comparing their output to the in‐situ density measurements from RBSP‐A for an 18‐month out‐of‐sample period from June 30, 2016 to January 01, 2018 and computing performance metrics. To validate the global density reconstructions qualitatively, we compare them to the IMAGE EUV images of the He+ particle distribution in the Earth's plasmasphere for a number of events in the past, including the Halloween storm in 2003.
We present a reconstruction of the dynamics of the radiation belts from solar cycles 17 to 24 which allows us to study how radiation belt activity has varied between the different solar cycles. The radiation belt simulations are produced using the Versatile Electron Radiation Belt (VERB)-3D code. The VERB-3D code simulations incorporate radial, energy, and pitch angle diffusion to reproduce the radiation belts. Our simulations use the historical measurements of Kp (available since solar cycle 17, i.e., 1933) to model the evolution radiation belt dynamics between L* = 1-6.6. A nonlinear auto regressive network with exogenous inputs (NARX) neural network was trained off GOES 15 measurements (January 2011-March 2014) and used to supply the upper boundary condition (L* = 6.6) over the course of solar cycles 17-24 (i.e., 1933-2017). Comparison of the model with long term observations of the Van Allen Probes and CRRES demonstrates that our model, driven by the NARX boundary, can reconstruct the general evolution of the radiation belt fluxes. Solar cycle 24 (January 2008-2017) has been the least active of the considered solar cycles which resulted in unusually low electron fluxes. Our results show that solar cycle 24 should not be used as a representative solar cycle for developing long term environment models. The developed reconstruction of fluxes can be used to develop or improve empirical models of the radiation belts.
Using over-5-year EMFISIS wave measurements from Van Allen Probes, we present a detailed survey to identify the controlling factors among the geomagnetic indices and solar wind parameters for the 1-min root mean square amplitudes of lower band chorus (LBC) and upper band chorus (UBC).
A set of important features are automatically determined by feature selection techniques, namely, Random Forest and Maximum Relevancy Minimum Redundancy. Our analysis results indicate the AE index with zero-time-delay dominates the intensity evolution of LBC and UBC, consistent with the evidence that chorus waves prefer to occur and amplify during enhanced substorm periods. Regarding solar wind parameters, solar wind speed and IMF B-z are identified as the controlling factors for chorus wave intensity. Using the combination of all these important features, a predictive neural network model of chorus wave intensity is established to reconstruct the temporal variations of chorus wave intensity, for which application of Random Forest produces the overall best performance.
Plain Language Summary
Whistler mode chorus waves are electromagnetic waves observed in the low-density region near the geomagnetic equator outside the plasmapause. The dynamics of Earth's radiation belts are largely influenced by chorus waves owing to their dual contributions to both radiation belt electron acceleration and loss. In this study, we use feature selection techniques to identify the controlling geomagnetic and solar wind factors for magnetospheric chorus waves. Feature selection techniques implement the processes which can select the features most influential to the output.
In this study, the inputs are geomagnetic indices and solar wind parameters and the output is the chorus wave intensity. The results indicate that AE index with zerotime delay dominates the chorus wave intensity. Furthermore, solar wind speed and IMF B-z are identified as the most important solar wind drivers for chorus wave intensity.
On basis of the combination of all these important geomagnetic and solar wind controlling factors, we develop a neural network model of chorus wave intensity, and find that the model with the inputs identified using the Random Forest method produces the overall best performance.
Van Allen Probes measurements revealed the presence of the most unusual structures in the ultra-relativistic radiation belts. Detailed modeling, analysis of pitch angle distributions, analysis of the difference between relativistic and ultra-realistic electron evolution, along with theoretical studies of the scattering and wave growth, all indicate that electromagnetic ion cyclotron (EMIC) waves can produce a very efficient loss of the ultra-relativistic electrons in the heart of the radiation belts. Moreover, a detailed analysis of the profiles of phase space densities provides direct evidence for localized loss by EMIC waves. The evolution of multi-MeV fluxes shows dramatic and very sudden enhancements of electrons for selected storms. Analysis of phase space density profiles reveals that growing peaks at different values of the first invariant are formed at approximately the same radial distance from the Earth and show the sequential formation of the peaks from lower to higher energies, indicating that local energy diffusion is the dominant source of the acceleration from MeV to multi-MeV energies. Further simultaneous analysis of the background density and ultra-relativistic electron fluxes shows that the acceleration to multi-MeV energies only occurs when plasma density is significantly depleted outside of the plasmasphere, which is consistent with the modeling of acceleration due to chorus waves.
We present two new empirical models of radiation belt electron flux at geostationary orbit. GOES-15 measurements of 0.8 MeV electrons were used to train a Nonlinear Autoregressive with Exogenous input (NARX) neural network for both modeling GOES-15 flux values and an upper boundary condition scaling factor (BF). The GOES-15 flux model utilizes an input and feedback delay of 2 and 2 time steps (i.e., 5 min time steps) with the most efficient number of hidden layers set to 10. Magnetic local time, Dst, Kp, solar wind dynamic pressure, AE, and solar wind velocity were found to perform as predicative indicators of GOES-15 flux and therefore were used as the exogenous inputs. The NARX-derived upper boundary condition scaling factor was used in conjunction with the Versatile Electron Radiation Belt (VERB) code to produce reconstructions of the radiation belts during the period of July-November 1990, independent of in-situ observations. Here, Kp was chosen as the sole exogenous input to be more compatible with the VERB code. This Combined Release and Radiation Effects Satellite-era reconstruction showcases the potential to use these neural network-derived boundary conditions as a method of hindcasting the historical radiation belts. This study serves as a companion paper to another recently published study on reconstructing the radiation belts during Solar Cycles 17-24 (Saikin et al., 2021, ), for which the results featured in this paper were used.
The investigation of heavy ions dynamics and properties in the Earth's magnetosphere is still an important field of research as they play an important role in several space weather aspects. We present a statistical survey of the average ion mass in the dayside magnetosphere made comparing plasma mass density with electron number density measurements and focusing on both spatial and geomagnetic activity dependence. Field line resonance frequency observations across the European quasi-Meridional Magnetometer Array, are used to infer the equatorial plasma mass density in the range of magnetic L-shells 1.6-6.2. The electron number density is derived from local electric field measurements made on Van Allen Probes using the Neural-network-based Upper-hybrid Resonance Determination algorithm. The analysis is conducted separately for the plasmasphere and the plasmatrough during favorable periods for which both the plasma parameters are observed simultaneously. We found that throughout the plasmasphere the average ion mass is similar or equal to 1 amu for a wide range of geomagnetic activity conditions, suggesting that the plasma mainly consist of hydrogen ions, without regard to the level of geomagnetic activity. Conversely, the plasmatrough is characterized by a variable composition, highlighting a heavy ion mass loading that increases with increasing levels of geomagnetic disturbance. During the most disturbed conditions, the average radial structure shows a broad maximum around 3-4 Earth radii, probably correlated with the accumulation of oxygen ions near the plasmapause. Those ions are mostly observed in the post-dawn and pre-dusk longitudinal sectors.
The radiation belts of the Earth, filled with energetic electrons, comprise complex and dynamic systems that pose a significant threat to satellite operation. While various models of electron flux both for low and relativistic energies have been developed, the behavior of medium energy (120-600 keV) electrons, especially in the MEO region, remains poorly quantified. At these energies, electrons are driven by both convective and diffusive transport, and their prediction usually requires sophisticated 4D modeling codes. In this paper, we present an alternative approach using the Light Gradient Boosting (LightGBM) machine learning algorithm. The Medium Energy electRon fLux In Earth's outer radiatioN belt (MERLIN) model takes as input the satellite position, a combination of geomagnetic indices and solar wind parameters including the time history of velocity, and does not use persistence. MERLIN is trained on >15 years of the GPS electron flux data and tested on more than 1.5 years of measurements. Tenfold cross validation yields that the model predicts the MEO radiation environment well, both in terms of dynamics and amplitudes o f flux. Evaluation on the test set shows high correlation between the predicted and observed electron flux (0.8) and low values of absolute error. The MERLIN model can have wide space weather applications, providing information for the scientific community in the form of radiation belts reconstructions, as well as industry for satellite mission design, nowcast of the MEO environment, and surface charging analysis.
Participants of the 2017 European Space Weather Week in Ostend, Belgium, discussed the stakeholder requirements for space weather-related models. It was emphasized that stakeholders show an increased interest in space weather-related models. Participants of the meeting discussed particular prediction indicators that can provide first-order estimates of the impact of space weather on engineering systems.
Geomagnetic indices are convenient quantities that distill the complicated physics of some region or aspect of near-Earth space into a single parameter. Most of the best-known indices are calculated from ground-based magnetometer data sets, such as Dst, SYM-H, Kp, AE, AL, and PC. Many models have been created that predict the values of these indices, often using solar wind measurements upstream from Earth as the input variables to the calculation. This document reviews the current state of models that predict geomagnetic indices and the methods used to assess their ability to reproduce the target index time series. These existing methods are synthesized into a baseline collection of metrics for benchmarking a new or updated geomagnetic index prediction model. These methods fall into two categories: (1) fit performance metrics such as root-mean-square error and mean absolute error that are applied to a time series comparison of model output and observations and (2) event detection performance metrics such as Heidke Skill Score and probability of detection that are derived from a contingency table that compares model and observation values exceeding (or not) a threshold value. A few examples of codes being used with this set of metrics are presented, and other aspects of metrics assessment best practices, limitations, and uncertainties are discussed, including several caveats to consider when using geomagnetic indices. Plain Language Summary One aspect of space weather is a magnetic signature across the surface of the Earth. The creation of this signal involves nonlinear interactions of electromagnetic forces on charged particles and can therefore be difficult to predict. The perturbations that space storms and other activity causes in some observation sets, however, are fairly regular in their pattern. Some of these measurements have been compiled together into a single value, a geomagnetic index. Several such indices exist, providing a global estimate of the activity in different parts of geospace. Models have been developed to predict the time series of these indices, and various statistical methods are used to assess their performance at reproducing the original index. Existing studies of geomagnetic indices, however, use different approaches to quantify the performance of the model. This document defines a standardized set of statistical analyses as a baseline set of comparison tools that are recommended to assess geomagnetic index prediction models. It also discusses best practices, limitations, uncertainties, and caveats to consider when conducting a model assessment.
The plasmasphere is a dynamic region of cold, dense plasma surrounding the Earth. Its shape and size are highly susceptible to variations in solar and geomagnetic conditions. Having an accurate model of plasma density in the plasmasphere is important for GNSS navigation and for predicting hazardous effects of radiation in space on spacecraft. The distribution of cold plasma and its dynamic dependence on solar wind and geomagnetic conditions remain, however, poorly quantified. Existing empirical models of plasma density tend to be oversimplified as they are based on statistical averages over static parameters. Understanding the global dynamics of the plasmasphere using observations from space remains a challenge, as existing density measurements are sparse and limited to locations where satellites can provide in-situ observations. In this dissertation, we demonstrate how such sparse electron density measurements can be used to reconstruct the global electron density distribution in the plasmasphere and capture its dynamic dependence on solar wind and geomagnetic conditions.
First, we develop an automated algorithm to determine the electron density from in-situ measurements of the electric field on the Van Allen Probes spacecraft. In particular, we design a neural network to infer the upper hybrid resonance frequency from the dynamic spectrograms obtained with the Electric and Magnetic Field Instrument Suite and Integrated Science (EMFISIS) instrumentation suite, which is then used to calculate the electron number density. The developed Neural-network-based Upper hybrid Resonance Determination (NURD) algorithm is applied to more than four years of EMFISIS measurements to produce the publicly available electron density data set.
We utilize the obtained electron density data set to develop a new global model of plasma density by employing a neural network-based modeling approach. In addition to the location, the model takes the time history of geomagnetic indices and location as inputs, and produces electron density in the equatorial plane as an output. It is extensively validated using in-situ density measurements from the Van Allen Probes mission, and also by comparing the predicted global evolution of the plasmasphere with the global IMAGE EUV images of He+ distribution. The model successfully reproduces erosion of the plasmasphere on the night side as well as plume formation and evolution, and agrees well with data.
The performance of neural networks strongly depends on the availability of training data, which is limited during intervals of high geomagnetic activity. In order to provide reliable density predictions during such intervals, we can employ physics-based modeling. We develop a new approach for optimally combining the neural network- and physics-based models of the plasmasphere by means of data assimilation. The developed approach utilizes advantages of both neural network- and physics-based modeling and produces reliable global plasma density reconstructions for quiet, disturbed, and extreme geomagnetic conditions.
Finally, we extend the developed machine learning-based tools and apply them to another important problem in the field of space weather, the prediction of the geomagnetic index Kp. The Kp index is one of the most widely used indicators for space weather alerts and serves as input to various models, such as for the thermosphere, the radiation belts and the plasmasphere. It is therefore crucial to predict the Kp index accurately. Previous work in this area has mostly employed artificial neural networks to nowcast and make short-term predictions of Kp, basing their inferences on the recent history of Kp and solar wind measurements at L1. We analyze how the performance of neural networks compares to other machine learning algorithms for nowcasting and forecasting Kp for up to 12 hours ahead. Additionally, we investigate several machine learning and information theory methods for selecting the optimal inputs to a predictive model of Kp. The developed tools for feature selection can also be applied to other problems in space physics in order to reduce the input dimensionality and identify the most important drivers.
Research outlined in this dissertation clearly demonstrates that machine learning tools can be used to develop empirical models from sparse data and also can be used to understand the underlying physical processes. Combining machine learning, physics-based modeling and data assimilation allows us to develop novel methods benefiting from these different approaches.