- In high-resolution solar physics, the volume and complexity of photometric, spectroscopic, and polarimetric ground-based data significantly increased in the last decade, reaching data acquisition rates of terabytes per hour. This is driven by the desire to capture fast processes on the Sun and the necessity for short exposure times "freezing" the atmospheric seeing, thus enabling ex post facto image restoration. Consequently, large-format and high-cadence detectors are nowadays used in solar observations to facilitate image restoration. Based on our experience during the "early science" phase with the 1.5 m GREGOR solar telescope (2014–2015) and the subsequent transition to routine observations in 2016, we describe data collection and data management tailored toward image restoration and imaging spectroscopy. We outline our approaches regarding data processing, analysis, and archiving for two of GREGOR's post-focus instruments (see http://gregor.aip.de), i.e., the GREGOR Fabry–Pérot Interferometer (GFPI) and the newly installedIn high-resolution solar physics, the volume and complexity of photometric, spectroscopic, and polarimetric ground-based data significantly increased in the last decade, reaching data acquisition rates of terabytes per hour. This is driven by the desire to capture fast processes on the Sun and the necessity for short exposure times "freezing" the atmospheric seeing, thus enabling ex post facto image restoration. Consequently, large-format and high-cadence detectors are nowadays used in solar observations to facilitate image restoration. Based on our experience during the "early science" phase with the 1.5 m GREGOR solar telescope (2014–2015) and the subsequent transition to routine observations in 2016, we describe data collection and data management tailored toward image restoration and imaging spectroscopy. We outline our approaches regarding data processing, analysis, and archiving for two of GREGOR's post-focus instruments (see http://gregor.aip.de), i.e., the GREGOR Fabry–Pérot Interferometer (GFPI) and the newly installed High-Resolution Fast Imager (HiFI). The heterogeneous and complex nature of multidimensional data arising from high-resolution solar observations provides an intriguing but also a challenging example for "big data" in astronomy. The big data challenge has two aspects: (1) establishing a workflow for publishing the data for the whole community and beyond and (2) creating a collaborative research environment (CRE), where computationally intense data and postprocessing tools are colocated and collaborative work is enabled for scientists of multiple institutes. This requires either collaboration with a data center or frameworks and databases capable of dealing with huge data sets based on virtual observatory (VO) and other community standards and procedures.…
![show more show more](/layouts/opus4/img/arrow_down.png)
![show less show less](/layouts/opus4/img/arrow_up.png)
MetadatenAuthor details: | Carsten DenkerORCiDGND, Christoph KuckeinORCiDGND, Meetu VermaORCiDGND, Sergio Javier Gonzalez Manrique GonzalezORCiD, Andrea DierckeORCiDGND, Harry Enke, Jochen KlarORCiD, Horst BalthasarORCiD, Rohan E. LouisORCiD, Ekaterina Ivanova DinevaORCiDGND |
---|
DOI: | https://doi.org/10.3847/1538-4365/aab773 |
---|
ISSN: | 0067-0049 |
---|
ISSN: | 1538-4365 |
---|
Title of parent work (English): | The astrophysical journal : an international review of spectroscopy and astronomical physics ; Supplement series |
---|
Publisher: | IOP Publ. Ltd. |
---|
Place of publishing: | Bristol |
---|
Publication type: | Article |
---|
Language: | English |
---|
Date of first publication: | 2018/05/11 |
---|
Publication year: | 2018 |
---|
Release date: | 2021/12/03 |
---|
Tag: | Sun: chromosphere; Sun: photosphere; astronomical databases; methods: data analysis; techniques: image processing; techniques: spectroscopic |
---|
Volume: | 236 |
---|
Issue: | 1 |
---|
Number of pages: | 12 |
---|
Funding institution: | Leibniz Graduate School for Quantitative Spectroscopy in Astrophysics [VEGA 2/0004/16]; German Science Foundation (DFG)German Research Program [312495]; European Regional Development Fund (ERDF)European Union (EU); German Federal Ministry of Education and Research (BMBF) Collaborative Research Program for the German Astrophysical Virtual Observatory (GAVO); BMBF grant "Survey-Competence"Federal Ministry of Education & Research (BMBF); Ministry of Human Resource Development, Government of IndiaMinistry of Human Resource Development (MHRD), Government of India |
---|
Organizational units: | Mathematisch-Naturwissenschaftliche Fakultät / Institut für Physik und Astronomie |
---|
DDC classification: | 5 Naturwissenschaften und Mathematik / 53 Physik / 530 Physik |
---|
Peer review: | Referiert |
---|
Publishing method: | Open Access / Green Open-Access |
---|