Utilizza questo identificativo per citare o creare un link a questo documento:
http://hdl.handle.net/20.500.12386/28342
Titolo: | The HARPS-N archive through a Cassandra, NoSQL database suite? | Autori: | MOLINARI, Emilio Carlo GUERRA, JOSE HARUTYUNYAN, AVET Lodi, Marcello Martin, Adrian |
Data pubblicazione: | 2016 | Titolo del volume in cui è pubblicato il poster: | Software and Cyberinfrastructure for Astronomy IV | Curatore/i del volume in cui è pubblicato il contributo: | Chiozzi, Gianluca; Guzman, Juan C. | Serie: | PROCEEDINGS OF SPIE | Numero: | 9913 | Da pagina:: | 99132A | Abstract: | The TNG-INAF is developing the science archive for the WEAVE instrument. The underlying architecture of the archive is based on a non relational database, more precisely, on Apache Cassandra cluster, which uses a NoSQL technology. In order to test and validate the use of this architecture, we created a local archive which we populated with all the HARPSN spectra collected at the TNG since the instrument's start of operations in mid-2012, as well as developed tools for the analysis of this data set. The HARPS-N data set is two orders of magnitude smaller than WEAVE, but we want to demonstrate the ability to walk through a complete data set and produce scientific output, as valuable as that produced by an ordinary pipeline, though without accessing directly the FITS files. The analytics is done by Apache Solr and Spark and on a relational PostgreSQL database. As an example, we produce observables like metallicity indexes for the targets in the archive and compare the results with the ones coming from the HARPS-N regular data reduction software. The aim of this experiment is to explore the viability of a high availability cluster and distributed NoSQL database as a platform for complex scientific analytics on a large data set, which will then be ported to the WEAVE Archive System (WAS) which we are developing for the WEAVE multi object, fiber spectrograph. | Titolo del convegno: | Software and Cyberinfrastructure for Astronomy IV | Luogo del convegno: | Edinburgh, United Kingdom | Periodo del convegno: | 26 June - 1 July 2016 | URI: | http://hdl.handle.net/20.500.12386/28342 | URL: | https://www.spiedigitallibrary.org/conference-proceedings-of-spie/9913/1/The-HARPS-N-archive-through-a-Cassandra-NoSQL-database-suite/10.1117/12.2233137.short | ISSN: | 0277-786X | ISBN: | 9781510602052 | DOI: | 10.1117/12.2233137 | Bibcode ADS: | 2016SPIE.9913E..2AM | Fulltext: | open |
È visualizzato nelle collezioni: | 3.01 Contributi in Atti di convegno |
File in questo documento:
File | Descrizione | Dimensioni | Formato | |
---|---|---|---|---|
99132A.pdf | Pdf editoriale | 515.74 kB | Adobe PDF | Visualizza/apri |
Page view(s)
69
controllato il 25-apr-2024
Download(s)
24
controllato il 25-apr-2024
Google ScholarTM
Check
Altmetric
Altmetric
Tutti i documenti in DSpace sono pubblicati ad Accesso Aperto, salvo diversa indicazione per alcuni documenti specifici.