Skip navigation
  • INAF logo
  • Home
  • Communities
    & Collections
  • Research outputs
  • Researchers
  • Organization units
  • Projects
  • Explore by
    • Research outputs
    • Researchers
    • Organization units
    • Projects
  • Login:
    • My DSpace
    • Receive email
      updates
    • Edit Account details
  • Italian
  • English

  1. OA@INAF
  2. PRODOTTI RICERCA INAF
  3. 3 CONTRIBUTI IN ATTI DI CONVEGNO (Proceedings)
  4. 3.01 Contributi in Atti di convegno
Please use this identifier to cite or link to this item: http://hdl.handle.net/20.500.12386/28342
Title: The HARPS-N archive through a Cassandra, NoSQL database suite?
Authors: MOLINARI, Emilio Carlo 
GUERRA, JOSE
HARUTYUNYAN, AVET
Lodi, Marcello
Martin, Adrian
Issue Date: 2016
Volume: Software and Cyberinfrastructure for Astronomy IV
Editors: Chiozzi, Gianluca; Guzman, Juan C.
Series: PROCEEDINGS OF SPIE 
Number: 9913
First Page: 99132A
Abstract: The TNG-INAF is developing the science archive for the WEAVE instrument. The underlying architecture of the archive is based on a non relational database, more precisely, on Apache Cassandra cluster, which uses a NoSQL technology. In order to test and validate the use of this architecture, we created a local archive which we populated with all the HARPSN spectra collected at the TNG since the instrument's start of operations in mid-2012, as well as developed tools for the analysis of this data set. The HARPS-N data set is two orders of magnitude smaller than WEAVE, but we want to demonstrate the ability to walk through a complete data set and produce scientific output, as valuable as that produced by an ordinary pipeline, though without accessing directly the FITS files. The analytics is done by Apache Solr and Spark and on a relational PostgreSQL database. As an example, we produce observables like metallicity indexes for the targets in the archive and compare the results with the ones coming from the HARPS-N regular data reduction software. The aim of this experiment is to explore the viability of a high availability cluster and distributed NoSQL database as a platform for complex scientific analytics on a large data set, which will then be ported to the WEAVE Archive System (WAS) which we are developing for the WEAVE multi object, fiber spectrograph.
Conference Name: Software and Cyberinfrastructure for Astronomy IV
Conference Place: Edinburgh, United Kingdom
Conference Date: 26 June - 1 July 2016
URI: http://hdl.handle.net/20.500.12386/28342
URL: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/9913/1/The-HARPS-N-archive-through-a-Cassandra-NoSQL-database-suite/10.1117/12.2233137.short
ISSN: 0277-786X
ISBN: 9781510602052
DOI: 10.1117/12.2233137
Bibcode ADS: 2016SPIE.9913E..2AM
Fulltext: open
Appears in Collections:3.01 Contributi in Atti di convegno

Files in This Item:
File Description SizeFormat 
99132A.pdfPdf editoriale515.74 kBAdobe PDFView/Open
Show full item record

Page view(s)

4
checked on Jan 16, 2021

Download(s)

2
checked on Jan 16, 2021

Google ScholarTM

Check

Altmetric


Items in DSpace are published in Open Access, unless otherwise indicated.


Explore by
  • Communities
    & Collections
  • Research outputs
  • Researchers
  • Organization units
  • Projects

Informazioni e guide per autori

https://openaccess-info.inaf.it: tutte le informazioni sull'accesso aperto in INAF

Come si inserisce un prodotto: le guide a OA@INAF

La Policy INAF sull'accesso aperto

Documenti e modelli scaricabili

Feedback
Built with DSpace-CRIS - Extension maintained and optimized by Logo 4SCIENCE