Milky Way Analysis through a Science Gateway: Workflows and Resource Monitoring
Date Issued
2016
Author(s)
•
•
•
•
Hajnal, Akos
•
Kacsuk, Peter
•
•
•
•
•
•
•
•
Abstract
This paper presents the latest developments on the VIALACTEA Science Gateway in the context of the FP7 VIALACTEA project. This science gateway operates as a central workbench for the VIALACTEA community in order to allow astronomers to process the new-generation (from Infrared to Radio) surveys of the Galactic Plane to build and deliver a quantitative 3D model of our Milky Way Galaxy. The final model will be used as a template for external galaxies to study star formation across the cosmic time. The adopted AGILE software development process allowed to fulfill the community needs in terms of required workflows and underlying resources monitoring. The scientific requirements arose during the process highlighted the needs for easy parameter setting, fully embarrassingly parallel computations and large-scale input dataset processing. Therefore the science gateway based on the WS-PGRADE/gUSE framework has been able to fulfill the requirements mainly exploiting the parameter sweep paradigm and parallel jobs execution of the workflow management system. Moving from the development to the production environment an efficient resource monitoring system has been implemented to easily analyse and debug sources of failure due to workflows computations. The results of the resource monitoring system are exploitable not only for IT experts administrators and workflow developers but also for the
Coverage
Proceedings of the 8th International Workshop on Science Gateways (IWSG 2016)
All editors
Gesing, Sandra; Krüger, Jens
Series
Volume
1871
Start page
12
Conferenece
8th International Workshop on Science Gateways (IWSG 2016)
Conferenece place
Rome, Italy
Conferenece date
8-10 June, 2016
Issn Identifier
1613-0073
Ads BibCode
2016scga.confE..12S
Rights
open.access
File(s)![Thumbnail Image]()
Loading...
Name
paper11.pdf
Description
pdf editoriale
Size
331.63 KB
Format
Adobe PDF
Checksum (MD5)
92c83b03ae869a5296c56af03b7443ae