Game of Templates. Deploying and (re-)using Virtualized Research Environments in High-Performance and High-Throughput Computing

DSpace Repository


Dateien:
Aufrufstatistik

URI: http://hdl.handle.net/10900/87671
http://nbn-resolving.de/urn:nbn:de:bsz:21-dspace-876719
http://dx.doi.org/10.15496/publikation-29057
Dokumentart: InProceedings (Aufsatz / Paper einer Konferenz etc.)
Date: 2019-04
Language: English
Faculty: 7 Mathematisch-Naturwissenschaftliche Fakultät
Department: Informatik
DDC Classifikation: 004 - Data processing and computer science
Keywords: Hochleistungsrechnen
Other Keywords: bwHPC Symposium
Virtual Research Environments
HPC
OS-level Virtualization
Docker Containers
Singularity Containers
Show full item record

Abstract:

The Virtual Open Science Collaboration Environment project worked on different use cases to evaluate the necessary steps for virtualization or containerization especially when considering the external dependencies of digital workflows. Virtualized Research Environments (VRE) can both help to broaden the user base of an HPC cluster like NEMO and offer new forms of packaging scientific workflows as well as managing software stacks. The eResearch initiative on VREs sponsored by the state of Baden-Württemberg provided the necessary framework for both the researchers of various disciplines as well as the providers of (large-scale) compute infrastructures to define future operational models of HPC clusters and scientific clouds. In daily operations, VREs running on virtualization or containerization technologies such as OpenStack or Singularity help to disentangle the responsibilities regarding the software stacks needed to fulfill a certain task. Nevertheless, the reproduction of VREs as well as the provisioning of research data to be computed and stored afterward creates a couple of challenges which need to be solved beyond the traditional scientific computing models.

This item appears in the following Collection(s)