Dynamic Resource Extension for Data Intensive Computing with Specialized Software Environments on HPC Systems

DSpace Repository

Show simple item record

dc.contributor.author Heidecker, Christoph
dc.contributor.author Schnepf, Matthias J.
dc.contributor.author Cube, R. Florian von
dc.contributor.author Giffels, Manuel
dc.contributor.author Sauter, Martin
dc.contributor.author Quast, Günter
dc.date.accessioned 2019-04-09T13:34:33Z
dc.date.available 2019-04-09T13:34:33Z
dc.date.issued 2019-04
dc.identifier.other 1668944065
dc.identifier.uri http://hdl.handle.net/10900/87665
dc.identifier.uri http://nbn-resolving.de/urn:nbn:de:bsz:21-dspace-876657 de_DE
dc.identifier.uri http://dx.doi.org/10.15496/publikation-29051
dc.description.abstract Modern High Energy Physics (HEP) requires large-scale processing of extensive amounts of scientific data. The needed computing resources are currently provided statically by HEP specific computing centers. To increase the number of available resources, for example to cover peak loads, the HEP computing development team at KIT concentrates on the dynamic integration of additional computing resources into the HEP infrastructure. Therefore, we developed ROCED, a tool to dynamically request and integrate computing resources including resources at HPC centers and commercial cloud providers. Since these resources usually do not support HEP software natively, we rely on virtualization and container technologies, which allows us to run HEP workflows on these so called opportunistic resources. Additionally, we study the efficient processing of huge amounts of data on a distributed infrastructure, where the data is usually stored at HEP specific data centers and is accessed remotely over WAN. To optimize the overall data throughput and to increase the CPU efficiency, we are currently developing an automated caching system for frequently used data that is transparently integrated into the distributed HEP computing infrastructure. en
dc.language.iso en de_DE
dc.publisher Universität Tübingen de_DE
dc.publisher Universität Tübingen de_DE
dc.subject.classification Hochleistungsrechnen de_DE
dc.subject.ddc 004 de_DE
dc.subject.other bwHPC Symposium de_DE
dc.subject.other HPC en
dc.subject.other HEP en
dc.subject.other LHC en
dc.subject.other NEMO en
dc.title Dynamic Resource Extension for Data Intensive Computing with Specialized Software Environments on HPC Systems en
dc.type InProceedings (Aufsatz / Paper einer Konferenz etc.) de_DE
utue.publikation.fachbereich Informatik de_DE
utue.publikation.fakultaet 7 Mathematisch-Naturwissenschaftliche Fakultät de_DE
utue.opus.portal bwhpc5 de_DE


This item appears in the following Collection(s)

Show simple item record