Home

Quick Links

Search

 
Containerizing Parallel MPI-based HPC ApplicationsNormal access

Authors: A. Bukhamsin and A. Schonewille
Event name: Third EAGE Workshop on High Performance Computing for Upstream
Session: Containers and Clouds
Publication date: 01 October 2017
DOI: 10.3997/2214-4609.201702320
Organisations: EAGE
Language: English
Info: Extended abstract, PDF ( 481.73Kb )
Price: € 20

Summary:
Software container technology based on Docker is a lightweight packaging and virtualization technology. These containers are used to package and run the application with all its dependencies in a portable image with minimum requirements. Because of the complexity and dependencies of HPC (High performance computing) applications, this concept can be used to pre-package HPC applications. Although Docker is already used in cloud computing, HPC implementations are lagging due to, what we believe, the nature of most HPC applications: inter-process communications and the shortcomings of spawning containerized MPI-based applications on compute resources. This paper shows our solution for containerizing HPC MPI applications and running them across multiple hosts connected with Infiniband interconnect.


Back to the article list