HPC Web Interfaces at CSC: Easy to Use HPC and Object Storage Access
Monday, May 13, 2024 3:00 PM to Wednesday, May 15, 2024 4:00 PM · 2 days 1 hr. (Europe/Berlin)
Foyer D-G - 2nd floor
Project Poster
HPC in the Cloud and HPC ContainersRuntime Systems for HPC
Information
Poster is on display.
End users are increasingly adopting non-terminal-based access methods, e.g. various web interfaces like Open OnDemand for doing their work on HPC. As user volumes grow and with novice users almost requiring an HPC web interface, deployments can no longer be improvised test setups but have to be maintained and developed with the same level of care as the underlying HPC cluster. A more flexible deployment infrastructure also facilitates scaling development work to more people in order to meet the growing heterogeneity of HPC users and applications. Furthermore, the HPC web interface should not be an isolated island, requiring users to go back to the command line if they need to interact with other site provided services, e.g., separate storage solutions, but instead should integrate with these additional services. The poster presents our continuous integration and container based deployment setup used to manage 12 separate instances of Open OnDemand on three supercomputers. The setup enables three separate groups: system administrators, computing environment specialists and application experts to work together to develop new features to improve the user experience. Additionally, we present the work done to seamlessly integrate the web interface with our object storage solutions. The work done during 2022 and 2023 represents a massive improvement from the initial setup where applications were deployed to manually managed VMs using improvised bash scripts.
Contributors:
End users are increasingly adopting non-terminal-based access methods, e.g. various web interfaces like Open OnDemand for doing their work on HPC. As user volumes grow and with novice users almost requiring an HPC web interface, deployments can no longer be improvised test setups but have to be maintained and developed with the same level of care as the underlying HPC cluster. A more flexible deployment infrastructure also facilitates scaling development work to more people in order to meet the growing heterogeneity of HPC users and applications. Furthermore, the HPC web interface should not be an isolated island, requiring users to go back to the command line if they need to interact with other site provided services, e.g., separate storage solutions, but instead should integrate with these additional services. The poster presents our continuous integration and container based deployment setup used to manage 12 separate instances of Open OnDemand on three supercomputers. The setup enables three separate groups: system administrators, computing environment specialists and application experts to work together to develop new features to improve the user experience. Additionally, we present the work done to seamlessly integrate the web interface with our object storage solutions. The work done during 2022 and 2023 represents a massive improvement from the initial setup where applications were deployed to manually managed VMs using improvised bash scripts.
Contributors:
Format
On-site