FabSim3 for Automation and Tool Integrations in VECMAtk
Only 126 seats left
Wednesday, June 30, 2021 3:00 PM to 4:00 PM · 1 hr. (Africa/Abidjan)
HPC Workflows
Information
Contributors:
Abstract:
FabSim3 is a python3 based toolkit to automate and simplify the creation, management, execution and modification of complex application workflows, using functionalities such as ensemble runs, remote executions and code couplings. This helps researchers to become more productive in general, and more effective with handling complex applications in particular. For instance, researchers may want to rerun an application among different platforms run with different ranges of input parameters, or define new workflow steps for their applications by using external libraries. Our aim is to do all these steps in a gray-box fashion, so that it is possible for researchers to examine essential aspects of their application in detail, scrutinize individual runs and their environment, debug their application, and repeat or reproduce runs with ease. FabSim3 APIs allow developers to describe their application workflow in a manner that hides low-level details, such as preparation of simulation runs, job submission and management, and file transferring. FabSim3 APIs encapsulate all these steps, by providing high-level functionalities, for developers to manage the workflow complexity of modern scientific simulationsVisit the Project Website
- Bartosz Bosak (Poznań Supercomputing and Networking Center)
- Derek Groen (Brunel University London)
- Paul Karlshoefer (Center for Excellence in Performance Programming ATOS)
- Piotr Kopta (Poznań Supercomputing and Networking Center)
- Tomasz Piontek (Poznań Supercomputing and Networking Center)
- Erwan Raffin (Atos)
- Diana Suleimenova (Brunel University London)
- Hamid Arabnejad (Brunel University London)
Abstract:
FabSim3 is a python3 based toolkit to automate and simplify the creation, management, execution and modification of complex application workflows, using functionalities such as ensemble runs, remote executions and code couplings. This helps researchers to become more productive in general, and more effective with handling complex applications in particular. For instance, researchers may want to rerun an application among different platforms run with different ranges of input parameters, or define new workflow steps for their applications by using external libraries. Our aim is to do all these steps in a gray-box fashion, so that it is possible for researchers to examine essential aspects of their application in detail, scrutinize individual runs and their environment, debug their application, and repeat or reproduce runs with ease. FabSim3 APIs allow developers to describe their application workflow in a manner that hides low-level details, such as preparation of simulation runs, job submission and management, and file transferring. FabSim3 APIs encapsulate all these steps, by providing high-level functionalities, for developers to manage the workflow complexity of modern scientific simulationsVisit the Project Website
