Birds of a Feather:
Integration of HPC & AI
Birds of a Feather
AI/Machine Learning/Deep Learning
Big Data Analytics
Scientific Software Development
TimeTuesday, June 18th11:30am - 12:30pm
DescriptionThe upsurge in interest in the use of AI from the research community and industry to tackle “real world” problems requires HPC resources to efficiently compute and scale these complex algorithms across thousands of nodes. Unfortunately, typical data scientists are not familiar with the unique requirements and characteristics of HPC environments. They usually develop their applications with high level scripting languages or frameworks such as TensorFlow and installation processes connect to external systems and download the open source software during the build. HPC environments, on the other hand, are often based on closed source applications that incorporate parallel and distributed computing API’s such as MPI and OpenMP, while users have restricted administrator privileges, and face security restrictions such as not allowing access to external systems.
This BoF aims to bring together contributors, data scientists, system administrators, architects, and developers interested in the integration of AI & HPC. We propose to discuss the issues associated with the deployment of AI frameworks in a traditional HPC environment and potential solutions that enable us to successfully deploy AI frameworks on large scale HPC production systems.
Scientific HPC Consultant Technical Consulting Engineer