International Symposium on Grids & Clouds 2020 (ISGC 2020)

The Pacific Research Platform and Chase-CI …. A distributed platform for interactive and batch use from Machine Learning with GPUs and FPGAs to Multi-Messenger Astrophysics

27 Aug 2020, 16:30

30m

Conference Room 1 (BHSS, Academia Sinica)

Oral Presentation Converging High Performance infrastructures: Supercomputers, clouds, accelerators Converging High Performance infrastructures: Supercomputers, clouds, accelerators Session

Speaker

Prof. Frank Wuerthwein (UCSD/SDSC)

Description

The NSF funded Pacific Research Platform Project operates a distributed compute environment including GPUs and FPGAs as accelerators that seamlessly extends into Google Cloud for use of TPUs as accelerators. It offers interactive access via Jupyter notebooks, and High Throughput Computing access via the Open Science Grid. The former tends to be the preferred platform for machine learning and AI applications, while the latter is primarily used by IceCube and LIGO for neutrinos and gravitational waves as windows to the universe. In this talk, we describe how we make these seemingly opposites, and hard to reconcile modalities of computation coexist within a single Kubernetes cluster.