May 23 – 26, 2022
Fluno Center on the University of Wisconsin-Madison Campus
America/Chicago timezone

Accelerating workflows at NERSC with HTCondor (In Person Speaker for All Registrants)

May 25, 2022, 9:00 AM
20m
Howard Auditorium (Fluno Center on the University of Wisconsin-Madison Campus)

Howard Auditorium

Fluno Center on the University of Wisconsin-Madison Campus

601 University Avenue, Madison, WI 53715-1035

Speaker

Nick Tyler (NERSC)

Availability of the Speaker

I cannot present on 05/26 because of travel.

Summary (2-4 sentences)

NERSC is interested in helping our users create complex and resilient scientific workflows. As part of this initiative NERSC is moving towards using cloud-like microservices and an api based approach to connect our users with our supercomputers. I will show how a HTCondor central manager and scheduler are running on spin, our cloud-like microservice architecture at NERSC, and how to use the NERSC SuperFacility api to start glidein workers on both Cori and Perlmutter. The goal of this work is to run our user facilities workflows more efficiently and I will highlight some applications that are working on transitioning over to using HTCondor to increase their workflows throughput.

Primary author

Nick Tyler (NERSC)

Presentation materials