Throughput Computing 2025

Jun 2, 2025, 7:00 AM → Jun 6, 2025, 11:15 PM America/Chicago

Howard Auditorium (Fluno Center on the University of Wisconsin-Madison Campus)

Monday, June 2

7:30 AM → 9:00 AM Registration, Coffee, and Light Breakfast

9:00 AM → 10:20 AM OSG at 20: Growing the Throughput Community

9:00 AM To Be Provided

Speaker: Miron Livny (UW-Center for High Throughput Computing)

9:30 AM State of OSG

Speaker: Frank Wuerthwein (UC San Diego)

10:00 AM To Be Provided

Speaker: Brian Bockelman (Morgridge Institute for Research)

10:20 AM → 10:50 AM Break

10:50 AM → 12:30 PM Erik Wright Keynote Presentation, David Swanson Awardee Presentation

10:50 AM Keynote Introduction

Speaker: Christina Koch (UW Madison)

10:55 AM Erik Wright's Keynote Presentation: Biological Discovery at an Unfathomable Scale

Recent technological advances have revealed an enormous diversity of lifeforms by sequencing their genomes. There are now millions of available genomes, each comprised of thousands of genes. The universe of newly discovered genes is expanding far faster than our ability to study them in the laboratory. Here, I will present how high-throughput computing is unlocking the function of novel genes at an unfathomable scale.

Speaker: Dr Erik Scott Wright (University of Pittsburgh)

12:00 PM Introduction of David Swanson Award

Speaker: Ronda Swanson (University of Nebraska-Lincoln)

12:05 PM David Swanson Awardee Presentation: Reconstructing Spider Webs from Behavioral Tracking.

12:30 PM → 1:30 PM Lunch

1:30 PM → 2:45 PM Throughput Computing in the Biology & Life Sciences Community

1:30 PM TBD (Remote Presentation)

Speaker: Oana Carja (Carnegie Mellon University)

1:55 PM TBD

Speaker: Jason Kwan (UW-Madison)

2:45 PM → 3:15 PM Break

3:15 PM → 4:50 PM Reenvisioning Identity in Distributed Services

3:15 PM Our Current Vision for Trustworthy Long-Term CILogon Operations

Speaker: Jim Basney (University of Illinois Urbana-Champaign)

3:40 PM Placement Tokens

Speaker: Matyas Selmeci (UW-Madison CHTC)

4:00 PM Give it to me... please? Authorization in Pelican

Speaker: Justin Hiemstra (Morgridge Institute for Research)

4:25 PM Fermilab’s Transition to Token Authentication

Fermilab is the first High Energy Physics institution to transition from X.509 user certificates to authentication tokens in production systems. All the experiments that Fermilab hosts are now using JSON Web Token (JWT) access tokens in their grid jobs. The tokens are defined using the WLCG Common JWT Profile. Many software components have been either created or updated for this transition, and the changes to those components are described. Most of the software is available to others as open source. There have been some glitches and learning curve issues but in general the system has been performing well and is being improved as operational problems are addressed.

Speaker: Dave Dykstra (Fermilab)

4:50 PM → 5:05 PM CHTC Fellow Lightning Talks

5:05 PM → 5:15 PM Closing Remarks

Tuesday, June 3

8:00 AM → 9:00 AM Coffee, Pastries and Registration

9:00 AM → 10:35 AM Campus Impacts on the National Science Community via the OSPool and OSDF

10:35 AM → 10:55 AM Break

10:55 AM → 12:30 PM HTC at Work at Campuses and in Research

10:55 AM Scaling Up Research: Integrating CENVAL-ARC resources with OSG and Expanding User Access (Remote Presentation)

Speaker: Sarvani Chadapalaka (University of California - Merced)

11:20 AM TBD

Speaker: Peter Pizzamenti (Syracuse University)

11:45 AM Supporting MicrobiologyResearch at Scale: Experiences and Perspectives

Speaker: Patricia Tran (UW-Madison)

12:10 PM Integrating NSF NCAR’s Data Infrastructure with OSDF

Speaker: Dr Harsha Hampapura (NSF National Center for Atmospheric Research)

12:30 PM → 1:30 PM Lunch

1:30 PM → 2:00 PM Door Open for 40 Years of The Condor Project: A Celebration

2:00 PM → 6:30 PM 40 Years of The Condor Project Commemorative Gathering (In-Person Only)

2:00 PM Welcome to 40 Years of The Condor Project

Speaker: Todd Tannenbaum (University of Wisconsin)

2:05 PM Reflections from Guri Sohi

2:15 PM Reflections from Rajesh Raman

2:25 PM Reflections from Ewa Deelman

2:35 PM Condor in Europe

Speaker: Helge Meinhard (CERN)

2:50 PM Reflections from Manish Parashar

3:00 PM Reflections from Peter Couvares

3:10 PM Reflections from Jim Basney

3:25 PM Reflections from Brian Bockelman

3:40 PM Reflections from Remzi Arpacai-Deusau

3:55 PM Reflections from Doug Thain

4:10 PM Reflections from Frank Wuerthwein

4:25 PM Reflections from Miron Livny

4:45 PM Reception

6:30 PM → 8:30 PM Evening on the Memorial Union Terrace

Wednesday, June 4

8:00 AM → 9:00 AM Coffee, Pastries and Registration

9:00 AM → 10:45 AM Campus Track: Campus/CC* Contributors (to OSPool & OSDF, current & future): Meet the Team and Stump the Experts

9:00 AM → 10:45 AM Tutorials and Workflows Track: Automation and Python in HTCSS Workflows

10:45 AM → 11:15 AM Break

11:15 AM → 12:30 PM Campus Track: Campus/CC* Technical Lightning Talks and Discussion

11:15 AM → 12:30 PM Tutorials and Workflows Track: Building Your Toolbox: HTCSS Overviews

12:30 PM → 1:30 PM Lunch

1:30 PM → 2:45 PM Tutorials and Workflows Track: Workloads and Workflows

2:45 PM → 3:05 PM Break

3:05 PM → 4:20 PM Scientific Collaborations Track: Collaborations Group Discussions

3:05 PM → 4:50 PM Tutorials and Workflows Track: Objects, Objects Everywhere: Using the OSDF in your Science

3:05 PM Data Everywhere: Using and Sharing Scientific Data with Pelican

Speaker: Dr Andrew Owen (UW-Madison/CHTC)

4:30 PM Advanced Pelican Topics

Speaker: Brian Bockelman (Morgridge Institute for Research)

4:50 PM → 5:10 PM Closing Remarks

Thursday, June 5

8:00 AM → 9:00 AM Coffee, Pastries and Registration

9:00 AM → 10:30 AM Joint CMS and US-ATLAS Session: Monitoring and Measuring

Conveners: Andrew Melo (Vanderbilt University), Shawn McKee (University of Michigan)

9:00 AM Networking: perfSONAR, SciTags and WLCG Site network monitoring

Speaker: Shawn McKee (University of Michigan)

9:15 AM Storage Monitoring and Analytics

Presentation on storage monitoring, analytics, diagnosis, best practices for WebDAV, Xrootd. Options for future storage

9:30 AM Discussion on next steps and joint work

Speakers: Andrew Melo (Vanderbilt University), Shawn McKee (University of Michigan)

9:00 AM → 10:30 AM Running ML, AI and GPU Workflows

9:00 AM GPU Access and AI workflows in CHTC and the OSPool

9:25 AM ARA Distributed Inference Experiments: Flying HTCondor Over a Field of Wireless Dreams

We present the initial design and proposed implementation for a series of long-baseline, distributed inference experiments leveraging ARA --- a platform for advanced wireless research that spans approximately 500 square kilometers near Iowa State University, including campus, the City of Ames, local research and producer farms, and neighboring rural communities in central Iowa. These experiments aim to demonstrate, characterize, and evaluate the use of distributed inference for computer vision tasks in rural and remote regions where high-capacity, low-latency wireless broadband access and backhaul networks enable edge computing devices and sensors in the field to offload compute-intensive workloads to cloud and high-performance computing systems embedded throughout the edge-to-cloud continuum. In each experiment, a distributed implementation of the MLPerf Inference benchmarks for image classification and object detection will measure standard inference performance metrics for an ARA subsystem configuration under different workload scenarios. Real-time network and weather conditions will also be monitored throughout each experiment to evaluate their impact on inference performance. Here, we highlight the role of HTCondor as the common scheduler and workload manager used to distribute the inference workload across ARA and beyond. We also discuss some of the unique challenges in deploying HTCondor on ARA and provide an update on the current status of the project.

Speaker: Martin Kandes (San Diego Supercomputer Center)

9:50 AM Pegasus WMS Deployments in ACCESS and NAIRR Pilot

Pegasus is a widely used scientific workflow management system built on top of HTCondor DAGMan. This talk will highlight how Pegasus is deployed within the NSF ACCESS ecosystem and the NAIRR Pilot. We will cover access point deployments, including the hosted ACCESS Pegasus platform (Open OnDemand and Jupyter), workflow execution nodes in HPC environments, and a JupyterLab-based access point within the Purdue Anvil Composable Subsystem. On the execution side, we will discuss several provisioning strategies, including HTCondor Annex, custom virtual machines on the Jetstream2 cloud, simple glidein configurations for campus clusters, and a dynamically autoscaled TestPool environment designed for workflow development and testing.

Speaker: Mats Rynge (USC / ISI)

10:15 AM Experiments and expansions: Leveraging PATh tools and NAIRR resources in ML workflows

Speaker: Ian Ross (U. Wisconsin)

10:30 AM → 11:00 AM Break

11:00 AM → 12:30 PM AI-driven Science with PATh Services

11:00 AM Mapping the Zymomonas mobilis Interactome

Speaker: Sameer DCosta (GLBRC / WEI)

11:25 AM Harnessing High Throughput Computing to Analyze and Mitigate Machine Learning Model Vulnerabilities

Speaker: Blaine Hoak (UW-Madison)

11:50 AM Large Scale Dataset Curation and Model Evaluation

Speaker: John Peters (UW-Madison)

12:10 PM Utilizing HTCondor, Pelican, and DAGman workflows for high-throughput phenotyping in dairy cattle

Speaker: Ariana Negreiro

11:00 AM → 12:30 PM Joint CMS and US-ATLAS Session: WLCG (Mini) Data Challenges

Conveners: Andrew Melo (Vanderbilt University), Shawn McKee (University of Michigan)

11:00 AM Capacity Challenges

Discuss tools and options for the next capacity challenge.

Speaker: Hironori Ito (Brookhaven National Laboratory)

11:15 AM Capability Challenge: SENSE/Rucio

Discuss plans for SENSE/Rucio testing for USATLAS/USCMS

Speaker: Diego Davila (UCSD)

11:30 AM Capability Challenge: Netbird/Wireguard

Speaker: Lincoln Bryant (University of Chicago)

11:45 AM Discussion & Planning

Discuss capacity and capability challenges. Which are we interesting in pursuing? Who will participate? When to schedule?

Speakers: Andrew Melo (Vanderbilt University), Shawn McKee (University of Michigan)

12:30 PM → 1:30 PM Lunch

1:30 PM → 2:45 PM Joint CMS and US-ATLAS Session: AI/ML, Tools and Operations

Conveners: Andrew Melo (Vanderbilt University), Shawn McKee (University of Michigan)

1:30 PM NGINX as Xrootd Replacement

Speaker: Andrew Melo (Vanderbilt University)

1:45 PM Data Streaming as a Service

Speaker: Alexei Klimentov (Brookhaven National Lab)

2:00 PM AI/ML Introduction and Discussion

Quick overview of AI/ML in WLCG so far
Needs for AI/ML for Infrastructure AND Infrastructure for AI/ML
Funding opportunities
Next step, areas on common interest/effort?

Speaker: Ilija Vukotic (University of Chicago)

1:30 PM → 2:45 PM Tutorial: Mastering Debugging (for admins)

2:45 PM → 3:05 PM Break

3:05 PM → 3:55 PM HTCondor: New Things You Should Know

3:05 PM → 3:55 PM Joint CMS and US-ATLAS Session: Analysis Facilities (AFs)

Conveners: Hironori Ito (Brookhaven National Laboratory), Lincoln Bryant (University of Chicago)

3:05 PM Introduction and Overview for AFs in WLCG

Speaker: Lincoln Bryant (University of Chicago)

3:20 PM AF Discussion

Shared development and prototyping for AFs?
Storage technologies to support AFs (Carlos Gamboa ?, 10 minutes)
Joint AFs: Can we “share” AFs between experiments: Belle II and ATLAS or Dune and CMS, etc ? (Hiro/Ofer/Lincoln ?)
Can we agree on a minimum baseline for AFs?
Standard “login”

Speakers: Hironori Ito (Brookhaven National Laboratory), Lincoln Bryant (University of Chicago)

3:55 PM → 4:10 PM Break

4:10 PM → 5:00 PM Interactive Audience Presentation

5:00 PM → 5:15 PM Closing Remarks

Friday, June 6

8:00 AM → 9:00 AM Coffee, Pastries and Registration

9:00 AM → 10:25 AM Throughput Computing Science Impacts

9:25 AM Processing Mouse Brain Data on CHTC using Research Drive Integration

Speaker: Ayden Bailey (UW-Madison)

10:25 AM → 10:45 AM Break

10:45 AM → 12:15 PM Managed and Staging Objects: Caches and Execution Points

10:45 AM Common Files and Where to Find Them

Speaker: Todd Miller (CHTC)

11:10 AM Disk Usage of Jobs at the EP

Speaker: Cole Bollig (UW-Center for High Throughput Computing)

11:30 AM Kingfisher: Toward Explicit Space Management

Speaker: Justin Hiemstra (Morgridge Institute for Research)

11:55 AM Using the National Data Platform Endpoint to Improve Access to Science Data

I describe the process of deploying the National Data Platform Endpoint (formerly Point of Presence / POP) on local infrastructure to provide a data streaming service for a published science dataset where the data origin is located in Hawaii. From the perspective of a software engineer I will cover the process of deploying the endpoint into a Kubernetes cluster or using Docker Compose. I will explain how I integrated access to local data with the endpoint and describe some useful lessons that were learned. Finally, from the perspective of a science user, I will demonstrate how to use the deployed endpoint to preprocess data and stream the results to a Jupyter notebook to visualize the data.

Speaker: Curt Dodds (Institute for Astronomy, University of Hawaii)

12:15 PM → 1:30 PM Lunch