HTCondor Week 2019

chaired by Todd Tannenbaum (University of Wisconsin), Mark Coatsworth (University of Wisconsin), Brian Bockelman (University of Nebraska-Lincoln)
from to (America/Chicago)
at Discovery Building on the University of Wisconsin-Madison Campus
330 N Orchard St, Madison, WI, 53715
Support Email: htcondor-week@cs.wisc.edu
Go to day
  • Monday, May 20, 2019
    • 08:00 - 09:00 Coffee and Registration ( Atrium )
    • 09:00 - 10:20 Monday AM Introductury Tutorials 1
      Conveners: Lauren Michael (UW-Madison), Christina Koch (UW Madison)
      Location: H.F. DeLuca Forum
      • 09:00 Introduction to CHTC 20'
        Speaker: Lauren Michael (UW-Madison)
        Material: Slides powerpoint file pdf file
      • 09:20 Intro to HTCondor Job Submission 1h0'
        Speaker: Christina Koch (UW Madison)
        Material: Slides powerpoint file pdf file
    • 09:00 - 10:20 Monday AM Advanced Tutorials 1
      Conveners: Brian Lin (UW-Madison CHTC), Mr. John Knoeller (University of Wisconsin, Madison)
      Location: Orchard View Room
      • 09:00 Philosophy of HTCondor 30'
        Speaker: Mr. Greg Thain (Center for High Throughput Computing)
        Material: Slides powerpoint file
      • 09:30 ClassAd Advanced Tutorial 30'
        Speaker: Mr. Jaime Frey (Center for High-Throughput Computing)
        Material: Slides powerpoint file
      • 10:00 HTCondor in the Cloud 20'
        Speaker: Mr. Todd Miller (CHTC)
        Material: Slides powerpoint file
    • 10:20 - 10:45 Break ( Atrium )
    • 10:45 - 12:15 Monday AM Introductory Tutorials 2
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      Location: H.F. DeLuca Forum
      • 10:45 HTCondor Job Testing, Troubleshooting, and Special Use Cases 20'
        Speaker: Christina Koch (UW Madison)
      • 11:15 Manage Workflows with HTCondor’s DAGMan 1h0'
        Speaker: Lauren Michael (UW-Madison)
        Material: Slides powerpoint file pdf file
    • 10:45 - 12:15 Monday AM Advanced Tutorials 2
      Conveners: Ian Ross (U. Wisconsin), Mr. Zach Miller (UW Madison)
      Location: Orchard View Room
      • 10:45 Negotiator Policy and Configuration 1h10'
        Speaker: Mr. Greg Thain (Center for High Throughput Computing)
        Material: Slides powerpoint file
      • 11:55 Advanced Submission Tutorial 20'
        Speaker: Mr. John Knoeller (University of Wisconsin, Madison)
        Material: Slides powerpoint file
    • 12:15 - 13:15 Lunch ( Atrium )
    • 13:15 - 14:45 Monday PM Advanced Workshops 1
      Conveners: Greg Thain (Center for High Throughput Computing), Aaron Moate (UW-Madison CHTC)
      • 13:15 Python Bindings Tutorial 40'
        Speaker: Brian Bockelman (University of Nebraska-Lincoln)
        Material: Slides link pdf file
      • 13:55 Work Queue tutorial 50'
        Speaker: Dr. Benjamin Tovar (University of Notre Dame)
        Material: Slides pdf file
    • 13:15 - 14:45 Monday PM CHTC Research 1
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      Location: H.F. DeLuca Forum
      • 13:15 Inferring Effective Connectivity From High-Dimensional ECoG Recordings 15'
        Speaker: Chris Endemann (UW-Madison Department of Anesthesiology)
        Material: Slides powerpoint file pdf file
      • 13:35 Genomic ancestry analysis in wild hybrid house mice 15'
        Speaker: Megan Frayer (UW-Madison Laboratory of Genetics)
        Material: Slides powerpoint file pdf file
      • 13:55 Uncertainty propagation in Fuel Cycle simulation using HTC 15'
        Speaker: Baptiste Mouginot (UW-Madison Department of Engineering)
        Material: Slides pdf file
      • 14:15 Alignment and CNV analysis in Cattle 15'
        Speaker: Beth Lett (UW-Madison Department of Animal Science)
        Material: Slides powerpoint file
    • 14:45 - 15:15 Break ( Atrium )
    • 14:45 - 15:15 Break ( Atrium )
    • 15:15 - 16:45 Monday PM Advanced Workshops 2
      Conveners: Mark Coatsworth (University of Wisconsin), Carl Edquist (UW-Madison CHTC)
      Location: Orchard View Room
      • 15:15 Pegasus Workshop 1h30'
        Speaker: Mr. Karan Vahi (Pegasus - Team USC Information Sciences Institute)
        Material: Slides pdf file
    • 15:15 - 16:15 Monday PM CHTC Research 2
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      Location: H.F. DeLuca Forum
      • 15:15 Image Analysis and Computation-Based Phenotyping 15'
        Speaker: Nathan Miller (UW-Madison Department of Botany)
      • 15:35 Grid Search Methods for Modeling Polymerization Kinetics 15'
        Speaker: Katie Ziebarth (UW-Madison Department of Chemistry)
        Material: Slides powerpoint file pdf file
      • 15:55 Studying RNA Virus Replication with Cryo-Electron Microscopy on HTC 15'
        Speaker: Hong Zhan (Morgridge Institute for Research)
        Material: Slides powerpoint file pdf file
    • 16:15 - 17:45 Ice Cream Mixer: talk with other HTCondor users ( Atrium )
  • Tuesday, May 21, 2019
    • 08:00 - 08:55 Coffee and Registration
    • 08:55 - 10:30 Tuesday AM Welcome and Keynote
      Conveners: Mark Coatsworth (University of Wisconsin), Mr. Todd Tannenbaum (University of Wisconsin)
      Location: H.F. DeLuca Forum
      • 08:55 Welcome to HTCondor Week 5'
        Speaker: Miron Livny (UW-Madison CHTC)
        Material: Slides powerpoint file
      • 09:00 Ice Fishing for Neutrinos: Exploring the mysteries of the cosmos from beneath the South Pole 1h0'
        Speaker: Dr. Francis Halzen (UW-Madison WIPAC)
      • 10:00 Computer and Data Sciences at UW-Madison 15'
        Speaker: Remzi Arpaci-Dusseau (UW-Madison Department of Computer Sciences)
        Material: Slides powerpoint file
    • 10:15 - 10:45 Break ( Atrium )
    • 10:45 - 12:15 Tuesday AM Technical Talks
      Conveners: Ian Ross (U. Wisconsin), Aaron Moate (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 10:45 IceCube Computing 20'
        Speaker: Benedikt Riedel (UW-Madison WIPAC)
        Material: Slides powerpoint file pdf file
      • 11:10 HTCondor in Foxconn Hyperscale AI HPC Cloud 15'
        Speaker: Hank Du (Foxconn Industrial Internet)
        Material: Slides pdf file
      • 11:25 Orpheus: Efficient Distributed Machine Learning via System and Algorithm Co- design 15'
        Speaker: Pengtao Xie (Petuum Inc.)
      • 11:45 What's new in HTCondor? What is upcoming? 25'
        Speaker: Mr. Todd Tannenbaum (University of Wisconsin)
        Material: Slides powerpoint file
    • 12:15 - 13:15 Lunch ( Atrium )
    • 13:15 - 15:20 Tuesday PM Technical Talks 1
      Conveners: Mr. Jaime Frey (Center for High-Throughput Computing), Tim Slauson (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 13:15 Space Telescope Science Institute (STScI) and HTCondor – Reporting on today and exploring tomorrow. 20'
        Speaker: Mrs. Mary Romelfanger (Space Telescope Science Institute)
        Material: Slides powerpoint file pdf file
      • 13:40 Simplifying submitting for our users with a custom submission API 20'
        Speaker: Mr. Collin Mehring (Dreamworks Animation)
        Material: Slides powerpoint file
      • 14:05 Updates from LIGO 20'
        Speaker: James Clark (Georgia Institute of Technology (LIGO))
        Material: Slides pdf file
      • 14:30 'Startd flocking' at and around the Milan Physics Dept. 20'
        Speaker: Francesco Prelz (INFN - Sezione di Milano)
        Material: Slides link
      • 14:55 HTCondor in Astronomy at NCSA 20'
        Speakers: Greg Daues (NCSA), Michael Johnson (National Center for Supercomputing Applications)
        Material: Slides powerpoint file pdf file
    • 15:20 - 15:45 Break ( Atrium )
    • 15:45 - 17:05 Tuesday PM Technical Talks 2
      Conveners: Josh Karpel (UW-Madison CHTC), Matyas Selmeci (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 15:45 An opportunistic HTCondor pool inside a interactive-friendly Kubernetes cluster 20'
        Speaker: Mr. Igor Sfiligoi (University of California San Diego)
        Material: Slides powerpoint file pdf file
      • 16:10 Pegasus : Introducing Integrity to Scientific Workflows 20'
        Speaker: Mr. Karan Vahi (Pegasus - Team USC Information Sciences Institute)
        Material: Slides powerpoint file pdf file
      • 16:35 AI platform on HTcondor 20'
        Speaker: Mr. Vishnu Vettrivel (Wisecube)
        Material: Slides powerpoint file pdf file
      • 17:00 Tuesday Closing Remarks 5'
        Speaker: Miron Livny (UW-Madison CHTC)
    • 17:05 - 19:00 Amazon Web Services Social
      Location: Atrium
  • Wednesday, May 22, 2019
    • 08:00 - 09:00 Coffee and Registration ( Atrium )
    • 09:00 - 10:35 Wednesday AM Campus Research
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      Location: H.F. DeLuca Forum
      • 09:00 Facilitating High Throughput Computing 15'
        Speaker: Lauren Michael (UW-Madison)
        Material: Slides powerpoint file pdf file
      • 09:20 Improving the quality of my research on urban residential hydrology by increasing the quantity of simulations using HTCondor 20'
        Speaker: Carolyn Voter (University of Wisconsin-Madison)
        Material: Slides powerpoint file
      • 09:45 Analyzing Soil Microbial Community Sequencing Data with the CHTC 20'
        Speaker: Thea Whitman (UW-Madison Department of Soil Science)
        Material: Slides pdf file
      • 10:10 High Throughput Computing For the Generation of a Self-Stabilizing Laser Sail Capable of Exploring Beyond Our Solar System 20'
        Speaker: Joel Siegel (UW-Madison Department of Physics)
        Material: Slides powerpoint file pdf file
    • 10:35 - 11:00 Break ( Atrium )
    • 11:00 - 12:15 Wednesday AM Technical Talks
      Conveners: Mr. Todd Miller (CHTC), Tim Theisen (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 11:00 High-throughput processing of telemetry data 20'
        Speakers: Dr. DJ Lee (Brigham Young University), Mr. Colton Mikes (Texas Tech University), Dr. Richard Erickson (US Geological Survey)
        Material: Slides powerpoint file pdf file
      • 11:25 Deploying and managing containers on OSG 20'
        Speaker: Marco Mambelli (Fermilab)
        Material: Slides pdf file
      • 11:50 Scientific Computing using AWS and HTCondor 20'
        Speaker: Dr. Sanjay Padhi (AWS)
        Material: Slides pdf file
    • 12:15 - 13:15 Lunch ( Atrium )
    • 13:15 - 15:20 Wednesday PM Technical Talks 1
      Conveners: Josh Karpel (UW-Madison CHTC), Brian Lin (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 13:15 HTCondor Solutions for the Future of the CMS Submission Infrastructure 20'
        Speaker: Dr. JAMES LETTS (UCSD)
        Material: Slides pdf file
      • 13:40 Managing a Dynamic Sharded Pool 20'
        Speaker: Anthony Tiradani (Fermilab National Accelerator Laboratory)
        Material: Slides powerpoint file pdf file
      • 14:05 HTCondor with google Cloud Platform 20'
        Speaker: Michiru Kaneda (The University of Tokyo)
        Material: Slides powerpoint file pdf file
      • 14:30 HTCondor Solutions for Several Scenarios at IHEP 20'
        Speaker: Jiaheng Zou (Institute of High Energy Physics (IHEP) of the Chinese Academy of Sciences (CAS))
        Material: Slides powerpoint file pdf file
      • 14:55 Job Submission via Share Filesystem: Running HTCondor Jobs on Isolated HPC Machines 20'
        Speaker: Mr. Jaime Frey (Center for High-Throughput Computing)
        Material: Slides powerpoint file
    • 15:20 - 15:50 Break ( Atrium )
    • 15:50 - 17:10 Wednesday PM Technical Talks 2
      Conveners: Jason Patton (University of Wisconsin), Tim Slauson (UW-Madison CHTC)
      Location: H.F. DeLuca Forum
      • 15:50 Python bindings based monitoring at CMS 20'
        Speaker: Diego Davila (CERN)
        Material: Slides pdf file
      • 16:15 Thinking about HTC Notebooks: High Throughput Computing via Jupyter Notebooks 15'
        Speaker: Mr. Todd Tannenbaum (University of Wisconsin)
        Material: Slides powerpoint file pdf file
      • 16:30 HTMap: High-Throughput Computing in Python 15'
        Speaker: Mr. Josh Karpel (University of Wisconsin - Madison)
        Material: Slides powerpoint file pdf file
      • 16:50 Wednesday Closing Remarks 20'
        Speaker: Miron Livny (UW-Madison CHTC)
    • 18:00 - 20:00 Wednesday Night Social
      Location: Wisconsin Memorial Union ( Terrace )
  • Thursday, May 23, 2019
    • 08:00 - 09:00 Coffee and Registration ( Atrium )
    • 09:00 - 10:40 Thursday AM Systems Administration Talks 1
      Conveners: Mr. Zach Miller (UW Madison), Greg Thain (Center for High Throughput Computing)
      Location: H.F. DeLuca Forum
      • 09:00 HTCondor Architecture 20'
        Speaker: Mr. Todd Tannenbaum (University of Wisconsin)
        Material: Slides powerpoint file pdf file
      • 09:25 Installation and configuration of a HTCondor Pool 20'
        Speaker: Tim Theisen (UW-Madison CHTC)
        Material: Slides presentation file pdf file
      • 09:50 Moving your job's data 20'
        Speaker: Brian Bockelman (Morgridge Institute for Research)
        Material: Slides pdf file
      • 10:15 Event-Sourced Monitoring of your HTCondor Cluster 20'
        Speaker: Mr. Kevin Retzke (Fermilab)
        Material: Slides powerpoint file pdf file
    • 10:40 - 11:00 Break ( Atrium )
    • 11:00 - 12:30 Thursday AM Systems Administration Talks 2
      Conveners: Mr. Jaime Frey (Center for High-Throughput Computing), Ian Ross (U. Wisconsin)
      Location: H.F. DeLuca Forum
      • 11:00 Federating HTCondor Pools 20'
        Speaker: Mr. Greg Thain (Center for High Throughput Computing)
        Material: Slides powerpoint file
      • 11:25 SciTokens and Credential Management 30'
        Speakers: Mr. Zach Miller (UW Madison), Jason Patton (University of Wisconsin)
        Material: Slides powerpoint file pdf file
      • 12:00 Schedd Job Transforms 30'
        Speaker: Mr. John Knoeller (University of Wisconsin, Madison)
        Material: Slides powerpoint file
    • 12:30 - 13:30 Lunch ( Atrium )