HTCondor Week 2019

America/Chicago
Discovery Building on the University of Wisconsin-Madison Campus

Discovery Building on the University of Wisconsin-Madison Campus

330 N Orchard St, Madison, WI, 53715
Brian Bockelman (University of Nebraska-Lincoln), Mark Coatsworth (University of Wisconsin), Todd Tannenbaum (University of Wisconsin)
Participants
  • Aaron Colcord
  • Aaron Moate
  • Alec Sheperd
  • Alexander Withers
  • Ally Miller
  • Andrew Maier
  • Anthony Tiradani
  • Arash Nemati Hayati
  • Baptiste Mouginot
  • Ben Huebner
  • Benedikt Riedel
  • Benjamin Tovar
  • Beth Lett
  • Boris Sadkhin
  • Brian Bockelman
  • Brian Lin
  • Bruno Coimbra
  • Burt Holzman
  • Carl Edquist
  • Carolyn Voter
  • Cheng-Han Du
  • Chris Endemann
  • Christina Koch
  • Collin Mehring
  • Daniel Wieder
  • David Schultz
  • Diego Davila
  • Doug Barton
  • Doug Cain
  • Emile Turatsinze
  • Eric Sedore
  • Evan Owens
  • Ewa Deelman
  • Farrukh Khan
  • Francesco Prelz
  • Francis Halzen
  • Gianni Pezzarossi
  • Greg Daues
  • Greg Thain
  • Hong Zhan
  • Hsin-Fang Chiang
  • Ian Ross
  • Igor Sfiligoi
  • Jaime Frey
  • Jake Rundall
  • James Clark
  • James Letts
  • James Robnett
  • Jason Patton
  • Jeff Gaynor
  • Jiaheng Zou
  • Jim Basney
  • Joel Siegel
  • John Caskey
  • John Knoeller
  • Josh Karpel
  • Joshua Shorenstein
  • Karan Vahi
  • Katie Ziebarth
  • Kent Cramer
  • Kenyi Hurtado Anampa
  • Kevin Retzke
  • Kevin Thompson
  • Lauren Michael
  • Lorena Lobato Pardavila
  • Marco Mambelli
  • Maria Acosta
  • Mark Coatsworth
  • Mary Romelfanger
  • Matyas Selmeci
  • Megan Frayer
  • Merina Albert
  • Michael DePalatis
  • Michael Fienen
  • Michael Johnson
  • Michael Pelletier
  • Michael Swam
  • Michiru Kaneda
  • Miron Livny
  • Nathan Kolbow
  • Nathan Miller
  • Nicholas Peregonow
  • Pengtao Xie
  • Pervez Choudhry
  • Peter Couvares
  • Philip Papadopoulos
  • Richard Erickson
  • Sanjay Padhi
  • Scott Bolte
  • Shawn Kwang
  • Shreyas Bhat
  • Steve Barnet
  • Thea Whitman
  • Tim Cartwright
  • Tim Slauson
  • Tim Theisen
  • Timothy Vruwink
  • Todd Miller
  • Todd Tannenbaum
  • Vishnu Vettrivel
  • Vladimir Brik
  • William Immendorf
  • William Strecker-Kellogg
  • Xin Gao
  • Yer Lor
  • Zach Miller
  • Zheng Sun
    • 8:00 AM 9:00 AM
      Coffee and Registration 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

    • 9:00 AM 10:20 AM
      Monday AM Advanced Tutorials 1 Orchard View Room

      Orchard View Room

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Brian Lin (UW-Madison CHTC), Mr John Knoeller (University of Wisconsin, Madison)
      • 9:00 AM
        Philosophy of HTCondor 30m
        Speaker: Mr Greg Thain (Center for High Throughput Computing)
        Slides
      • 9:30 AM
        ClassAd Advanced Tutorial 30m
        Speaker: Mr Jaime Frey (Center for High-Throughput Computing)
        Slides
      • 10:00 AM
        HTCondor in the Cloud 20m
        Speaker: Mr Todd Miller (CHTC)
        Slides
    • 9:00 AM 10:20 AM
      Monday AM Introductury Tutorials 1 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      • 9:00 AM
        Introduction to CHTC 20m
        Speaker: Lauren Michael (UW-Madison)
        Slides
      • 9:20 AM
        Intro to HTCondor Job Submission 1h
        Speaker: Christina Koch (UW Madison)
        Slides
    • 10:20 AM 10:45 AM
      Break 25m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 10:45 AM 12:15 PM
      Monday AM Advanced Tutorials 2 Orchard View Room

      Orchard View Room

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Ian Ross (U. Wisconsin), Mr Zach Miller (UW Madison)
      • 10:45 AM
        Negotiator Policy and Configuration 1h 10m
        Speaker: Mr Greg Thain (Center for High Throughput Computing)
        Slides
      • 11:55 AM
        Advanced Submission Tutorial 20m
        Speaker: Mr John Knoeller (University of Wisconsin, Madison)
        Slides
    • 10:45 AM 12:15 PM
      Monday AM Introductory Tutorials 2 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      • 10:45 AM
        HTCondor Job Testing, Troubleshooting, and Special Use Cases 20m
        Speaker: Christina Koch (UW Madison)
      • 11:15 AM
        Manage Workflows with HTCondor’s DAGMan 1h
        Speaker: Lauren Michael (UW-Madison)
        Slides
    • 12:15 PM 1:15 PM
      Lunch 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 1:15 PM 2:45 PM
      Monday PM Advanced Workshops 1
      Conveners: Aaron Moate (UW-Madison CHTC), Greg Thain (Center for High Throughput Computing)
      • 1:15 PM
        Python Bindings Tutorial 40m
        Speaker: Brian Bockelman (University of Nebraska-Lincoln)
        Slides
      • 1:55 PM
        Work Queue tutorial 50m
        Speaker: Dr Benjamin Tovar (University of Notre Dame)
        Slides
    • 1:15 PM 2:45 PM
      Monday PM CHTC Research 1 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      • 1:15 PM
        Inferring Effective Connectivity From High-Dimensional ECoG Recordings 15m
        Speaker: Chris Endemann (UW-Madison Department of Anesthesiology)
        Slides
      • 1:35 PM
        Genomic ancestry analysis in wild hybrid house mice 15m
        Speaker: Megan Frayer (UW-Madison Laboratory of Genetics)
        Slides
      • 1:55 PM
        Uncertainty propagation in Fuel Cycle simulation using HTC 15m
        Speaker: Baptiste Mouginot (UW-Madison Department of Engineering)
        Slides
      • 2:15 PM
        Alignment and CNV analysis in Cattle 15m
        Speaker: Beth Lett (UW-Madison Department of Animal Science)
        Slides
    • 2:45 PM 3:15 PM
      Break 30m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 2:45 PM 3:15 PM
      Break 30m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 3:15 PM 4:45 PM
      Monday PM Advanced Workshops 2 Orchard View Room

      Orchard View Room

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Carl Edquist (UW-Madison CHTC), Mark Coatsworth (University of Wisconsin)
      • 3:15 PM
        Pegasus Workshop 1h 30m
        Speaker: Mr Karan Vahi (Pegasus - Team USC Information Sciences Institute)
        Slides
    • 3:15 PM 4:15 PM
      Monday PM CHTC Research 2 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      • 3:15 PM
        Image Analysis and Computation-Based Phenotyping 15m
        Speaker: Nathan Miller (UW-Madison Department of Botany)
      • 3:35 PM
        Grid Search Methods for Modeling Polymerization Kinetics 15m
        Speaker: Katie Ziebarth (UW-Madison Department of Chemistry)
        Slides
      • 3:55 PM
        Studying RNA Virus Replication with Cryo-Electron Microscopy on HTC 15m
        Speaker: Hong Zhan (Morgridge Institute for Research)
        Slides
    • 4:15 PM 5:45 PM
      Ice Cream Mixer: talk with other HTCondor users 1h 30m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 8:00 AM 8:55 AM
      Coffee and Registration 55m
    • 8:55 AM 10:30 AM
      Tuesday AM Welcome and Keynote H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Mark Coatsworth (University of Wisconsin), Mr Todd Tannenbaum (University of Wisconsin)
      • 8:55 AM
        Welcome to HTCondor Week 5m
        Speaker: Miron Livny (UW-Madison CHTC)
        Slides
      • 9:00 AM
        Ice Fishing for Neutrinos: Exploring the mysteries of the cosmos from beneath the South Pole 1h
        Speaker: Dr Francis Halzen (UW-Madison WIPAC)
      • 10:00 AM
        Computer and Data Sciences at UW-Madison 15m
        Speaker: Remzi Arpaci-Dusseau (UW-Madison Department of Computer Sciences)
        Slides
    • 10:15 AM 10:45 AM
      Break 30m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 10:45 AM 12:15 PM
      Tuesday AM Technical Talks H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Aaron Moate (UW-Madison CHTC), Ian Ross (U. Wisconsin)
      • 10:45 AM
        IceCube Computing 20m
        Speaker: Benedikt Riedel (UW-Madison WIPAC)
        Slides
      • 11:10 AM
        HTCondor in Foxconn Hyperscale AI HPC Cloud 15m
        Speaker: Hank Du (Foxconn Industrial Internet)
        Slides
      • 11:25 AM
        Orpheus: Efficient Distributed Machine Learning via System and Algorithm Co- design 15m
        Speaker: Pengtao Xie (Petuum Inc.)
      • 11:45 AM
        What's new in HTCondor? What is upcoming? 25m
        Speaker: Mr Todd Tannenbaum (University of Wisconsin)
        Slides
    • 12:15 PM 1:15 PM
      Lunch 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 1:15 PM 3:20 PM
      Tuesday PM Technical Talks 1 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Mr Jaime Frey (Center for High-Throughput Computing), Tim Slauson (UW-Madison CHTC)
      • 1:15 PM
        Space Telescope Science Institute (STScI) and HTCondor – Reporting on today and exploring tomorrow. 20m
        Speaker: Mrs Mary Romelfanger (Space Telescope Science Institute)
        Slides
      • 1:40 PM
        Simplifying submitting for our users with a custom submission API 20m
        Speaker: Mr Collin Mehring (Dreamworks Animation)
        Slides
      • 2:05 PM
        Updates from LIGO 20m
        Speaker: James Clark (Georgia Institute of Technology (LIGO))
        Slides
      • 2:30 PM
        'Startd flocking' at and around the Milan Physics Dept. 20m
        Speaker: Francesco Prelz (INFN - Sezione di Milano)
        Slides
      • 2:55 PM
        HTCondor in Astronomy at NCSA 20m
        Speakers: Greg Daues (NCSA), Michael Johnson (National Center for Supercomputing Applications)
        Slides
    • 3:20 PM 3:45 PM
      Break 25m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 3:45 PM 5:05 PM
      Tuesday PM Technical Talks 2 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Josh Karpel (UW-Madison CHTC), Matyas Selmeci (UW-Madison CHTC)
      • 3:45 PM
        An opportunistic HTCondor pool inside a interactive-friendly Kubernetes cluster 20m
        Speaker: Mr Igor Sfiligoi (University of California San Diego)
        Slides
      • 4:10 PM
        Pegasus : Introducing Integrity to Scientific Workflows 20m
        Speaker: Mr Karan Vahi (Pegasus - Team USC Information Sciences Institute)
        Slides
      • 4:35 PM
        AI platform on HTcondor 20m
        Speaker: Mr Vishnu Vettrivel (Wisecube)
        Slides
      • 5:00 PM
        Tuesday Closing Remarks 5m
        Speaker: Miron Livny (UW-Madison CHTC)
    • 5:05 PM 7:00 PM
      Amazon Web Services Social Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 8:00 AM 9:00 AM
      Coffee and Registration 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 9:00 AM 10:35 AM
      Wednesday AM Campus Research H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Christina Koch (UW Madison), Lauren Michael (UW-Madison)
      • 9:00 AM
        Facilitating High Throughput Computing 15m
        Speaker: Lauren Michael (UW-Madison)
        Slides
      • 9:20 AM
        Improving the quality of my research on urban residential hydrology by increasing the quantity of simulations using HTCondor 20m
        Speaker: Carolyn Voter (University of Wisconsin-Madison)
        Slides
      • 9:45 AM
        Analyzing Soil Microbial Community Sequencing Data with the CHTC 20m
        Speaker: Thea Whitman (UW-Madison Department of Soil Science)
        Slides
      • 10:10 AM
        High Throughput Computing For the Generation of a Self-Stabilizing Laser Sail Capable of Exploring Beyond Our Solar System 20m
        Speaker: Joel Siegel (UW-Madison Department of Physics)
        Slides
    • 10:35 AM 11:00 AM
      Break 25m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 11:00 AM 12:15 PM
      Wednesday AM Technical Talks H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Tim Theisen (UW-Madison CHTC), Mr Todd Miller (CHTC)
      • 11:00 AM
        High-throughput processing of telemetry data 20m
        Speakers: Mr Colton Mikes (Texas Tech University), Dr DJ Lee (Brigham Young University), Dr Richard Erickson (US Geological Survey)
        Slides
      • 11:25 AM
        Deploying and managing containers on OSG 20m
        Speaker: Marco Mambelli (Fermilab)
        Slides
      • 11:50 AM
        Scientific Computing using AWS and HTCondor 20m
        Speaker: Dr Sanjay Padhi (AWS)
        Slides
    • 12:15 PM 1:15 PM
      Lunch 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 1:15 PM 3:20 PM
      Wednesday PM Technical Talks 1 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Brian Lin (UW-Madison CHTC), Josh Karpel (UW-Madison CHTC)
      • 1:15 PM
        HTCondor Solutions for the Future of the CMS Submission Infrastructure 20m
        Speaker: Dr JAMES LETTS (UCSD)
        Slides
      • 1:40 PM
        Managing a Dynamic Sharded Pool 20m
        Speaker: Anthony Tiradani (Fermilab National Accelerator Laboratory)
        Slides
      • 2:05 PM
        HTCondor with google Cloud Platform 20m
        Speaker: Michiru Kaneda (The University of Tokyo)
        Slides
      • 2:30 PM
        HTCondor Solutions for Several Scenarios at IHEP 20m
        Speaker: Jiaheng Zou (Institute of High Energy Physics (IHEP) of the Chinese Academy of Sciences (CAS))
        Slides
      • 2:55 PM
        Job Submission via Share Filesystem: Running HTCondor Jobs on Isolated HPC Machines 20m
        Speaker: Mr Jaime Frey (Center for High-Throughput Computing)
        Slides
    • 3:20 PM 3:50 PM
      Break 30m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 3:50 PM 5:10 PM
      Wednesday PM Technical Talks 2 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Jason Patton (University of Wisconsin), Tim Slauson (UW-Madison CHTC)
      • 3:50 PM
        Python bindings based monitoring at CMS 20m
        Speaker: Diego Davila (CERN)
        Slides
      • 4:15 PM
        Thinking about HTC Notebooks: High Throughput Computing via Jupyter Notebooks 15m
        Speaker: Mr Todd Tannenbaum (University of Wisconsin)
        Slides
      • 4:30 PM
        HTMap: High-Throughput Computing in Python 15m
        Speaker: Mr Josh Karpel (University of Wisconsin - Madison)
        Slides
      • 4:50 PM
        Wednesday Closing Remarks 20m
        Speaker: Miron Livny (UW-Madison CHTC)
    • 6:00 PM 8:00 PM
      Wednesday Night Social Terrace (Wisconsin Memorial Union)

      Terrace

      Wisconsin Memorial Union

    • 8:00 AM 9:00 AM
      Coffee and Registration 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 9:00 AM 10:40 AM
      Thursday AM Systems Administration Talks 1 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Greg Thain (Center for High Throughput Computing), Mr Zach Miller (UW Madison)
      • 9:00 AM
        HTCondor Architecture 20m
        Speaker: Mr Todd Tannenbaum (University of Wisconsin)
        Slides
      • 9:25 AM
        Installation and configuration of a HTCondor Pool 20m
        Speaker: Tim Theisen (UW-Madison CHTC)
        Slides
      • 9:50 AM
        Moving your job's data 20m
        Speaker: Brian Bockelman (Morgridge Institute for Research)
        Slides
      • 10:15 AM
        Event-Sourced Monitoring of your HTCondor Cluster 20m
        Speaker: Mr Kevin Retzke (Fermilab)
        Slides
    • 10:40 AM 11:00 AM
      Break 20m Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
    • 11:00 AM 12:30 PM
      Thursday AM Systems Administration Talks 2 H.F. DeLuca Forum

      H.F. DeLuca Forum

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715
      Conveners: Ian Ross (U. Wisconsin), Mr Jaime Frey (Center for High-Throughput Computing)
      • 11:00 AM
        Federating HTCondor Pools 20m
        Speaker: Mr Greg Thain (Center for High Throughput Computing)
        Slides
      • 11:25 AM
        SciTokens and Credential Management 30m
        Speakers: Jason Patton (University of Wisconsin), Mr Zach Miller (UW Madison)
        Slides
      • 12:00 PM
        Schedd Job Transforms 30m
        Speaker: Mr John Knoeller (University of Wisconsin, Madison)
        Slides
    • 12:30 PM 1:30 PM
      Lunch 1h Atrium

      Atrium

      Discovery Building on the University of Wisconsin-Madison Campus

      330 N Orchard St, Madison, WI, 53715