HTCondor Week 2018

May 21, 2018, 8:00 AM → May 24, 2018, 1:30 PM America/Chicago

Howard Auditorium (Fluno Center on the University of Wisconsin-Madison Campus)

Monday, May 21

8:00 AM → 9:00 AM Coffee and Registration

Coffee, tea, ice water

9:00 AM → 10:10 AM Monday AM Introductory Tutorials 1

Conveners: Mark Coatsworth (University of Wisconsin), Mr Todd Tannenbaum (University of Wisconsin)

9:00 AM HTCondor User Tutorial

Speaker: Christina Koch (UW-Madison CHTC)

Slides 2018-Koch-user-tutorial.pdf 2018-Koch-user-tutorial.pptx

10:10 AM → 10:40 AM Break

10:40 AM → 12:15 PM Monday AM Introductory Tutorials 2

Conveners: Brian Lin (UW-Madison CHTC), Jaime Frey (UW-Madison CHTC)

10:40 AM Workflows with HTCondor’s DAGMan

Speaker: Lauren Michael (UW-Madison CHTC)

Slides 2018-LMichael-DAGManTutorial.pdf 2018-LMichael-DAGManTutorial.pptx

11:35 AM Tutorial: HTCondor Python Bindings

Speaker: Brian Bockelman (University of Nebraska-Lincoln)

Slides Bockelman-HTCondorWeek-Python-2018.pdf

12:15 PM → 1:15 PM Lunch

1:15 PM → 3:15 PM Monday PM Advanced Tutorials 1

Conveners: Ian Ross (UW-Madison CHTC), Lauren Michael (UW-Madison)

1:15 PM Tutorial: Administrating HTCondor

Speaker: Greg Thain (UW-Madison CHTC)

Slides GthainAdminBasics.pdf GthainAdminBasics.pptx

2:20 PM Tutorial: How to submit jobs and where to find them

Speaker: John Knoeller (UW-Madison CHTC)

Slides TJs_Advanced_Submit_Condor_Week_2018.pptx

2:55 PM PU! Setting up parallel universe in your pool and when (not!) to use it

Speaker: Jason Patton (UW-Madison CHTC)

Slides Patton_Parallel_Universe.pdf Patton_Parallel_Universe.pptx

3:15 PM → 3:50 PM Break

3:50 PM → 4:45 PM Monday PM Advanced Tutorials 2

Conveners: Mr John Knoeller (University of Wisconsin, Madison), Tim Theisen (UW-Madison CHTC)

3:50 PM Negotiator Policy and Configuration

Speaker: Greg Thain (UW-Madison CHTC)

Slides Negotiator_Configuration.pdf Negotiator_Configuration.pptx

Tuesday, May 22

8:00 AM → 9:00 AM Coffee and Registration

Coffee, tea, ice water

9:00 AM → 10:15 AM Tuesday AM Technical Talks 1

Conveners: Mr Greg Thain (Center for High Throughput Computing), Matyas Selmeci (UW-Madison CHTC)

9:00 AM Welcome to HTCondor Week

Speaker: Miron Livny (UW-Madison CHTC)

Slides 05-18-CW_[Autosaved].pptx

9:20 AM What's new in HTCondor? What is upcoming?

Speaker: Todd Tannenbaum (UW-Madison CHTC)

Slides TannenbaumT_WhatsNew_HTCondor_Week_2018.pdf TannenbaumT_WhatsNew_HTCondor_Week_2018.pptx

9:50 AM HTCondor at CERN: Status and outlook

Speaker: Helge Meinhard (CERN)

Slides 2018-05-22-Condorweek-CondorAtCERN.pdf

10:15 AM → 10:50 AM Break

10:50 AM → 12:15 PM Tuesday AM Technical Talks 2

Conveners: Christina Koch (UW Madison), Mr Jason Patton (University of Wisconsin)

10:50 AM The SciTokens Authorization Model: JSON Web Tokens & OAuth

Speakers: Brian Bockelman (University of Nebraska-Lincoln), Jim Basney (NCSA)

Slides SciTokens-HTCondorWeek2018.pdf SciTokens-HTCondorWeek2018.pptx

11:15 AM HTCondor with KRB/AFS at DESY interactive batch farm

Speakers: Christoph Beyer (Deutsches Elektronen-Synchrotron), Mr Zach Miller (UW Madison)

Slides HTC_week_2018_talk.pdf ZKM-Creds.ppt

11:50 AM Securing flocking with Docker

Speaker: Kevin Hrpcek (UW-Madison Space Science and Engineering Center)

Slides securing_condor_flocking.pdf securing_condor_flocking.pptx

12:15 PM → 1:20 PM Lunch

1:20 PM → 3:10 PM Tuesday PM Technical Talks 1

Conveners: Carl Edquist (UW-Madison CHTC), Mr Zach Miller (UW Madison)

1:20 PM Using HTCondor and Singularity to run GPU jobs on the Titan Supercomputer

Speaker: Vladimir Brik (UW-Madison WIPAC)

Slides HTCondor_Week_2018__HTCondor_on_Titan.pdf

1:45 PM Improving the Scheduling Efficiency and Scalability of a Global Multi-core HTCondor Pool in CMS

Speaker: James Letts (UCSD Physics)

Slides CMS-HTCondor-Week-2018.pdf

2:10 PM Prioritizing vanilla and grid jobs from local users on a Tier-3 condor cluster

Speaker: Kenyi Hurtado Anampa (University of Notre Dame)

Slides HTCondor_NDT3experience.pdf

2:35 PM HTCondor Annex: Elasticity into the public cloud

Speaker: Todd Miller (UW-Madison CHTC)

Slides condor_annex-Tutorial-v5.pdf condor_annex-Tutorial-v5.pptx

3:10 PM → 3:45 PM Break

3:45 PM → 5:05 PM Tuesday PM Technical Talks 2

Conveners: Aaron Moate (UW-Madison CHTC), Mr Todd Miller (CHTC)

3:45 PM HTCondor for machine learning in biology

Speaker: Anthony Gitter (UW-Madison; Morgridge Institute for Research)

Slides gitter_htcondor_20180522.pdf gitter_htcondor_20180522.pptx

4:10 PM Amazon Web Services with HTCondor

Speaker: Sanjay Padhi (Amazon Web Services)

Slides AWS_HTCondor2018.pptx

4:35 PM Pegasus + HTCondor DAGMan: Expanding Scientific Workflows Horizons

Speaker: Karan Vahi (Pegasus - Team USC Information Sciences Institute)

Slides vahi-pegasus-cw-2018-final.pdf

5:00 PM Tuesday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

6:00 PM → 8:00 PM Social at the Terrace Sponsored by Google Cloud

6:00 PM Social at the Memorial Union Terrace Sponsored by Google Cloud

Please Join Us for a Social at the Memorial Union Terrace, 6 - 8 pm. Gift card for dinner and drinks courtesy of Google Cloud.

Speaker: HTCondor Team (University of Wisconsin-Madison)

Wednesday, May 23

8:00 AM → 9:00 AM Coffee and Registration

Coffee, tea, ice water

9:00 AM → 10:10 AM Wednesday AM Technical Talks 1

Conveners: Mr John Knoeller (University of Wisconsin, Madison), Tim Slauson (UW-Madison CHTC)

9:00 AM Probabilistic Simulation of Knee Contact and Ligament Loading using HTCondor

Speakers: Darryl Thelen (UW-Madison Mechanical Engineering), Joshua Roth (UW-Madison Mechanical Engineering)

Slides rothThelen_htcCondorWeek_v2.pptx

9:25 AM Using HTCondor to Calibrate and Archive HST and JWST Data

Speaker: Matthew Burger (Space Telescope Science Institute)

Slides Burger-HTCondorTalk.pdf

9:50 AM HTCondor and VC3: Virtual Clusters for Community Computation

Speaker: Ben Tovar (University of Notre Dame)

Slides vc3_condor_week_2018.pdf

10:10 AM → 10:40 AM Break

10:40 AM → 12:15 PM Wednesday AM Technical Talks 2

Conveners: Mr Jason Patton (University of Wisconsin), Mark Coatsworth (University of Wisconsin)

10:40 AM Migrate and run HTCondor job to SLURM cluster via container

Speaker: Jingyan Shi (Institute of High Energy Physics (IHEP) of the Chinese Academy of Sciences (CAS))

Slides htcondor_week_shijy_v2.pdf

11:05 AM Automatic for the People: Containers for LIGO software development on the Open Science Grid and other diverse computing resources

Speaker: Thomas Downes (University of Wisconsin-Milwaukee)

Slides for_the_People_(HTCondor_Week_2018).pdf https://docs.google.com/presentation/d/1pUYn7JbUDgV28BLDJGrTYJFFydliXTaM7OXxtg90iLY/edit?usp=sharing

11:30 AM Using Random Walk Monte Carlo to Measure Microstructure in Lung

Speaker: Annelise Malkus (UW-Madison Department of Medical Physics)

Transparents HTCondorWeek2018.pptx

11:55 AM Changing Compute Landscape at Brookhaven

Speaker: William Strecker-Kellogg (Brookhaven National Lab)

Slides htc18-bnl-will.pdf

12:15 PM → 1:15 PM Lunch

1:15 PM → 3:25 PM Wednesday PM Technical Talks 1

Conveners: Ian Ross (UW-Madison CHTC), Mr Zach Miller (UW Madison)

1:15 PM Migrating INFN-T1 to HTCondor

Speaker: Stefano Dal Pra (INFN-CNAF)

Slides HTC_cnaf_htcweek_2018.pdf

1:40 PM Docker with HTCondor at FNAL

Speaker: Anthony Tiradani (Fermilab National Accelerator Laboratory)

Slides FNALDocker_HTCondorweek2018_rev1.pdf FNALDocker_HTCondorweek2018_rev1.pptx

2:05 PM Managing Caffe Machine Learning Jobs with HTCondor

Speaker: Michael Pelletier (Raytheon)

Slides Managing_Caffe_Machine_Learning_with_HTCondor.pdf Managing_Caffe_Machine_Learning_with_HTCondor.pptx

2:30 PM HTCondor at an Animation Studio

Speaker: Collin Mehring (Dreamworks Animation)

Slides HTCondorAtDreamWorksAnimation.pdf HTCondorAtDreamWorksAnimation.pptx

2:55 PM HTCondor in KBase - The DOE Systems Biology Knowledgebase

Speakers: Boris Sadkhin (Argonne Lab), Daniel Murphy-Olson (Argonne Lab), Steve Chan (Lawrence Berkeley Lab)

Slides HTCondor2018_KBase.pdf HTCondor2018_KBase.pptx

3:25 PM → 3:55 PM Break

3:55 PM → 5:15 PM Wednesday PM Technical Talks 2

Conveners: Mr Greg Thain (Center for High Throughput Computing), Tim Theisen (UW-Madison CHTC)

3:55 PM Challenges of Containerization in the distributed computing environment

Speaker: Marco Mambelli (Fermilab)

Slides Containerization-condor_week.pdf

4:20 PM The Octopus Scarf

Speaker: James Adams (STFC Rutherford Appleton Laboratory)

Slides htcondor2018-octopus-scarf.pdf

4:45 PM Late materialization has partially materialized

Speaker: John Knoeller (UW-Madison CHTC)

Slides TJs_Late_Materialization_Condor_Week_2018.pptx

5:10 PM Wednesday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

Thursday, May 24

8:00 AM → 9:00 AM Coffee and Registration

Coffee, tea, ice water

9:00 AM → 10:20 AM Thursday AM UW Campus Research 1

Conveners: Brian Lin (UW-Madison CHTC), Christina Koch (UW Madison)

9:00 AM Research Computing Facilitation at CHTC

Speaker: Lauren Michael (UW-Madison CHTC)

Slides RCFWisconsin.pdf RCFWisconsin.pptx

9:10 AM Python: Swiss-Army Glue

Speaker: Josh Karpel (UW-Madison Department of Physics)

Slides PythonSwissArmyGlue.pdf PythonSwissArmyGlue.pptx

9:35 AM Using a process-based forest simulation model to study effects of climate change on wildfire and forests in the western US

Speaker: Winslow Hansen (UW-Madison Department of Integrative Biology)

Slides Hansen_CONDOR.pdf Hansen_CONDOR.pptx

10:00 AM UW-Madison HTCondor InSAR Workflow: Distributed computing for bulk processing of interferometric synthetic aperture radar data

Speaker: Elena Reinisch (UW-Madison Department of Geoscience)

Slides HTCondorWeek2018Presentation.pdf HTCondorWeek2018Presentation.pptx

10:20 AM → 10:45 AM Break

10:45 AM → 12:30 PM Thursday AM UW Campus Research 2

Conveners: Aaron Moate (UW-Madison CHTC), Lauren Michael (UW-Madison)

10:45 AM HTCondor in your backyard: modeling urban residential hydrology

Speaker: Carolyn Voter (UW-Madison Department of Civil & Environmental Engineering)

Slides CVoter_HTCondorWeek_2018.05.24.pptx

11:10 AM Simulating Disordered Spin Systems for Quantum Computing using HTCondor

Speaker: A. Barış Özgüler (UW-Madison Department of Physics)

Slides barisozguler_htcondor2018.pdf

11:35 AM Landsat Image Time Series Processing using HTCondor on UW-CHTC and OSG Resources

Speaker: Matthew Garcia (UW-Madison Department of Forest and Wildlife Ecology)

Slides MGarcia_HTCondorWeek2018.pdf MGarcia_HTCondorWeek2018.pptx

12:00 PM High-Throughput Machine Learning from Electronic Health Records

Speaker: Ross Kleiman (UW-Madison Department of Computer Sciences)

Slides 2018-05-24_HTCondor_Week.pptx

12:25 PM Thursday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

12:30 PM → 1:30 PM Lunch