HTCondor Week 2018

May 21, 2018, 8:00 AM → May 24, 2018, 1:30 PM America/Chicago

Howard Auditorium (Fluno Center on the University of Wisconsin-Madison Campus)

Monday, May 21

8:00 AM Coffee and Registration

Coffee, tea, ice water

Monday AM Introductory Tutorials 1

Conveners: Mark Coatsworth (University of Wisconsin), Mr Todd Tannenbaum (University of Wisconsin)

1 HTCondor User Tutorial

Speaker: Christina Koch (UW-Madison CHTC)

Slides 2018-Koch-user-tutorial.pdf 2018-Koch-user-tutorial.pptx

10:10 AM Break

Monday AM Introductory Tutorials 2

Conveners: Brian Lin (UW-Madison CHTC), Jaime Frey (UW-Madison CHTC)

2 Workflows with HTCondor’s DAGMan

Speaker: Lauren Michael (UW-Madison CHTC)

Slides 2018-LMichael-DAGManTutorial.pdf 2018-LMichael-DAGManTutorial.pptx

3 Tutorial: HTCondor Python Bindings

Speaker: Brian Bockelman (University of Nebraska-Lincoln)

Slides Bockelman-HTCondorWeek-Python-2018.pdf

12:15 PM Lunch

Monday PM Advanced Tutorials 1

Conveners: Ian Ross (UW-Madison CHTC), Lauren Michael (UW-Madison)

4 Tutorial: Administrating HTCondor

Speaker: Greg Thain (UW-Madison CHTC)

Slides GthainAdminBasics.pdf GthainAdminBasics.pptx

5 Tutorial: How to submit jobs and where to find them

Speaker: John Knoeller (UW-Madison CHTC)

Slides TJs_Advanced_Submit_Condor_Week_2018.pptx

6 PU! Setting up parallel universe in your pool and when (not!) to use it

Speaker: Jason Patton (UW-Madison CHTC)

Slides Patton_Parallel_Universe.pdf Patton_Parallel_Universe.pptx

3:15 PM Break

Monday PM Advanced Tutorials 2

Conveners: Mr John Knoeller (University of Wisconsin, Madison), Tim Theisen (UW-Madison CHTC)

7 Negotiator Policy and Configuration

Speaker: Greg Thain (UW-Madison CHTC)

Slides Negotiator_Configuration.pdf Negotiator_Configuration.pptx

Tuesday, May 22

8:00 AM Coffee and Registration

Coffee, tea, ice water

Tuesday AM Technical Talks 1

Conveners: Mr Greg Thain (Center for High Throughput Computing), Matyas Selmeci (UW-Madison CHTC)

8 Welcome to HTCondor Week

Speaker: Miron Livny (UW-Madison CHTC)

Slides 05-18-CW_[Autosaved].pptx

9 What's new in HTCondor? What is upcoming?

Speaker: Todd Tannenbaum (UW-Madison CHTC)

Slides TannenbaumT_WhatsNew_HTCondor_Week_2018.pdf TannenbaumT_WhatsNew_HTCondor_Week_2018.pptx

10 HTCondor at CERN: Status and outlook

Speaker: Helge Meinhard (CERN)

Slides 2018-05-22-Condorweek-CondorAtCERN.pdf

10:15 AM Break

Tuesday AM Technical Talks 2

Conveners: Christina Koch (UW Madison), Mr Jason Patton (University of Wisconsin)

11 The SciTokens Authorization Model: JSON Web Tokens & OAuth

Speakers: Brian Bockelman (University of Nebraska-Lincoln), Jim Basney (NCSA)

Slides SciTokens-HTCondorWeek2018.pdf SciTokens-HTCondorWeek2018.pptx

12 HTCondor with KRB/AFS at DESY interactive batch farm

Speakers: Christoph Beyer (Deutsches Elektronen-Synchrotron), Mr Zach Miller (UW Madison)

Slides HTC_week_2018_talk.pdf ZKM-Creds.ppt

13 Securing flocking with Docker

Speaker: Kevin Hrpcek (UW-Madison Space Science and Engineering Center)

Slides securing_condor_flocking.pdf securing_condor_flocking.pptx

12:15 PM Lunch

Tuesday PM Technical Talks 1

Conveners: Carl Edquist (UW-Madison CHTC), Mr Zach Miller (UW Madison)

14 Using HTCondor and Singularity to run GPU jobs on the Titan Supercomputer

Speaker: Vladimir Brik (UW-Madison WIPAC)

Slides HTCondor_Week_2018__HTCondor_on_Titan.pdf

15 Improving the Scheduling Efficiency and Scalability of a Global Multi-core HTCondor Pool in CMS

Speaker: James Letts (UCSD Physics)

Slides CMS-HTCondor-Week-2018.pdf

16 Prioritizing vanilla and grid jobs from local users on a Tier-3 condor cluster

Speaker: Kenyi Hurtado Anampa (University of Notre Dame)

Slides HTCondor_NDT3experience.pdf

17 HTCondor Annex: Elasticity into the public cloud

Speaker: Todd Miller (UW-Madison CHTC)

Slides condor_annex-Tutorial-v5.pdf condor_annex-Tutorial-v5.pptx

3:10 PM Break

Tuesday PM Technical Talks 2

Conveners: Aaron Moate (UW-Madison CHTC), Mr Todd Miller (CHTC)

18 HTCondor for machine learning in biology

Speaker: Anthony Gitter (UW-Madison; Morgridge Institute for Research)

Slides gitter_htcondor_20180522.pdf gitter_htcondor_20180522.pptx

19 Amazon Web Services with HTCondor

Speaker: Sanjay Padhi (Amazon Web Services)

Slides AWS_HTCondor2018.pptx

20 Pegasus + HTCondor DAGMan: Expanding Scientific Workflows Horizons

Speaker: Karan Vahi (Pegasus - Team USC Information Sciences Institute)

Slides vahi-pegasus-cw-2018-final.pdf

21 Tuesday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

Social at the Terrace Sponsored by Google Cloud

22 Social at the Memorial Union Terrace Sponsored by Google Cloud

Please Join Us for a Social at the Memorial Union Terrace, 6 - 8 pm. Gift card for dinner and drinks courtesy of Google Cloud.

Speaker: HTCondor Team (University of Wisconsin-Madison)

Wednesday, May 23

8:00 AM Coffee and Registration

Coffee, tea, ice water

Wednesday AM Technical Talks 1

Conveners: Mr John Knoeller (University of Wisconsin, Madison), Tim Slauson (UW-Madison CHTC)

23 Probabilistic Simulation of Knee Contact and Ligament Loading using HTCondor

Speakers: Darryl Thelen (UW-Madison Mechanical Engineering), Joshua Roth (UW-Madison Mechanical Engineering)

Slides rothThelen_htcCondorWeek_v2.pptx

24 Using HTCondor to Calibrate and Archive HST and JWST Data

Speaker: Matthew Burger (Space Telescope Science Institute)

Slides Burger-HTCondorTalk.pdf

25 HTCondor and VC3: Virtual Clusters for Community Computation

Speaker: Ben Tovar (University of Notre Dame)

Slides vc3_condor_week_2018.pdf

10:10 AM Break

Wednesday AM Technical Talks 2

Conveners: Mr Jason Patton (University of Wisconsin), Mark Coatsworth (University of Wisconsin)

26 Migrate and run HTCondor job to SLURM cluster via container

Speaker: Jingyan Shi (Institute of High Energy Physics (IHEP) of the Chinese Academy of Sciences (CAS))

Slides htcondor_week_shijy_v2.pdf

27 Automatic for the People: Containers for LIGO software development on the Open Science Grid and other diverse computing resources

Speaker: Thomas Downes (University of Wisconsin-Milwaukee)

Slides for_the_People_(HTCondor_Week_2018).pdf https://docs.google.com/presentation/d/1pUYn7JbUDgV28BLDJGrTYJFFydliXTaM7OXxtg90iLY/edit?usp=sharing

28 Using Random Walk Monte Carlo to Measure Microstructure in Lung

Speaker: Annelise Malkus (UW-Madison Department of Medical Physics)

Transparents HTCondorWeek2018.pptx

29 Changing Compute Landscape at Brookhaven

Speaker: William Strecker-Kellogg (Brookhaven National Lab)

Slides htc18-bnl-will.pdf

12:15 PM Lunch

Wednesday PM Technical Talks 1

Conveners: Ian Ross (UW-Madison CHTC), Mr Zach Miller (UW Madison)

30 Migrating INFN-T1 to HTCondor

Speaker: Stefano Dal Pra (INFN-CNAF)

Slides HTC_cnaf_htcweek_2018.pdf

31 Docker with HTCondor at FNAL

Speaker: Anthony Tiradani (Fermilab National Accelerator Laboratory)

Slides FNALDocker_HTCondorweek2018_rev1.pdf FNALDocker_HTCondorweek2018_rev1.pptx

32 Managing Caffe Machine Learning Jobs with HTCondor

Speaker: Michael Pelletier (Raytheon)

Slides Managing_Caffe_Machine_Learning_with_HTCondor.pdf Managing_Caffe_Machine_Learning_with_HTCondor.pptx

33 HTCondor at an Animation Studio

Speaker: Collin Mehring (Dreamworks Animation)

Slides HTCondorAtDreamWorksAnimation.pdf HTCondorAtDreamWorksAnimation.pptx

34 HTCondor in KBase - The DOE Systems Biology Knowledgebase

Speakers: Boris Sadkhin (Argonne Lab), Daniel Murphy-Olson (Argonne Lab), Steve Chan (Lawrence Berkeley Lab)

Slides HTCondor2018_KBase.pdf HTCondor2018_KBase.pptx

3:25 PM Break

Wednesday PM Technical Talks 2

Conveners: Mr Greg Thain (Center for High Throughput Computing), Tim Theisen (UW-Madison CHTC)

35 Challenges of Containerization in the distributed computing environment

Speaker: Marco Mambelli (Fermilab)

Slides Containerization-condor_week.pdf

36 The Octopus Scarf

Speaker: James Adams (STFC Rutherford Appleton Laboratory)

Slides htcondor2018-octopus-scarf.pdf

37 Late materialization has partially materialized

Speaker: John Knoeller (UW-Madison CHTC)

Slides TJs_Late_Materialization_Condor_Week_2018.pptx

38 Wednesday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

Thursday, May 24

8:00 AM Coffee and Registration

Coffee, tea, ice water

Thursday AM UW Campus Research 1

Conveners: Brian Lin (UW-Madison CHTC), Christina Koch (UW Madison)

39 Research Computing Facilitation at CHTC

Speaker: Lauren Michael (UW-Madison CHTC)

Slides RCFWisconsin.pdf RCFWisconsin.pptx

40 Python: Swiss-Army Glue

Speaker: Josh Karpel (UW-Madison Department of Physics)

Slides PythonSwissArmyGlue.pdf PythonSwissArmyGlue.pptx

41 Using a process-based forest simulation model to study effects of climate change on wildfire and forests in the western US

Speaker: Winslow Hansen (UW-Madison Department of Integrative Biology)

Slides Hansen_CONDOR.pdf Hansen_CONDOR.pptx

42 UW-Madison HTCondor InSAR Workflow: Distributed computing for bulk processing of interferometric synthetic aperture radar data

Speaker: Elena Reinisch (UW-Madison Department of Geoscience)

Slides HTCondorWeek2018Presentation.pdf HTCondorWeek2018Presentation.pptx

10:20 AM Break

Thursday AM UW Campus Research 2

Conveners: Aaron Moate (UW-Madison CHTC), Lauren Michael (UW-Madison)

43 HTCondor in your backyard: modeling urban residential hydrology

Speaker: Carolyn Voter (UW-Madison Department of Civil & Environmental Engineering)

Slides CVoter_HTCondorWeek_2018.05.24.pptx

44 Simulating Disordered Spin Systems for Quantum Computing using HTCondor

Speaker: A. Barış Özgüler (UW-Madison Department of Physics)

Slides barisozguler_htcondor2018.pdf

45 Landsat Image Time Series Processing using HTCondor on UW-CHTC and OSG Resources

Speaker: Matthew Garcia (UW-Madison Department of Forest and Wildlife Ecology)

Slides MGarcia_HTCondorWeek2018.pdf MGarcia_HTCondorWeek2018.pptx

46 High-Throughput Machine Learning from Electronic Health Records

Speaker: Ross Kleiman (UW-Madison Department of Computer Sciences)

Slides 2018-05-24_HTCondor_Week.pptx

47 Thursday Closing Remarks

Speaker: Miron Livny (UW-Madison CHTC)

12:30 PM Lunch