This helps protect our community. Learn more

Job Wrapper Scripts: Problems and Alternatives

514 subscribers

91 views 3 years ago

In this talk, Greg Thain provides an overview of job wrapper scripts and explains how to reliably run jobs, even on unreliable places. Topics include: reliability, a review of how HTCondor runs jobs, problems with wrappers under HTCondor, and a discussion of new and old solutions. Slides: https://agenda.hep.wisc.edu/event/173... All talks, speakers, and materials from HTCondor Week 2022: https://agenda.hep.wisc.edu/event/173... All materials from past HTCondor Week and European Workshop Meetings: https://htcondor.org/past_condor_week...

...more

1Likes

91Views

2022May 27

For us, reliability means

5:10

Let's talk about exit codes...

8:44

HTCondor does what about exit codes?

9:36

Remember how HTCondor sees the job?

12:13

Transcript

Follow along using the transcript.

Center for High Throughput Computing

514 subscribers

Job Wrapper Scripts: Problems and Alternatives

Key moments View all

For us, reliability means

For us, reliability means

For us, reliability means

Let's talk about exit codes...

Let's talk about exit codes...

Let's talk about exit codes...

HTCondor does what about exit codes?

HTCondor does what about exit codes?

HTCondor does what about exit codes?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

This is a common CS pattern

This is a common CS pattern

This is a common CS pattern

Wrapper Env var

Wrapper Env var

Wrapper Env var

Wrapper untar

Wrapper untar

Wrapper untar

Summary

Summary

Summary

Center for High Throughput Computing

Job Wrapper Scripts: Problems and Alternatives

Key moments

For us, reliability means

For us, reliability means

For us, reliability means

Let's talk about exit codes...

Let's talk about exit codes...

Let's talk about exit codes...

HTCondor does what about exit codes?

HTCondor does what about exit codes?

HTCondor does what about exit codes?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

This is a common CS pattern

This is a common CS pattern

This is a common CS pattern

Wrapper Env var

Wrapper Env var

Wrapper Env var

Wrapper untar

Wrapper untar

Wrapper untar

Summary

Summary

Summary

Description

Key moments View all

For us, reliability means

For us, reliability means

For us, reliability means

Let's talk about exit codes...

Let's talk about exit codes...

Let's talk about exit codes...

HTCondor does what about exit codes?

HTCondor does what about exit codes?

HTCondor does what about exit codes?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

Remember how HTCondor sees the job?

Center for High Throughput Computing

Transcript

Key moments

Key moments