Sign in to confirm you’re not a bot
This helps protect our community. Learn more

Evolution of the CMS Submission Infrastructure to Support Heterogeneous Resources

Partnership to Advance Throughput Computing
125 subscribers
11 views 4 years ago
Learn about how HTCondor supports the CMS experiment, a high energy physics general-purpose experiment running at the European Organization for Nuclear Research (CERN). The landscape of computing power available for the CMS experiment is already evolving from almost exclusively x86 processors, predominantly deployed at WLCG sites, towards a more diverse mixture of Grid, HPC and Cloud facilities, incorporating a higher fraction of non-CPU components, such as GPUs. The CMS Global Pool is consequently adapting to the heterogeneous resource scenario, aiming at making the new resource types available to CMS. An optimal level of granularity in their description and matchmaking strategy will be essential in order to ensure efficient allocation and matchmaking to CMS workflows. Current uncertainties involve what types of resources will be available in the future, how to prioritize diverse workflows to those diverse types, and how to deal with a diversit …...more
...more
Evolution of the CMS Submission Infrastructure to Support Heterogeneous Resources
0Likes
11Views
2021Jun 14
Learn about how HTCondor supports the CMS experiment, a high energy physics general-purpose experiment running at the European Organization for Nuclear Research (CERN). The landscape of computing power available for the CMS experiment is already evolving from almost exclusively x86 processors, predominantly deployed at WLCG sites, towards a more diverse mixture of Grid, HPC and Cloud facilities, incorporating a higher fraction of non-CPU components, such as GPUs. The CMS Global Pool is consequently adapting to the heterogeneous resource scenario, aiming at making the new resource types available to CMS. An optimal level of granularity in their description and matchmaking strategy will be essential in order to ensure efficient allocation and matchmaking to CMS workflows. Current uncertainties involve what types of resources will be available in the future, how to prioritize diverse workflows to those diverse types, and how to deal with a diversity of policy preferences by the resource providers. This video describes the present capabilities of the CMS Submission Infrastructure and its critical dependencies on the underlying tools (such as HTCondor and GlideinWMS), along with its necessary evolution towards a full integration and support of heterogeneous resources according to the CMS needs. Presented on May 25 by Marco Mascheroni as part of HTCondor Week 2021. Slide decks are available here: https://agenda.hep.wisc.edu/event/157... Learn more about CERN and the CMS experiment: https://home.cern/ Questions? We're happy to answer questions about the PATh Project and help researchers, campus computing providers, and research collaborations leverage both CHTC and OSG resources! Visit our contact page: https://path-cc.io/contact/ and contact us at support@opensciencegrid.org with any questions.

Follow along using the transcript.

Partnership to Advance Throughput Computing

125 subscribers