Automating Research Data Workflows with Globus

This webinar builds on our previous one, which demonstrated how to use Globus to manage data within the ALCF and beyond. During this webinar, we will cover common data management use cases, like synchronization and distribution, and demonstrate how the Globus command line interface (CLI) and API can be used to automate these tasks. We will also provide specific examples to instruct users how to automate scripted transfers to/from endpoints, and how to have a script return an inventory of data stored on an endpoint. You will be able to test drive the Globus CLI and underlying APIs using a Jupyter notebook during and after the webinar.

About the Speaker

Rick Wagner is the Globus Professional Services manager, managing a team of engineers supporting organizations and research projects in solving large-scale and complex data management challenges. The team currently works on XSEDE, E3SM, and building data services for ALCF users and projects. Rick was the HPC Systems Manager at the San Diego Supercomputer Center and his starting point in research was computational astrophysics.

About ALCF Developer Sessions

This webinar series is aimed at increasing the dialogue between ALCF users and the developers of leadership-class systems and software. Attendees are encouraged to bring any questions related to ALCF systems.