Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use GlobusComputeExecutor #136

Merged
merged 5 commits into from
Nov 22, 2024

Conversation

christopherwharrop-noaa
Copy link
Collaborator

@christopherwharrop-noaa christopherwharrop-noaa commented Nov 22, 2024

This PR adds support for the new Parsl GlobusComputeExecutor to run tasks on globus compute endpoints. The configuration was modified to accommodate this change and all globus compute tests were converted to use the new executor.

The configuration code was modified to allow selection of specific resources to load from the supplied configuration yaml. This allows multiple tests and applications to share a single configuration file for resource specification but only load the resources needed for the specific situation.

The test configuration file was modified to use jinja2 templating for supplying endpoint ids. The endpoint ids are not known until they are started during the test, so jinja2 is used to update the config at runtime.

Closes #133

@christopherwharrop-noaa christopherwharrop-noaa added Test-MPAS-App Run CI test of the MPAS App and removed Test-MPAS-App Run CI test of the MPAS App labels Nov 22, 2024
@christopherwharrop-noaa christopherwharrop-noaa merged commit 6c54491 into main Nov 22, 2024
6 checks passed
@christopherwharrop-noaa christopherwharrop-noaa deleted the feature/globus-compute-executor branch November 22, 2024 17:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support Parsl's GlobusComputeExecutor
1 participant