Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cf_write set Lustre striping parameter before file creation #757

Open
burlen opened this issue Jun 1, 2023 · 1 comment
Open

cf_write set Lustre striping parameter before file creation #757

burlen opened this issue Jun 1, 2023 · 1 comment
Labels
2_medium_priority an issue that should be fixed, but is not critical to the next release feature I/O high priority I/O issues

Comments

@burlen
Copy link
Collaborator

burlen commented Jun 1, 2023

currently we see a big improvement in I/O performance when setting the striping parameters. This currently has to be done manually in the shell before the run, but could be automated by examining the size of the incoming data before the file is created. We currently determine the file size after the file is created so some refactor is necessary.
@burlen burlen added feature I/O high priority I/O issues 2_medium_priority an issue that should be fixed, but is not critical to the next release labels Jun 1, 2023
@burlen
Copy link
Collaborator Author

burlen commented Jun 1, 2023

See #710

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
2_medium_priority an issue that should be fixed, but is not critical to the next release feature I/O high priority I/O issues
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@burlen