Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

list: support getting partial lists? #5

Open
ThomasWaldmann opened this issue Aug 4, 2024 · 2 comments
Open

list: support getting partial lists? #5

ThomasWaldmann opened this issue Aug 4, 2024 · 2 comments

Comments

@ThomasWaldmann
Copy link
Member

ThomasWaldmann commented Aug 4, 2024

the list of all object ids in the backend / in the store could get rather long.

guess this needs to sort the IDs, so that we have a stable order?
maybe sorting each directory by itself is already good enough.

update:

backend: list is not that long as we only do flat single-directory listings and we usually use nesting to avoid too many items in a single directory.

store: does the recursion, so result is overall larger. but is a generator yielding single items, so no big lists are being built.

@ThomasWaldmann
Copy link
Member Author

ThomasWaldmann commented Aug 17, 2024

#15 implements sorting for .list.

if we have a sorted (or at least stable, not random) list order, we can use e.g. the last list member for continuing the listing with another .list call that lists everything AFTER the given member.

@ThomasWaldmann
Copy link
Member Author

There is also a related .list issue in borg and the interaction between borg and borgstore is rather a slow (but at least correct) hack right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant