Skip to content
This repository has been archived by the owner on May 9, 2024. It is now read-only.

Avoid unnecessary buffers creation for shuffle #558

Open
ienkovich opened this issue Jun 28, 2023 · 0 comments
Open

Avoid unnecessary buffers creation for shuffle #558

ienkovich opened this issue Jun 28, 2023 · 0 comments

Comments

@ienkovich
Copy link
Contributor

Looks like we create unused output buffers for a shuffle execution unit. This is because we create all actual buffers in Executor but each QueryExecutionContext then creates QueryMemoryInitializer allocating unused memory. Memory consumption should be insignificant due to 1 entry count used for those buffers, but this indicates shuffle design flaws.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant