Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NUMA aware CPUBackend #14

Open
marty1885 opened this issue Jun 3, 2019 · 1 comment
Open

NUMA aware CPUBackend #14

marty1885 opened this issue Jun 3, 2019 · 1 comment
Labels
CPU About the CPU backend optimization make stuff faster!

Comments

@marty1885
Copy link
Member

Currently CPUBackend is not NUMA aware, so Etaler might run slower on a NUMA system (Multi-socket servers/ AMD 1st gen EPYC/ AMD ThreadRipper). Binding threads on NUMA nodes. allocating memory on NUMA local memory and running separate backends on NUMA nodes should allow Etaler to run fast on NUMA systems.

Yet since TBB is not NUMA aware. So we might need to drop TBB to support NUMA.
@marty1885 marty1885 added CPU About the CPU backend optimization make stuff faster! labels Jun 3, 2019
@marty1885
Copy link
Member Author

We might want to implement a thread pool w/ std::thread and pin threads to numa nodes using boost::numa. Seems to be the most portable solution.

@marty1885 marty1885 mentioned this issue Jul 13, 2019
Draft
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
CPU About the CPU backend optimization make stuff faster!
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@marty1885