Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

avoid synced copy in tensor pool #2514

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

avoid synced copy in tensor pool #2514

wants to merge 1 commit into from

Commits on Oct 23, 2024

  1. avoid synced copy in tensor pool 

    Summary:
index select will implicitly move the indices to device if it was in CPU. However, this copy would be blocking.

An additional improvement we could do is to make sure indices tensor is on pinned memory.

Differential Revision: D64840859
    @842974287 @facebook-github-bot
    842974287 authored and facebook-github-bot committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    703d98c View commit details
    Browse the repository at this point in the history