Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build latest version with different CUDA #81

Open
Destroy666x opened this issue Apr 2, 2024 · 3 comments
Open

Build latest version with different CUDA #81

Destroy666x opened this issue Apr 2, 2024 · 3 comments

Comments

@Destroy666x
Copy link
Contributor

I noticed there's now some CPU_OR_CUDA parameter which doesn't let me build it with CUDA 12.3 which I have installed and tht worked fine previously, e.g.

 .github/scripts/Build-Windows.ps1 -Target x64 -ExtraCmakeArgs '-D','LOCALVOCAL_WITH_CUDA=ON','-D',"CUDA_TOOLKIT_ROOT_DIR='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.3'"

. Any reason of this limitation?

@royshil
Copy link
Collaborator

royshil commented Apr 3, 2024

@Destroy666x I've updated the build instructions now take a look in the readme, it's very simple

Additionally you don't need to build from source with cuda anymore because I prebuild it for you for cuda 12 and 11, so just download and install

@Destroy666x
Copy link
Contributor Author

Yea, I've seen. But I'm asking for building for specific version. Is it not possible anymore? I think I see now that it ues some prebuilt binaries

@royshil
Copy link
Collaborator

royshil commented Apr 4, 2024

@Destroy666x yes it's possible, but now i'm building whisper separately since the CUDA builds on CI are easily 20-25 minutes which is way too much.
you can still build localvocal and it will fetch the prebuilt whisper for cuda from https://github.com/occ-ai/occ-ai-dep-whispercpp

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants