Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError: CUDA failed with error CUDA driver version is insufficient for CUDA runtime version #1814

Open
SwAt1563 opened this issue Nov 4, 2024 · 1 comment

Comments

@SwAt1563
Copy link

SwAt1563 commented Nov 4, 2024

image
image
image


Issue Summary:
I'm attempting to run faster-whisper with GPU support on my device, which has CUDA 12.6 installed and cudnn 9.5. The following package versions are being used:

  • faster-whisper==1.0.3
  • ctranslate2==4.4.0
  • wyoming==1.5.3

The model runs successfully on the CPU; however, it does not utilize the GPU as expected. I am looking for a solution to enable GPU acceleration for faster-whisper using CUDA 12.6.

@minhthuc2502
Copy link
Collaborator

Starting from version 4.5.0, ctranslate2 is compatible with cuDNN 9.5. Try updating ctranslate2 to this version or later.

Additionally, ensure that your CUDA driver supports CUDA 12.6.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants