WhisperLiveKit/docs/troubleshooting.md

Troubleshooting

GPU drivers & cuDNN visibility

Linux error: Unable to load libcudnn_ops.so* / cudnnCreateTensorDescriptor

Reported in issue #271 (Arch/CachyOS)

faster-whisper (used for the SimulStreaming encoder) dynamically loads cuDNN.
If the runtime cannot find libcudnn_*, verify that CUDA and cuDNN match the PyTorch build you installed:

1. Install CUDA + cuDNN (Arch/CachyOS example):

   sudo pacman -S cuda cudnn
   sudo ldconfig
   

2. Make sure the shared objects are visible:

   ls /usr/lib/libcudnn*
   

3. Check what CUDA version PyTorch expects and match that with the driver you installed:

   python - <<'EOF'
   import torch
   print(torch.version.cuda)
   EOF
   nvcc --version
   

4. If you installed CUDA in a non-default location, export CUDA_HOME and add $CUDA_HOME/lib64 to LD_LIBRARY_PATH.

Once the CUDA/cuDNN versions match, whisperlivekit-server starts normally.

Windows error: Could not locate cudnn_ops64_9.dll

Reported in issue #286 (Conda on Windows)

PyTorch bundles cuDNN DLLs inside your environment (<env>\Lib\site-packages\torch\lib).
When ctranslate2 or faster-whisper cannot find cudnn_ops64_9.dll:

1. Locate the DLL shipped with PyTorch, e.g.

   E:\conda\envs\WhisperLiveKit\Lib\site-packages\torch\lib\cudnn_ops64_9.dll
   

2. Add that directory to your PATH or copy the cudnn_*64_9.dll files into a directory that is already on PATH (such as the environment's Scripts/ folder).
3. Restart the shell before launching wlk.

Installing NVIDIA's standalone cuDNN 9.x and pointing PATH/CUDNN_PATH to it works as well, but is usually not required.

---

PyTorch / CTranslate2 GPU builds

Torch not compiled with CUDA enabled

Reported in issue #284

If torch.zeros(1).cuda() raises that assertion it means you installed a CPU-only wheel.
Install the GPU-enabled wheels that match your CUDA toolkit:

pip install --upgrade torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu130

Replace cu130 with the CUDA version supported by your driver (see PyTorch install selector).
Validate with:

import torch
print(torch.cuda.is_available(), torch.cuda.get_device_name())

CTranslate2 device count: 0 or Could not infer dtype of ctranslate2._ext.StorageView

Follow-up in issue #284

ctranslate2 publishes separate CPU and CUDA wheels. The default pip install ctranslate2 brings the CPU build, which makes WhisperLiveKit fall back to CPU tensors and leads to the dtype error above.

1. Uninstall the CPU build: pip uninstall -y ctranslate2.
2. Install the CUDA wheel that matches your toolkit (example for CUDA 13.0):

   pip install ctranslate2==4.5.0 -f https://opennmt.net/ctranslate2/whl/cu130
   

   (See the CTranslate2 installation table for other CUDA versions.)
3. Verify:

   import ctranslate2
   print("CUDA devices:", ctranslate2.get_cuda_device_count())
   

If you intentionally want CPU inference, run wlk --backend whisper to avoid mixing CPU-only CTranslate2 with a GPU Torch build.

---

Hopper / Blackwell (sm_121a) systems

Reported in issue #276 (NVIDIA DGX Spark)

CUDA 12.1a GPUs ship before some toolchains know about the architecture ID, so Triton/PTXAS need manual hints:

export CUDA_HOME="/usr/local/cuda-13.0"
export PATH="$CUDA_HOME/bin:$PATH"
export LD_LIBRARY_PATH="$CUDA_HOME/lib64:$LD_LIBRARY_PATH"

# Tell Triton where the new ptxas lives
export TRITON_PTXAS_PATH="$CUDA_HOME/bin/ptxas"

# Force PyTorch to JIT kernels for all needed architectures
export TORCH_CUDA_ARCH_LIST="8.0 9.0 10.0 12.0 12.1a"

After exporting those variables (or adding them to your systemd service / shell profile), restart wlk. Incoming streams will now compile kernels targeting sm_121a without crashing.

---

Need help with another recurring issue? Open a GitHub discussion or PR and reference this document so we can keep it current.