Install NVIDIA CUDA On WSL2 In 6 Easy Steps
Install NVIDIA CUDA on WSL2: Update WSL, remove old GPG key, install Linux x86 CUDA Toolkit, download & organize files, copy keyring.gpg, run apt update & install CUDA.
Hello again! This time I was trying to get my Ollama setup running on the GPU because I noticed that, by default, it was only using my CPU cores. I suspected that my CUDA drivers weren't set up correctly on WSL2. Here are the steps I followed to install it on my machine: First, I searched on google and found Microsoft's documentation, which you can access here: Enable NVIDIA CUDA on WSL The firsts steps envolve ensuring you have a WSL instance running with a glibc-based distribution, such as Ubuntu or Debian. Just a side note: By default, when you install the CUDA drivers on a windows machine...