Complete guide to running a GPU accelerated LLM with WSL2

This is probably the easiest way to run an LLM for free on your PC

Dasha Herrmannova, Ph.D.

--

A laptop computer with a llama wearing glasses popping out of the screen.
Created using Midjourney.

If you would like to be able to test different LLMs locally for free and happen to have a GPU powered PC at home you’re in luck — thanks to the wonderful Open Source community, running different LLMs on Windows is very straightforward. In this article I…

--

--