Jailbroken PS5s now run local AI models on GPU at up to 124 tokens/s

Tom's Hardware reports that a jailbroken PlayStation 5 can now run local AI models through a native fork of PS5LM, a port of llama.cpp. The fork, posted by Reddit user u/AdIllustrious7246, uses PS5_Vulkan, a port of the RADV graphics driver, to send instructions to the PS5's AMD GPU. That lets the console run larger models than the original CPU-based port.

An earlier unofficial port by GitHub user cobanov ran as a payload on the CPU and was limited to about 6.25 GiB of RAM; holding more would freeze the home screen. The native version can use up to 11.4 GiB and includes a dashboard showing token generation speed, GPU/CPU use, power draw, temperatures, and memory split. It also works with llama.cpp's web UI, so users can chat from other local devices.

With the GPU in use, u/AdIllustrious7246 measured around 20 tokens per second for Qwen 27B, 61 tok/s for Gemma 4 E4B, and 124 tok/s for Llama 3.2 3B. Tom's Hardware notes that while this is an impressive homebrew feat, it is unlikely to trigger a GPU crisis like crypto mining did, because data-center AI demand is already straining GPU and RAM supplies and the PS5's hardware is relatively modest.