The short version
- A jailbroken PS5 can now run a 27-billion-parameter LLM locally using a fork of PS5LM.
- Smaller models achieve speeds exceeding 100 tokens per second by accessing the GPU and additional RAM.
- The modification hijacks the CPU to enable native execution of AI workloads on gaming hardware.
Developers have successfully modified jailbroken PlayStation 5 consoles to run large language models (LLMs) locally, transforming the gaming device into a functional AI server. This breakthrough involves a fork of the PS5LM software that enables native execution of AI workloads by hijacking the console’s CPU and accessing its GPU and additional memory resources. The achievement highlights the versatility of modern gaming hardware when repurposed for computational tasks beyond entertainment.
According to Wccftech, a jailbroken PS5 was turned into a local AI server capable of running a 27-billion-parameter LLM. This is a significant feat given the constraints typically associated with consumer gaming consoles. The ability to process such a large model locally suggests that the modified system can handle complex AI inference tasks without relying on cloud-based services, offering users greater privacy and control over their data.
Tom’s Hardware reported that these jailbroken PS5s can run local AI models at speeds exceeding 100 tokens per second. Specifically, smaller models have reached impressive speeds of 124 tokens per second. This performance level is notable for a device not originally designed for high-throughput AI processing. The speed improvements are attributed to the software’s ability to bypass standard system limitations and utilize the console’s full hardware potential.
The technical mechanism behind this capability involves a fork of PS5LM that goes native, effectively hijacking the CPU to manage AI tasks. By accessing the GPU and more RAM, the modified system overcomes the memory bottlenecks that usually hinder LLM execution on consumer devices. Startup Fortune noted that a jailbroken PlayStation 5 is now running a 27-billion-parameter AI model, emphasizing the scale of the models that can be supported.
Gadget Review confirmed that the jailbroken PS5 runs the 27B-parameter AI model locally via PS5LM. This development has sparked interest among tech enthusiasts and developers who are exploring unconventional hardware for AI inference. The ability to run large models on a gaming console opens up new possibilities for local AI applications, from personal assistants to creative tools, without the need for expensive dedicated servers.
However, there are limitations to this setup. While the performance is impressive for smaller models, running larger models like the 27B-parameter LLM may still face constraints in terms of speed and efficiency compared to specialized AI hardware. The modifications required to achieve this functionality also void warranties and may pose security risks, as jailbreaking consoles can expose them to malware and other vulnerabilities.
Pasquale Pillitteri reported that Qwen 27B arrives on a jailbroken PlayStation 5, indicating that specific models like Qwen are being tested and optimized for this platform. This suggests an ongoing effort by the developer community to refine AI performance on gaming hardware. The success of these experiments could lead to broader adoption of gaming consoles as affordable AI computing devices.
The trend reflects a growing curiosity about leveraging existing consumer electronics for AI tasks. As AI models become more prevalent, the demand for accessible and cost-effective hardware solutions increases. Gaming consoles, with their powerful GPUs and CPUs, represent an untapped resource for local AI processing. This innovation could democratize access to advanced AI capabilities for hobbyists and small-scale developers.
Despite the excitement, practical adoption may be limited by the technical expertise required to jailbreak consoles and install the necessary software. Additionally, Sony’s strict policies against unauthorized modifications mean that users risk losing access to online services and updates. The balance between performance gains and potential drawbacks will influence how widely this technique is adopted.
As the technology evolves, it remains to be seen whether gaming manufacturers will incorporate features that support AI workloads natively or if the community will continue to push boundaries through modifications. For now, the jailbroken PS5 stands as a testament to the ingenuity of developers in repurposing hardware for new and innovative uses.
Sources behind this briefing
Go to the original reporting
- Wccftech↗A Jailbroken PS5 Got Turned Into a Local AI Server That Can Run A 27B LLM, Smaller Models Can Reach Impressive Speeds Of 124 Tok/s, But There Are Limitations
- Tom's Hardware↗Jailbroken PS5s can now run local AI models at over 100+ tokens per second — fork of PS5LM goes native, hijacks the CPU, and accesses the GPU and more RAM
- Startup Fortune↗A jailbroken PlayStation 5 is now running a 27 billion parameter AI model
- Gadget Review↗Jailbroken PS5 Runs 27B-Parameter AI Model Locally via PS5LM
