llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
v0.8.3: the app is now PS5LM Plus
Abhiramcae4ac94fb16
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 0287cd1..a7d015f 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -7,6 +7,17 @@ v0.1.x are the upstream payload releases by cobanov.## [Unreleased]+## [0.8.3] - 2026-10-13++### Changed+- The app is now called **PS5LM Plus**, to tell it apart from Mert Cobanov's+ original PS5LM payload: on the home screen, in the dashboard header and in+ the console's notifications. The title ID (PPSA99581), the data folder+ (`/data/PS5LM`) and the repository stay as they were, so updating keeps+ settings, models and downloads.+- The dashboard header shows the chat's address without "Chat at http://",+ so it clears the page tabs with any IP address.+## [0.8.2] - 2026-10-13### Changeddiff --git a/README.md b/README.mdindex 85baf11..927864c 100644--- a/README.md+++ b/README.md@@ -1,18 +1,18 @@-<p align="center"><img src="docs/media/app/icon.png" width="128" alt="PS5LM app icon"></p>+<p align="center"><img src="docs/media/app/icon.png" width="128" alt="PS5LM Plus app icon"></p>-# PS5LM+# PS5LM Plus**llama.cpp on a jailbroken PlayStation 5, on its GPU.** A native app that runs GGUF language models on the console itself, with a dashboard on the TV, a model store, and a chat and OpenAI-compatible API for every device on your network.-> **This is a fork.** PS5LM was created by **[Mert Cobanov](https://github.com/cobanov)** ([cobanov/PS5LM](https://github.com/cobanov/PS5LM), [ps5lm.cobanov.dev](https://ps5lm.cobanov.dev)): the llama.cpp port, the payload, its model library and the research all come from there. This fork, by me, adds the **native GPU app**, offered back upstream in [cobanov/PS5LM#12](https://github.com/cobanov/PS5LM/pull/12). The original payload's README is kept in [docs/PAYLOAD.md](docs/PAYLOAD.md).+> **This is a fork.** PS5LM was created by **[Mert Cobanov](https://github.com/cobanov)** ([cobanov/PS5LM](https://github.com/cobanov/PS5LM), [ps5lm.cobanov.dev](https://ps5lm.cobanov.dev)): the llama.cpp port, the payload, its model library and the research all come from there. This fork, by me, adds the **native GPU app**, named PS5LM Plus to tell it apart from the original, offered back upstream in [cobanov/PS5LM#12](https://github.com/cobanov/PS5LM/pull/12). The original payload's README is kept in [docs/PAYLOAD.md](docs/PAYLOAD.md).<p align="center">- <img src="docs/media/app/dashboard-generating.jpg" width="820" alt="The PS5LM dashboard on the TV while Qwen 3.8 27B generates at 20.9 tok/s">+ <img src="docs/media/app/dashboard-generating.jpg" width="820" alt="The PS5LM Plus dashboard on the TV while Qwen 3.8 27B generates at 20.9 tok/s"></p>## What it does-A payload gets about 6 GiB of memory and no GPU. A native app (a title) gets the console's 12 GiB of direct memory and the GPU, so PS5LM runs as one: llama-server with ggml's Vulkan backend on Mihawk-99's RADV port, in one 11.44 GiB device heap.+A payload gets about 6 GiB of memory and no GPU. A native app (a title) gets the console's 12 GiB of direct memory and the GPU, so PS5LM Plus runs as one: llama-server with ggml's Vulkan backend on Mihawk-99's RADV port, in one 11.44 GiB device heap.| Model (on the PS5 GPU) | Context | Generation ||---|---|---|@@ -73,7 +73,7 @@ A jailbroken PS5, with these payloads loaded before you start the app:|---|---|---|| [kstuff-lite](https://github.com/EchoStretch/kstuff-lite) | the kernel patches homebrew titles run on | required || [etaHEN](https://github.com/etaHEN/etaHEN) | homebrew support (see the note below) | required |-| [ShadowMountPlus](https://github.com/drakmor/ShadowMountPlus) | registers PS5LM from `/data/homebrew` on the home screen | required |+| [ShadowMountPlus](https://github.com/drakmor/ShadowMountPlus) | registers PS5LM Plus from `/data/homebrew` on the home screen | required || [elfldr](https://github.com/ps5-payload-dev/elfldr) (port 9021) | lets the app start ps5-exporter: thermals, fan, power and real free space | strongly recommended || [ftpsrv](https://github.com/ps5-payload-dev/ftpsrv) (port 2121) | installing and updating the app, copying models from a PC | recommended |@@ -82,7 +82,7 @@ ps5-exporter comes inside the app; you do not load it yourself.## Install1. Download `ps5lm-app-vX.Y.Z.zip` from this fork's [releases](https://github.com/abhi245y/PS5LM/releases) and check it against its `.sha256`.-2. Unzip it and copy the `PPSA99581` folder to `/data/homebrew/PPSA99581` over FTP. ShadowMountPlus adds **PS5LM** to the home screen.+2. Unzip it and copy the `PPSA99581` folder to `/data/homebrew/PPSA99581` over FTP. ShadowMountPlus adds **PS5LM Plus** to the home screen.3. Start PS5LM. Pick a model in **Get models**, or copy a `.gguf` to `/data/PS5LM/models`, or to `PS5LM/models` on a USB drive (exFAT) or the M.2 drive.4. Choose the model in the library. Once the dashboard says Ready, open `http://<console IP>:8081` on a phone or computer.@@ -172,4 +172,4 @@ Earlier PS5 LLM work hand-writes GPU kernels for one model at a time. PS5LM portGPL-3.0-or-later, see [LICENSE](LICENSE). llama.cpp keeps its MIT licence. No Sony SDK files, keys, firmware or model weights are in this repository.-PS5LM is not affiliated with Sony Interactive Entertainment or Alibaba. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.+PS5LM Plus is not affiliated with Sony Interactive Entertainment or Alibaba. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.diff --git a/ps5/app/dashboard.cpp b/ps5/app/dashboard.cppindex e60e197..9fbcd67 100644--- a/ps5/app/dashboard.cpp+++ b/ps5/app/dashboard.cpp@@ -1149,8 +1149,9 @@ void Dashboard::draw_header(gfx::DrawList & list) const {const float in = tween::stagger(age_, 0, 0.05f, 0.5f);list.push_opacity(in);const float y = 124 - 10.0f * (1.0f - in);- const float w = ui::text(list, fonts_.display, "PS5LM", kGridX - 3, y, 56, kInk);- std::string sub = "v" PS5LM_VERSION " \xC2\xB7 Chat at " + live_.address;+ float w = ui::text(list, fonts_.display, "PS5LM", kGridX - 3, y, 56, kInk);+ w += ui::text(list, fonts_.display, " Plus", kGridX - 3 + w, y, 56, kBrand);+ std::string sub = "v" PS5LM_VERSION " \xC2\xB7 " + live_.address;ui::text(list, fonts_.regular, sub, kGridX + w + 24, y, 24, kInk.with_alpha(kMuted));const char * word = state_word(live_.state);@@ -1381,7 +1382,7 @@ void Dashboard::draw_usage_details(gfx::DrawList & list, const Rect & panel) conconst bool serving = L.state == ServerState::ready || L.state == ServerState::generating;char text[96];caps(list, f, "USAGE", panel.x + 56, panel.y + 60, 20, kCyan);- ui::text(list, f.regular, "What the console is doing for PS5LM, over the last two minutes.", panel.x + 56,+ ui::text(list, f.regular, "What the console is doing for PS5LM Plus, over the last two minutes.", panel.x + 56,panel.y + 96, 20, kInk.with_alpha(kMuted));const float x0 = panel.x + 56, colw = (panel.w - 112 - 48) * 0.5f, x1 = x0 + colw + 48;diff --git a/ps5/app/main.cpp b/ps5/app/main.cppindex 8adfc16..3575bf5 100644--- a/ps5/app/main.cpp+++ b/ps5/app/main.cpp@@ -508,7 +508,7 @@ struct Models {pthread_attr_setstacksize(&attr, 16u << 20); // the console's default stack is smallpthread_create(&server, &attr, run_server, nullptr);server_started = true;- notify("PS5LM: loading the model onto the GPU");+ notify("PS5LM Plus: loading the model onto the GPU");}void stop() {@@ -637,7 +637,7 @@ int main(int, char **) {} else {stats.set_state(ServerState::no_model);if (models.rows.empty()) {- notify("PS5LM: no models; copy a .gguf to /data/PS5LM/models or PS5LM/models on a USB drive");+ notify("PS5LM Plus: no models; copy a .gguf to /data/PS5LM/models or PS5LM/models on a USB drive");}}@@ -686,11 +686,11 @@ int main(int, char **) {Live live = stats.snapshot();if (g_server_rc >= 0 && live.state != ServerState::failed && live.state != ServerState::no_model) {stats.set_state(ServerState::failed);- notify("PS5LM: the server stopped, see /data/PS5LM/llama.log");+ notify("PS5LM Plus: the server stopped, see /data/PS5LM/llama.log");}const bool serving = live.state == ServerState::ready || live.state == ServerState::generating;if (serving && !was_serving) {- notify("PS5LM: ready, chat in a browser on this network");+ notify("PS5LM Plus: ready, chat in a browser on this network");}was_serving = serving;if (n % 30 == 0) {@@ -755,7 +755,7 @@ int main(int, char **) {const bool over = gib > models.settings.scratch_limit_gib;if (over && !scratch_warned) {char text[128];- std::snprintf(text, sizeof(text), "PS5LM: the chat's scratch folder holds %.1f GiB; clear it in Settings", gib);+ std::snprintf(text, sizeof(text), "PS5LM Plus: the chat's scratch folder holds %.1f GiB; clear it in Settings", gib);notify(text);std::printf("ps5lm-app: %s\n", text + 7);}@@ -767,7 +767,7 @@ int main(int, char **) {if (mv.saved != saved_seen) {saved_seen = mv.saved;models.rescan(stats, false);- notify(("PS5LM: " + mv.note).c_str());+ notify(("PS5LM Plus: " + mv.note).c_str());}dash.set_market(std::move(mv));}@@ -842,7 +842,7 @@ int main(int, char **) {std::filesystem::remove_all(e.path(), ec);}stats.set_scratch(folder_bytes(kScratch) / 1073741824.0);- notify("PS5LM: scratch folder cleared");+ notify("PS5LM Plus: scratch folder cleared");std::printf("ps5lm-app: scratch folder cleared\n");}// The same requests from the PC (scripts/ps5lm-app.sh load|unload).diff --git a/ps5/app/preview_main.cpp b/ps5/app/preview_main.cppindex a1e2cfa..4e7b0cf 100644--- a/ps5/app/preview_main.cpp+++ b/ps5/app/preview_main.cpp@@ -56,7 +56,7 @@ float g_loading = -1; // >= 0: draw the loading state at this progressps5lm::Live sample(float seconds, bool generating) {ps5lm::Live L;L.state = generating ? ps5lm::ServerState::generating : ps5lm::ServerState::ready;- L.address = "http://192.168.1.19:8081";+ L.address = "192.168.1.19:8081";L.model_label = "Qwen3.8-27B-UD-Q2_K_XL";L.model_arch = "qwen35";L.preset = "Qwen 3.8";diff --git a/ps5/app/sce_sys/param.json b/ps5/app/sce_sys/param.jsonindex 527376a..d8692e2 100644--- a/ps5/app/sce_sys/param.json+++ b/ps5/app/sce_sys/param.json@@ -15,7 +15,7 @@"conceptId": "99581","contentBadgeType": 1,"contentId": "UP9000-PPSA99581_00-PS5LMVULKAN00001",- "contentVersion": "01.008.002",+ "contentVersion": "01.008.003","downloadDataSize": 256,"gameIntent": {"permittedIntents": [@@ -31,7 +31,7 @@"localizedParameters": {"defaultLanguage": "en-US","en-US": {- "titleName": "PS5LM"+ "titleName": "PS5LM Plus"}},"masterVersion": "01.00",diff --git a/ps5/app/stats.cpp b/ps5/app/stats.cppindex 2126587..143616b 100644--- a/ps5/app/stats.cpp+++ b/ps5/app/stats.cpp@@ -227,7 +227,7 @@ void StatsCollector::start(int port) {std::lock_guard<std::mutex> lock(mutex_);live_.cpus = usable_cpus();const std::string ip = local_address();- live_.address = "http://" + (ip.empty() ? std::string("<console IP>") : ip) + ":" + std::to_string(port);+ live_.address = (ip.empty() ? std::string("<console IP>") : ip) + ":" + std::to_string(port);}std::thread([this] { run(); }).detach();}diff --git a/ps5/app/stats.hpp b/ps5/app/stats.hppindex 4a40260..d566b76 100644--- a/ps5/app/stats.hpp+++ b/ps5/app/stats.hpp@@ -41,7 +41,7 @@ struct ModelRow {struct Live {ServerState state = ServerState::loading;- std::string address; // "http://192.168.1.19:8081"+ std::string address; // "192.168.1.19:8081"// The model that runs.std::string model_label;diff --git a/ps5/app/version.hpp b/ps5/app/version.hppindex 449a574..cb69553 100644--- a/ps5/app/version.hpp+++ b/ps5/app/version.hpp@@ -4,4 +4,4 @@// The app's version, semver. The one place it is set: scripts read it from// here (scripts/release-app.sh), and git tags are v<this>. Bump it with an// entry in CHANGELOG.md.-#define PS5LM_VERSION "0.8.2"+#define PS5LM_VERSION "0.8.3"