llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
Merge main into feature/model-market
Abhiram976cefd5144b
diff --cc CHANGELOG.mdindex ec4cde9,a848a89..9cf49e8--- a/CHANGELOG.md+++ b/CHANGELOG.md@@@ -15,19 -35,12 +35,22 @@@ v0.1.x are the upstream payload release- Logs page: `app.log` and `llama.log`, scrollable, with an errors-only filter.- Model details on Cross over the Model tile: every llama-server argument, theplan, cache and preset; Triangle opens the library.- - THERMALS tile (SoC and CPU temperature, SoC power), STORAGE tile (free space- on /data and USB), and the CPU clock.+ - THERMALS tile (SoC and CPU temperature, fan duty), STORAGE tile (free space+ on /data and USB), and the CPU clock. A title may not read the sensors+ (`0x80020002`), so the app bundles Marice's ps5-exporter (GPL-3.0, pinned+ v0.2.0) and sends it to elfldr when it is not running.+ - `scripts/ps5lm-app.sh press <button>`: drive the screens from a PC.+- Chat tools: the browser chat's model can read, write, edit and search files+ (llama-server's built-in tools), confined to `/data/PS5LM/scratch` by+ `patches/0003-tools-root.patch`. Settings has a switch, a size warning+ (default 2 GiB) and a Clear action.+- Images: a vision model's `mmproj` file beside it is loaded with it+ (`--mmproj`), and the planner counts its memory.++- The planner can plan from the first bytes of a GGUF (a range request), the+ base of the model market's fit column.+### Changed- One MEMORY tile replaces MEMORY and GPU MEMORY (the GPU and CPU share onepool); CONTEXT takes in the session counts.diff --cc ps5/app/dashboard.cppindex 8d26eb1,c8a3f41..f14bc64--- a/ps5/app/dashboard.cpp+++ b/ps5/app/dashboard.cpp@@@ -1278,10 -1422,10 +1471,11 @@@ void Dashboard::draw_hints(DashboardFraui::draw_hints(frame.overlay, fonts_, style, hints, 3, kGridX + kGridW, true);} else if (details_.value > 0.5f) {const ui::Hint hints[] = { { ui::Button::triangle, "Library" }, { ui::Button::circle, "Back" } };- ui::draw_hints(frame.overlay, fonts_, style, hints, 2, kGridX + kGridW, true);+ const bool model = detail_tile_ == kModel;+ ui::draw_hints(frame.overlay, fonts_, style, model ? hints : hints + 1, model ? 2 : 1, kGridX + kGridW, true);} else if (page_ == 1) {- const bool toggle = in_rows_ && is_toggle(kCategories[setting_category_].rows[setting_row_].id);+ const Setting row_id = kCategories[setting_category_].rows[setting_row_].id;+ const bool toggle = in_rows_ && (is_toggle(row_id) || row_id == Setting::clear_scratch);if (!in_rows_) {const ui::Hint hints[] = { { ui::Button::dpad, "Choose" }, { ui::Button::cross, "Open" } };ui::draw_hints(frame.scene, fonts_, style, hints, 2, kGridX + kGridW, true);