Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported
Python
fix(android): fall back to pwd -P when the depot probe runs off MSYS
Alex Zhou0bea963cb046
diff --git a/android/tools/llama/build_vendor_libs.sh b/android/tools/llama/build_vendor_libs.shindex 49a9006..6498b41 100644--- a/android/tools/llama/build_vendor_libs.sh+++ b/android/tools/llama/build_vendor_libs.sh@@ -7,7 +7,9 @@# Usage: bash tools/llama/build_vendor_libs.sh [--replay] (--replay = re-apply bands + verify)set -euo pipefailREPO=$(cd "$(dirname "$0")/../.." && pwd)-DEPOT=${EDGE0_DEPOT:-$(cd "$REPO/.." && pwd -W)} # depot root (this repo lives at <depot>/android)+# `pwd -W` is the Git-Bash (MSYS) form only; on Linux/macOS it has no -W and would abort+# the script at set -e, so fall back to `pwd -P`. EDGE0_DEPOT still wins if set.+DEPOT=${EDGE0_DEPOT:-$(cd "$REPO/.." && { pwd -W 2>/dev/null || pwd -P; })} # depot root (this repo lives at <depot>/android)WT=$DEPOT/wt/and[ -f "$DEPOT/vendor.llama.pin" ] || { echo "ABORT: vendor.llama.pin missing at depot root ($DEPOT)"; exit 1; }PIN=$(cut -d' ' -f1 "$DEPOT/vendor.llama.pin")