Skip to content

armgit / Edge0

Public Imported from GitHub
0

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported

Python
1.7 KB
Raw Blame
edge0
=====

This project bundles or adapts the following third-party works:

mlx-lm (MIT License)
  - `python/src/edge0/backends/mlx/_impl/qwen3_next.py` is vendored from mlx-lm
    0.31.0 (https://github.com/ml-explore/mlx-lm), with additive hooks for
    prerouter routing and layer callbacks.  Non-prerouter paths are kept
    byte-identical to the upstream file.
  - mlx-lm is used at runtime for checkpoint / tokenizer loading.
  Copyright (c) 2023-2024 Apple Inc. and the mlx-lm contributors.

bailing_hybrid (Apache License 2.0)
  - `python/src/edge0/backends/mlx/_impl/bailing_hybrid.py` is vendored from the
    Ling 3.0 MLX implementation (rapid-mlx / Ling-3.0-tiny, Apache-2.0), with
    prerouter hook identifiers renamed for consistency with the framework.
  Copyright (c) the bailing / Ling MLX contributors.

llama.cpp (MIT License)
  - The Android and Windows engines build their inference core from a
    pristine upstream checkout of llama.cpp
    (https://github.com/ggml-org/llama.cpp), pinned at commit 7ab4ee7
    (release b11100) via `vendor.llama.pin` and materialized into the
    gitignored `vendor/llama.cpp` by the platform build scripts.
  - It is never patched in place: all modifications ship as replayable
    patch bands under `patches/llama.cpp/{common,android,windows}` and are
    replayed into an isolated build worktree at compile time.
  - ggml (Apache License 2.0) is developed within the same upstream tree.
  - Not vendored as files in this repo; built from source by the consumer
    (see `android/NOTICE` and `windows/NOTICE` for the per-platform detail).
  Copyright (c) 2023-2024 The ggml authors.

All other files are Copyright (c) 2025 edge0 contributors, licensed under
the Apache License, Version 2.0 (see LICENSE).