Open-source AI browser agent for Chrome and Firefox (monorepo) 🧠
JavaScript ai-agentai-agentsai-toolsbrowser-aibrowser-automationbrowser-extensionchrome-aichrome-devtoolschrome-extensionchrome-extensionsfirefox-addonfirefox-addonsfirefox-extensionfirefox-extensionsgemmagemma4minimaxoffline-aioffline-llmqwen
blog: introduce OpenBonsai open-source ternary quantization
Codex release-state test7f657912da48
diff --git a/web/blog/index.html b/web/blog/index.htmlindex 0733b0df4..379210877 100644--- a/web/blog/index.html+++ b/web/blog/index.html@@ -669,6 +669,18 @@"url": "https://webbrain.one/blog","image": "https://webbrain.one/og-image.png","blogPost": [+ {+ "@type": "BlogPosting",+ "headline": "Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models",+ "url": "https://webbrain.one/blog/openbonsai-open-source-ternary-quantization",+ "datePublished": "2026-10-29",+ "description": "Introducing OpenBonsai, an open-source (Apache-2.0) framework to compress models and fine-tunes into Prism ML-compatible ternary weights (-1, 0, +1), shrinking Qwen3.5-9B from ~18 GB to ~2 GB on an RTX 5090.",+ "author": {+ "@type": "Person",+ "name": "Emre Sokullu",+ "url": "https://emresokullu.com"+ }+ },{"@type": "BlogPosting","headline": "Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060",@@ -1492,14 +1504,19 @@<kbd class="search-key" aria-hidden="true">/</kbd></div><div class="archive-status" role="status" aria-live="polite" aria-atomic="true">- <span id="results-count">65 notes</span>+ <span id="results-count">66 notes</span><span class="archive-status-rule" aria-hidden="true"></span><span id="page-status"></span></div></section><div class="post-list" id="post-list">- <a href="/blog/spark-x26-lfm3-minicpm-v47-tool-routing" class="post-card" data-search="Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060 Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060 Official Q4 GGUF runs of Spark-X2.6-4B, LFM3-1.7B, MiniCPM-V 4.7, and WebBrain-Compass-VLD-Tiny-v5 on WebBrain's frozen browser benchmark, featuring parallel execution across dual RTX 5060 Ti GPUs and an expanded historical leaderboard. Frozen compact agent benchmark comparing Spark-X2.6-4B, Liquid AI LFM3-1.7B, MiniCPM-V-4.7-1B, and WebBrain-Compass-VLD-Tiny-v5 locally on dual NVIDIA RTX 5060 Ti GPUs. October 29, 2026 2026-10-29 Spark-X2.6 Liquid AI LFM3 MiniCPM-V 4.7 WebBrain Compass VLD webbrain-compass-vld-tiny-v5 browser agent benchmark tool calling NVIDIA RTX 5060 Ti llama.cpp">+ <a href="/blog/openbonsai-open-source-ternary-quantization" class="post-card" data-search="Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models We are releasing OpenBonsai, an open-source framework to compress models into ternary weights compatible with Prism ML's format. Shrink Qwen3.5-9B from ~18 GB to ~2 GB on a single RTX 5090. Introducing OpenBonsai, an open-source (Apache-2.0) framework to compress models and fine-tunes into Prism ML-compatible ternary weights (-1, 0, +1), shrinking Qwen3.5-9B from ~18 GB to ~2 GB on an RTX 5090. October 29, 2026 2026-10-29 OpenBonsai ternary quantization tiny models on-device AI WebBrain Qwen3.5-9B Prism ML Ternary Bonsai llama.cpp local AI">+ <div class="post-meta">October 29, 2026 · 4 min read</div>+ <div class="post-title">Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models</div>+ <div class="post-excerpt">We are releasing OpenBonsai, an open-source framework to compress models into ternary weights compatible with Prism ML's format. Shrink Qwen3.5-9B from ~18 GB to ~2 GB on a single RTX 5090.</div>+ </a>+<a href="/blog/spark-x26-lfm3-minicpm-v47-tool-routing" class="post-card" data-search="Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060 Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060 Official Q4 GGUF runs of Spark-X2.6-4B, LFM3-1.7B, MiniCPM-V 4.7, and WebBrain-Compass-VLD-Tiny-v5 on WebBrain's frozen browser benchmark, featuring parallel execution across dual RTX 5060 Ti GPUs and an expanded historical leaderboard. Frozen compact agent benchmark comparing Spark-X2.6-4B, Liquid AI LFM3-1.7B, MiniCPM-V-4.7-1B, and WebBrain-Compass-VLD-Tiny-v5 locally on dual NVIDIA RTX 5060 Ti GPUs. October 29, 2026 2026-10-29 Spark-X2.6 Liquid AI LFM3 MiniCPM-V 4.7 WebBrain Compass VLD webbrain-compass-vld-tiny-v5 browser agent benchmark tool calling NVIDIA RTX 5060 Ti llama.cpp"><div class="post-meta">October 29, 2026 · 8 min read</div><div class="post-title">Spark-X2.6, LFM3, MiniCPM-V 4.7, and WebBrain Compass VLD: Compact Agent Routing on NVIDIA RTX 5060</div><div class="post-excerpt">Official Q4 GGUF runs of Spark-X2.6-4B, LFM3-1.7B, MiniCPM-V 4.7, and WebBrain-Compass-VLD-Tiny-v5 on WebBrain's frozen browser benchmark, featuring parallel execution across dual RTX 5060 Ti GPUs and an expanded historical leaderboard.</div>diff --git a/web/blog/openbonsai-open-source-ternary-quantization/index.html b/web/blog/openbonsai-open-source-ternary-quantization/index.htmlnew file mode 100644index 000000000..81942e064--- /dev/null+++ b/web/blog/openbonsai-open-source-ternary-quantization/index.html@@ -0,0 +1,605 @@+<!DOCTYPE html>+<html lang="en">+<head>+ <meta charset="UTF-8">+ <meta name="viewport" content="width=device-width, initial-scale=1.0">+ <title>Introducing OpenBonsai: Open-Source Ternary Quantization - WebBrain Blog</title>+ <meta name="description" content="Introducing OpenBonsai, an open-source (Apache-2.0) framework to compress models and fine-tunes into Prism ML-compatible ternary weights (-1, 0, +1), shrinking Qwen3.5-9B from ~18 GB to ~2 GB on an RTX 5090.">+ <meta name="keywords" content="OpenBonsai, ternary quantization, tiny models, on-device AI, WebBrain, Qwen3.5-9B, Prism ML, Ternary Bonsai, llama.cpp, local AI">+ <meta property="og:title" content="Introducing OpenBonsai: Open-Source Ternary Quantization">+ <meta property="og:description" content="OpenBonsai brings open ternary quantization to on-device models: compress Qwen3.5-9B from ~18 GB down to ~2 GB in 5 hours on an RTX 5090.">+ <meta property="og:type" content="article">+ <meta property="og:url" content="https://webbrain.one/blog/openbonsai-open-source-ternary-quantization">+ <meta property="og:image" content="https://webbrain.one/og-image.png">+ <meta property="og:image:secure_url" content="https://webbrain.one/og-image.png">+ <meta property="og:image:type" content="image/png">+ <meta property="og:image:width" content="1200">+ <meta property="og:image:height" content="630">+ <meta property="og:image:alt" content="WebBrain — Open-source AI browser agent">+ <meta name="twitter:card" content="summary_large_image">+ <meta name="twitter:title" content="Introducing OpenBonsai: Open-Source Ternary Quantization">+ <meta name="twitter:description" content="Shrink 9B models to ~2 GB with open ternary quantization. OpenBonsai compresses your own models and fine-tunes into Prism ML-compatible weights.">+ <meta name="twitter:image" content="https://webbrain.one/twitter-image.png">+ <meta name="twitter:image:alt" content="WebBrain — Open-source AI browser agent">+ <link rel="icon" type="image/png" href="/favicon.png">+ <link rel="canonical" href="https://webbrain.one/blog/openbonsai-open-source-ternary-quantization">+ <!-- Blog is English-only; alternates point to locale homepages. -->+ <link rel="alternate" hreflang="en" href="https://webbrain.one/">+ <link rel="alternate" hreflang="es" href="https://webbrain.one/es/">+ <link rel="alternate" hreflang="fr" href="https://webbrain.one/fr/">+ <link rel="alternate" hreflang="tr" href="https://webbrain.one/tr/">+ <link rel="alternate" hreflang="zh" href="https://webbrain.one/zh/">+ <link rel="alternate" hreflang="ru" href="https://webbrain.one/ru/">+ <link rel="alternate" hreflang="uk" href="https://webbrain.one/uk/">+ <link rel="alternate" hreflang="ar" href="https://webbrain.one/ar/">+ <link rel="alternate" hreflang="ja" href="https://webbrain.one/ja/">+ <link rel="alternate" hreflang="ko" href="https://webbrain.one/ko/">+ <link rel="alternate" hreflang="id" href="https://webbrain.one/id/">+ <link rel="alternate" hreflang="th" href="https://webbrain.one/th/">+ <link rel="alternate" hreflang="ms" href="https://webbrain.one/ms/">+ <link rel="alternate" hreflang="tl" href="https://webbrain.one/tl/">+ <link rel="alternate" hreflang="he" href="https://webbrain.one/he/">+ <link rel="alternate" hreflang="x-default" href="https://webbrain.one/">+ <style>+ *, *::before, *::after { margin: 0; padding: 0; box-sizing: border-box; }+ :root {+ --bg: #0b0e17;+ --bg-card: #111827;+ --bg-card-hover: #1a2233;+ --surface: #161d2e;+ --border: rgba(255,255,255,0.07);+ --text: #e4e4ec;+ --text-dim: #8b8fa4;+ --accent: #6c63ff;+ --accent-glow: rgba(108,99,255,0.25);+ --accent2: #a78bfa;+ --success: #34d399;+ --warning: #fbbf24;+ --danger: #f87171;+ --tint-soft: rgba(255,255,255,0.05);+ --tint-soft-2: rgba(255,255,255,0.04);+ --tint-medium: rgba(255,255,255,0.08);+ --nav-bg: rgba(11,14,23,0.85);+ --code-bg: #0a0e17;+ --inline-code-bg: rgba(255,255,255,0.06);+ --shadow-strong: rgba(0,0,0,0.40);+ --radius: 12px;+ --radius-lg: 16px;+ --max-w: 760px;+ color-scheme: dark;+ }+ :root[data-theme="light"] {+ --bg: #f7f1e6;+ --bg-card: #fffdf8;+ --bg-card-hover: #f2e9d4;+ --surface: #ede2cb;+ --border: rgba(89,55,25,0.15);+ --text: #2c1810;+ --text-dim: #6b5b47;+ --accent: #5b52e8;+ --accent-glow: rgba(91,82,232,0.20);+ --accent2: #7c6ce6;+ --success: #2d8866;+ --warning: #9a6500;+ --danger: #b74747;+ --tint-soft: rgba(89,55,25,0.05);+ --tint-soft-2: rgba(89,55,25,0.07);+ --tint-medium: rgba(89,55,25,0.10);+ --nav-bg: rgba(247,241,230,0.85);+ --code-bg: #fff7e6;+ --inline-code-bg: rgba(89,55,25,0.08);+ --shadow-strong: rgba(89,55,25,0.18);+ color-scheme: light;+ }+ html { scroll-behavior: smooth; }+ body {+ font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Inter, Roboto, sans-serif;+ background: var(--bg);+ color: var(--text);+ line-height: 1.75;+ font-size: 17px;+ overflow-x: hidden;+ }+ a { color: var(--accent2); text-decoration: none; }+ a:hover { text-decoration: underline; }+ .glow-bg {+ position: fixed;+ inset: 0;+ z-index: -1;+ pointer-events: none;+ overflow: hidden;+ }+ .glow-bg::before,+ .glow-bg::after {+ content: '';+ position: absolute;+ border-radius: 50%;+ filter: blur(120px);+ opacity: 0.26;+ }+ .glow-bg::before {+ width: 500px;+ height: 500px;+ background: var(--accent);+ top: -220px;+ left: -160px;+ }+ .glow-bg::after {+ width: 500px;+ height: 500px;+ background: var(--accent2);+ right: -180px;+ bottom: -230px;+ opacity: 0.18;+ }+ nav {+ position: sticky;+ top: 0;+ z-index: 100;+ background: var(--nav-bg);+ backdrop-filter: saturate(160%) blur(12px);+ -webkit-backdrop-filter: saturate(160%) blur(12px);+ border-bottom: 1px solid var(--border);+ }+ .nav-inner {+ max-width: var(--max-w);+ margin: 0 auto;+ padding: 14px 24px;+ display: flex;+ align-items: center;+ justify-content: space-between;+ gap: 20px;+ }+ .nav-brand {+ display: inline-flex;+ align-items: center;+ gap: 6px;+ flex-shrink: 0;+ color: var(--text);+ font-size: 18px;+ font-weight: 700;+ text-decoration: none;+ }+ .nav-brand:hover { text-decoration: none; }+ .nav-brand .brand-logo { width: 26px; height: 26px; border-radius: 7px; flex: 0 0 auto; }+ .nav-brand .domain { opacity: 0.5; font-weight: 400; }+ .nav-links {+ display: flex;+ align-items: center;+ justify-content: flex-end;+ gap: 16px;+ min-width: 0;+ }+ .nav-links a {+ position: relative;+ color: var(--text-dim);+ font-size: 14px;+ font-weight: 500;+ white-space: nowrap;+ }+ .nav-links a:hover { color: var(--text); text-decoration: none; }+ .nav-links a[aria-current="page"] { color: var(--text); }+ .nav-links a[aria-current="page"]::after {+ content: '';+ position: absolute;+ left: 1px;+ right: 1px;+ bottom: -7px;+ height: 3px;+ border-radius: 999px;+ background: linear-gradient(90deg, var(--accent2), var(--accent));+ box-shadow: 0 2px 12px var(--accent-glow);+ }+ .lang-dropdown {+ background: var(--tint-soft);+ color: var(--text);+ border: 1px solid var(--border);+ border-radius: 8px;+ padding: 6px 10px;+ font-size: 13px;+ max-width: 120px;+ }+ .lang-dropdown:focus { outline: 2px solid var(--accent-glow); outline-offset: 1px; }+ .lang-dropdown option { background-color: var(--bg-card-hover); color: var(--text); }+ .theme-toggle {+ appearance: none;+ -webkit-appearance: none;+ background: var(--tint-soft-2);+ border: 1px solid var(--border);+ border-radius: 999px;+ width: 30px;+ height: 30px;+ padding: 0;+ display: inline-flex;+ align-items: center;+ justify-content: center;+ flex-shrink: 0;+ cursor: pointer;+ color: var(--text-dim);+ transition: background 0.2s, color 0.2s, border-color 0.2s, transform 0.1s;+ }+ .theme-toggle:hover {+ background: var(--tint-medium);+ border-color: var(--accent);+ color: var(--text);+ transform: translateY(-1px);+ }+ .theme-toggle:focus-visible {+ outline: 2px solid var(--accent2);+ outline-offset: 2px;+ }+ .theme-toggle svg { width: 16px; height: 16px; display: block; }+ .theme-toggle .icon-sun { display: block; }+ .theme-toggle .icon-moon { display: none; }+ :root[data-theme="light"] .theme-toggle .icon-sun { display: none; }+ :root[data-theme="light"] .theme-toggle .icon-moon { display: block; }+ main,+ article {+ max-width: var(--max-w);+ margin: 0 auto;+ padding: 64px 24px 80px;+ }+ .sr-only {+ position: absolute;+ width: 1px;+ height: 1px;+ padding: 0;+ margin: -1px;+ overflow: hidden;+ clip: rect(0, 0, 0, 0);+ white-space: nowrap;+ border: 0;+ }+ h1 {+ font-size: 38px;+ line-height: 1.2;+ font-weight: 700;+ letter-spacing: 0;+ margin-bottom: 16px;+ }+ .lede {+ color: var(--text-dim);+ line-height: 1.6;+ }+ .lede {+ font-size: 19px;+ margin-bottom: 40px;+ }+ .meta {+ font-size: 13px;+ color: var(--text-dim);+ margin-bottom: 12px;+ letter-spacing: 0;+ }+ h2 {+ font-size: 24px;+ font-weight: 700;+ margin-top: 48px;+ margin-bottom: 14px;+ letter-spacing: 0;+ }+ h3 {+ font-size: 18px;+ font-weight: 600;+ margin-top: 32px;+ margin-bottom: 10px;+ color: var(--text);+ }+ h4, h5, h6 {+ color: var(--text);+ margin-top: 28px;+ margin-bottom: 10px;+ line-height: 1.35;+ }+ p { margin-bottom: 16px; }+ ul, ol { margin: 0 0 16px 20px; }+ li { margin-bottom: 6px; }+ code {+ font-family: 'SF Mono', 'Menlo', 'Consolas', monospace;+ font-size: 0.88em;+ background: var(--inline-code-bg);+ padding: 2px 6px;+ border-radius: 4px;+ color: color-mix(in srgb, var(--accent2) 80%, var(--text));+ }+ pre {+ background: var(--code-bg);+ border: 1px solid var(--border);+ border-radius: var(--radius);+ padding: 18px 20px;+ overflow-x: auto;+ margin: 20px 0;+ font-size: 14px;+ line-height: 1.55;+ box-shadow: 0 18px 60px var(--shadow-strong);+ }+ pre code {+ background: transparent;+ padding: 0;+ color: inherit;+ font-size: inherit;+ }+ blockquote {+ border-left: 3px solid var(--accent);+ padding: 4px 0 4px 18px;+ margin: 20px 0;+ color: var(--text-dim);+ font-style: italic;+ }+ blockquote p:last-child { margin-bottom: 0; }+ hr {+ border: 0;+ border-top: 1px solid var(--border);+ margin: 36px 0;+ }+ article img {+ max-width: 100%;+ height: auto;+ display: block;+ border-radius: var(--radius);+ border: 1px solid var(--border);+ margin: 24px 0;+ }+ .table-wrap { overflow-x: auto; margin: 24px 0; }+ table {+ width: 100%;+ min-width: 560px;+ border-collapse: collapse;+ font-size: 14px;+ }+ th, td {+ text-align: left;+ padding: 10px 12px;+ border-bottom: 1px solid var(--border);+ vertical-align: top;+ }+ th {+ color: var(--text-dim);+ font-weight: 600;+ font-size: 12px;+ text-transform: uppercase;+ letter-spacing: 0;+ background: var(--tint-soft-2);+ }+ td code { font-size: 12px; }+ .win { color: var(--success); font-weight: 600; }+ .lose { color: var(--danger); }+ .meh { color: var(--warning); }+ .callout {+ background: color-mix(in srgb, var(--accent) 10%, transparent);+ border: 1px solid color-mix(in srgb, var(--accent) 24%, transparent);+ border-radius: var(--radius);+ padding: 16px 20px;+ margin: 24px 0;+ font-size: 15px;+ line-height: 1.65;+ color: var(--text-dim);+ }+ .callout strong { color: var(--text); }+ .author-box {+ margin-top: 64px;+ padding-top: 32px;+ border-top: 1px solid var(--border);+ color: var(--text-dim);+ font-size: 14px;+ }+ .post-list { display: flex; flex-direction: column; gap: 18px; }+ .post-card {+ display: block;+ background: var(--bg-card);+ border: 1px solid var(--border);+ border-radius: var(--radius-lg);+ padding: 24px 26px;+ transition: background 0.18s, border-color 0.18s, transform 0.18s;+ }+ .post-card:hover {+ background: var(--bg-card-hover);+ border-color: color-mix(in srgb, var(--accent) 30%, transparent);+ transform: translateY(-1px);+ text-decoration: none;+ }+ .post-meta {+ font-size: 12px;+ color: var(--text-dim);+ letter-spacing: 0;+ margin-bottom: 8px;+ }+ .post-title {+ font-size: 21px;+ font-weight: 600;+ color: var(--text);+ margin-bottom: 6px;+ letter-spacing: 0;+ line-height: 1.35;+ }+ .post-excerpt {+ color: var(--text-dim);+ font-size: 15px;+ line-height: 1.6;+ }+ footer {+ max-width: var(--max-w);+ margin: 0 auto;+ padding: 40px 24px;+ border-top: 1px solid var(--border);+ display: flex;+ justify-content: space-between;+ gap: 24px;+ color: var(--text-dim);+ font-size: 13px;+ }+ footer a { color: var(--text-dim); }+ footer a:hover { color: var(--text); }+ @media (max-width: 700px) {+ body { font-size: 16px; }+ .nav-inner { padding: 14px 20px; align-items: flex-start; }+ .nav-links { gap: 12px; flex-wrap: wrap; }+ .lang-dropdown { display: none; }+ h1 { font-size: 28px; }+ .lede { font-size: 16px; }+ main, article { padding: 48px 20px 64px; }+ h2 { font-size: 20px; margin-top: 36px; }+ .post-card { padding: 20px; }+ .post-title { font-size: 19px; }+ footer { flex-direction: column; padding: 32px 20px; }+ }+ @media (max-width: 420px) {+ .nav-inner { gap: 12px; }+ .nav-links a[href="https://github.com/webbrain-one/webbrain"] { display: none; }+ .theme-toggle { width: 28px; height: 28px; }+ }+ </style>+ <script>+ (function () {+ try {+ var saved = localStorage.getItem('webbrain-theme');+ var theme = (saved === 'light' || saved === 'dark')+ ? saved+ : (window.matchMedia('(prefers-color-scheme: light)').matches ? 'light' : 'dark');+ document.documentElement.setAttribute('data-theme', theme);+ } catch (_) {+ document.documentElement.setAttribute('data-theme', 'dark');+ }+ })();+ </script>+ <!-- Plausible analytics: start -->+ <!-- Privacy-friendly analytics by Plausible -->+ <script async src="https://157.230.3.9.sslip.io/js/pa-omp0F7DsOXM4sGKR50l7S.js"></script>+ <script>+ window.plausible=window.plausible||function(){(plausible.q=plausible.q||[]).push(arguments)},plausible.init=plausible.init||function(i){plausible.o=i||{}};+ plausible.init()+ </script>+ <!-- Plausible analytics: end -->+ <script type="application/ld+json">+{+ "@context": "https://schema.org",+ "@type": "BlogPosting",+ "headline": "Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models",+ "description": "Introducing OpenBonsai, an open-source (Apache-2.0) framework to compress models and fine-tunes into Prism ML-compatible ternary weights (-1, 0, +1), shrinking Qwen3.5-9B from ~18 GB to ~2 GB on an RTX 5090.",+ "author": {+ "@type": "Person",+ "name": "Emre Sokullu",+ "url": "https://emresokullu.com"+ },+ "datePublished": "2026-10-29",+ "image": "https://webbrain.one/og-image.png",+ "publisher": {+ "@type": "Organization",+ "name": "WebBrain",+ "logo": {+ "@type": "ImageObject",+ "url": "https://webbrain.one/logo-github.png"+ }+ },+ "mainEntityOfPage": {+ "@type": "WebPage",+ "@id": "https://webbrain.one/blog/openbonsai-open-source-ternary-quantization"+ }+}+ </script>+</head>+<body>+ <div class="glow-bg"></div>+ <nav>+ <div class="nav-inner">+ <a href="/" class="nav-brand"><img class="brand-logo" src="/logo-github.png" alt="" aria-hidden="true"> WebBrain<span class="domain">.one</span></a>+ <div class="nav-links">+ <a href="/">Home</a>+ <a href="/docs/">Docs</a>+ <a href="/blog" aria-current="page">Blog</a>+ <select class="lang-dropdown" id="lang-dropdown" aria-label="Select language" data-current="en"><option value="en">English</option><option value="es">Español</option><option value="fr">Français</option><option value="tr">Türkçe</option><option value="zh">中文</option><option value="ru">Русский</option><option value="uk">Українська</option><option value="ar">العربية</option><option value="ja">日本語</option><option value="ko">한국어</option><option value="id">Bahasa Indonesia</option><option value="th">ไทย</option><option value="ms">Bahasa Melayu</option><option value="tl">Filipino</option><option value="he">עברית</option></select>+ <button class="theme-toggle" type="button" id="theme-toggle" aria-label="Toggle light / dark theme" title="Toggle light / dark theme">+ <svg class="icon-sun" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true">+ <circle cx="12" cy="12" r="4"/>+ <path d="M12 2v2M12 20v2M4.93 4.93l1.41 1.41M17.66 17.66l1.41 1.41M2 12h2M20 12h2M4.93 19.07l1.41-1.41M17.66 6.34l1.41-1.41"/>+ </svg>+ <svg class="icon-moon" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true">+ <path d="M21 12.79A9 9 0 1 1 11.21 3 7 7 0 0 0 21 12.79z"/>+ </svg>+ </button>+ <a href="https://github.com/webbrain-one/webbrain" target="_blank" rel="noopener">GitHub</a>+ </div>+ </div>+ </nav>++ <article>+ <div class="meta">October 29, 2026 · 4 min read · <a href="/blog">← All posts</a></div>+ <h1>Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models</h1>+ <p class="lede"><strong>My long-term goal is to make a tiny WebGPU model the core of WebBrain.</strong> Today, we are releasing OpenBonsai: an open-source (Apache-2.0) framework that lets you compress your own models or fine-tunes into ternary weights compatible with Prism ML's format, shrinking Qwen3.5-9B from ~18 GB down to ~2 GB on a single RTX 5090.</p>+<h2 id="the-path-to-tiny-ondevice-models">The path to tiny on-device models</h2>+<p>As you might know, I'm passionate about tiny AI models. The web browser is where people spend their digital lives, and having an intelligent browser agent that runs completely private, local, and fast requires pushing model efficiency to the limit. My long-term goal is to make a tiny WebGPU model the core of WebBrain.</p>+<p>Our recent experiments with combined vision-language and decision models, including <a href="https://huggingface.co/webbrain-one/webbrain-compass-vld-tiny-v5-onnx" target="_blank" rel="noopener">WebBrain Compass VLD Tiny</a> (based on MiniCPM-V 4.7) and <a href="https://huggingface.co/webbrain-one/lfm3-vld-2b" target="_blank" rel="noopener">LFM3-VLD-2B</a>, suggest that we are getting closer. Compact, purpose-built architectures can deliver impressive domain competence without needing a cluster of enterprise GPUs.</p>+<h2 id="shrinking-capable-models-the-ternary-gap">Shrinking capable models: the ternary gap</h2>+<p>While training and fine-tuning compact base models is one path forward, I've also been exploring a complementary approach: shrinking larger, highly capable foundation models through ternary quantization, as Prism ML has done with its Ternary Bonsai models.</p>+<p>Prism ML did an impressive job: fitting a 9B model into roughly 2 GB by representing weights with ternary values (-1, 0, +1). Their weights are open, but the compression recipe is not. You can fine-tune their pre-quantized models, but you cannot take your own fine-tuned model and compress it into that same format using their publicly available tools.</p>+<p>Going from BF16 to ternary has remained Prism ML's secret sauce. That's the gap I wanted to tackle.</p>+<h2 id="the-clue-attending-to-your-own-thoughts">The clue: attending to your own thoughts</h2>+<p>A recent paper from Intel Labs China (Wang et al., <em>"Attend to Your Own Thoughts"</em>) offered an interesting clue: calibrate compression using the model's own reasoning traces, rather than relying solely on generic text corpora.</p>+<p>Reasoning traces expose the critical pathways a model uses when thinking through complex steps. Calibrating the quantizer against these internal activation states preserves the weights that actually drive the model's decision-making.</p>+<p>So I put the idea to the test in my homelab, with assistance from my AI agents.</p>+<h2 id="enter-openbonsai">Enter OpenBonsai</h2>+<p>The result is <strong>OpenBonsai</strong>, an open-source (Apache-2.0) framework that lets you compress your own models or fine-tunes into ternary weights compatible with Prism ML's format.</p>+<p>Here is what we have achieved so far:</p>+<ul><li><strong>Qwen3.5-9B:</strong> ~18 GB (BF16) → ~2 GB (Ternary)</li><li><strong>Runtime:</strong> Fully compatible with Prism ML's <code>llama.cpp</code> fork</li><li><strong>Compression time:</strong> ~5 hours end-to-end on a single NVIDIA GeForce RTX 5090</li><li><strong>Reproducibility:</strong> The same pipeline also worked on Qwen3-8B without code changes</li></ul>+<h2 id="research-preview-results-and-limitations">Research preview: results and limitations</h2>+<p>The results are encouraging, although there is still a quality gap compared with the original uncompressed models and Prism's own releases. </p>+<p>This is a research preview, not a finished product. In the spirit of open science, I have documented the benchmarks, limitations, and the experiments that didn't work along the way. Hopefully, others in the open-source and local AI community can build on this, refine the calibration methods, and push open ternary quantization further.</p>+<h2 id="try-it-out">Try it out</h2>+<p>Here is the first compressed model checkpoint, along with the framework to ternarize your own fine-tunes:</p>+<ul><li>🤗 <strong>Model:</strong> <a href="https://huggingface.co/webbrain-one/openbonsai-qwen-3.5-9b" target="_blank" rel="noopener">webbrain-one/openbonsai-qwen-3.5-9b</a></li><li>💻 <strong>Framework:</strong> <a href="https://github.com/esokullu/openbonsai" target="_blank" rel="noopener">esokullu/openbonsai on GitHub</a></li><li>🌐 <strong>Project website:</strong> <a href="https://openbonsai.org" target="_blank" rel="noopener">openbonsai.org</a></li></ul>+<p>I'd love to see what others can do with it!</p>+<p>Tags: #TinyModels #TernaryQuantization #OnDeviceAI #OpenSource #LocalAI #WebBrain</p>++ <div class="author-box">+ Written by <a href="https://emresokullu.com" target="_blank" rel="noopener">Emre Sokullu</a>. WebBrain 33.0.0 and later is GPL-3.0-or-later and open on <a href="https://github.com/webbrain-one/webbrain" target="_blank" rel="noopener">GitHub</a>.+ </div>+ </article>++ <footer>+ <div>© 2026 WebBrain · <a href="/privacy">Privacy</a></div>+ <div><a href="https://github.com/webbrain-one/webbrain" target="_blank" rel="noopener">GitHub</a></div>+ </footer>+ <script>+ (function () {+ const btn = document.getElementById('theme-toggle');+ if (!btn) return;+ const root = document.documentElement;++ function setTheme(theme, persist) {+ root.setAttribute('data-theme', theme);+ if (persist) {+ try { localStorage.setItem('webbrain-theme', theme); } catch (_) {}+ }+ }++ btn.addEventListener('click', function () {+ const next = root.getAttribute('data-theme') === 'light' ? 'dark' : 'light';+ setTheme(next, true);+ });++ const mq = window.matchMedia('(prefers-color-scheme: light)');+ function onMQ(e) {+ try {+ if (localStorage.getItem('webbrain-theme')) return;+ } catch (_) {}+ setTheme(e.matches ? 'light' : 'dark', false);+ }+ if (typeof mq.addEventListener === 'function') mq.addEventListener('change', onMQ);+ else if (typeof mq.addListener === 'function') mq.addListener(onMQ);+ })();+ </script>+ <script>+ (function () {+ const LOCALES = ["en","es","fr","tr","zh","ru","uk","ar","ja","ko","id","th","ms","tl","he"];+ const sel = document.getElementById('lang-dropdown');+ if (!sel) return;+ sel.value = sel.dataset.current || 'en';+ sel.addEventListener('change', function () {+ const target = sel.value;+ if (!LOCALES.includes(target)) return;+ window.location.href = target === 'en' ? '/' : '/' + target + '/';+ });+ })();+ </script>+</body>+</html>diff --git a/web/blog/posts/openbonsai-open-source-ternary-quantization.md b/web/blog/posts/openbonsai-open-source-ternary-quantization.mdnew file mode 100644index 000000000..125e4b148--- /dev/null+++ b/web/blog/posts/openbonsai-open-source-ternary-quantization.md@@ -0,0 +1,88 @@+---+title: >+ Introducing OpenBonsai: Open-Source Ternary Quantization for Tiny, Capable On-Device Models+slug: openbonsai-open-source-ternary-quantization+sortOrder: -450+date: 2026-10-29+readTime: 4 min read+description: >+ Introducing OpenBonsai, an open-source (Apache-2.0) framework to compress models and fine-tunes into Prism ML-compatible ternary weights (-1, 0, +1), shrinking Qwen3.5-9B from ~18 GB to ~2 GB on an RTX 5090.+excerpt: >+ We are releasing OpenBonsai, an open-source framework to compress models into ternary weights compatible with Prism ML's format. Shrink Qwen3.5-9B from ~18 GB to ~2 GB on a single RTX 5090.+titleTag: >+ Introducing OpenBonsai: Open-Source Ternary Quantization - WebBrain Blog+ogTitle: >+ Introducing OpenBonsai: Open-Source Ternary Quantization+ogDescription: >+ OpenBonsai brings open ternary quantization to on-device models: compress Qwen3.5-9B from ~18 GB down to ~2 GB in 5 hours on an RTX 5090.+twitterTitle: >+ Introducing OpenBonsai: Open-Source Ternary Quantization+twitterDescription: >+ Shrink 9B models to ~2 GB with open ternary quantization. OpenBonsai compresses your own models and fine-tunes into Prism ML-compatible weights.+keywords:+ - OpenBonsai+ - ternary quantization+ - tiny models+ - on-device AI+ - WebBrain+ - Qwen3.5-9B+ - Prism ML+ - Ternary Bonsai+ - llama.cpp+ - local AI+author: Emre Sokullu+authorUrl: https://emresokullu.com+lede: >+ **My long-term goal is to make a tiny WebGPU model the core of WebBrain.** Today, we are releasing OpenBonsai: an open-source (Apache-2.0) framework that lets you compress your own models or fine-tunes into ternary weights compatible with Prism ML's format, shrinking Qwen3.5-9B from ~18 GB down to ~2 GB on a single RTX 5090.+---++## The path to tiny on-device models++As you might know, I'm passionate about tiny AI models. The web browser is where people spend their digital lives, and having an intelligent browser agent that runs completely private, local, and fast requires pushing model efficiency to the limit. My long-term goal is to make a tiny WebGPU model the core of WebBrain.++Our recent experiments with combined vision-language and decision models, including [WebBrain Compass VLD Tiny](https://huggingface.co/webbrain-one/webbrain-compass-vld-tiny-v5-onnx) (based on MiniCPM-V 4.7) and [LFM3-VLD-2B](https://huggingface.co/webbrain-one/lfm3-vld-2b), suggest that we are getting closer. Compact, purpose-built architectures can deliver impressive domain competence without needing a cluster of enterprise GPUs.++## Shrinking capable models: the ternary gap++While training and fine-tuning compact base models is one path forward, I've also been exploring a complementary approach: shrinking larger, highly capable foundation models through ternary quantization, as Prism ML has done with its Ternary Bonsai models.++Prism ML did an impressive job: fitting a 9B model into roughly 2 GB by representing weights with ternary values (-1, 0, +1). Their weights are open, but the compression recipe is not. You can fine-tune their pre-quantized models, but you cannot take your own fine-tuned model and compress it into that same format using their publicly available tools.++Going from BF16 to ternary has remained Prism ML's secret sauce. That's the gap I wanted to tackle.++## The clue: attending to your own thoughts++A recent paper from Intel Labs China (Wang et al., *"Attend to Your Own Thoughts"*) offered an interesting clue: calibrate compression using the model's own reasoning traces, rather than relying solely on generic text corpora.++Reasoning traces expose the critical pathways a model uses when thinking through complex steps. Calibrating the quantizer against these internal activation states preserves the weights that actually drive the model's decision-making.++So I put the idea to the test in my homelab, with assistance from my AI agents.++## Enter OpenBonsai++The result is **OpenBonsai**, an open-source (Apache-2.0) framework that lets you compress your own models or fine-tunes into ternary weights compatible with Prism ML's format.++Here is what we have achieved so far:++- **Qwen3.5-9B:** ~18 GB (BF16) → ~2 GB (Ternary)+- **Runtime:** Fully compatible with Prism ML's `llama.cpp` fork+- **Compression time:** ~5 hours end-to-end on a single NVIDIA GeForce RTX 5090+- **Reproducibility:** The same pipeline also worked on Qwen3-8B without code changes++## Research preview: results and limitations++The results are encouraging, although there is still a quality gap compared with the original uncompressed models and Prism's own releases.++This is a research preview, not a finished product. In the spirit of open science, I have documented the benchmarks, limitations, and the experiments that didn't work along the way. Hopefully, others in the open-source and local AI community can build on this, refine the calibration methods, and push open ternary quantization further.++## Try it out++Here is the first compressed model checkpoint, along with the framework to ternarize your own fine-tunes:++- 🤗 **Model:** [webbrain-one/openbonsai-qwen-3.5-9b](https://huggingface.co/webbrain-one/openbonsai-qwen-3.5-9b)+- 💻 **Framework:** [esokullu/openbonsai on GitHub](https://github.com/esokullu/openbonsai)+- 🌐 **Project website:** [openbonsai.org](https://openbonsai.org)++I'd love to see what others can do with it!++Tags: #TinyModels #TernaryQuantization #OnDeviceAI #OpenSource #LocalAI #WebBrain