Free, open-source AI video generator for Mac. Run LTX-2.5 and MiniMax H3 (Hailuo) locally on Apple Silicon: text-to-video and image-to-video with sound, lip-sync, character LoRA training, songs from lyrics (YuE2) and image editing (Qwen-Image-Edit). One-click install via Pinokio. Offline: no cloud, no API key, no NVIDIA GPU.
Python ai-filmmakingai-videoai-video-generatorapple-siliconhailuoimage-to-videolip-synclocal-ailora-trainingltx-2ltx-2-5ltx-videomacosminimax-h3mlxmusic-generationoffline-aipinokiotext-to-videovideo-generation
README: say what Phosphene is in the words people search, and what is coming
mrbizarro7009e81fef4f
diff --git a/README.md b/README.mdindex ba08eaf..8417ba6 100644--- a/README.md+++ b/README.md@@ -1,111 +1,183 @@-# Phosphene+# Phosphene: free local AI video generator for Mac-AI video with sound, songs and images, made locally on your Mac.+**Run LTX-2.5 and MiniMax H3 (Hailuo) on your Apple Silicon Mac. Text-to-video and image-to-video with sound, lip-sync, songs and image editing. Offline: no cloud, no API key, no NVIDIA GPU.**<p align="center">- <img src="assets/the_commuter_hero.gif" alt="The Commuter, a 75-second One Shot made in Phosphene" width="100%">+ <img src="assets/the_commuter_hero.gif" alt="The Commuter: a 75-second AI video made offline on one Mac with Phosphene and MiniMax H3" width="100%"></p>-“The Commuter”: a 75-second One Shot rendered overnight on one Mac with Hailuo H3, from a single designed still. [More clips](https://phosphene.video/gallery/).+<p align="center"><sub>“The Commuter”: a 75-second One Shot rendered overnight on one Mac with MiniMax H3, from a single designed still. <a href="https://phosphene.video/gallery/">More clips in the gallery</a>.</sub></p>-[Website](https://phosphene.video) · [Docs](https://phosphene.video/docs/) · [Benchmarks](https://phosphene.video/benchmarks/) · [Changelog](https://phosphene.video/changelog/) · [@PhospheneAI](https://x.com/PhospheneAI)+<p align="center">+ <a href="https://phosphene.video/download/"><b>Download</b></a> ·+ <a href="https://phosphene.video/docs/">Docs</a> ·+ <a href="https://phosphene.video/gallery/">Gallery</a> ·+ <a href="https://phosphene.video/benchmarks/">Render times</a> ·+ <a href="https://phosphene.video/changelog/">Changelog</a> ·+ <a href="https://github.com/mrbizarro/phosphene/discussions">Discussions</a> ·+ <a href="https://x.com/PhospheneAI">@PhospheneAI</a>+</p>++Phosphene is a free, open-source AI video generator that runs locally on a Mac with M1, M2, M3, M4 or M5.+It runs **LTX-2.5** and **MiniMax H3 (Hailuo H3)** for text-to-video and image-to-video with sound in the same pass,+**YuE2** for songs from lyrics, and **Qwen-Image-Edit** and **FLUX.2** for images. It installs with one click through Pinokio+and is built on Apple's MLX: no CUDA, no cloud GPU, no API key, no credits and no watermark.+Your prompts, pictures and videos never leave your Mac.++**Current release: v4.19.13.** See [what's new](https://phosphene.video/changelog/). Made by Mr Bizarro.++## Why Phosphene++- **Free, with no credits.** No subscription, no sign-up, no watermark, no per-render charge. Make as many takes as you like.+- **Private and offline.** Rendering happens on your Mac. Download the models once, then work without a connection.+- **Sound comes with the picture.** Footsteps, rooms, voices and lip movement are generated together, not added later.+- **One app for the whole film.** Shots, long takes, songs, stills, trained characters and an editing timeline.+- **Made for the Mac.** Phosphene checks your memory and only offers what your Mac can run.++## What you can make++### Text-to-video and image-to-video with sound (LTX-2.5 on Apple Silicon)++Turn a prompt or a picture into a video clip with sound, using the MLX port of Lightricks' LTX-2.5. Set first and last frames, guide a shot with 3–8 keyframes,+**Extend** a clip, **Retake** one moment, or lip-sync a face to your own voice or song. Upscale & Face Fix is built in.+Works from 16 GB of memory. [Video guide](https://phosphene.video/docs/video/)++### Run MiniMax H3 (Hailuo) locally on a Mac++MiniMax H3, also called Hailuo H3, makes scenes where people talk, with lips that match their voices.+Use keyframes, extend a shot, lip-sync, or **Add sound** to give a silent clip its own soundscape.+About 75 GB, one click from the Pinokio sidebar, from 36 GB of memory.+Its licence excludes the EU, UK, South Korea and US. [MiniMax H3 guide](https://phosphene.video/docs/hailuo-h3/)++### Long AI films: One Shot, Storyboard and the Editor-**Current release: v4.19.13.** See what's new in the [changelog](https://phosphene.video/changelog/).+- **One Shot:** one continuous shot of 30 seconds to 2 minutes that never cuts. [Guide](https://phosphene.video/docs/one-shot/)+- **Storyboard:** turn one idea into a multi-shot film. Plan the shots, render them, keep the best takes, or turn on Auto. Add a song to cut a music video to the beat. [Guide](https://phosphene.video/docs/storyboard/)+- **Editor:** trim, split, J-cuts and L-cuts, music, titles and transitions. Render one file or send the timeline to DaVinci Resolve, Premiere Pro or After Effects. [Guide](https://phosphene.video/docs/editor/)-Phosphene is a free, open-source app for Apple Silicon Macs, built on Apple's MLX by Mr Bizarro.-Renders run offline, and your prompts, pictures and videos stay on your Mac.-Optional extras download when a feature first needs them.+### Remix your own footage-## What it does+- **Motion Control:** copy the motion, camera move and pose of a clip you give it while your prompt paints a new subject and scene. [Guide](docs/MOTION_CONTROL.md)+- **Ingredients:** compose 2–8 reference pictures (a character, a prop, a place) into one clip.+- **Colorize:** turn black-and-white footage into colour.-- **Video with LTX-2.5:** turn text or a picture into video with sound from the same prompt.- Set first and last keyframes, Extend a clip, Retake one moment, or lip-sync a face to your voice or song.- Upscale & Face Fix and [Motion Control](docs/MOTION_CONTROL.md) are included. Adapts from 16 GB of memory.+### Songs from lyrics with YuE2: a local Suno alternative-- **Scenes with Hailuo H3:** make scenes with dialogue you can hear.- Use keyframes, extend a shot, lip-sync, or add sound to a silent clip.- About 75 GB, one click from the Pinokio sidebar. Needs 36 GB+ memory.- Its licence excludes the EU, UK, South Korea and US.+Music Studio uses YuE2 to write a full song with vocals and instruments from your lyrics and a style, or an instrumental.+Make another take, cover a song, or get the score. About 11 GB, installed inside the app, from 24 GB of memory. [Music guide](https://phosphene.video/docs/music/)-- **Music Studio:** YuE2 makes songs with vocals from lyrics and a style.- Make another take or work on the score. About 11 GB, installed inside the panel. Needs 24 GB+ memory.+### AI image editing with Qwen-Image-Edit and FLUX.2-- **Images:** Qwen-Image-Edit and FLUX.2 via mflux make images and edit them in words, like “make the jacket red”.- Use up to three reference pictures, then send a still straight to video.+Qwen-Image-Edit and FLUX.2 (via mflux) make images and edit them in words, like “make the jacket red”,+with up to three reference pictures. Ideogram 4 puts readable words on a picture. Send any still straight to video. [Images guide](https://phosphene.video/docs/images/)-- **Storyboard, One Shot and the Editor:** build a film from one prompt or shot by shot.- Cut it on the Editor timeline with music and room tone.+### Train a character LoRA on your Mac (face and voice)-- **Train a character:** train a face and voice LoRA on your Mac from your own photos and recordings.+Train an LTX-2 character LoRA of an original character, or of yourself, on your Mac: face from your photos, voice from your recordings.+Local Gemma writes the training captions for you. Browse and install LTX LoRAs from CivitAI inside the app.+[Training guide](https://phosphene.video/docs/train-character/) · [LoRAs](https://phosphene.video/docs/loras/)-- **Scripts and agents:** queue renders through the [local HTTP API](docs/API.md).- There's also an [image layout API for agents](docs/AGENT_API.md).+### Scripts and AI agents-- **Prompt help:** Google's Gemma runs locally for Enhance, training captions and the storyboard planner.- Enhance sharpens a prompt.+Everything the app does is reachable over a [local HTTP API](docs/API.md), so Claude Code, Codex or your own script can queue renders.+There is also an [image layout API for agents](docs/AGENT_API.md).+Gemma runs locally for prompt **Enhance**, captions and the storyboard planner.<p align="center">- <img src="https://github.com/user-attachments/assets/0c504d54-1666-4a64-8872-7d471682c8f0" alt="The Phosphene panel" width="100%">+ <img src="assets/phosphene_app_mac.jpg" alt="The Phosphene AI video app on a Mac: LTX-2.5 text-to-video with a trained character LoRA" width="100%"></p>-## Hardware+## Mac requirements: M1 to M5, memory and disk-Apple Silicon only, M1 or newer. Intel Macs and Windows are not supported.+Any Apple Silicon Mac, M1 or newer, including MacBook Air, MacBook Pro, Mac mini and Mac Studio. Memory decides what you can run. Intel Macs and Windows are not supported.-| Memory | What to expect |+| Memory | What you can make || --- | --- || 16–24 GB | LTX-2.5 video from text or a picture at smaller sizes, and images. Songs from 24 GB. |-| 32–36 GB | Everything above. Hailuo H3 from 36 GB. |+| 32–36 GB | Everything above. MiniMax H3 from 36 GB. || 48–64 GB | LTX keyframes, Extend, trained characters with Q8 weights, and the High tier. |-| 96 GB+ | Most modes at full size (available from 80 GB). Size limits come off at 120 GB. |+| 96 GB+ | Most modes at full size (from 80 GB). Size limits come off at 120 GB. |-Phosphene is built on an M4 Max with 64 GB. See the [benchmarks](https://phosphene.video/benchmarks/).+**Disk:** the first install downloads 27.5 GB before Start, then about 10.7 GB in the background.+MiniMax H3 (about 75 GB) and Music Studio (about 11 GB) are optional.-**Disk:** a fresh install downloads 27.5 GB before Start, then about 10.7 GB in the background after the first start.-Hailuo H3 (~75 GB) and the music engine (~11 GB) are optional.+## How fast is it on a Mac?-## Install+On an M4 Max with 64 GB, a 5-second LTX-2.5 clip at High takes about 6 minutes,+a 5-second MiniMax H3 clip on Draft + Fast about 5 minutes, and a 3-minute song about 3 minutes.+Smaller Macs take longer: across Phosphene users, a 5-second LTX-2.5 clip at Balanced (480p) took a median 10m40s on a 16 GB M4.+Phosphene estimates the time before you press Generate. See [render times by Mac](https://phosphene.video/benchmarks/).-Today, install through [Pinokio](https://pinokio.computer):+## One-click install with Pinokio++Phosphene installs with one click through [Pinokio](https://pinokio.computer), a free app launcher:1. Install Pinokio.2. Open **Discover → Download from URL** and paste `https://github.com/mrbizarro/phosphene`.3. Press **Install**.-4. Press **Start**, then open the panel.+4. Press **Start**, then open the app.To update, press **Update** in Pinokio, then restart Phosphene.-See the [full install guide](https://phosphene.video/docs/install/) for details, or the [manual install](docs/MANUAL_INSTALL.md) to do it by hand.+More detail in the [install guide](https://phosphene.video/docs/install/), the [manual install](docs/MANUAL_INSTALL.md) if you prefer the terminal,+and [troubleshooting](https://phosphene.video/docs/troubleshooting/).+[Linux on Apple Silicon](docs/LINUX.md) is maintained by @joshuaswarren on a best-effort basis.-A free [native Mac app](https://phosphene.video/download/) is coming soon.-It can reuse models your Pinokio install already downloaded.+## What's coming-[Linux on Apple Silicon](docs/LINUX.md) is maintained by @joshuaswarren on a best-effort basis.-It is not installed by Pinokio.+These open with **Phosphene 5.0**:++- **A native Mac app,** so you won't need Pinokio. It can reuse the models your Pinokio install already downloaded.+- **Pro,** for people who use Phosphene every day: new speed-ups first (MiniMax H3 renders about 1.6× faster today), [Phosphene Remote](https://phosphene.video/remote/) to start and watch renders from your iPhone, and priority support. $15 a month or $120 a year.+- **Founding:** 3 years of Pro for one payment of $149, limited to 200 seats.++Nothing is on sale yet. [Join the list](https://phosphene.video/pricing/) to get the launch email.+Everything available today stays free, Phosphene stays open source under MIT, and new model ports reach everyone free.++## FAQ++**Is Phosphene really free?**+Yes. No subscription, credits or watermark, and every feature available today stays free. Pro adds speed-ups and Remote; it does not lock today's features.++**Does it work offline?**+Yes. Download the models once, then render without a connection. When online, it checks GitHub for updates and downloads models you ask for.++**Can I run LTX-2 or MiniMax H3 on an M1, M2 or 16 GB Mac?**+LTX-2.5 runs from 16 GB at smaller sizes on any Apple Silicon Mac. MiniMax H3 needs 36 GB. See the [Mac requirements](#mac-requirements-m1-to-m5-memory-and-disk).++**LTX-2.5 or MiniMax H3: which should I use?**+MiniMax H3 for people talking: dialogue and voices that match lips. LTX-2.5 for everything else: more modes, keyframes, trained characters, Motion Control and smaller Macs. Phosphene has both in one switcher.++**Are LTX-2.5 and MiniMax H3 open source?**+Their weights are open to download, each under its own community licence (see [License](#license)). Phosphene's code is MIT.-## Where we're going+**Does it run on Windows or Intel Macs?**+No. Phosphene is built for Apple Silicon. On Windows with an NVIDIA GPU, look at ComfyUI or WanGP.-- A free native Mac app, so you won't need Pinokio.-- Pro, for people who use Phosphene every day or earn money with it.-- More models. Bringing new open models to the Mac first is the point. New ports reach everyone free; Pro may get them up to 24 hours early.-- Everything available today stays free.+**Can I run Wan 2.2 or FramePack on a Mac?**+Phosphene doesn't include them. Draw Things lists Wan 2.2, and mlx-video runs Wan 2.1 and 2.2 from Python. Phosphene's LTX-2.5 and MiniMax H3 cover the same jobs with sound.-## Pro+**What is the best local AI video generator for Mac? How is Phosphene different from ComfyUI, Draw Things or LTX Desktop?**+ComfyUI gives you a node graph for every model; Phosphene gives you ready-made workflows built on MLX for the Mac.+Draw Things has an App Store app and cloud compute; LTX Desktop comes from the makers of LTX.+Our [honest comparison](https://phosphene.video/blog/how-to-make-ai-video-on-a-mac/) says where each is ahead.-We love open source. Phosphene will always be open source and well maintained.-If you can afford it, Pro keeps the lights on: faster renders, priority support and more.+**Is it an alternative to Veo 3, Runway, Kling or Higgsfield?**+Those run in the cloud and charge per render. Phosphene runs open models on your own Mac for free. Cloud models are faster, and some are sharper; Phosphene is private, unlimited and yours.-Pro is coming soon. Nothing is on sale yet. [Join the waitlist](https://phosphene.video/pricing/).+**Can I use what I make commercially?**+Phosphene's code is MIT. Each model has its own licence, and some are non-commercial (see [License](#license)). Check a model's licence before you sell its output.## Privacy-No prompt, picture, video or filename is uploaded; the panel listens on `127.0.0.1` only, with no login, so don't expose it to a network.+No prompt, picture, video or filename is uploaded. The app listens on `127.0.0.1` only, with no login, so don't expose it to a network.Phosphene checks GitHub for updates and contacts Hugging Face or CivitAI only when you download models or LoRAs.Anonymous usage counts (version, hardware class such as “M4 Max / 64 GB”, and render stats) are on by default;one click in Settings turns them off, and [every field is documented](docs/ANALYTICS.md).+Make original or stylised characters, or yourself with documented consent; see the [acceptable use policy](https://phosphene.video/acceptable-use/).## Contributing-[Bug reports](https://github.com/mrbizarro/phosphene/issues) and PRs are welcome.+[Bug reports](https://github.com/mrbizarro/phosphene/issues), ideas in [Discussions](https://github.com/mrbizarro/phosphene/discussions) and pull requests are welcome.A report with your chip, macOS version, Phosphene version and the error line is worth as much as a patch.Contributors are credited in the [release notes](https://github.com/mrbizarro/phosphene/releases). See [CONTRIBUTING.md](CONTRIBUTING.md).diff --git a/assets/phosphene_app_mac.jpg b/assets/phosphene_app_mac.jpgnew file mode 100644index 0000000..ddbc049Binary files /dev/null and b/assets/phosphene_app_mac.jpg differ