Transform your 3D texturing workflow with the power of generative AI, directly within Blender!
describe the 0.5.0 setup page, lato.2 and object prompts in the readme
sakalondc7b2603be977
diff --git a/README.md b/README.mdindex 927fe26..a5ce5c5 100644--- a/README.md+++ b/README.md@@ -19,7 +19,7 @@ StableGen is a Blender add-on that textures meshes and whole scenes with diffusi## One prompt to a rigged asset-Describe a character and pick one of the preview images; StableGen does the rest in one run. TRELLIS.2 builds the mesh, SkinTokens rigs it, and views generated around it are projected into its texture. A run can also start from an image, skip the rig, or keep the texture TRELLIS.2 makes itself. [TRELLIS.2](https://github.com/sakalond/StableGen/wiki/TRELLIS.2-mesh-generation)+Describe a character and pick one of the preview images; StableGen does the rest in one run. TRELLIS.2 builds the mesh, SkinTokens rigs it, and views generated around it are projected into its texture. A run can also start from an image, skip the rig, or keep the texture TRELLIS.2 makes itself. Afterwards, LATO.2 can rebuild any mesh as low-poly topology, and Make Solid removes the hidden interior shells TRELLIS.2 meshes carry. [TRELLIS.2](https://github.com/sakalond/StableGen/wiki/TRELLIS.2-mesh-generation)<p><picture><source media="(min-width: 768px)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/blank.svg"><source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/pipeline-phone-dark.webp"><img src="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/pipeline-phone-light.webp" alt="The StableGen panel: a prompt, the preview gallery, then the mesh, rig and texture generated in Blender"></picture><picture><source media="(max-width: 767px)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/blank.svg"><source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/pipeline-dark.webp"><img src="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/pipeline-light.webp" alt="The StableGen panel: a prompt, the preview gallery, then the mesh, rig and texture generated in Blender"></picture>@@ -69,7 +69,7 @@ Bake the result, PBR maps included, into UV textures and export it with its rig## Working by hand-Each step can also be done by hand: reorder the cameras and give views their own prompts, change how the views blend and reproject without generating again, extract PBR maps, and repaint a region with Masked Edit.+Each step can also be done by hand: reorder the cameras, give views their own prompts and describe objects once for every view that sees them, change how the views blend and reproject without generating again, extract PBR maps, and repaint a region with Masked Edit.<p><picture><source media="(min-width: 768px)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/blank.svg"><source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/tools-phone-dark.webp"><img src="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/tools-phone-light.webp" alt="The StableGen panel: camera order and view prompts, blending, PBR maps and Masked Edit"></picture><picture><source media="(max-width: 767px)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/blank.svg"><source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/tools-dark.webp"><img src="https://raw.githubusercontent.com/sakalond/stablegen-media/main/readme/tools-light.webp" alt="The StableGen panel: camera order and view prompts, blending, PBR maps and Masked Edit"></picture>@@ -95,6 +95,7 @@ Texturing works by projection. Each camera gets a generated view that follows th- [TRELLIS.2](https://github.com/microsoft/TRELLIS.2) generates meshes, through ComfyUI's own TRELLIS.2 nodes.- [SDXL](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) with ControlNet and IPAdapter, and [Qwen Image](https://github.com/QwenLM/Qwen-Image), generate the texture views. [MOSS-Image](https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT) and [Bria FIBO 2.0](https://huggingface.co/briaai/Fibo-2.0-edit-turbo) are available as experimental architectures.- [SkinTokens](https://github.com/VAST-AI-Research/SkinTokens) rigs characters.+- [LATO.2](https://github.com/LoHhhha/LATO.2) rebuilds meshes as low-poly topology, through the [ComfyUI-LATO2](https://github.com/sakalond/ComfyUI-LATO2) node.- [Marigold](https://github.com/prs-eth/Marigold) and [StableDelight](https://github.com/Stable-X/StableDelight) estimate the PBR maps.## Gallery@@ -123,18 +124,18 @@ Texturing works by projection. Each camera gets a generated view that follows th1. Download the add-on ZIP for your system (Windows x64, Linux x64 or macOS on Apple Silicon) from [Releases](https://github.com/sakalond/stablegen/releases). In Blender, open **Edit > Preferences > Get Extensions**, choose **Install from Disk** in the top-right menu, and select the ZIP.2. Under **System > Network**, enable **Allow Online Access**.-3. In StableGen's add-on preferences, choose where **ComfyUI** comes from:- - **StableGen's own**: pick an install folder and press **Install ComfyUI**. StableGen sets up ComfyUI with its own Python and torch for your GPU, then starts and stops it by itself. Windows and Linux.- - **My ComfyUI folder**: a ComfyUI you already have (portable, git or Desktop install). StableGen installs models into it and starts it when needed.- - **Remote server**: a ComfyUI on another machine, at its server address. Install the models there with the installer (below).-4. Under **Models**, install what you need: SDXL or Qwen Image 2.1 for texturing, TRELLIS.2 for meshes, auto-rigging, PBR maps and the experimental architectures. Each shows its download size, and an interrupted download resumes.-5. Set **Output Directory**.+3. Open the StableGen panel in the 3D Viewport's sidebar (**N**). Its **ComfyUI setup** page opens the first time, and later under **•••** > **ComfyUI setup**. Choose where ComfyUI comes from:+ - **Install StableGen's own**: pick an install folder and press **Install ComfyUI**. StableGen sets up ComfyUI with its own Python and torch for your GPU, about 5 GB, then starts and stops it by itself. Tested on Windows so far.+ - **Use my ComfyUI folder**: a ComfyUI you already have (portable, git or Desktop install, or one that runs on your system Python). StableGen installs models into it and starts it when needed.+ - **Connect to a server**: a ComfyUI on another machine, at its server address. Install the models there with the installer (below).+4. Under **Models** on the same page, install what you need: SDXL or Qwen Image 2.1 for texturing, TRELLIS.2 for meshes, auto-rigging, PBR maps, LATO.2 and the experimental architectures. Each shows its download size; installs can be queued and removed, and an interrupted download resumes. When the selected architecture's models are missing, an **Install** line under Architecture downloads them too.+5. Set **Output Directory** in the add-on preferences.On a remote ComfyUI, or without Blender, run the installer on that machine and restart ComfyUI:```bashpython installer.py <path to ComfyUI> --packages 3,8```-Package 3 sets up SDXL texturing, package 13 Qwen Image 2.1, package 8 mesh generation, package 14 auto-rigging, and packages 15 to 17 the experimental architectures. `python installer.py --create-comfyui <folder>` sets up StableGen's own ComfyUI there.+Package 3 sets up SDXL texturing, package 13 Qwen Image 2.1, package 8 mesh generation, package 14 auto-rigging, packages 15 to 17 the experimental architectures, and package 18 LATO.2 low-poly remeshing. `python installer.py --create-comfyui <folder>` sets up StableGen's own ComfyUI there.[Installation](https://github.com/sakalond/StableGen/wiki/Installation) covers every installer package, unattended installs, a remote server and manual setup.@@ -152,7 +153,7 @@ Press <kbd>N</kbd> in the 3D Viewport and open the **StableGen** tab.**Generate an asset**1. Set **Architecture** to **TRELLIS.2** and choose a preset tagged **Mesh + texture**.-2. On the **Mesh** page, set **Generate mesh from** to **Prompt**, describe the object and enable **Preview gallery**.+2. On the **Mesh** page, describe the object. **Generate mesh from** starts on **Prompt**, with the **Preview gallery** on.3. To rig a character in the same run, enable **Auto-rig** under **Rigging & Animation**.4. Click **Generate asset**, then pick a preview image.