ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
Python ai-agentsamdcomfyuidockerllama-cppllmlocal-ain8nnvidiaopen-webuiragself-hostedspeech-to-textstrix-halotext-to-speechworkflow-automation
Continue (AI Coding Assistant)
Open-source AI coding assistant for VS Code and JetBrains IDEs. Uses ODS's local LLM for code completion and chat — no cloud required.
Requirements
- GPU: NVIDIA, AMD, or Apple Silicon
- Dependencies: llama-server
Enable / Disable
ods enable continue
ods disable continue
Your data is preserved when disabling. To re-enable later: ods enable continue
Access
- URL:
http://localhost:8890(config server)
First-Time Setup
- Enable the service:
ods enable continue - Install the Continue extension in your IDE (VS Code or JetBrains)
- Configure IDE to use
http://<ods>:8890as the remote config server - Or manually set the API base URL to ODS's LLM endpoint