Formerly KrillinAI, VideoTranslation and Dubbing Tool for 120+ Languages. Open-source AI workspace for creators, powered by Codex. Video downloader, video translation, create videos, images, audios, and edits with Agents in one place. For your Social Media like YouTube, TikTok, Instagram, etc.
TypeScript agent-skillscodex-clideskop-appdubbingimage-generationlocalizationskillsttsvideo-editingvideo-generationvideo-transcriptionvideo-translation
docs: update readme
沈浩facc00486f33
diff --git a/README.md b/README.mdindex 5f26085a..99b7efad 100644--- a/README.md+++ b/README.md@@ -15,13 +15,14 @@KrillinAI是一个为追求高质量视频翻译的用户和开发者设计的解决方案,提供从视频下载到最终成品的一站式工作流程,用AI赋能跨语言文化沟通。## 主要特点与功能:-🎯 **一键启动**:无需复杂的环境配置,Krillin AI支持自动安装依赖,快速上手,立即投入使用。-📥 **视频获取**:集成yt-dlp,直接通过YouTube,Bilibili链接下载视频,简化素材收集过程。-📜 **字幕识别**:基于Whisper模型进行字幕识别,高速、高质量转录。-🧠 **智能字幕分割对齐**:利用自研算法对字幕进行智能分割和对齐,避免错位和上下文丢失。-🔄 **自定义词汇替换**:支持一键替换词汇,适应特定领域语言风格。-🌍 **专业级翻译**:整句翻译引擎,确保上下文一致和语义连贯。-🎙️ **多样化外部服务选择**:支持OpenAI、阿里云等主流供应商(持续集成中)的语音和大模型服务,满足不同场景下的需求。+🎯 **一键启动**:无需复杂的环境配置,Krillin AI支持自动安装依赖,快速上手,立即投入使用+📥 **视频获取**:集成yt-dlp,直接通过YouTube,Bilibili链接下载视频,简化素材收集过程,也可直接上传本地视频+📜 **字幕识别和翻译**:支持OpenAI、阿里云等主流供应商的语音和大模型服务以及Faster Whisper本地模型(持续集成中)+🧠 **智能字幕分割对齐**:利用自研算法对字幕进行智能分割和对齐,摆脱生硬的断句+🔄 **自定义词汇替换**:支持一键替换词汇,适应特定领域语言风格+🌍 **专业级翻译**:整段翻译引擎,确保上下文一致和语义连贯+🎙️ **配音和声音克隆**:可选默认的男女生音色生成翻译后的视频朗读配音,或者上传本地音频样本克隆音色进行朗读+📝 **配音对齐**:跨语言配音,也能与原字幕对齐## 语言支持输入语言支持:🇨🇳中文,🇺🇸英文,🇯🇵日语(持续增加中)@@ -65,12 +66,12 @@ https://github.com/user-attachments/assets/0b32fad3-c3ad-4b6a-abf0-0865f0dd2385### To: macOS用户本软件没有做签名,因此在macOS上运行时,在完成“基本步骤”中的文件配置后,还需要手动信任应用,方法如下:-1. 在终端打开可执行文件(假设文件名是krillinai)所在目录+1. 在终端打开可执行文件(假设文件名是KrillinAI-v1.0.0-windows)所在目录2. 依次执行以下命令:```- sudo xattr -rd com.apple.quarantine ./krillinai- sudo chmod +x ./krillinai- ./krillinai+ sudo xattr -rd com.apple.quarantine ./KrillinAI-v1.0.0-windows+ sudo chmod +x ./KrillinAI-v1.0.0-windows+ ./KrillinAI-v1.0.0-windows```即可启动服务diff --git a/docs/README_en.md b/docs/README_en.mdindex b694d053..61dad8d7 100644--- a/docs/README_en.md+++ b/docs/README_en.md@@ -14,13 +14,14 @@Krillin AI is a one-stop solution designed for users and developers seeking high-quality video processing. It provides an end-to-end workflow, from video download to the final product, ensuring every frame of your content is extraordinary.## Key Features and Functions:-🎯 **One-Click Startup**: There is no need for complicated environment configuration. Krillin AI supports automatic installation of dependencies, allowing you to quickly get started and put it into use immediately.-📥 **Video Acquisition**: With yt-dlp integrated, it can directly download videos via YouTube and Bilibili links, simplifying the process of collecting materials.-📜 **Subtitle Recognition**: Based on the Whisper model, it conducts subtitle recognition, enabling high-speed and high-quality transcription.-🧠 **Intelligent Subtitle Segmentation and Alignment**: Utilizing self-developed algorithms to perform intelligent segmentation and alignment of subtitles, avoiding misalignment and loss of context.-🔄 **Custom Vocabulary Replacement**: It supports one-click replacement of vocabulary to adapt to the language style of specific fields.-🌍 **Professional-Level Translation**: The sentence translation engine ensures the consistency of context and semantic coherence.-🎙️ **Diverse Options for External Services**: It supports voice and large model services from mainstream providers (ongoing integration) such as OpenAI and Alibaba Cloud, meeting the needs in different scenarios.+🎯 **One-Click Start**: There is no need for complicated environment configuration. Krillin AI supports automatic installation of dependencies, enabling you to quickly get started and put it into use immediately.+📥 **Video Acquisition**: Integrated with yt-dlp, it can directly download videos via YouTube and Bilibili links, simplifying the process of material collection. You can also directly upload local videos.+📜 **Subtitle Recognition and Translation**: It supports voice and large model services of mainstream providers such as OpenAI and Alibaba Cloud, as well as local models (continuous integration in progress).+🧠 **Intelligent Subtitle Segmentation and Alignment**: Utilize self-developed algorithms to conduct intelligent segmentation and alignment of subtitles, getting rid of rigid sentence breaks.+🔄 **Custom Vocabulary Replacement**: Support one-click replacement of vocabulary to adapt to the language style of specific fields.+🌍 **Professional Translation**: The whole-paragraph translation engine ensures the consistency of context and semantic coherence.+🎙️ **Dubbing and Voice Cloning**: You can choose the default male or female voice tones to generate video reading dubbing for the translated content, or upload local audio samples to clone voice tones for dubbing.+📝 **Dubbing Alignment**: It can perform cross-language dubbing and also align with the original subtitles.## Language SupportInput languages: 🇨🇳 Chinese, 🇺🇸 English, 🇯🇵 Japanese supported (more languages being added)@@ -61,12 +62,12 @@ https://github.com/user-attachments/assets/0b32fad3-c3ad-4b6a-abf0-0865f0dd2385### To: macOS UsersThis software is not signed, so after completing the file configuration in the "Basic Steps," you will need to manually trust the application on macOS. Follow these steps:-1. Open the terminal and navigate to the directory where the executable file (assuming the file name is `krillinai`) is located.+1. Open the terminal and navigate to the directory where the executable file (assuming the file name is `KrillinAI-v1.0.0-windows`) is located.2. Execute the following commands in sequence:```-sudo xattr -rd com.apple.quarantine ./krillinai-sudo chmod +x ./krillinai-./krillinai+sudo xattr -rd com.apple.quarantine ./KrillinAI-v1.0.0-windows+sudo chmod +x ./KrillinAI-v1.0.0-windows+./KrillinAI-v1.0.0-windows```This will start the service.