MashiroSaber03/Saber-Translator
✨ 一款小白也能轻松使用的漫画翻译工具，旨在帮助漫画爱好者轻松跨越语言障碍，畅享原汁原味的日文漫画。 利用先进的 AI 技术，智能检测漫画中的对话气泡，精准识别日文文本，并快速翻译成流畅自然的中文。 ✨ 无论是图片还是 PDF 格式的漫画，Saber-Translator 都能轻松应对，让你无压力阅读心爱的漫画作品。在线体验：https://saber.mashirosaber.work/
What it solves
Saber-Translator is a comprehensive tool for translating and managing manga. It automates the tedious process of removing original text from images, translating the dialogue, and rendering the new text back into the manga panels, while providing a system to organize these projects into a digital bookshelf.
How it works
The project uses a multi-stage pipeline to process manga pages:
- Text Detection & OCR: It identifies text bubbles using models like DBNet or YOLO and extracts the text via OCR engines (e.g., MangaOCR, PaddleOCR).
- AI Translation: The extracted text is translated using various AI providers (e.g., DeepSeek, Gemini, Ollama) or a specialized "High Quality" mode that uses multimodal models to consider context across multiple images.
- Image Inpainting: It removes the original text using tools like LaMA to restore the background.
- Rendering: The translated text is embedded back into the image with customizable fonts and styles.
Additionally, it includes Manga Insight, a RAG-based (Retrieval-Augmented Generation) engine that analyzes the manga's plot, identifies characters, and allows users to ask questions about the story using vector search.
Who it’s for
It is designed for manga readers and translators who want to automate the translation of foreign-language comics or manage their translated collections with an integrated reader and analysis tool.
Highlights
- Full Pipeline: Integrated workflow from file import (PDF, ZIP, CBZ) to final export.
- Multimodal Context: A high-quality translation mode that analyzes multiple images simultaneously for better coherence.
- Manga Insight: AI-powered plot analysis, character relationship mapping, and semantic search for specific scenes.
- Browser Integration: Chrome and Edge extensions that allow users to translate manga directly on web pages.
- Customizable Editor: A built-in editor for fine-tuning text placement, fonts, and colors after AI translation.
- Plugin System: Support for custom plugins and an AI assistant to help create them.
Related
- Project
- Project
- Project
- Project
- Project