Skip to content

anantham/LexiconForge

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

LexiconForge : Let the AI customize the translation for you!

Tired of waiting for official translations? Wish you could continue the story right after the anime or manga ends?

LexiconForge is your gateway to the world of web novels. It is an interface that lets you translate chapters from almost any source (let me know and I can add support), in any language, to any language!

This was a passion project because of how much I love going into these worlds.

๐ŸŽฎ Use it instantly: lexicon-forge.vercel.app is live for anyone to read and translate right now.

๐Ÿ’Ž Patreon concierge: Subscribers get 1:1 onboarding, priority feature requests, bug fixes, and a complimentary $10 API credit to start reading. Join here.

Demo gif

Watch full video here


โœจ Key Features: The Ultimate Reading Experience

LexiconForge is more than just a translator; it's a power tool for readers.

๐Ÿ“š Reader Feedback Loop Highlights

  1. ๐Ÿ‘ / ๐Ÿ‘Ž on any line to teach the model your taste and steadily improve every chapter.
  2. ๐Ÿ”’ Privacy-first architecture keeps your API keys and translation history on-device.
  3. ๐Ÿง  Bring your own favorite modelโ€”Gemini, Claude, DeepSeek, OpenRouter, Flux, moreโ€”all supported.
  4. โ“ Use the question emoji to generate cultural footnotes and etymology explanations on demand.
  5. ๐ŸŽจ Summon bespoke illustrations by reacting to your favorite scene with the art emoji.
  6. โœ๏ธ Tap the edit button to surgically refine the AI's output before saving it.
  7. ๐Ÿ“– Compare against trusted fan translations inline, toggling between AI, raw, and fan versionsโ€”use Settings to control whether fan translations are sent as reference to the AI or kept purely for comparison.
  8. ๐Ÿ“ฆ Export polished EPUBs for offline reading once you've curated the perfect translation.
  9. ๐ŸŽ›๏ธ Experiment with prompts, OST generation, img2img steering, session analytics, and more quality-of-life tools built for deep reading.

Floating toolbar with emoji reactions Footnotes explaining translation choices Compare AI vs fan translation inline Hundreds of AI models to choose from Illustration generation example Versioned translations snapshot

๐ŸŒ Universal Web Novel Access

  • ๐Ÿ“– Multi-Site Support: Currently supports 5 major web novel platforms:

    • Kakuyomu (kakuyomu.jp) - Japanese light novels
    • Syosetu (ncode.syosetu.com) - Japanese web novels
    • Dxmwx (dxmwx.org) - Chinese web novels
    • Kanunu (kanunu8.com, kanunu.net) - Chinese literature archive
    • NovelCool (novelcool.com) - Multi-language novel platform
  • ๐ŸŒ Intelligent CORS Proxy System: 10+ redundant proxy servers with automatic health monitoring and failover for reliable content fetching.

  • โšก Smart Preloading: Background fetching of upcoming chapters for seamless reading (configurable 0-50 chapters ahead).

  • ๐Ÿ”— Navigation Memory: Intelligent usage of Disk and Ram to ensure the app does not slow your computer down.

๐Ÿค– Advanced AI Translation

  • ๐Ÿ”‘ Multi-Provider Support: Use your own API keys for Gemini, Claude, DeepSeek, or OpenRouter. You control your usage and data. If you need help contact admin in the @webnovels group to get an API key that works!
  • ๐Ÿ“Š 22+ AI Models: Access the latest generation of AI models across all providers to find your perfect translator. Quality and style varies across models and prompt combinations.
  • ๐Ÿ”ฎ Coming Soon: Direct OpenAI integration (requires backend proxy for security).
  • ๐ŸŽ›๏ธ Fine-Tuned Control: Adjust temperature (creativity), context depth (0-5 previous chapters), and model-specific settings.
  • ๐Ÿ’ฐ Real-Time Cost Tracking: Obsessive focus on cost-efficiency. See exactly how much each translation costs, down to the fraction of a cent, with 2025 pricing.
  • ๐Ÿ›‘ Cancelable Requests: Click the red spinner to abort inโ€‘flight translations instantly.
  • โœ… Structure Guarantees: Built-in validation for illustration and footnote markers keeps body text and JSON aligned.
  • ๐ŸŽฏ Fan Translation Control: Toggle whether fan translations are sent to the AI as reference (Settings โ†’ General โ†’ "Include Fan Translation as Reference"). When enabled (default), the AI uses fan translations as ground truth to improve quality. When disabled, test pure translation quality with only raw text and previous chaptersโ€”fan translations remain available for side-by-side comparison.

๐Ÿง  Collaborative AI Training & Interactive Features

  • ๐Ÿ’ฌ Text Selection Feedback: Select any text and rate it ๐Ÿ‘๐Ÿ‘Ž? to teach the AI your preferences.
  • โ“ Smart Explanations: Click the ? emoji on selected text to generate detailed footnotes explaining translation choices, cultural context, or literary techniques.
  • ๐ŸŽจ Illustration Generation: Click the ๐ŸŽจ emoji on selected passages to automatically generate contextual illustration prompts that capture key story moments.
  • โœ๏ธ Prompt Template Library: Create, save, and manage custom system prompts for different novel types (Wuxia, Romance, Technical, etc.).
  • ๐Ÿ”„ Amendment Proposals: AI suggests prompt improvements based on your feedback patterns.
  • ๐Ÿ“ Inline Annotations: Collaborative feedback system with comments and rating history.

๐ŸŽจ Rich Media & Export

  • ๐Ÿ–ผ๏ธ Advanced AI Image Generation: Bring pivotal story moments to life with cutting-edge image generation:
  • Multi-Model Support: Flux models (PiAPI), Imagen 3.0/4.0, and Gemini image generation
  • 21 LoRA Style Models: XLabs (7) and CivitAI (14) collections for artistic transformation - anime, realism, cyberpunk, art deco, and more
  • img2img with Steering Images: Guide generation with reference images for consistent character/scene styling
  • Advanced Controls: Negative prompts, guidance scale (1.5-5.0), and LoRA strength tuning (0.1-2.0)
  • Smart Context Placement: AI automatically places illustration markers at key story moments
  • Collapsible Interface: Advanced controls hidden by default for distraction-free reading
  • ๐Ÿ“š Professional EPUB Export: Generate beautiful e-books with:
  • Comprehensive translation statistics and cost breakdowns
  • Provider/model usage analytics across your entire library
  • Embedded AI-generated illustrations with captions
  • Customizable acknowledgments and project descriptions
  • ๐Ÿ’พ Complete Data Ownership: Export/import your entire session as JSON. Your reading history, translations, feedback, and settings belong to you.

๐ŸŽต Audio Generation

  • ๐ŸŽง Scene Music & Cues: Generate background music or ambient tracks from style prompts
  • ๐Ÿงฉ Two Modes: txt2audio (from text prompt) and audio2audio (style transfer)
  • ๐ŸŽ›๏ธ Style Presets: Curated prompts (Dark Cinematic, Strategistโ€™s Gambit, etc.)
  • ๐Ÿ“ˆ Cost Awareness: Providerโ€‘reported durations and simple cost estimates
  • ๐Ÿ” Optโ€‘In: Works with your PiAPI key; entirely clientโ€‘side

โšก Performance & Storage

  • ๐Ÿ—„๏ธ Dual-Tier Architecture: Instant UI updates (Zustand) + unlimited persistent storage (IndexedDB) for the best of both worlds.
  • ๐Ÿ”„ Session Persistence: Survive browser crashes and restarts. Your progress is never lost.
  • ๐Ÿ“Š Professional Statistics: Detailed breakdowns of token usage, costs, translation time, and model performance across your entire library.
  • ๐Ÿš€ Smart Preloading: Configurable background fetching (0-10 chapters ahead) with intelligent rate limiting and deduplication.
  • ๐ŸŽฏ Advanced Navigation: Smart URL mapping, browser history integration, and cross-session chapter hydration.
  • ๐Ÿ”ง Developer-Friendly Debugging: Optional console logging system to monitor translation performance and troubleshoot issues.

๐Ÿš€ Getting Started

The Easy Way: Use the Live Version

The easiest way to start is with the official hosted version on Vercel. No installation required!

โžก๏ธ Click here to launch LexiconForge

If youโ€™d like a guided setup, tailored prompts, or bespoke feature development, hop onto the Patreonโ€”Iโ€™ll work with you directly to craft the perfect reading experience.

For Developers: Self-Hosting

Want to run your own instance? It's easy.

  1. Clone the repository.
  2. Install dependencies: npm install
  3. Add your API keys to a new .env.local file:
    VITE_GEMINI_API_KEY=your_gemini_key_here
    VITE_DEEPSEEK_API_KEY=your_deepseek_key_here
    VITE_CLAUDE_API_KEY=your_claude_key_here
    VITE_OPENROUTER_API_KEY=your_openrouter_key # Access to 100+ models including GPT-4o
    VITE_PIAPI_API_KEY=your_piapi_key_here      # For Flux models and LoRA
    # Note: Direct OpenAI support coming soon (requires backend proxy)
  4. Run the app: npm run dev

Fan Translation Merge (Optional)

If you have reference fan translations (e.g., from human translators), you can merge them into an exported session JSON:

npm run merge-fan-translations path/to/session.json path/to/fan-translations/ [output.json]

What this does:

  • Matches fan translation files by chapter number (e.g., chapter-256.txt โ†’ chapter 256)
  • Adds them to the session as fanTranslation field for each chapter
  • Prints merge coverage statistics (how many chapters got fan translations)

Fan translations unlock:

  • Side-by-side comparison: Toggle between AI, raw, and fan versions while reading
  • AI reference mode: When "Include Fan Translation as Reference" is enabled (Settings โ†’ General), the AI uses fan translations as ground truth to improve quality
  • Quality benchmarking: Disable the reference mode to test how well the AI translates from raw text alone, using fan translations purely for comparison

Technical Architecture

For detailed technical information, see the Project Structure & Technical Details.


๐Ÿ“š Documentation

  • Settings Reference: docs/Settings.md
  • Environment Variables: docs/EnvVars.md
  • Providers & Models: docs/Providers.md
  • Image/Illustrations: see Rich Media section above
  • Audio Generation: docs/Audio.md
  • Workers & Batch Jobs: docs/Workers.md
  • Data Schemas (Translation/Session): docs/Schemas.md
  • EPUB Export & Templates: docs/EPUB.md
  • Architecture Decisions (ADRs): docs/ and docs/adr/
  • Chrome Extension (BookToki scraper): chrome_extension/README.md

๐Ÿ’ฌ Community & Support

Have a question, a feature request, or want to see what's next? The project is fully open sourceโ€”hack on it with me, or just hang out with other readers.

  • Join our Telegram Group: Get help, suggest new site adapters, and chat with other users at @webnovels.
  • Patreon concierge: Become a patron for bespoke support, new feature prototypes, and API credits.
  • You can try readomni and let me know if you like it more than LexiconForge and why!

โค๏ธ Support the Project

LexiconForge is a passion project. If you find it useful, please consider supporting its continued development.

  • Donate via Ethereum: adityaarpitha.eth
  • Sponsor ongoing work: Patreon link

๐Ÿ”ง Developer Quick Links

  • Contributing Guide: CONTRIBUTING.md
  • Debugging Flags: docs/Debugging.md
  • Prompt Configuration: config/PROMPT_DOCUMENTATION.md

About

AI-powered collaborative novel translator with multi-provider support and real-time feedback

Resources

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •