LLM Wiki: Continuously compiles documents into a searchable knowledge graph
A desktop knowledge base that continuously organizes documents into an interlinked wiki instead of rebuilding answers from scratch like traditional RAG.
GitHub nashsu/llm_wiki Updated 2026-09-11 Branch main Stars 18.1K Forks 2.1K
TypeScript Rust Knowledge base RAG LanceDB MinerU Desktop application

🧭 Decision Guide

Try it if you

  • 你要把PDF、DOCX、Markdown和网页资料持续维护成带来源追踪的Wiki。
    README的Features列出Multi-format Document Parsing、Two-Step Chain-of-Thought Ingest与Source Folder Auto-Watch。
  • 你正在使用Claude Code或Codex,需要通过本地MCP查询项目、文件和知识图谱。
    README的Local HTTP API + MCP Server + AI Agent Skill章节列出127.0.0.1:19828、本地MCP及Claude Code/Codex。
  • 你希望把关键词检索与LanceDB向量检索组合,并使用OpenAI兼容模型端点。
    README的Features列出Vector Semantic Search、LanceDB和OpenAI-compatible endpoint。
  • 你需要检查知识关联、社区和知识缺口,而不只是返回文本答案。
    README列出4-Signal Knowledge Graph、Louvain Community Detection和Graph Insights。

Skip it if you

  • 你的部署不能提供LLM API key和model配置。
    README的Quick Start第2步要求在Settings中配置LLM provider、API key和model。
  • 你的环境不接受macOS、Windows或Linux桌面安装包。
    README的Pre-built Binaries仅列出macOS .dmg、Windows .msi和Linux .deb/.AppImage。
  • 你的合规评审要求明确的开源许可证条款。
    项目元数据的许可协议为Other,提供材料未给出具体许可文本。
  • 你的检索流程必须完全依赖现查现答,而不保存持续生成的Wiki状态。
    项目描述明确区别于traditional RAG,核心机制是incrementally builds and maintains a persistent wiki。

Requirements

  • 可使用macOS、Windows或Linux预构建包:.dmg、.msi、.deb或.AppImage。
  • Quick Start要求在Settings配置LLM provider、API key和model。
  • 如启用Deep Research,README列出Tavily、SerpApi或SearXNG Web Search提供商。
  • 如使用MCP,需要先运行README中的npm run mcp:build。
  • 如使用本地接口,需要启用API并在Settings → API + MCP生成token。

First step (verbatim from README)

npm run mcp:build

Watch out

  • MCP客户端与桌面端共用同一API面,接口默认JSON不流式,需stream或text/event-stream才返回SSE。
    README的Local HTTP API + MCP Server章节明确说明chat接口的stream与SSE行为。
  • API的未认证访问由Settings → API + MCP控制,默认设计仍包含token-protected与127.0.0.1-only限制。
    README的Local HTTP API + MCP Server章节明确列出token-protected、127.0.0.1-only及未认证开关。
  • 大上下文配置范围是4K到1M tokens,且内容按60/20/5/15分配。
    README的17. Configurable Context Window章节给出4K到1M tokens和60/20/5/15 split。
  • Wiki索引可从已有页面重建,但外部更新页面也提供单页embed接口,处理方式不同。
    README列出Project Management & Migration的rebuild Wiki index,以及POST /api/v1/projects/{id}/pages/embed。

Not stated in the README

  • README材料未说明各LLM provider的完整兼容性、价格影响和认证方式。
  • README材料未说明PDF、Office、EPUB/MOBI等格式的解析准确率与最大文件规模。
  • README材料未说明本地MinerU运行所需的硬件、依赖版本和资源消耗。
  • README材料未说明4K到1M上下文窗口对应模型的实际可用范围。
  • README材料未说明10位贡献者、5个版本和10个最近提交分别对应的维护频率与发布计划。
  • README材料未提供Other许可证的具体条款,也未说明商业分发限制。
  • README材料未列出与本项目功能直接对比的替代方案。

💡 Deep Analysis

6
Yes I already use Claude Code or Codex. I want an Agent to call LLM Wiki’s wiki, source, and graph retrieval, and place generated Markdown or HTML in the workspace. Can I integrate it directly without writing a separate API adapter?
For: An automation developer using Claude Code or Codex who wants an Agent to access a local wiki through MCP or an Agent Skill, perform hybrid search, and generate workspace files.

Yes: the README explicitly provides a local HTTP API, an MCP Server, and an Agent Skill for Claude Code and Codex, covering the integration and output requirements you described.

  • “Local HTTP API + MCP Server + AI Agent Skill” lists hybrid search, file reading, graph traversal, and source rescanning, so the client does not need to reimplement the core retrieval layer.
  • The same section exposes the built-in API at 127.0.0.1:19828 and states that a bundled MCP server is available.
  • “Rust Backend Chat Agent & Skills” says the Agent can use wiki/source/graph/web retrieval, workspace file tools, and approved shell commands.
  • “Generated Outputs Preview” supports previewing Markdown, HTML, images, and other workspace files created by the Agent; external shell commands still require explicit approval.

This makes it a good fit as a local knowledge service for Claude Code or Codex. However, the README does not document remote multi-user access, an MCP client compatibility matrix, or recovery behavior after an abnormal API shutdown.

  • Local HTTP API + MCP Server + AI Agent Skill: built-in `127.0.0.1:19828` JSON API
  • Local HTTP API + MCP Server + AI Agent Skill: ready-made agent skill installs into Claude Code / Codex
  • Rust Backend Chat Agent & Skills: wiki/source/graph/web retrieval; workspace file tools; approved shell commands
  • Generated Outputs Preview: Agent-created Markdown, HTML, images, and other workspace files
npx skills add …
Not stated in the README:The README does not list concrete compatibility versions for Claude Code, Codex, or other MCP clients;Concurrency and locking behavior for multiple external Agents accessing one project is unspecified;The process for generating, rotating, and revoking local tokens is unspecified
No My technical materials change over time, and answers should rely as much as possible on imported originals. I want to use Chat, Read Sources Only, Review, and Lint together. Can this project replace an authoritative knowledge base where factual accuracy is strict?
For: An engineer who needs evidence-constrained answers from technical materials and plans to maintain an evolving Wiki with Chat, Read Sources Only, Review, and Lint.

No: it should not be used directly as an authoritative knowledge base, although it is suitable as a source-traceable layer for understanding and maintaining technical materials. Read Sources Only narrows the evidence scope but cannot guarantee that the source or the model’s interpretation is always correct.

  • “Source-grounded Retrieval” provides Read Sources Only, requiring answers to rely exclusively on imported original material and reducing unsupported expansion.
  • “Async Review System” lets the LLM flag items requiring human judgment and provides predefined actions and pre-generated search queries; Quick Start also tells users to check Review.
  • Quick Start recommends running Lint periodically to maintain Wiki health, indicating an ongoing maintenance loop rather than one-time page generation.
  • Project insights explicitly state that generated knowledge may contain omissions, misclassification, or outdated information. Source tracking enables evidence recovery but does not eliminate hallucinations. The usage limitations also say the system cannot guarantee reliable conclusions for professional, legal, medical, or high-risk technical content.

It is therefore suitable for organizing, retrieving, and exploring materials, but not as the sole source of truth, a compliance database, or a high-risk decision authority.

  • Features: Source-grounded Retrieval — Read Sources Only mode
  • Features: Async Review System; Quick Start: Check Review; Run Lint periodically
  • Project insights: source tracking does not automatically eliminate model misreading, omissions, or hallucinations
  • Project insights usage_limitations: cannot guarantee reliable conclusions for professional, legal, medical, or high-risk technical content
Not stated in the README:Whether Review items prevent unreviewed pages from entering Chat retrieval;The rules, severity levels, and customization options of Lint;The eventual-consistency timing for old Wiki pages, embeddings, and graph relationships after source updates
Yes I need to import PDFs, DOCX files, and recursive folders, possibly with interruptions during ingestion. I also want external modifications or deletions under `raw/sources/` to stay synchronized. Is LLM Wiki a better fit than a one-shot RAG tool?
For: A personal knowledge-base maintainer with many PDFs, Office documents, and recursive folders who needs import cancellation, retries, and tracking of external source changes.

Yes: the persistent ingestion queue, incremental cache, and source-folder watcher directly address interruption recovery and ongoing synchronization, rather than rebuilding context only when a question is asked.

  • “Persistent Ingest Queue” explicitly supports serial processing, crash recovery, cancellation, retry, and progress visualization, which fits imports that may be interrupted.
  • “Folder Import” supports recursive import while preserving directory structure and uses folder context as an LLM classification hint.
  • “Source Folder Auto-Watch” monitors external changes under raw/sources/ and keeps ingest and delete cleanup synchronized.
  • The project overview and “What is this?” emphasize incremental construction, persistent storage, and continuous maintenance. Complete project archives and rebuilding the Wiki index from existing pages are also supported.

It is therefore a better match than one-shot RAG when the goal is a long-lived, maintained Wiki. The README does not, however, specify an ingestion-size limit, single-machine performance, the queue’s persistence location, or parsing success rates for complex scanned PDFs and Office layouts.

  • Features: Persistent Ingest Queue — serial processing with crash recovery, cancel, retry, and progress visualization
  • Features: Folder Import; Source Folder Auto-Watch
  • Source Folder Auto-Watch: detects external changes in `raw/sources/` and keeps ingest/delete cleanup in sync
  • What is this?: incrementally builds and maintains a persistent wiki; Quick Start: Activity Panel, Review, and Lint
Not stated in the README:The maximum number of sources, file size, and queue length supported per project;Actual parsing coverage for scanned PDFs, complex Office tables, and media files;Exact deletion and cascade-cleanup behavior during interruptions or duplicate events
Yes I already use Tavily, SerpApi, or SearXNG. I want knowledge-graph gaps to generate multi-query Web Research and have the search results automatically ingested back into the Wiki. Does LLM Wiki cover this end-to-end workflow?
For: A research-oriented engineer who wants to combine a local Wiki with Tavily, SerpApi, or SearXNG, automatically research knowledge gaps, and ingest the results back into the Wiki.

Yes: the README provides knowledge-gap discovery, Deep Research, multi-query Web Search, and automatic ingestion of results, covering the workflow you described.

  • “Graph Insights” lists surprising connections and knowledge gaps and supports one-click Deep Research, using the persistent knowledge graph as the entry point.
  • “Deep Research” generates LLM-oriented search topics and performs multi-query searches through Tavily, SerpApi, or SearXNG.
  • The same feature states that search results are automatically ingested into the Wiki, so research output becomes available for later retrieval rather than remaining only in the current conversation.
  • “Rust Backend Chat Agent & Skills” also exposes web search as an Agent tool alongside wiki, source, and graph retrieval.

This fits a research workflow that expands a personal Wiki with external information. However, the README does not explain deduplication, copyright, or quality filtering for search results. It also does not say whether existing source text is sent to external search providers by default, and network availability and third-party API quotas are not defined.

  • Features: Graph Insights — surprising connections and knowledge gaps with one-click Deep Research
  • Features: Deep Research — Tavily, SerpApi, or SearXNG; auto-ingest results into wiki
  • Rust Backend Chat Agent & Skills: wiki/source/graph/web retrieval
  • Project insights: Deep Research depends on external search services and network availability
Not stated in the README:Configuration fields, authentication, and quota handling for Tavily, SerpApi, and SearXNG;Whether Web Research results receive deduplication, source-trust, and copyright filtering;Retry, rollback, and source-labeling behavior when search-result ingestion fails
Yes My collection mainly consists of image-heavy PDFs and technical documents. I need to search beyond body text, have a vision model describe embedded images, and jump from search results back to the original page. Does LLM Wiki support this multimodal retrieval workflow?
For: An engineer maintaining a collection of technical papers and image-heavy engineering PDFs who wants image-aware search and direct traceability back to original sources.

Yes: the README explicitly connects embedded-image extraction from PDFs, factual descriptions from a vision model, image-aware search, and source navigation in one workflow.

  • “Multimodal Image Ingestion” says the system extracts embedded images from PDFs and uses a vision LLM to generate factual captions.
  • The same feature lists image-aware search results, lightbox preview, and jump-to-source, directly matching your requirements for image retrieval and page-level traceability.
  • “Multi-format Document Parsing” also covers PDFs, Office documents, EPUB/MOBI, images, and media, so the input is not limited to plain text.
  • Project insights state that original sources, Wiki pages, embeddings, and graph relationships are persisted, while source tracking provides an evidence path during retrieval.

This does not guarantee that image captions are correct. The README does not specify supported vision models, whether scanned PDFs follow the same pipeline, the recognition boundary for tables and charts, or the storage cost and ranking details of image indexing.

  • Features: Multimodal Image Ingestion — extract embedded images from PDFs; vision LLM; image-aware search results; jump-to-source
  • Features: Multi-format Document Parsing
  • Project insights: the system generates factual image captions and shows image previews with source navigation
  • Project insights: Wiki content, original sources, embeddings, graph relationships, and review status are persisted
Not stated in the README:Which specific vision LLMs are supported, including image-size limits and cost models;Whether scanned PDFs, tables, charts, and complex layouts are reliably recognized;Whether image captions are stored in LanceDB or another persistent index
It depends I mainly process PDFs, Office documents, and local folders on a macOS or Windows desktop. I want a persistent personal knowledge base, with some processing done locally and other models accessed through OpenAI-compatible endpoints. Is LLM Wiki suitable?
For: A researcher managing PDFs, Office documents, and local folders who wants a continuously updated desktop knowledge base while controlling where sensitive data is sent.

It depends: the project fits a multi-format, desktop-first personal knowledge base, but the README does not prove that every processing step stays local.

  • The “Features” section lists PDF, Office, EPUB/MOBI, images, media, web clips, URL batches, and recursive folder import. PDF processing can use built-in, cloud, or local MinerU.
  • “Flexible Model Configuration” allows per-project model configuration and independent Chat/Ingest routing. “Vector Semantic Search” supports LanceDB and OpenAI-compatible embedding endpoints.
  • “Quick Start” requires configuring an LLM provider, API key, and model, so an external model service may be a prerequisite.
  • Source traceability, Read Sources Only, and complete project archive import/export support long-term maintenance and evidence recovery.

However, the README does not specify which source text, images, or embeddings are sent to cloud providers under each configuration. It also does not document the range of supported local models, encryption, or enterprise-grade access controls.

  • Features: Multi-format Document Parsing; Flexible Model Configuration; Vector Semantic Search
  • Quick Start: Configure your LLM provider (API key + model)
  • Features: Source-grounded Retrieval; Project Management & Migration
  • Project insights: the local HTTP API defaults to 127.0.0.1; data may flow to different model or search providers
Not stated in the README:Which concrete models and hardware requirements apply to local MinerU, Chat, and Ingest processing;Whether cloud models, embedding services, or Web Search receive source text, images, or metadata;Whether project archives and local indexes provide encryption or access control

✨ Highlights

  • Two-Step Ingest analyzes first, then builds wiki pages with traceability and incremental caching
  • The 4-Signal graph combines links, source overlap, Adamic-Adar, and type affinity
  • Supports PDF, Office, EPUB/MOBI, and local MinerU parsing
  • Includes the 127.0.0.1:19828 API, MCP, and Claude Code integration

🔧 Engineering

  • The desktop app continuously turns PDF, DOCX, and Markdown sources into interlinked wiki pages
  • Read Sources Only restricts answers to the originally imported materials
  • LanceDB provides optional vector retrieval and supports OpenAI-compatible endpoints
  • The Rust Backend Chat Agent supports wiki, graph, web retrieval, and streaming tool events

⚠️ Risks

  • The README requires an LLM API key and model in Settings before completing Quick Start
  • Deep Research depends on web-search providers such as Tavily, SerpApi, or SearXNG
  • The local API listens on 127.0.0.1:19828 but still involves tokens and an unauthenticated-access switch
  • The license metadata is Other, and the README does not provide specific license terms

👥 For who?

  • Personal knowledge-base users managing PDF, Office, and web materials
  • Developers using Claude Code or Codex who need local MCP retrieval
  • Users who want the Rust Agent to generate Markdown, HTML, or image files
  • LLM application experimenters needing a configurable 4K-to-1M-token context window