zrt-ai-lab/ViNote

ViNote（视记AI）｜DeepSeek Harness SDK 驱动的开源视频知识 Agent。以工具编排、SQLite 会话恢复和流式交互，串联 YouTube / Bilibili 检索、下载、转写与笔记生成，支持视频问答、知识卡片和思维导图。FastAPI + React，支持 OpenAI 兼容接口模型。

What it solves

ViNote transforms video content from platforms like YouTube and Bilibili, as well as local files, into structured knowledge assets. It eliminates the manual effort of watching long videos for information extraction by automating transcription, summarization, and knowledge organization.

How it works

The system uses a pipeline that prioritizes extracting existing platform subtitles to save time. If subtitles are unavailable, it uses Faster-Whisper for local audio transcription. An LLM (via OpenAI-compatible APIs) then processes the text to generate structured Markdown notes, summaries, and mind maps. It also features an AI agent (ViNoter) powered by the DeepSeek Harness SDK that allows users to search for videos across platforms and trigger note generation using natural language.

Who it’s for

  • Students and researchers who need to quickly synthesize information from educational videos.
  • Content creators looking to organize video-based research.
  • Knowledge workers who want to convert video tutorials into searchable, structured documentation.

Highlights

  • Conversational Video Search: An AI agent that searches YouTube and Bilibili and generates notes based on natural language requests.
  • Multi-Format Output: Automatically creates structured notes, summaries, interactive mind maps (via Markmap), and knowledge cards.
  • Flexible Input: Supports online URLs, local video files (MP4, AVI, MOV, MKV), and batch processing of playlists.
  • Knowledge Management: Includes a SQLite-based system for categorizing notes with tags and performing full-text searches.
  • ** QtGui-based ASR**: Supports multiple ASR providers including Whisper, FunASR, and Qwen3.

Related

  • Project
    JefferyHcool/BiliNote

    An AI-powered video note-taking tool that converts videos from Bilibili, YouTube, and other platforms into structured Markdown notes with automatic summaries and screenshots.

  • Project
    lycohana/BiliSum

    BiliSum is a video-to-knowledge tool that converts Bilibili, YouTube, and local videos into transcriptions, visual notes, and a local RAG-powered knowledge base.

  • Project
    mizorewww/course2md

    course2md turns YouTube, Bilibili, or local videos into illustrated Markdown/HTML notes. It captures slides as screenshots and places the transcript below each, with optional local speech recognition and AI-powered proofreading and summaries.

  • Project
    via007/bilibili-rag

    A RAG-based system that converts Bilibili video collections into a searchable personal knowledge base by transcribing audio to text and indexing it for AI-driven Q&A.

  • Project
    harry0703/AudioNotes

    A local-first audio and video transcription tool that converts recordings into structured Markdown notes and enables AI-powered Q&A over the content.