chn-lee-yumi/MaterialSearch

Semantic search. Search local photos and videos through natural language. AI语义搜索本地素材。以图搜图、查找本地素材、根据文字描述匹配画面、视频帧搜索、根据画面描述搜索视频。

What it solves

MaterialSearch allows users to search through their local collections of photos and videos using natural language descriptions or existing images, eliminating the need for manual tagging or complex folder structures to find specific visual media.

How it works

The system scans local directories for images and videos and uses a CLIP-based model (specifically chinese-clip-vit-base-patch16) to create searchable embeddings. It supports text-to-image, image-to-image, text-to-video, and image-to-video search, where video search identifies specific matching clips or segments based on the provided query.

Who it’s for

It is designed for individuals who manage large local libraries of visual assets and want a fast, AI-powered way to retrieve specific content without relying on traditional file names or metadata.

Highlights

  • Multimodal Search: Supports searching for images and videos using both text descriptions and image samples.
  • Video Segment Retrieval: Can find specific clips within videos rather than just the video file itself.
  • Hardware Flexibility: Works on CPU (amd64) and supports GPU acceleration for faster processing.
  • Easy Deployment: Available as a pre-packaged Windows bundle or a Docker image for streamlined setup.

Related

  • Project
  • Project
  • Project
  • Project