greyovo/PicQuery

🔍 Search local images with natural language on Android, powered by OpenAI's CLIP model. / 在 Android 上用自然语言搜索本地图片 (基于 OpenAI 的 CLIP 模型)

What it solves

PicQuery allows users to search through their local photo libraries using natural language descriptions (in English or Chinese) or by using another image as a query, without needing to upload photos to a cloud service.

How it works

The app builds a local index of photos on the device. It utilizes Apple's MobileCLIP2-S0 / dfndr2b models to create embeddings for images and text. It offers two different inference runtime options for Android: ONNX Runtime and TFLite (LiteRT), allowing users to compare search performance and accuracy across different backends.

Who it’s for

Android users who want a private, on-device way to search their photo galleries using AI-powered semantic search.

Highlights

  • On-device processing: All indexing and searching happen locally for privacy and speed.
  • Multilingual support: Supports search queries in both English and Chinese.
  • Image-based search: Ability to use a photo as a query to find similar images.
  • Flexible runtimes: Supports both ONNX Runtime and TFLite/LiteRT for model inference.

Related

  • Project
  • Project
  • Project
  • Project