sqliteai/sqlite-vector
SQLite-Vector is a cross-platform, ultra-efficient SQLite extension that brings vector search capabilities to your embedded database.
What it solves
SQLite-Vector provides production-grade vector search capabilities directly within SQLite. It eliminates the need for external vector databases (like FAISS or Weaviate) or complex, time-consuming preindexing processes (like HNSW or DiskANN), making it ideal for Edge AI, mobile apps, and privacy-preserving offline workloads.
How it works
It is implemented as a cross-platform SQLite extension that allows vectors to be stored as standard BLOBs in ordinary tables. It uses highly optimized C implementation with SIMD acceleration for distance calculations. To improve performance and reduce memory usage, it employs various quantization techniques, including TurboQuant (a low-bit scalar quantizer) and other formats like INT8 or 1BIT, allowing the system to scan vectors without reconstructing them fully.
Who it’s for
Developers building RAG (Retrieval-Augmented Generation) or semantic search applications who want a lightweight, embedded solution that runs on iOS, Android, Windows, Linux, macOS, or in the browser via WASM.
Highlights
- No preindexing: Start searching immediately without long preprocessing phases.
- Ordinary tables: Store vectors as
BLOBs without needing special virtual tables. - TurboQuant support: High-efficiency 2, 3, and 4-bit quantization scans.
- Low memory footprint: Defaults to 30MB of RAM usage.
- Cross-platform: Native support for all major operating systems and mobile platforms.
- Offline ready: Works entirely on-device for privacy and speed.
Related
- Project
- Project
- Project
- Project
- Project