A small, portable vector database powered by SQLite for on-device RAG? 🤯 sqlite-vec is a new vector search SQLite extension written entirely in C with no dependencies, MIT/Apache-2.0 dual licensed.
sqlite-vec queries:
- 1 million 128-dimensional vectors in just 17ms
- 500,000 ctors in 41ms
sqlite-vec supports:
💾 Matryoshka embedding slicing
💡 Binary quantization reduces storage by 32x with minimal accuracy loss
🤏🏻 L2, cosine and Hamming distance calculations
🧮 Retrieval against Python List and NP Arrays
🛠️ SDKs for Python, Javascript, Go, Rust, Wasm and more
🧠 local direct embedding with “sqlite-lembed” for gguf models and @ggerganov Llama.CPP
☁️ remote embedding with “sqlite-rembed” for @OpenAI compatible APIs
 |
VOOZH | about |
