Real ChatGPT answer · index seeddMOadoPZZqgcompleteB2B software · AI and automation toolsinformational
How does vector database indexing actually work under the hood, and what makes HNSW different from IVF when querying embeddings at scale?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
How does vector database indexing actually work under the hood, and what makes HNSW different from IVF when querying embeddings at scale?
1 real search · 1 real-search pass
FAISS documentation IVF inverted file index nlist nprobe HNSW index search efSearch constructionGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 1 queries…
Searches and sources
ChatGPT1 real searches · gpt-6
FAISS documentation IVF inverted file index nlist nprobe HNSW index search efSearch construction Google ↗
- Struct faiss::IndexIVF · faiss.ai
- Faiss indexes · facebookresearch/faiss Wiki · github.com
- Faiss indexes · facebookresearch/faiss Wiki · github.com
- Guidelines to choose an index · facebookresearch/faiss Wiki · github.com
- FAISS GitHub repository · github.com
- FAISS index types and comparison · github.com
- FAISS documentation · faiss.ai