Can someone explain why our current RAG pipeline using Pinecone is returning irrelevant chunks and what alternative vector database fixes this issue fastest
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
Can someone explain why our current RAG pipeline using Pinecone is returning irrelevant chunks and what alternative vector database fixes this issue fastest
3 real searches · 1 real-search pass
Pinecone documentation hybrid search reranking metadata filtering vector search retrieval relevanceGoogle ↗
OBSERVEDOther / navigational
Qdrant documentation hybrid search reranking filtering dense sparse vectorsGoogle ↗
OBSERVEDOther / navigational
Weaviate documentation hybrid search reranking vector database retrievalGoogle ↗
OBSERVEDOther / navigational
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
ChatGPT real searches (3)
Classes come from the query-classifier (a local Laya model). 3 of 3 calls are low-confidence (under 50%) — hover a query in the table to see its confidence.
Searches and sources
ChatGPT3 real searches · gpt-6
Pinecone documentation hybrid search reranking metadata filtering vector search retrieval relevance Google ↗
Qdrant documentation hybrid search reranking filtering dense sparse vectors Google ↗
Weaviate documentation hybrid search reranking vector database retrieval Google ↗
- Qdrant docs · qdrant.tech
- Hybrid Search in Qdrant · qdrant.tech
- Hybrid Queries · qdrant.tech
- Hybrid Search with Reranking · qdrant.tech
- Weaviate docs · docs.weaviate.io
- Reranking · docs.weaviate.io
- Hybrid search · docs.weaviate.io
- pgvector GitHub · github.com
- Query and search · docs.weaviate.io
- Rerankers and Two-Stage Retrieval · pinecone.io
- Refine Retrieval Quality with Pinecone Rerank · pinecone.io
- Reranking results · sdk.pinecone.io
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
Pinecone documentation hybrid search reranking metadata filtering vector search retrieval relevance OBSERVED | Google ↗ AI Mode ↗ | — | Other / navigational | — | — | 1x of 1 | |
Qdrant documentation hybrid search reranking filtering dense sparse vectors OBSERVED | Google ↗ AI Mode ↗ | — | Other / navigational | — | — | 1x of 1 | |
Weaviate documentation hybrid search reranking vector database retrieval OBSERVED | Google ↗ AI Mode ↗ | — | Other / navigational | — | — | 1x of 1 |