What is the most efficient way to partition our S3 parquet files so Athena queries stop scanning the entire bucket and running up our AWS bill
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
What is the most efficient way to partition our S3 parquet files so Athena queries stop scanning the entire bucket and running up our AWS bill
1 real search · 1 real-search pass
site:docs.aws.amazon.com Athena partitioning data best practices Parquet partition projection small files partition keysGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 1 queries…
Searches and sources
ChatGPT1 real searches · gpt-6
site:docs.aws.amazon.com Athena partitioning data best practices Parquet partition projection small files partition keys Google ↗
- Optimize data · docs.aws.amazon.com
- What is partitioning? · docs.aws.amazon.com
- Reduce throttling at the service level · docs.aws.amazon.com
- Partition your data · docs.aws.amazon.com
- Use partition projection with Amazon Athena · docs.aws.amazon.com
- Optimize your tables · docs.aws.amazon.com