Can you compare the real world token consumption and managing LLM token budgets between Claude 3.5 Sonnet and GPT 4o for daily business emails?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
Can you compare the real world token consumption and managing LLM token budgets between Claude 3.5 Sonnet and GPT 4o for daily business emails?
3 real searches · 1 real-search pass
Anthropic Claude 3.5 Sonnet tokenization tokenizer documentation input output tokens pricing context windowGoogle ↗
OBSERVED
OpenAI GPT-4o tokenizer tokens documentation tiktoken context window pricingGoogle ↗
OBSERVED
Claude 3.5 Sonnet GPT-4o email writing token usage comparison benchmarkGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 3 queries…
Searches and sources
ChatGPT3 real searches · gpt-6
Anthropic Claude 3.5 Sonnet tokenization tokenizer documentation input output tokens pricing context window Google ↗
OpenAI GPT-4o tokenizer tokens documentation tiktoken context window pricing Google ↗
Claude 3.5 Sonnet GPT-4o email writing token usage comparison benchmark Google ↗
- Understanding and counting tokens · help.openai.com
- Introducing Claude 3.5 Sonnet \ Anthropic · anthropic.com
- GPT-4o Model · developers.openai.com
- GPT-4o (Nov '24) vs Claude 3.5 Sonnet (June '24): Model Comparison · artificialanalysis.ai
- Pricing · platform.claude.com
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
Anthropic Claude 3.5 Sonnet tokenization tokenizer documentation input output tokens pricing context window OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
OpenAI GPT-4o tokenizer tokens documentation tiktoken context window pricing OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
Claude 3.5 Sonnet GPT-4o email writing token usage comparison benchmark OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 |