We want to evaluate fine-tuning open source models like Llama 3 versus just paying for proprietary API calls, factoring in hosting expenses on AWS or RunPod.
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
We want to evaluate fine-tuning open source models like Llama 3 versus just paying for proprietary API calls, factoring in hosting expenses on AWS or RunPod.
4 real searches · 1 real-search pass
2026 AWS EC2 GPU instance pricing g6 g5 on-demand NVIDIA L4 A10G hourly pricingGoogle ↗
OBSERVED
RunPod GPU cloud pricing RTX 4090 A100 H100 hourly serverless 2026Google ↗
OBSERVED
Llama 3.1 8B 70B inference hosting cost tokens per second vLLM benchmarkGoogle ↗
OBSERVED
OpenAI API pricing GPT-4.1 mini GPT-4.1 input output tokens official pricingGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 4 queries…
Searches and sources
ChatGPT4 real searches · gpt-6
2026 AWS EC2 GPU instance pricing g6 g5 on-demand NVIDIA L4 A10G hourly pricing Google ↗
RunPod GPU cloud pricing RTX 4090 A100 H100 hourly serverless 2026 Google ↗
Llama 3.1 8B 70B inference hosting cost tokens per second vLLM benchmark Google ↗
OpenAI API pricing GPT-4.1 mini GPT-4.1 input output tokens official pricing Google ↗
- Cloud GPU Instances for AI Workloads · runpod.io
- GPU Cloud Pricing | Per-Second H100, A100, RTX · runpod.io
- GPU Cost Calculator · costmon.com
- open-source-llm-models-wiki/wiki/sources/aws-extended-gpu-pricing-2026-05.md at main · ilayzeidman/open-source-llm-models-wiki · github.com
- GPT-5.4 Mini Model · developers.openai.com
- Pricing · developers.openai.com
Queries
4 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
2026 AWS EC2 GPU instance pricing g6 g5 on-demand NVIDIA L4 A10G hourly pricing OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
RunPod GPU cloud pricing RTX 4090 A100 H100 hourly serverless 2026 OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
Llama 3.1 8B 70B inference hosting cost tokens per second vLLM benchmark OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
OpenAI API pricing GPT-4.1 mini GPT-4.1 input output tokens official pricing OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 |