looking for the best open source llms that we can self host on cheap aws instances to replace our expensive commercial api calls
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
looking for the best open source llms that we can self host on cheap aws instances to replace our expensive commercial api calls
3 real searches · 1 real-search pass
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 3 queries…
Searches and sources
ChatGPT3 real searches · gpt-6
best open weight LLM models 2026 Qwen3.5 Gemma 4 DeepSeek latest model cards license inference hardware Google ↗
AWS EC2 GPU instance pricing g6 g5 L4 A10G us-east-1 on demand 2026 Google ↗
vLLM supported models quantization serving documentation 2026 Google ↗
- Qwen on Hugging Face · huggingface.co
- Qwen/Qwen3.5-9B · huggingface.co
- GitHub - xigh/open-weight-models: Curated list of open-weight AI models with commercially exploitable licenses, verified benchmarks, and no EU restrictions. · github.com
- Official Gemma 4 model card · ai.google.dev
- Official announcement · openai.com
- How to run gpt-oss with Transformers · developers.openai.com
- DeepSeek model collection · huggingface.co
- Best Open-Source LLMs in 2026: Ranked, Priced & Compared · theairankings.com
- Best Open Source LLMs in 2026: Rankings and Licensing Comparison · onyx.app
- Microsoft model collection · huggingface.co
- Accelerated computing · aws.amazon.com
- Amazon EC2 G6 Instances · aws.amazon.com
- Compare AWS EC2 G6 Instance Pricing · economize.cloud
- g6.xlarge pricing: from $0.8048/hr · 4 vCPU, 16 GB RAM · AWS · cloudparity.io
- EC2 On-Demand Instance Pricing · aws.amazon.com
- Online Serving · docs.vllm.ai
- OpenAI-Compatible Server · docs.vllm.ai
- vLLM documentation · docs.vllm.ai
- LiteLLM documentation · docs.litellm.ai
- Ollama · ollama.com
- Hugging Face models · huggingface.co
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
best open weight LLM models 2026 Qwen3.5 Gemma 4 DeepSeek latest model cards license inference hardware OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
AWS EC2 GPU instance pricing g6 g5 L4 A10G us-east-1 on demand 2026 OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 | |
vLLM supported models quantization serving documentation 2026 OBSERVED | Google ↗ AI Mode ↗ | — | — | — | — | 1x of 1 |