Compare the fine-tuning efficiency and inference latency of Mistral 8x22B versus Llama 3 70B when deployed for automated sentiment analysis and ticket routing.
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
Compare the fine-tuning efficiency and inference latency of Mistral 8x22B versus Llama 3 70B when deployed for automated sentiment analysis and ticket routing.
3 real searches · 1 real-search pass
Mixtral 8x22B official model card active parameters 39B context length architectureGoogle ↗
OBSERVEDOther / navigational
Meta Llama 3 70B official model card architecture context length parametersGoogle ↗
OBSERVEDReason
Mixtral 8x22B vs Llama 3 70B inference benchmark latency throughput vLLM quantization fine tuning LoRAGoogle ↗
OBSERVEDComparison
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
ChatGPT real searches (3)
Classes come from the query-classifier (a local Laya model). 2 of 3 calls are low-confidence (under 50%) — hover a query in the table to see its confidence.
Searches and sources
ChatGPT3 real searches · gpt-6
Mixtral 8x22B official model card active parameters 39B context length architecture Google ↗
Meta Llama 3 70B official model card architecture context length parameters Google ↗
Mixtral 8x22B vs Llama 3 70B inference benchmark latency throughput vLLM quantization fine tuning LoRA Google ↗
- Mixtral 8x22B - Mistral AI · docs.mistral.ai
- Cheaper, Better, Faster, Stronger · mistral.ai
- Introducing Meta Llama 3: The most capable openly available LLM to date · ai.meta.com
- Performance · docs.nvidia.com
- Mixtral · docs.nvidia.com
- llama3/MODEL_CARD.md at main · meta-llama/llama3 · github.com
- vllm-benchmark/benchmark_v0.md at main · LambdaLabsML/vllm-benchmark · github.com
Queries
3 queries · click a column to sort
| Query / type | Search | Intent | Query class | Routing format | Cluster | Freq ↓ | Weight |
|---|---|---|---|---|---|---|---|
Mixtral 8x22B official model card active parameters 39B context length architecture OBSERVED | Google ↗ AI Mode ↗ | — | Other / navigational | — | — | 1x of 1 | |
Meta Llama 3 70B official model card architecture context length parameters OBSERVED | Google ↗ AI Mode ↗ | — | Reason | — | — | 1x of 1 | |
Mixtral 8x22B vs Llama 3 70B inference benchmark latency throughput vLLM quantization fine tuning LoRA OBSERVED | Google ↗ AI Mode ↗ | — | Comparison | — | — | 1x of 1 |