How do token limits work in the OpenAI API and what happens to my prompt if it goes over the maximum length?
Download run
Fan-out diagram
The searches the AI actually ran for this prompt.
SEED QUERY
How do token limits work in the OpenAI API and what happens to my prompt if it goes over the maximum length?
1 real search · 1 real-search pass
site:platform.openai.com/docs token limits context window maximum input tokens request exceeds context length API errorGoogle ↗
OBSERVED
Badge and edge weight = share of passes that produced the query. Hover a query for its intent and routing format.
Query classes
Google's semantic query class for every sub-query: what kind of answer each search is after, simulated vs real.
Classifying 1 queries…
Searches and sources
ChatGPT1 real searches · gpt-6
site:platform.openai.com/docs token limits context window maximum input tokens request exceeds context length API error Google ↗
- OpenAI model documentation · platform.openai.com
- OpenAI Tokenizer · platform.openai.com
- Conversation state guide · platform.openai.com
- API pricing · platform.openai.com