The Useful Side of AI

1769527984190.png


I have tried to use that one but the only thing that I can see is :

1769528032700.png


The system seems to be stalled there.

Has anyone else been able to have an answer from that website?
 
Thanks @Mandatory Intellectomy.

Something else to consider for regular AI users is the context window. This may not be well understood by everyone that each model has a context window or limit and if you reach that limit, it will start to ignore some of the initial prompts or data, therefore missing some of the context and will begin to hallucinate. Some models might be employing RAG (Retrieval Augmented Generation) which summarizes the conversation or picks the important useful text for generating subsequent responses. Either way, its time to stop conversing at this point and begin a new one.

How does a context window works?

Below image example will help demonstrate, assuming a context limit of 256K. Note that 10 words will equate to 12-15 tokens. When you ask your subsequent questions, all of the conversation up to that point is sent along with your latest question. So, the token usage grows very fast with lengthy responses.

1769561788946.png


Current Context window limits -

ChatGPT (OpenAI) - 256K-400K depending on which model is being used
Google Gemini - 1M
Claude - 200K-1M depending on which model is being used
Grok 4 - 256K
Grok 4.1 - 2M
 
You must log in or register to reply here.

Trending content

Back
Top Bottom