All CategoriesGeneral

How long is the memory in AI agents?

How long is the memory in AI agents?


Written by Axultan A.

Updated on June 13, 2023

The memory length in AI agents, particularly in the context of natural language processing models like GPT-3.5 or GPT-4, is determined by their context window size. This context window size is defined by the number of tokens (words or subwords) that the model can process and keep track of at a given time.

For Invicta AI, the context window size (memory window) is around 2048 tokens. This means it can effectively remember and process information within this range. However, once this limit is exceeded, the model might lose track of earlier parts of the conversation or text.

To overcome these limitations, users can use Invicta AI's “Knowledge Base” feature to upload any additional information that they would want to preserve in the AI's memory.