Concepts / Understanding Anterograde Amnesia in AI Models

Understanding Anterograde Amnesia in AI Models

Anterograde amnesia is the failure of an AI model to retain information from one session to the next.

  • Programming

A Follow-Up Question From Last Week

Imagine a model that helped a customer's analyst last week. Today the same customer comes back with a follow-up question. Before reading on, decide for yourself whether the model can build on what happened last week. Your answer determines a failure mode that shapes how AI systems have to be designed around the model.

What do you think happens?

Can the model build on last week's conversation when the follow-up arrives?

  • Yes, the model remembers everything from last week

  • No, nothing from last week is available to the model unless the surrounding system supplies it

Reveal answer
Answer:

No, nothing from last week is available to the model unless the surrounding system supplies it.

The model does not remember previous conversations, and it does not carry corrections forward on its own. Anything the system remembers must be supplied from outside the model.

Definition

Anterograde amnesia is the failure of an AI model to retain information from one session to the next. The name borrows from a human memory condition, but the analogy is only a loose guide for understanding the AI case.

Where a Session Starts and Stops

A session is one bounded stretch of work with the model. Within it, the model answers using the information it is given. When the session ends and a new one begins, the new session starts without the previous one attached. The timeline below traces this boundary, from the first session through to the point where the next one starts.

Session 1 beginsModel answers fromthe information givenSession 1 endsPrevious conversationnot available to the modelSession 2 beginsModel sees only whatis suppliedwork proceedssession closesstate at boundarynew session opensonly supplied input
At the moment one session ends and a new one begins, what state is still available to the model, and what is gone?

The diagram makes one point clear. Session 2 begins at the far end of a boundary that erased the conversational context. The model in Session 2 is the same model, but it is not holding Session 1 in view. Whatever the second session needs has to arrive through the input that the system provides.

Within a Session Versus Across Sessions

The key word in the definition is across. Within a single session, the model can work with the information it is given, including earlier turns of that same conversation. The failure appears when a new session begins. Nothing from the previous session is available to the model unless the surrounding system supplies it.

Key point

Anterograde amnesia does not mean the model is unable to use information. It means the model does not keep information from one session to the next. A correction made in one session does not automatically improve later answers.

What the Model Does Not Carry Forward

The source names several things the model does not remember once a session ends: previous conversations, rejected phrasings, and corrections made by experts. The comparison below sorts these customer-facing items into what is lost by default and what survives only when the wrapper stores it. The point is not that the model forgets gradually; the point is that the default outcome at a session boundary is loss.

Previous conversationStated preferencesRejected phrasingsUploaded filesExpert correctionsCorrections writtento wrapper store
For each kind of information, does it survive into the next session or not, and what has to be true for it to survive?

Consider a customer who tells the system their reports should always use metric units. In a second session, the system will only honor that preference if something outside the model holds it and supplies it again. The same logic applies to a correction an expert made to a wrong answer, and to a file the customer uploaded last week. The model itself does not hold any of these forward.

Where the System's Memory Lives

If the model does not keep memory between sessions, the system as a whole can still have memory. The source is direct about where it sits: whatever memory the system has lives in the wrapper, not in the model. The model and the wrapper are separate parts of the system, and the wrapper is the part that can retain information across sessions.

Wrapperholds the system's memoryModelhandles each session it isgivenMemory storeinformation kept acrosssessionsSession inputwhat the model is giventhis sessionFDEresponsible for the wrappersupplies contextkeeps informationbuilds each session inputdesigns and owns
Which components sit inside the wrapper, which sit inside the model, and who is responsible for the wrapper?

The diagram shows the division of responsibility. The model handles each session it is given. The wrapper is where information from earlier sessions has to be kept so the system can use it later. Anything the customer expects the system to remember must be placed in the wrapper, because the model will not carry it forward on its own.

Who Decides What the System Remembers

Because the wrapper holds the system's memory, its design becomes a central concern. The source states that the wrapper is the FDE's responsibility, so the design of the wrapper determines what the system can remember across sessions. Whoever builds the deployment must decide three things: what information is worth keeping, where it is stored, and how it is supplied back to the model when a later session needs it.

Tracing a Preference Through Two Sessions

Worked example

A stated preference across a session boundary

A customer tells the system in Session 1 that they want all summaries in short bullet points. In Session 2, the customer asks for a new summary. Does the model format it as bullets, and what has to happen for that to be true?

  1. 1
    Session 1 happens

    The customer states the preference. The model answers within this session, so it can use the preference while the session is open.

  2. 2
    Session 1 ends

    The model does not keep the preference as part of its own memory. The conversation context that contained it is no longer available to the model.

  3. 3
    Wrapper decision

    For the preference to survive, the wrapper has to have recorded it. This is the step the FDE's design controls.

  4. 4
    Session 2 begins

    The wrapper supplies the stored preference as part of the input for the new session. The model then sees it and can apply it.

  5. 5
    Without the wrapper step

    If the wrapper did not record the preference, Session 2 starts with nothing to supply, and the model has no basis for bullets.

Result

The model formats the summary as bullets only if the wrapper stored the preference and supplied it at the start of Session 2. The model's own behavior is not what carries the preference across.

Mistakes When Reasoning About AI Memory

  • Common mistake

    Assuming the model remembers last week because the answers seemed to improve

    What it looks like

    A team sees a better answer in a new session and concludes the model learned from an earlier correction.

    Why it fails

    The source says an earlier correction does not automatically improve later answers. Any improvement must come from information the surrounding system supplies.

    Do this instead

    Check whether the wrapper stored and supplied the correction before crediting the model.

  • Common mistake

    Treating the model and the system as the same thing

    What it looks like

    A customer expects the whole product to remember their preferences, and the team blames the model when a preference is missing.

    Why it fails

    Whatever memory the system has lives in the wrapper, not in the model. The two parts have different responsibilities.

    Do this instead

    Locate the memory question in the wrapper and the wrapper's design, which the FDE owns.

  • Common mistake

    Assuming that anything said in a conversation is kept

    What it looks like

    A customer uploads a file in one session and expects it to be available in the next without anyone storing it.

    Why it fails

    The model does not carry session content forward, so the file survives only if the wrapper keeps and supplies it.

    Do this instead

    Decide explicitly what the wrapper stores, and make sure it is supplied at the start of later sessions.

  • Common mistake

    Confusing a within-session memory with a across-session memory

Practice: Predicting What Survives

EASY

A customer's analyst corrects a model's wrong figure during Session 1. Session 2 begins the next day. Without looking back at the text, predict whether the model will avoid the same wrong figure in Session 2, and state which part of the system would need to change for the correction to survive. Then explain how you reached that prediction.

Hints
  • Recall what the source says about corrections made by experts.
  • Ask where memory lives in the system, and who is responsible for that layer.

Key Takeaways

  • Anterograde amnesia in AI models is the failure of a model to retain information from one session to the next.
  • Within a session the model works with the information it is given; across sessions, nothing carries over unless the surrounding system supplies it.
  • Previous conversations, rejected phrasings, and expert corrections are not retained by the model after a session ends.
  • Whatever memory the system has lives in the wrapper, not in the model, and the wrapper is the FDE's responsibility.