Hippocampal-cingulate dynamics in the human brain link reinforcement-learning and memory
By combining intracranial recordings with computational modeling, this study demonstrates that positive reward prediction errors not only guide decision-making but also shape human memory through dynamic interactions between the anterior cingulate cortex and hippocampus.
Original paper licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). This is an AI-generated explanation of a preprint that has not been peer-reviewed. It is not medical advice. Do not make health decisions based on this content. Read full disclaimer
Every day, our brains make countless choices, weighing options to find the best path forward. When we make a choice and the result is better or worse than we expected, our brain registers that difference as a learning signal. Scientists call this a "reward prediction error." It is the mental spark that tells us to repeat a successful action or avoid a disappointing one. For decades, researchers have understood how this signal helps us learn what to do next. But a deeper question has remained unanswered: does this same signal also decide what we remember? We know that surprising moments often stick in our minds more vividly than routine ones, yet the biological mechanism linking a moment of surprise to the formation of a lasting memory has been a mystery.
To solve this, a team of researchers turned to the human brain itself, bypassing the limitations of standard brain scans to listen directly to the electrical activity of neurons. They worked with twenty-three patients who were already undergoing neurosurgical monitoring for epilepsy. These patients had thin electrodes placed deep inside their brains to locate seizure origins, a standard clinical procedure that also offered a rare window into the brain's inner workings. The patients played a card game where they had to learn which of two decks offered better rewards. Uniquely, every time they drew a card and received feedback, a new, unique image of a face appeared on the screen. The game was designed so that the images themselves were irrelevant to winning; they were simply incidental background details. Immediately after the game, the patients took a memory test, trying to recognize which faces they had seen before.
The results confirmed that the brain's learning signal directly shapes memory. The researchers found that when a player received a better-than-expected reward, their brain generated a strong prediction error signal. This specific signal predicted whether the player would later remember the face that appeared on that same trial. Faces associated with these positive surprises were remembered significantly better than those linked to neutral or disappointing outcomes. The study showed that this relationship held true not just for the patients, but also for a large group of healthy people who played the same game online, suggesting this is a fundamental feature of how the human brain works.
But how does the brain move a fleeting feeling of surprise into a lasting memory? The researchers traced the path of this information by recording electrical activity from different brain regions. They discovered that during the game, when the reward feedback appeared, the prediction error signal was broadly encoded across the prefrontal cortex, the area at the front of the brain responsible for decision-making. However, when the patients later tried to recognize the faces, this signal did not simply reappear in the same widespread pattern. Instead, a specific region called the anterior cingulate cortex, located deep in the center of the brain, briefly reactivated the pattern of the original surprise.
Crucially, this reactivation in the anterior cingulate was not enough on its own to guarantee a successful memory. The study ruled out the idea that the memory center of the brain, the hippocampus, simply reactivated the surprise signal by itself. Instead, the researchers found that successful memory depended on a precise conversation between the two regions. When a patient successfully recognized a face, the pattern of activity from the anterior cingulate was re-expressed within the hippocampus. It was as if the hippocampus reached out, grabbed the specific "surprise" pattern held by the anterior cingulate, and used it to reconstruct the full memory of that moment. This connection was so specific that it only happened for faces that were successfully remembered, not for those that were forgotten.
The study also looked at the timing of these interactions. The researchers found that the two regions communicated using a specific rhythm of electrical waves known as theta oscillations. When a face associated with a positive surprise was shown, the hippocampus and the anterior cingulate synchronized their activity, with the hippocampus leading the rhythm. This synchronization was stronger for the faces that were later remembered, suggesting that this rhythmic coupling is the mechanism that binds the feeling of surprise to the visual image, locking it into long-term storage.
These findings offer a clear picture of how the brain prioritizes what to keep. The learning signal that guides our choices does more than just update our future behavior; it actively selects which moments of our experience are preserved. By coordinating the anterior cingulate and the hippocampus, the brain ensures that the most significant, surprising moments are the ones that persist. This discovery provides a biological explanation for why we remember the unexpected and suggests that the same circuits that help us learn from our mistakes might also be the ones that shape our personal history.
Drowning in papers in your field?
Get daily digests of the most novel papers matching your research keywords — with technical summaries, in your language.