Anthropic says it solved the long-running AI agent problem with a new multi-session Claude SDK
In the rapidly evolving landscape of AI, the challenge of agent memory has emerged as a significant hurdle for enterprises. Agents, which are built on foundational models, often struggle with limited context windows, leading to memory lapses that can result in forgotten instructions and inconsistent performance over time. Anthropic, a prominent AI research organization, has taken a significant step in addressing this issue with its Claude Agent SDK. In a recent blog post, Anthropic outlined a two-fold solution that aims to enhance the memory capabilities of long-running agents, allowing them to operate effectively across multiple sessions without losing track of previous interactions.
The core of Anthropic’s solution lies in the introduction of two distinct types of agents: the initializer agent and the coding agent. The initializer agent is responsible for setting up the environment and documenting the actions taken by agents, ensuring that a comprehensive history is maintained. This foundational setup is crucial for enabling the coding agent to make incremental progress on tasks while leaving behind structured updates for future sessions. This approach mimics the practices of effective software engineers, who consistently document their work and build upon previous developments. By addressing the limitations of context management, Anthropic aims to provide a more robust framework for agents, allowing them to engage in complex projects that span multiple sessions without losing critical information.
As the demand for enhanced agent memory solutions grows, various companies have begun exploring this space, including LangChain with its LangMem SDK, Memobase, and OpenAI’s Swarm. Anthropic’s innovative approach not only improves the Claude Agent SDK but also contributes to a broader conversation about the future of agentic memory in AI. While the initial experiments have been focused on full-stack web app development, Anthropic acknowledges that the insights gained may extend to other domains such as scientific research and financial modeling. As research in this area continues to expand, the potential for developing more effective long-running agents remains promising, paving the way for enhanced performance and reliability in AI applications across various industries.
Agent memory remains a problem that enterprises want to fix, as agents forget some instructions or conversations the longer they run.Â
Anthropic
believes it has solved this issue for its
Claude Agent SDK
, developing a two-fold solution that allows an agent to work across different context windows.
“The core challenge of long-running agents is that they must work in discrete sessions, and each new session begins with no memory of what came before,” Anthropic wrote in
a blog post
. “Because context windows are limited, and because most complex projects cannot be completed within a single window, agents need a way to bridge the gap between coding sessions.”
Anthropic engineers proposed a two-fold approach for its Agent SDK: An initializer agent to set up the environment, and a coding agent to make incremental progress in each session and leave artifacts for the next. Â
The agent memory problem
Since agents are built on foundation models, they remain constrained by the limited, although continually growing, context windows. For long-running agents, this could create a larger problem, leading the agent to forget instructions and behave abnormally while performing a task.
Enhancing agent memory
becomes essential for consistent, business-safe performance.Â
Several methods emerged over the past year, all attempting to bridge the gap between context windows and agent memory.
LangChain
’s LangMem SDK,
Memobase
and
OpenAI
’s Swarm are examples of companies offering memory solutions. Research on agentic memory has also exploded recently, with proposed
frameworks like Memp
and the
Nested Learning Paradigm
from
Google
offering new alternatives to enhance memory.Â
Many of the current memory frameworks are open source and can ideally adapt to different large language models (LLMs) powering agents. Anthropic’s approach improves its Claude Agent SDK.Â
How it works
Anthropic identified that even though the Claude Agent SDK had context management capabilities and “should be possible for an agent to continue to do useful work for an arbitrarily long time,” it was not sufficient. The company said in its blog post that a model
like Opus 4.5
running the Claude Agent SDK can “fall short of building a production-quality web app if it’s only given a high-level prompt, such as ‘build a clone of claude.ai.’”Â
The failures manifested in two patterns, Anthropic said. First, the agent tried to do too much, causing the model to run out of context in the middle. The agent then has to guess what happened and cannot pass clear instructions to the next agent. The second failure occurs later on, after some features have already been built. The agent sees progress has been made and just declares the job done.Â
Anthropic researchers broke down the solution: Setting up an initial environment to lay the foundation for features and prompting each agent to make incremental progress towards a goal, while still leaving a clean slate at the end.Â
This is where the two-part solution of Anthropic’s agent comes in. The initializer agent sets up the environment, logging what agents have done and which files have been added. The coding agent will then ask models to make incremental progress and leave structured updates.Â
“Inspiration for these practices came from knowing what effective software engineers do every day,” Anthropic said.Â
The researchers said they added testing tools to the coding agent, improving its ability to identify and fix bugs that weren’t obvious from the code alone.Â
Future research
Anthropic noted that its approach is “one possible set of solutions in a long-running agent harness.” However, this is just the beginning stage of what could become a wider research area for many in the AI space.Â
The company said its experiments to boost long-term memory for agents haven’t shown whether a single general-purpose coding agent works best across contexts or a multi-agent structure.Â
Its demo also focused on full-stack web app development, so other experiments should focus on generalizing the results across different tasks.
“It’s likely that some or all of these lessons can be applied to the types of long-running agentic tasks required in, for example, scientific research or financial modeling,” Anthropic said.
