AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation

Basic Information

• Paper ID: 2506.00551
• Title: AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation
• Authors: Ming Wang, Peidong Wang, Lin Wu, Xiaocui Yang, Daling Wang, Shi Feng, Yuxin Chen, Bixuan Wang, Yifei Zhang
• Classification: cs.CL cs.AI
• Publication Date: June 10, 2025 (arXiv preprint)
• Paper Link: https://arxiv.org/abs/2506.00551

Abstract

Due to cost and ethical concerns associated with involving real help-seekers in AI-driven mental health research, researchers have developed Large Language Model (LLM)-based conversational agents (CA) to simulate help-seekers using customized configurations such as personal profiles, symptoms, and scenarios. Although these efforts advance AI applications in mental health, achieving more realistic help-seeker simulation faces two critical challenges: dynamic evolution and multi-session memory. Help-seekers' psychological states frequently fluctuate throughout the counseling process, which typically spans multiple sessions. To address this issue, this paper proposes AnnaAgent, an emotion and cognition dynamic agent system equipped with three-level memory. AnnaAgent integrates an emotion regulator and chief complaint guide trained on real counseling dialogues, enabling dynamic control of the simulator's configuration. Furthermore, its three-level memory mechanism effectively integrates short-term and long-term memory across sessions. Evaluation results demonstrate that AnnaAgent achieves more realistic help-seeker simulation in psychological counseling compared to existing baselines.

Research Background and Motivation

Problem Definition

The core problem this research addresses is how to more realistically simulate help-seeker behavior in AI-driven mental health research. Specifically:

1. Cost and Ethical Constraints: Involving large numbers of real help-seekers in research is not only costly but may also raise ethical concerns
2. Limitations of Existing Simulation Methods: Current LLM-based conversational agents exhibit problems such as flat emotional expression and excessive acceptance of suggestions when simulating help-seekers
3. Lack of Dynamism: Existing methods cannot simulate emotional fluctuations and cognitive changes that help-seekers experience during counseling
4. Absence of Multi-Session Memory: Psychological counseling is typically a long-term, multi-session process, yet existing methods lack cross-session memory mechanisms

Research Significance

Mental health issues represent a critical challenge facing contemporary society, while the number of trained therapists is limited. AI technology holds tremendous potential for mental health support but requires more realistic help-seeker simulation to:

• Construct datasets and evaluate effectiveness
• Train psychological counselors
• Conduct psychological research and experiments

Limitations of Existing Methods

Through literature review, the authors identified the following problems with existing help-seeker simulation methods:

1. Static Configuration: Emotions and symptom cognition remain unchanged throughout the counseling process
2. Lack of Memory Mechanisms: Inability to handle dialogues involving content from previous sessions
3. Unrealistic Behavior: Tendency to agree with suggestions, excessive compliance, and flat emotional expression

Core Contributions

1. First to Propose two key challenges—dynamic evolution and multi-session memory—and formalize dynamic evolution as changes in emotion and chief complaint, while categorizing multi-session memory into different stages
2. Designed the AnnaAgent System: An emotion and cognition dynamic agent system with three-level memory that simulates dynamic evolution in counseling by controlling changes in emotion and symptom cognition during dialogue
3. Validated System Effectiveness: Through experimental evaluation, demonstrated that AnnaAgent can more realistically simulate help-seeker behavior in psychological counseling

Methodology Details

Task Definition

The help-seeker simulation task requires assigning role configurations to the LLM, including:

• Profile: Basic personal information (age, gender, occupation, etc.)
• Complaint: Help-seeker's cognition of symptoms and primary concerns
• Situation: Living environment and experienced events
• Status: Physical and psychological-related states
• Emotion: Expected emotional response style

Model Architecture

AnnaAgent employs a multi-agent system architecture containing two main agent groups:

1. Dynamic Evolution Control Group

Emotion Regulation:

• Emotion Reasoner: Trained on Qwen2.5-7B-Instruct using the D4 dataset to learn emotion evolution patterns from real counseling
• Emotion Perturbator: Introduces random perturbations to avoid fixed emotion change patterns, assigning probability weights based on emotion distance:

$P(emo_T) = \frac{w(d(G_T, G_B) \times |G_T|)}{\sum_{G_j} w(d(G_B, G_j)) \times |G_j|}$

where $G_B$ and $G_T$ represent base and target emotion groups respectively, and $d(\cdot)$ denotes the distance between emotion groups.

Chief Complaint Guidance:

• Chief Complaint Chain Generation: Generates chief complaint evolution chains based on help-seeker configuration and recent events
• Chief Complaint Switching Control: Determines through algorithms whether to switch to the next stage's chief complaint in the chain

2. Three-Level Memory Scheduling Group

• Real-Time Memory: Dialogue content from the current session
• Short-Term Memory: Recent events and state changes, captured through self-report scales
• Long-Term Memory: Dialogue and scale records from previous sessions, scheduled through Agentic RAG

Technical Innovations

1. Dynamic Evolution Modeling: First to formalize help-seeker dynamic changes as evolution across two dimensions: emotion and chief complaint
2. Three-Level Memory Mechanism: A temporally-stratified memory system designed based on memory theory
3. Data-Driven Evolution Learning: Trains emotion and chief complaint change models based on real counseling data
4. Multi-Agent Coordination: Achieves complex dynamic control and memory scheduling through inter-agent collaboration

Experimental Setup

Datasets

• D4 Dataset: Chinese depression diagnosis-oriented dialogue dataset
• DAIC-WOZ Dataset: English mental health dialogue dataset
• Data annotation performed using GPT-4o, with chief complaint chain data reviewed by 3 psychology experts

Evaluation Metrics

1. Anthropomorphism: Evaluates consistency between simulator utterances and real help-seekers using BERT-score
2. Personality Fidelity: Designs interview questions and evaluates configuration matching using G-Eval scoring
3. Previous Session Cognition Accuracy: Assesses the effectiveness of long-term memory

Baseline Methods

Three baseline methods were selected:

• Chen et al. (2023a)
• Duro et al. (2024)
• Qiu and Lan (2024)

Implementation Details

• Backbone Model: Qwen2.5-7B-Instruct
• Counselor Models: PsycoLLM, EmoLLM, SoulChat
• Emotion Classification: Based on GoEmotions emotion categories
• Assessment Tools: SCL-90, BDI, SAAS and other self-report scales

Experimental Results

Main Results

Anthropomorphism Comparison: On D4 and DAIC datasets, AnnaAgent achieved best or second-best performance when interacting with different counselor models:

Personality Fidelity: AnnaAgent overall outperformed baseline methods in G-Eval scoring.

Ablation Studies

1. Dynamic Evolution Ablation: Removing the dynamic evolution component reduced F1 score from 0.6691 to 0.6144 (D4 dataset)
2. Long-Term Memory Ablation: Removing long-term memory significantly decreased the virtual help-seeker's cognition accuracy regarding previous sessions

Generalization Study

Experiments on GPT-4o-mini and Llama-3.1-8B-Instruct demonstrated that AnnaAgent exhibits good cross-model stability, with relative standard deviations below 10%.

Related Work

LLM Applications in Mental Health

• Dialogue Systems: ChatCounselor, Serena and others provide mental health counseling support
• Diagnosis and Treatment: Improve diagnostic accuracy, treatment effectiveness, and service accessibility

Traditional Help-Seeker Simulation

• Standardized Patients: Real people role-playing, higher cost but greater realism
• Virtual Help-Seekers: Lower cost but insufficient realism

LLM Role-Playing

• Role Knowledge Construction: Through fine-grained role information and emotion annotation
• Personalized Training: Conditional instruction tuning combined with personality trait information

Conclusions and Discussion

Main Conclusions

1. AnnaAgent successfully addresses the challenges of dynamic evolution and multi-session memory in help-seeker simulation
2. Emotion and chief complaint evolution models trained on real data effectively enhance simulation realism
3. The three-level memory mechanism demonstrates excellent performance in handling cross-session information

Limitations

1. Formalization Simplification: Certain formalization simplification of the dynamic evolution process was necessary for technical implementation convenience
2. Crude Memory System: The coordination mechanism of the three-level memory system remains relatively preliminary
3. Data Dependency: Highly dependent on the quality and quantity of real counseling data

Future Directions

1. More fine-grained dynamic evolution modeling
2. More sophisticated multi-session memory coordination mechanisms
3. Extension to more mental health scenarios and languages

In-Depth Evaluation

Strengths

1. Accurate Problem Identification: First to explicitly propose two core challenges—dynamic evolution and multi-session memory
2. Reasonable Method Design: Clear multi-agent system architecture with well-defined module functions
3. Comprehensive Experiments: Includes main results, ablation studies, and generalization verification
4. High Practical Value: Provides important tools for mental health AI research

Weaknesses

1. Limited Theoretical Depth: Lacks deep psychological theoretical analysis of dynamic evolution mechanisms
2. Single Evaluation Metrics: Primarily relies on automated metrics, lacking human evaluation by professional psychologists
3. Insufficient Ethical Consideration: While ethical review is mentioned, discussion of potential misuse risks is insufficient

Impact

1. Academic Contribution: Provides new research directions and benchmarks for the AI mental health field
2. Practical Value: Applicable to counselor training, psychological research, and multiple other scenarios
3. Reproducibility: Provides open-source code facilitating research reproduction and extension

Applicable Scenarios

• Psychological counselor training and evaluation
• Mental health dialogue system development
• Psychological research and experimentation
• Mental health data augmentation

References

The paper cites abundant related work, including:

• Survey works on AI applications in mental health
• Research on LLM role-playing and multi-agent systems
• Research on psychological counseling and standardized patients
• Literature on memory theory and RAG technology

Overall Assessment: This is an important paper in the AI mental health field that systematically addresses key technical challenges in help-seeker simulation. While there is room for improvement in theoretical depth and evaluation methods, its innovative approach and practical value make it a significant advance in the field.