2025-11-25T10:34:17.502250

From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models

Dong, Jin, Yang et al.

Purpose: Emotion is a fundamental component of human communication, shaping understanding, trust, and engagement across domains such as education, healthcare, and mental health. While large language models (LLMs) exhibit strong reasoning and knowledge generation capabilities, they still struggle to express emotions in a consistent, controllable, and contextually appropriate manner. This limitation restricts their potential for authentic human-AI interaction. Methods: We propose a controllable emotion generation framework based on Emotion Vectors (EVs) - latent representations derived from internal activation shifts between neutral and emotion-conditioned responses. By injecting these vectors into the hidden states of pretrained LLMs during inference, our method enables fine-grained, continuous modulation of emotional tone without any additional training or architectural modification. We further provide theoretical analysis proving that EV steering enhances emotional expressivity while maintaining semantic fidelity and linguistic fluency. Results: Extensive experiments across multiple LLM families show that the proposed approach achieves consistent emotional alignment, stable topic adherence, and controllable affect intensity. Compared with existing prompt-based and fine-tuning-based baselines, our method demonstrates superior flexibility and generalizability. Conclusion: Emotion Vector (EV) steering provides an efficient and interpretable means of bridging rational reasoning and affective understanding in large language models, offering a promising direction for building emotionally resonant AI systems capable of more natural human-machine interaction.

academic

From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models

基本信息

论文ID: 2502.04075
标题: From Rational Answers to Emotional Resonance: The Role of Controllable Emotion Generation in Language Models
作者: Yurui Dong, Luozhijie Jin, Yao Yang, Bingjie Lu, Jiaxi Yang, Zhi Liu
分类: cs.CL (Computation and Language)
发表时间: 2025年2月 (arXiv预印本)
论文链接: https://arxiv.org/abs/2502.04075

摘要

本文针对大语言模型(LLMs)在情感表达方面的不足，提出了基于情感向量(Emotion Vectors, EVs)的可控情感生成框架。该方法通过提取中性和情感条件响应之间的内部激活差异，构建潜在表示，并在推理时将这些向量注入预训练LLMs的隐藏状态中，实现对情感语调的精细连续调制，无需额外训练或架构修改。理论分析证明EV引导在增强情感表达力的同时保持了语义保真度和语言流畅性。

研究背景与动机

问题定义

当前大语言模型虽然在推理和知识生成方面表现出色，但在情感表达方面存在显著不足：

情感表达不一致：模型生成的内容要么情感中性，要么语调不一致，或情感导向不可控
缺乏情感智能：在教育、医疗、心理健康等领域，纯粹事实性但情感冷漠的回应往往无法满足用户期望
应用场景受限：情感表达能力的缺失限制了AI系统在需要情感共鸣的人机交互场景中的应用

研究重要性

情感是人类交流的基本组成部分，在多个关键领域发挥重要作用：

教育领域：教师的鼓励和耐心能显著影响学生的动机和坚持性
医疗保健：医生的情感参与和共情沟通能改善患者依从性、满意度甚至临床康复轨迹
心理健康：情感共鸣能力是提供有意义支持的先决条件

现有方法局限性

指令调优方法：往往不够灵活，难以适应广泛的应用和模型架构
提示策略：依赖精心设计的模板和外部评估模块
推理时向量编辑：主要关注最后token位置，缺乏全局意义，难以应用于需要高泛化性的情感等任务

核心贡献

提出了基于情感向量(EV)的可控情感生成框架：通过比较情感诱导和中性提示的模型响应来提取可重用且高效的情感向量
实现了无监督、高鲁棒性的情感控制：无需训练或架构更改，具有全局一致性
提供了严格的理论分析：证明EV引导在增强情感表达的同时保持语义保真度
构建了专门的评估数据集：EmotionQuery和EmotionQuery+数据集用于情感生成评估
实现了连续精细控制：通过标量缩放提供对情感强度的连续精细控制，支持跨模型家族的广泛适用性

数据集构建：创建EmotionQuery数据集，包含500个查询，每种情感状态100个查询
内部输出捕获：对每个查询，模型在中性和情感设置下生成内部表示
```
Ōl = (1/T) Σ(t=1 to T) Ol[t]
```
情感偏移测量：计算情感和中性设置下的输出差异
```
ΔO^(ek)_l = Ō^(emotion(ek))_l - Ō^(neutral)_l
```
情感向量构建：在数据集上平均情感偏移
```
EV^(ek)_l = (1/N) Σ(i=1 to N) ΔO^(i,ek)_l
```