A Human-In-The-Loop Simulation Framework for Evaluating Control Strategies in Gait Assistive Robots

Basic Information

• Paper ID: 2503.05825
• Title: A Human-In-The-Loop Simulation Framework for Evaluating Control Strategies in Gait Assistive Robots
• Authors: Yifan Wang, Sherwin Stephen Chan, Mingyuan Lei, Lek Syn Lim, Henry Johan, Bingran Zuo, Wei Tech Ang
• Classification: cs.RO (Robotics), cs.SY (Systems and Control), eess.SY (Systems and Control)
• Publication Date: March 5, 2025 (arXiv preprint)
• Paper Link: https://arxiv.org/abs/2503.05825

Abstract

With global population aging, effective rehabilitation and mobility assistance devices have become increasingly important. Gait assistive robots represent a promising solution; however, designing adaptive controllers for various gait disorders presents a significant challenge. This paper proposes a human-in-the-loop (HITL) simulation framework specifically designed for gait assistive robots, addressing the unique challenges posed by passive support systems. The research team integrated realistic physical human-robot interaction (pHRI) models to enable quantitative evaluation of robotic control strategies, highlighting the superior performance of velocity-adaptive controllers compared to traditional PID controllers in maintaining compliance and reducing gait distortion. The study evaluated the accuracy of simulated interactions against real-world data, revealing differences in human adaptation strategies and their impact on gait.

Research Background and Motivation

Problem Definition

1. Aging Challenges: Global population aging leads to declining balance control capacity and increased fall risk, with falls becoming a leading cause of accidental death in elderly populations.
2. Heterogeneity of Gait Disorders: Gait disorders with varying etiologies and severity levels complicate the design of universal robotic systems and controllers.
3. User Adaptation Issues: Users exhibit unique adaptive behaviors toward devices, presenting challenges to controller predictability.

Research Significance

Gait assistive robots can improve rehabilitation outcomes and reduce caregiving burden; however, they require personalized customization to meet each user's specific needs. Extensive testing faces ethical and practical challenges, limiting data-driven optimization and improvement.

Limitations of Existing Approaches

1. Physical Separation vs. Tight Coupling: Existing pHRI research primarily focuses on physically separated collaboration (e.g., robotic arm cooperation) or tightly coupled systems (e.g., exoskeletons), neither fully satisfying the passive support requirements of gait assistive robots.
2. Transparency and Compliance Balance: Gait assistive robots must balance providing dynamic assistance while maintaining user movement independence.
3. Sim-to-Real Transfer: Existing sim-to-real frameworks primarily focus on the robot itself, with limited assessment of how human movement and behavior are affected by the robot.

Core Contributions

1. Specialized HITL Simulation Framework: Proposes a human-in-the-loop simulation framework specifically designed for gait assistive robots, addressing the unique challenges of passive support systems.
2. Realistic pHRI Model: Employs a six-degree-of-freedom mass-spring-damper mechanism to simulate and investigate human-robot interaction and its effects on human behavior.
3. Discovery of Adaptation Strategy Differences: Reveals that different human adaptation strategies to the robot may lead to variations in gait behavior.
4. Control Strategy Evaluation Tool: Demonstrates the potential of HITL as a tool for developing personalized control strategies by comparing velocity-adaptive and PID controllers.

Methodology Details

Task Definition

Develop a simulation environment capable of accurately modeling human-robot interaction for evaluating and optimizing control strategies in gait assistive robots, particularly regarding compliance and transparency performance.

Model Architecture

1. Human Digital Twin

• Skeletal Model: 27-degree-of-freedom full-body skeletal model, including 6 unactuated root joints, 5 ball joints, and 6 revolute joints
• Control Strategy: Model-free deep reinforcement learning (DRL) approach to develop human control policy πh(ah|sh)
• Motion Priors: Utilizes network architecture from Peng et al., employing motion priors and discriminators to guide RL agents in learning reference motion data
• Perturbation Training: Introduces perturbations during training to enhance stability and robustness

2. Robot Digital Twin

• Physical Model: Created from high-quality CAD models based on the Mobile Robot Balance Assistant (MRBA)
• System Identification: Dynamic parameters (e.g., joint damping coefficients and friction losses) estimated and validated through system identification
• Control Architecture: Identical control architecture and parameter settings as the physical robot
• Dual Controller Implementation:
  • PID Controller: Serves as baseline and default controller
  • Velocity-Adaptive Controller: Capable of real-time adaptation to user walking speed

3. Physical Human-Robot Interaction Model (pHRI Model)

Employs a constrained six-degree-of-freedom mass-spring-damper model to describe interaction patterns:

$F_i = k \cdot q + d \cdot \dot{q} \text{ if } q_{min} < q < q_{max}$

Where:

• $F_i = [F_x, F_y, F_z, \tau_x, \tau_y, \tau_z]^T$: Generated force and torque vector
• $q = [q_{tx}, q_{ty}, q_{tz}, q_{rx}, q_{ry}, q_{rz}]^T$: Joint position vector
• $k$ and $d$: Joint stiffness and damping coefficients
• $q_{min}$ and $q_{max}$: Joint limits

Technical Innovations

1. Passive Support System Modeling: First specialized HITL framework development targeting the passive support characteristics of gait assistive robots
2. Six-Degree-of-Freedom Interaction Model: Innovatively employs constrained six-DOF mass-spring-damper systems to simulate soft harness interface
3. Multi-Faceted Performance Evaluation: Simultaneously evaluates compliance (tracking error) and transparency (gait distortion)

Experimental Setup

Experimental Subject

• One healthy 28-year-old male volunteer (95 kg, 1.81 m)
• Study approved by Nanyang Technological University Institutional Review Board (IRB-2024-257)

Experimental Protocol

1. Baseline Testing: Natural walking over 10 meters, repeated 4 times
2. Robot-Assisted Walking: Completed 4 trials of 10-meter walks using both PID and velocity-adaptive controllers
3. Data Collection: Markerless motion capture system, sampling rate 50 Hz

Evaluation Metrics

1. Simulation Validation Metrics

• Statistical Parametric Mapping (SPM): Employs one-way ANOVA based on random field theory to assess differences between simulated and real data

2. Controller Performance Assessment

• Compliance: Forward (ex) and lateral (ey) tracking errors
• Transparency:
  • Spatiotemporal gait parameters (stride length, cadence)
  • Joint angle standard deviation (gait stability indicator)

Data Processing

• Selected 16 complete gait cycles for analysis
• Applied 4th-order Butterworth low-pass filter (cutoff frequency 12 Hz)
• Normalized all lower limb joint angles to gait cycle

Experimental Results

Main Results

1. Tracking Performance Comparison

2. Spatiotemporal Gait Parameters Comparison

3. Gait Stability (Joint Angle Standard Deviation)

Key Findings

1. Simulation-Reality Discrepancies

• Range of Motion Differences: Real subjects showed reduced range of motion in hip, knee, and ankle joints in the sagittal plane, while no significant reduction was observed in simulation
• Adaptation Strategy Differences:
  • Real subjects: Trunk flexion to drag the robot
  • Simulated characters: Increased ankle dorsiflexion to generate greater propulsive force

2. Controller Performance Comparison

• Velocity-Adaptive Controller Advantages:
  • Significantly smaller tracking errors
  • Better preservation of gait parameters
  • Smaller joint angle standard deviations, indicating more stable gait
• PID Controller Limitations:
  • Significantly reduced stride length and cadence
  • Response delays necessitate user adaptive adjustments

Related Work

HITL Applications in Assistive Robotics

• Assisted Dressing: Clegg et al.'s deep reinforcement learning synthesis of human dressing motion
• Exoskeleton Systems: Kumar et al.'s learning of fall prevention control strategies
• Grasping Tasks: Yow et al.'s shared autonomy control under uncertainty

Current State of pHRI Research

• Physically Separated Systems: Real-time adaptation in robotic arm collaboration
• Tightly Coupled Systems: End-to-end controller development for exoskeletons
• This Paper's Contribution: Fills research gap in passive support systems

Conclusions and Discussion

Main Conclusions

1. HITL Framework Effectiveness: Successfully developed a specialized simulation framework for gait assistive robots
2. Control Strategy Optimization: Velocity-adaptive controllers significantly outperform PID controllers in compliance and transparency
3. Importance of Adaptation Strategies: Different human adaptation strategies significantly affect human-robot interaction effectiveness

Limitations

1. Digital Twin Adaptability: Simulated characters exhibited unexpected adaptive behaviors differing from real humans
2. Soft Body Modeling Absence: Lack of soft harness and soft body simulation limits interaction fidelity
3. Single Subject: Data based on only one healthy subject, lacking diversity

Future Directions

1. Diverse Adaptation Strategies: Develop human digital twins capable of learning various compensatory strategies
2. Soft Body Modeling Integration: Incorporate soft body and harness modeling to enhance interaction realism
3. Personalized Control Strategies: Create and fine-tune personalized control strategies for different users

In-Depth Evaluation

Strengths

1. Strong Innovation: First specialized HITL framework for gait assistive robots, filling a research gap
2. Complete Methodology: Integrated framework combining human digital twin, robot digital twin, and pHRI model
3. Sufficient Validation: Verified simulation results through real experiments, providing valuable comparative analysis
4. High Practical Value: Provides effective tool for control strategy development in gait assistive robots

Weaknesses

1. Sample Limitations: Based on single healthy subject, lacking diversity and representativeness
2. Simplified Modeling: Simplified modeling of soft harness and human soft tissue affects simulation fidelity
3. Preset Adaptation Strategies: Digital twin adaptation strategies are learned, potentially not conforming to real user behavior
4. Limited Evaluation Metrics: Lacks assessment of subjective experiences such as user comfort and fatigue

Impact

1. Academic Contribution: Provides new simulation tools and evaluation methods for gait assistive robot research
2. Practical Value: Can be used for control strategy optimization, reducing human experimentation requirements
3. Scalability: Framework demonstrates good extensibility, applicable to different types of gait assistance devices

Applicable Scenarios

1. Control Strategy Development: Preliminary verification and optimization of new control algorithms
2. Personalized Customization: Tailoring control parameters for different user populations
3. Safety Assessment: Evaluating control strategy safety before real-world testing
4. Education and Training: Training and teaching for relevant researchers

References

This paper cites 33 relevant references spanning multiple fields including gait assistive robots, human-robot interaction, and reinforcement learning, providing a solid theoretical foundation for the research.

Summary: The proposed HITL simulation framework provides an innovative tool for control strategy development in gait assistive robots. While possessing certain limitations, it demonstrates significant value in reducing human experimentation requirements and improving development efficiency, making a meaningful contribution to the field's advancement.