Differential Analysis of Pseudo Haptic Feedback: Novel Comparative Study of Visual and Auditory Cue Integration for Psychophysical Evaluation

Basic Information

• Paper ID: 2510.09570
• Title: Differential Analysis of Pseudo Haptic Feedback: Novel Comparative Study of Visual and Auditory Cue Integration for Psychophysical Evaluation
• Authors: Nishant Gautam, Somya Sharma, Peter Corcoran, Kaspar Althoefer
• Institutions: Queen Mary University of London (Advanced Robotics), University of Galway (C3I)
• Classification: cs.HC cs.GR cs.NE cs.RO physics.med-ph
• Paper Link: https://arxiv.org/abs/2510.09570

Abstract

This study explores pseudo-haptic feedback technology, which deceives the brain into "feeling" forces that are not actually applied through carefully designed visual or auditory cues, providing a low-cost alternative to traditional haptic hardware. The research employs a comparative psychophysical study using a Unity-based Rollball game to quantitatively analyze how visual and auditory stimuli combine to evoke pseudo-haptic pressure sensations on commercial tablets. Four participants manipulated a virtual ball across three textured terrains while real-time finger force was captured using a Robotous RFT40 force-torque sensor. Experimental results demonstrate that for terrains 1-3, average haptic forces in visual-only trials were 0.40 N, 0.79 N, and 0.88 N respectively, while auditory-only trials yielded 0.41 N, 0.81 N, and 0.90 N. The study demonstrates that consumer-grade isometric devices can reliably induce and measure graded pseudo-haptic feedback.

Research Background and Motivation

Problem Definition

Traditional haptic technology faces several critical challenges:

1. High Hardware Costs: Professional force-feedback motors and actuators are bulky and expensive, limiting widespread application beyond research laboratories and high-end simulators
2. Lack of Quantitative Evidence: Despite two decades of pseudo-haptic proof-of-concept work, quantitative evidence remains lacking regarding how specific visual and audio parameters jointly modulate perceived pressure
3. Insufficient Measurement Precision: It remains unclear whether consumer-grade isometric devices can induce and measure such effects with sufficient fidelity for rigorous psychophysical research

Research Significance

Pseudo-haptic technology promises to shift the "touch" burden from hardware to multisensory integration, offering low-cost, software-defined tactile experiences scalable to commercial smartphones and tablets. This technology has important applications in:

• Motor rehabilitation trainers
• Tactile assistance tools
• Immersive gaming
• Robotics
• Biomedical applications

Core Contributions

1. Economical Multimodal Testing Platform: Demonstrates that a £200 tablet plus off-the-shelf force sensors can replicate key functions of high-end haptic devices, enabling rapid, portable experimentation
2. Systematized Cue-Force Mapping: By decoupling audio and visual channels, demonstrates that both higher spatial frequency textures and higher-pitched sounds elicit stronger autonomous pressure, with their combination producing superadditive effects
3. Psychophysical Benchmarks: Reports just-noticeable differences (JND) for surface variation below 0.05 N, establishing baseline pressure ranges (0.40-0.90 N)
4. Application Prospects: Opens pathways for inexpensive motor rehabilitation trainers, tactile assistance tools, and immersive gaming

Methodology Details

Experimental Design

The research employs a "Rollball" game developed in the Unity engine as the experimental platform, where participants must roll a virtual ball across three terrains with different textures.

Hardware Configuration

• Tablet Device: Lenovo M10 HD 2nd Gen 10.1" tablet
• Force Sensor: Robotous RFT40 force-torque sensor (capacity 100N, millinewton-level precision)
• Dimensions: 40(D)×18.5(H) mm, weight 60g

Terrain Design

1. Terrain 1: Smooth surface without obstacles, providing baseline measurements
2. Terrain 2: Gravel-like texture with holes and crack obstacles
3. Terrain 3: Mountain terrain with steep and varied slopes

Audio Cue Design

Each terrain is paired with different rolling sound configurations:

• Terrain 1: 440 Hz - 4.7 kHz
• Terrain 2: 440 Hz - 13.1 kHz (producing "tapping" sounds during collisions)
• Terrain 3: 440 Hz - 8.9 kHz

Experimental Conditions

The research designed three experimental conditions:

1. Visual Cues Only: Participants rely solely on visual texture information
2. Auditory Cues Only: Participants rely solely on audio feedback
3. Audiovisual Combined: Both visual and auditory cues provided simultaneously

Measurement Metrics

Touch Radius Measurement

When users touch the screen, a "touch effect circle" is generated, with its radius proportional to applied pressure:

$P = T_e \times t_d$

where $T_e$ represents the touch event or touch effect circle, and $t_d$ represents total touch duration (seconds).

Just-Noticeable Difference (JND)

Calculated using Weber's Law:

$K = \Delta I / I$

where $\Delta I$ represents additional stimulus exceeding original intensity, $I$ represents the original intensity of sensation, and K is the Weber constant.

Experimental Setup

Participants

• Experimental Group: 4 individuals (2 male, 2 female), ages 22-26
• Control Group: 2 candidates (1 male age 34, 1 female age 33)
• Screening Criteria: Exclusion of candidates with history of epilepsy, migraines, or neurological disorders

Experimental Environment

• Controlled environment avoiding sudden temperature and humidity changes
• Avoidance of excessive force or torque application to sensors
• Tablet equipped with anti-scratch screen protector

Data Collection

• Real-time force-torque data acquisition
• Touch radius telemetry
• Average measurements of 10 touches/clicks per terrain

Experimental Results

Primary Results

Average Haptic Pressure Data

Touch Radius Readings

Key Findings

1. Systematic Force Increase: Haptic force increases systematically with increasing cue intensity
2. Auditory Advantage: Pressure applied under auditory-only conditions is slightly higher than visual-only conditions
3. Multisensory Integration: Audiovisual combined conditions further reduce force required to perceive surface changes
4. Frequency-Pressure Correlation: Both higher audio frequencies and denser visual textures elicit stronger muscle activation

Psychophysical Analysis

Participants reported perceiving differences in force required for touchpad interaction almost immediately upon changes in terrain or auditory feedback. The study established JND benchmarks for surface variation, providing target pressure ranges for future pseudo-haptic interfaces.

Related Work

Visual Cue Research

• Yoshida et al. (1968): Used SD method to study material tactile perception
• Hollins et al. (2000): Conducted multidimensional perception research using 17 textured materials
• Li et al. (2016): Proposed CAD-based soft surface simulation

Auditory Cue Research

• "Parchment Skin Illusion": Any change in auditory feedback can induce texture perception changes
• Audio Delay Effects: Auditory feedback delay weakens pseudo-feedback effects
• Material Identification: Low-pitched sounds cause users to perceive objects as heavier

Conclusions and Discussion

Main Conclusions

1. Technical Feasibility: Consumer-grade isometric devices can reliably induce and measure graded pseudo-haptic feedback
2. Multisensory Integration: The combination of visual and auditory cues produces superadditive effects, confirming multisensory integration theory
3. Application Potential: Opens pathways for inexpensive rehabilitation tools, training simulators, and assistance interfaces
4. Measurement Precision: Establishes benchmarks with JND below 0.05 N and baseline pressure ranges of 0.40-0.90 N

Limitations

1. Sample Size: Only 4 participants, relatively small sample
2. Experimental Duration: Constrained by two-and-a-half-month time limitations
3. Physiological Measurements: Did not employ psychophysiological measures such as skin conductance and heart rate
4. Device Dependency: Touch radius values depend on specific devices

Future Directions

1. Extended Research: Collaboration with neuroscientists employing electromyography and electrooculography
2. Therapeutic Applications: Distraction therapy and sensory re-education for burn patients
3. Technology Integration: Integration with Ultraleap's ultrasonic touch arrays and MediaPipe framework
4. Multimodal Exploration: Integration of thermal and airflow feedback

In-Depth Evaluation

Strengths

1. Innovative Approach: First systematic quantification of visual and auditory cue effects on pseudo-haptic feedback
2. Practical Value: Demonstrates feasibility of low-cost consumer devices with significant commercial application prospects
3. Rigorous Design: Employs multiple measurement methods (force sensors, touch radius, psychophysical assessment)
4. Interdisciplinary Significance: Combines human-computer interaction, psychophysics, robotics, and other fields

Limitations

1. Insufficient Statistical Power: Sample size of 4 is too small, affecting statistical significance and generalizability
2. Control Experiment Design: Lacks a true no-cue control group
3. Individual Difference Analysis: Insufficient analysis of inter-individual differences and influencing factors
4. Long-term Effects: Does not investigate adaptation effects and impacts of prolonged use

Impact

1. Academic Contribution: Provides important quantitative foundation for pseudo-haptic research
2. Industrial Application: Offers new technological pathways for consumer electronics, gaming, and rehabilitation medicine
3. Methodological Value: Establishes reproducible experimental paradigms and measurement standards

Applicable Scenarios

1. Rehabilitation Medicine: Motor rehabilitation training, sensory function recovery
2. Educational Training: Surgical simulators, skill training systems
3. Consumer Electronics: Mobile device haptic feedback enhancement
4. Assistive Technology: Navigation systems for visually impaired, tactile assistance tools

References

The paper cites 41 relevant references covering important works in tactile perception, multisensory integration, virtual reality, human-computer interaction, and other research domains, providing a solid theoretical foundation for the research.

Overall Assessment: This study makes important contributions to the pseudo-haptic feedback field by systematically quantifying the effects of audiovisual cues on tactile perception through rigorous experimental design, opening new pathways for low-cost haptic technology development. Despite limitations such as small sample size, its innovative methodology and practical value make it an important reference in the field.