2025-11-21T15:04:16.225643

Two Explorative Studies on Tangible Augmented Reality for Neurodevelopmental Disorders

Vona, Valcamonica, Garzotto

Tangible Augmented Reality (TAR) is an interaction paradigm that integrates physical and digital worlds to create immersive, interactive experiences. This paper explores two TAR applications, Holomarket and Along the Oceanic Flow (ATOF), and presents insights from two exploratory studies evaluating their usability and likeability among individuals with neurodevelopmental disorders (NDD). Holomarket is designed to simulate a supermarket shopping experience, helping users develop essential life skills such as item selection, basic arithmetic, and money handling. Participants interacted with augmented food items and a smart cash register, navigating a virtual supermarket environment. While participants enjoyed the realistic setting and tangible interactions, some usability challenges, such as difficulty manipulating virtual objects and discomfort with prolonged headset use, were noted. ATOF transforms the user environment into an oceanic world, where participants use a dolphin-shaped smart object to complete tasks like collecting items and solving puzzles. This application aims to improve motor coordination and cognitive skills. Participants appreciated the immersive experience, the customizable tasks, and the tangible dolphin interface. However, some faced difficulties interacting with specific virtual elements. Overall, both applications demonstrated potential as therapeutic tools for NDD, offering engaging and immersive experiences. Despite some usability challenges and hardware limitations, the positive feedback suggests that TAR could play a crucial role in future therapeutic interventions. Further research is needed to refine these applications and enhance user interaction and comfort.

academic

Two Explorative Studies on Tangible Augmented Reality for Neurodevelopmental Disorders

基本信息

论文ID: 2510.14598
标题: Two Explorative Studies on Tangible Augmented Reality for Neurodevelopmental Disorders
作者: Francesco Vona (University of Applied Sciences Hamm-Lippstadt), Giulia Valcamonica (Politecnico di Milano), Franca Garzotto (Politecnico di Milano)
分类: cs.HC (Human-Computer Interaction)
发表时间: 2025年10月16日
论文链接: https://arxiv.org/abs/2510.14598

摘要

本文探索了两个切向增强现实(TAR)应用——Holomarket和Along the Oceanic Flow (ATOF)，并通过两项探索性研究评估了它们在神经发育障碍(NDD)人群中的可用性和喜爱度。Holomarket模拟超市购物体验，帮助用户发展基本生活技能；ATOF将用户环境转换为海洋世界，通过海豚形状的智能对象提升运动协调和认知技能。尽管存在一些可用性挑战和硬件限制，积极的反馈表明TAR在未来治疗干预中具有重要潜力。

研究背景与动机

问题定义

本研究旨在解决神经发育障碍(NDD)人群在日常生活技能训练和治疗干预中面临的挑战。NDD包括自闭症谱系障碍(ASD)、注意缺陷多动障碍(ADHD)和智力障碍等，这些疾病影响认知、社交和运动功能。

问题重要性

治疗需求迫切：NDD影响个体的日常生活能力，需要个性化的治疗干预
传统方法局限：现有AR/VR治疗方法缺乏触觉交互，而NDD人群特别受益于多感官参与
技术发展机遇：沉浸式技术的快速发展为治疗干预开辟了新前沿

现有方法局限性

AR和VR治疗缺乏切向交互元素
缺乏针对NDD人群的专门设计原则
物理和数字交互的整合不足

研究动机

通过TAR技术结合智能对象(Smart Objects)，为NDD人群创造直观、参与度高的治疗体验，弥补传统AR治疗中触觉反馈的缺失。

核心贡献

首创性研究：据作者所知，这是首次探索TAR在NDD人群中应用的研究
双应用开发：开发了两个针对不同技能训练的TAR应用系统
实证评估：通过探索性研究验证了TAR在NDD治疗中的可行性和接受度
设计指导：提供了TAR应用设计的关键经验和指导原则
跨学科合作：展示了心理学家、护理人员和工程师协作设计的成果

方法详解

任务定义

本研究定义了两个不同的治疗任务：

生活技能训练：通过Holomarket培养购物、算术和金钱处理能力
运动认知训练：通过ATOF提升运动协调和认知技能

系统架构

Holomarket系统

核心组件：
- Microsoft HoloLens作为AR显示设备
- 全息食物货架和购物清单
- 配备RFID的智能收银机
- RFID标签的食物道具和货币
交互模式：
- Each Price Mode：记忆游戏结合购物体验
- Total Price Mode：计算总价和支付训练
技术实现：使用Unity、Visual Studio、Vuforia和Mixed Reality Toolkit (MRTK)开发