Social Robot Augmented Telepresence For Remote Assessment And Rehabilitation Of Patients With Upper Extremity Impairment

Loading...
Thumbnail Image
Degree type
Doctor of Philosophy (PhD)
Graduate group
Mechanical Engineering & Applied Mechanics
Discipline
Subject
Computer Vision
Social Robot Augmented Telepresence
Social Robotics
Socially Assistive Robotics
Telehealth
Telerehabilitation
Biomedical
Robotics
Funder
Grant number
License
Copyright date
2022-10-05T20:22:00-07:00
Distributor
Related resources
Author
Sobrepera, Michael Joseph
Contributor
Abstract

With the shortage of rehabilitation clinicians in rural areas and elsewhere, remote rehabilitation (telerehab) fills an important gap in access to rehabilitation. We have developed a first of its kind social robot augmented telepresence (SRAT) system --- Flo --- which consists of a humanoid robot mounted onto a mobile telepresence base, with the goal of improving the quality of telerehab. The humanoid has arms, a torso, and a face to play games with and guide patients under the supervision of a remote clinician. To understand the usability of this system, we conducted a survey of hundreds of rehab clinicians. We found that therapists in the United States believe Flo would improve communication, patient motivation, and patient compliance, compared to traditional telepresence for rehab. Therapists highlighted the importance of high-quality video to enable telerehab with their patients and were positive about the usefulness of features which make up the Flo system for enabling telerehab. To compare telepresence interactions with vs without the social robot, we conducted controlled studies, the first to rigorously compare SRAT to classical telepresence (CT). We found that for many SRAT is more enjoyable than and preferred over CT. The results varied by age, motor function, and cognitive function, a novel result. To understand how therapists and patients respond to and use SRAT in the wild over long-term use, we deployed Flo at an elder care facility. Therapists used Flo with their own patients however they deemed best. They developed new ways to use the system and highlighted challenges they faced. To ease the load of performing assessments via telepresence, I constructed a pipeline to predict the motor function of patients using RGBD video of them doing activities via telepresence. The pipeline extracts poses from the video, calculates kinematic features and reachable workspace, and predicts level of impairment using a random forest of decision trees. Finally, I have aggregated our findings over all these studies and provide a path forward to continue the evolution of SRAT.

Advisor
Michelle J. Johnson
Date of degree
2022-01-01
Date Range for Data Collection (Start Date)
Date Range for Data Collection (End Date)
Digital Object Identifier
Series name and number
Volume number
Issue number
Publisher
Publisher DOI
Journal Issue
Comments
Recommended citation