Thursday, March 27, 2025, 12:55AM |  40°
MENU
Advertisement
Henry Evans plays poker with his wife, Jane, using an interface developed by CMU students to control a robot. Evans has quadriplegia from a stroke nearly 20 years ago.
4
MORE

CMU students test their robotic interface, living with a man with quadriplegia

Courtesy CMU

CMU students test their robotic interface, living with a man with quadriplegia

The device allows users to control a robot using the tilt of a head or voice recognition

It started as a theoretical class project to improve the use of robots in a health care setting. It ended in a trip to California for two Carnegie Mellon students, who lived with a man with quadriplegia for a week as they tested and perfected their robotic interface.

Akhil Padmanabha, a third-year robotics Ph.D. student, and Janavi Gupta, a sophomore computer science major, began working on the technology in mid-2022 and early 2023, respectively. The project, called Head-Worn Assisted Teleoperation, or HAT, allows users to control a robot using the tilt of their head or voice recognition, rather than strictly handheld controls.

In California, in the Los Altos Hills home of Henry and Jane Evans, they watched the interface come to life. Evans, who lost the ability to move his limbs and speak after a stroke nearly 20 years ago, used their technology to feed himself, close the blinds and even grab a Red Bull.

Advertisement

They practiced some tasks every day, such as “blanket, tissue, trash” — in which Evans needed to move a blanket, grab a tissue, wipe his face with it, and throw the tissue away. Evans improved his speed on that particular task from taking more than 16 minutes the first day to less than nine minutes at the end of the week.

Other parts of the day were more open-ended. They picked strawberries with Jane Evans in her garden and played poker with Henry, who used the HAT interface to control his cards.

Evans volunteers frequently to assist with research testing new adaptive devices, and regularly invites researchers to stay with him in his home. Padmanabha offered to stay with his parents, who live nearby, but Evans suggested that it would be more effective for the researchers to spend time living with him.

Advertisement

“You hear about the struggles of someone with quadriplegia but until you actually live with them, you don’t see all the details,” said Padmanabha. “It’s very interesting to see that and think about how you can use robotics or technology to address those issues.”

Without being there, it would be hard to predict which tasks had the most impact, said Gupta.

“He really enjoyed being able to scratch his itches,” she said. “I didn’t realize that was so important — it feels like such a small thing.”

Evans has some movement in his fingers, and was able to use the interface robot partially with his head movement and partially with his hand and a computer mouse.

Gupta and Padmanabha used existing hardware components, but had to solder them together to create the prototype and developed the code from scratch. The HAT interface controlled a commercially available robot called Stretch, which is more often used via a computer screen.

Evans appreciated that he was able to perform tasks, such as eating, without a computer right in front of his face. His favorite feature of the HAT device was the “assisted driving” feature, in which the technology is able to figure out how to grasp objects without explicit direction from the user. It’s a feature that Evans hopes will be incorporated into other assistive devices.

“Technology in this area is moving very quickly and it is exciting to be a part of it,” he said in an email.

Evans also provided them with feedback to improve the performance of HAT, such as allowing the device to record sequences of movements and play them back. Such technologies are essential for his well-being, he said.

“My quality of life is definitely positively correlated with increased independence,” he said via email. “Without technology, I would be lying in bed waiting to die.”

Gupta and Padmanabha don’t have active plans to commercialize the HAT device, but have heard from other researchers who are interested in incorporating some of their work.

Both of them plan to focus their careers in the development of health care technology.

“This helped me cement that interest,” said Gupta. “A lot of times, when you are taking classes, you don’t know how it could actually impact people.”

Anya Sostek: asostek@post-gazette.com 

First Published: April 19, 2024, 9:30 a.m.
Updated: April 20, 2024, 12:24 p.m.

RELATED
SHOW COMMENTS (0)  
Join the Conversation
Commenting policy | How to Report Abuse
If you would like your comment to be considered for a published letter to the editor, please send it to letters@post-gazette.com. Letters must be under 250 words and may be edited for length and clarity.
Partners
Advertisement
On Tuesday,  Saint Francis University revealed that it will move to the Division III Presidents’ Athletic Conference, with its athletic programs shifting from Division I to Division III starting in the 2026-2027 academic year.
1
sports
Saint Francis' move to Division III causes shockwaves and 'heartbreak' around campus
The Cathedral of Learning, centerpiece of the University of Pittsburgh campus
2
business
Three more Pitt researchers lose NIH funding
 Hundreds gathered at the winners circle at The Meadows Racetrack and Casino in Washington County on Wednesday, March 26, 2025 to pay tribute to a driver killed in an accident on the track. Hunter Myers, 27, died of head injuries a day after an incident involving another driver and horse on March 19.
3
local
Driver with 'bigger-than-life personality' honored at Meadows horse track a week after his death
Pittsburgh Pirates starting pitcher Jared Jones delivers during the second inning of a baseball game against the Washington Nationals in Pittsburgh, Sunday, Sept. 8, 2024.
4
sports
Pirates' Jared Jones diagnosed with UCL sprain, won't pick up a baseball for approximately 6 weeks
A vintage Isaly's ice cream ad.
5
life
Isaly’s is bringing its chipped chopped ham back to Pittsburgh
Henry Evans plays poker with his wife, Jane, using an interface developed by CMU students to control a robot. Evans has quadriplegia from a stroke nearly 20 years ago.  (Courtesy CMU)
Henry Evans laughs during dinner with CMU students Akhil Padmanabha and Janavi Gupta.  (Courtesy of Carnegie Mellon University)
Henry Evans communicates with CMU student Janavi Gupta using a letterboard.  (Courtesy of CMU)
A diagram of the HAT interface built by two CMU students to control a mobile robot used by Henry Evans, left, who has quadriplegia.  (Courtesy of Carnegie Mellon University)
Courtesy CMU
Advertisement
LATEST news
Advertisement
TOP
Email a Story