Get the latest delivered to your inbox
Privacy Policy

Now Reading

AI-Powered Communication Solution for People Living With ALS Revealed at Lenovo Tech World

The Scott-Morgan Foundation and Lenovo debuted a new technology suite combining predictive AI, hyper-realistic avatars, personalized voices, and eye-gaze tracking

AI-Powered Communication Solution for People Living With ALS Revealed at Lenovo Tech World

The Scott-Morgan Foundation and Lenovo debuted a new technology suite combining predictive AI, hyper-realistic avatars, personalized voices, and eye-gaze tracking

Published 11-29-24

Submitted by Lenovo

SEATTLE, November 29, 2024 /CSRwire/ - At Lenovo Tech World ’24, global technology leader Lenovo and the Scott-Morgan Foundation (SMF), a non-profit pioneering innovative assistive tech, revealed an AI-powered solution for people with amyotrophic lateral sclerosis (ALS) and other severe disabilities. The new, scalable tech reveals new possibilities for applying generative AI to accessibility challenges and further advances a shared vision of delivering Smarter AI for all.

The integrated solution combines a circular keyboard interface designed by SMF and built by Lenovo, predictive AI from Lenovo, personalized AI voice replicas from ElevenLabs, hyper-realistic avatars from D-ID, and eye-tracking tech from IrisBond to provide fast, accurate, and personal communication.

The proof of concept, now in active testing with SMF’s community of people with ALS and leading clinicians, builds on years of collaboration between SMF and Lenovo to reimagine and scale assistive technology. Focusing on ALS, a neurodegenerative disorder that typically leads to full-body paralysis, inspires solutions that benefit countless other diseases and disabilities.

Lenovo Tech World opened with a story of a father recently diagnosed with ALS using the technology to tell stories and sing lullabies to his two young children in his own voice.

Erin on stage, a digital device in front of them and a colorful starry sky displayed behind.

“This is Smarter AI for All: applying transformative technologies to the most pressing human challenges,” said Linda Yao, Vice President of AI Solutions and Services at Lenovo. “With compassionate partners like the Scott-Morgan Foundation and a bold vision to bring AI to everyone, we are using our AI expertise and portfolio to show how bright the future can be.”

The collaboration emerged from the SMF mission to break down barriers between technologies and democratize life-changing solutions that ensure a universal right to thrive.

“We live in a world where over half a billion people are silenced, not by choice, but by disability,” said LaVonne Roberts, Executive Director of SMF. “Imagine a world where even the most severely disabled individuals can fully express themselves, where cutting-edge technology gives voice to the voiceless. We’re not just imagining this world—we’re building it together with Lenovo. With over 500 million people worldwide grappling with muscular or neurological conditions, our work has the potential to impact lives on a massive scale.”

A communication device open to a circular display of letters and symbols.

Live at Lenovo Tech World

Erin Taylor, a disability advocate and botany enthusiast with ALS, used the technology to introduce herself and then welcome Lenovo Chairman and CEO Yuanqing Yang to the stage at Tech World.

“I find renewed strength and hope when I see what is possible through technology, especially with the latest advances in AI,” said Erin, who shares her experiences and perspective with a rapidly growing social media audience. “Speaking with my voice as it sounded pre-diagnosis is incredible, of course, but what excites me most is participating in the development of smarter technology for others.”

Erin also helped demo the technology on the show floor and continues to offer key feedback to the development team.

Building on early designs first unveiled at CES 2024, Lenovo spearheaded the development of a fully functional, fully integrated prototype.

“We prioritized human-centric design and leveraged our expertise in innovative user experiences,” said Lenovo UX prototyper Daniel Pollock, who led the interface development. “It’s an absolute privilege to contribute and collaborate on this project and incorporate such powerful AI technology.”

" "
Erin Taylor live on stage at Tech World 2024

Building a consortium of AI innovation

Traditional voice banking is an arduous process, often limited by the vocal deterioration that can emerge as an early symptom of ALS. Past models also suffered from a clear lack of emotional expressiveness, limited to robotic cadences and unnatural rhythms—but AI has changed all that. Now, limited audio samples, even of poor quality, can generate a compelling, on-demand AI voice.

“Over the past year, we’ve been deeply inspired by individuals reclaiming their voices despite all the challenges, and we’re grateful for the chance to play a small part in that process,” said Mati Staniszewski, CEO of ElevenLabs. “Now, with the incredible support of the Scott-Morgan Foundation, we’re taking these efforts to the next level. We’re proud to help remove communication barriers and empower people.”

That customized voice feeds directly into the avatar technology from D-ID. Again, scalability and ease are a priority with assistive tech, and D-ID is able to generate lifelike avatars from still photos or very limited video.

“This powerful technology is so often used for business or entertainment—which of course we love to see and support—but promoting social good is where we see it make a lifechanging impact. D-ID has a long track record of leveraging its technology to help worthy causes such as combatting domestic violence, raising awareness of sex trafficking, and numerous education and advocacy efforts,” said Gil Perry, co-founder and CEO of D-ID. “Working with this collaboration perfectly fits our strategy of using AI to make the world better and more connected.”

The complete solution currently runs on Lenovo’s ThinkPad x12 detachable PC, which offers an ideal union of power and portability. The detachable form factor helps the device mount readily on a variety of surfaces—from kitchen tables to wheelchairs—and integrate IrisBond’s eye-tracking hardware and software. Here, IrisBond used their Hiru camera, which works across platforms and under different conditions to precisely track eye movement. Lenovo is also developing more personalized AI models to facilitate communication.

“We’ve been working with SMF for a few years to help disrupt the assistive tech landscape and give people greater agency and independence,” said Eduardo Jauregui Torrecilla, CEO of IrisBond. “We have a history of hands-on support and development for people with ALS, cerebral palsy, and countless conditions where the eye is our greatest tool to communicate—and AI is transforming what’s possible in extraordinary ways.”

The Scott-Morgan Foundation will work directly with clinicians, technologists, and people with ALS to further refine and test the technology.

This solution was one of the dreams of visionary roboticist Dr. Peter Scott-Morgan, who passed in 2022. At the time, rendering an avatar or speaking with a banked voice was time-consuming, expensive, resource-intensive, and far less expressive and accurate than what’s possible with generative AI.

“The technology has leapt forward immeasurably in just the past two years, driven by AI,” said Andrew Morgan, CEO of the Scott-Morgan Foundation. “We have always believed that AI is the gateway for a revolution in assistive technology, but we need to bang the drum and advocate for these solutions—to give a voice to those who need it most and include them in the process. We are still in uncharted territory, and I can’t wait to see what solutions we pioneer and democratize next.”

lenovo logo

Lenovo

Lenovo

Lenovo is a US$62 billion revenue global technology powerhouse, ranked #217 in the Fortune Global 500, employing 77,000 people around the world, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company by further expanding into growth areas that fuel the advancement of ‘New IT’ technologies (client, edge, cloud, network, and intelligence) including server, storage, mobile, software, solutions, and services. This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992)(ADR: LNVGY). To find out more visit https://www.lenovo.com, and read about the latest news via our StoryHub.

More from Lenovo

Join today and get the latest delivered to your inbox