A partnership with Dementia Australia has led to the use of virtual reality and game engine technology to transform dementia care.
Sinister shadows. A carpet that looks like a seething column of bugs. Streams of nagging instructions. These are some of what users experience when they don EDIE, a virtual reality system developed by Deakin University for Dementia Australia.
Unpleasant though they may be, these EDIE experiences are transforming healthcare for people with dementia, by providing major insights to carers and family about what it’s really like to live with dementia.
The team of researchers – who will be based within Deakin’s new Applied Artificial Intelligence Institute (A2I2) – have been working with Dementia Australia (DA) for the past three years, developing products to build understanding and improve dementia care. They have played a major role in contributing to DA’s reputation as an international leader in the use of cutting-edge technology to improve healthcare.
DA’s showpiece, EDIE (Educational Dementia Immersive Experience), consists of an app and accompanying VR that convey the cognitive changes that may be experienced by a person with dementia through an immersive experience. These changes could include impaired memory, mood, planning or problem solving abilities.
EDIE also passively highlights how changes around the home can significantly improve quality of life. For instance, a person with dementia may have difficulty perceiving surfaces that contain repetitive patterns. These can appear to be moving or have insects walking across them, which can be extremely disorienting and frightening.
“EDIE has been a game-changer for us,” said Dr Tanya Petrovich, DA’s Business Development Manager. “It is helping us to achieve our vision of improved care for the thousands of Australians with dementia.”
“Users are making changes as a result of their experiences, particularly through improving furniture and design in homes and residential facilities and their own behaviour in interactions.”
“We have received fabulous testimonials about how individuals are changing their workplace practice and doing more to advocate on behalf of their clients. Also, the support provided by the Deakin team far exceeded the product development phase. Their consideration to the ways customers can be assisted with ongoing support is a cornerstone of the product’s success.”
In Australia, an estimated 1.2 million people are involved in the care of people with dementia, and more than 425,416 people live with dementia. With an ageing population, this number is expected to increase to 536,164 by 2025 and almost 1,100,890 by 2056.
DA Vic division provides training to over 17,000 professional carers each year and has reached 2000 carers with EDIE in Victoria so far. EDIE will be rolled out around Australia over the next two years and has been purchased by CDS Boutique (Concept du Sablier), which specialises in therapeutic products and training in Canada.
One of Dementia Australia’s biggest supporters is the Leader of the Opposition, the Hon Bill Shorten, who saw a demonstration of EDIE at a DA roundtable discussion last year and was so impressed he organised a demonstration in Canberra to the Shadow Cabinet and caucus in November. (An excerpt from his speech is printed below).
Another DA/Deakin collaboration is seeing the peak body working with A2I2 and Deakin Motion.Lab to extend its “Virtual Forest” – a soothing virtual atmosphere, achieved through a large interactive screen, a simple and intuitive program, and gaming technology. The system is having psychological benefits for many patients with dementia living in aged care facilities and will be extended with new scenes, such as seascapes and snow scenes, by the Deakin team.
Kelly Burns and Tanya Petrovich of Dementia Australia accepting the award for Information Technology in Aged Care (ITAC) 2017 – Best Aged Care Software Development and/or Deployment in Aged Care.
Tanya Petrovich relishes being a VR pioneer in healthcare. After beginning her career with a PhD in genetics, she discovered she enjoyed teaching more than research and has worked in education for over 30 years.
“Virtual Reality is an extremely powerful way to teach,” she said. “I started on this VR journey after meeting a game developer at a conference, who told me that video games are really good teachers. He reminded me that kids don’t need manuals to learn how to play a computer game. Their learning is intuitive.
“In two years we could well have an intelligent avatar with dementia that will even further improve our training. There are tremendous opportunities for technology to improve care for people around the world with conditions like dementia.”
Bill Shorten, Leader of the Opposition, TUESDAY, 21 NOVEMBER 2017
“…About two months ago I took part in what they call, in the usual non-Shakespearean language, the Educative Dementia Immersive Experience – but it was developed by Dementia Australia and videogame software producers.
I was shocked. I was simply shocked.
What you do, is you put on a virtual reality headset – it’s the 3D goggles which no politician should ever be filmed in. But what the experience is, is you are someone living with dementia, and you have to get out of your bed at night time and go to the bathroom.
But as you learn, the striped wallpaper and the patterned carpet can look like seething columns of bugs.
The room is full of sinister shadows, the door handle, if you can find it, isn’t working.
Your partner, no doubt for decades, is in the bed frustrated, telling you where to go to go to the toilet.
You hear the shouted directions, which don’t all fully comprehend.
You can hear your own breathing.
You imagine there are things in the dark corners of the hallway, but yet you bang into the objects that are there and you didn’t see.
And you think that you’ve finally made it to the toilet – it turns out you’ve urinated in the washing basket in the corner of the room.
Without a doubt, it was for three and a half minutes, some of the most shocking, dystopian, experience that I could not have imagined. But it puts me in the shoes of someone living in dementia.
So what I did is, I asked my whole Shadow Cabinet to do the same immersive experience.
And then I asked my Caucus, the Parliamentary Labor Party, to go through the same experience.
Once you have seen these bleak minutes, you know that you can’t let people you love go through this experience on their own…”
Leader of the Opposition, the Hon Bill Shorten, learns about EDIE.
Published by Deakin Research on 15 May 2018
The Applied Artificial Intelligence Institute (A²I²) collaborates with industry to act as a catalyst for change through the use of Artificial Intelligence. Our team of research fellows, data scientists and software engineers contribute to the development of human-in-the-loop artificial intelligence and AI experimentation for sectors such as defence, health care, security, social media, advanced manufacturing and more.View Website