Augmented reality for deaf and hard-of-hearing visitors

At an Andy Warhol exhibition in Naples, Orpheo let the artworks speak for themselves, in sign language. Together with the Italian National Institute for the Deaf and producer Arthemisia, Orpheo developed Unmute Art: a multimedia guide with augmented reality that makes the exhibition accessible to deaf and hard-of-hearing visitors and is at the same time a special experience for hearing visitors.

Augmented reality for deaf and hearing visitors alike

Unmute Art uses augmented reality (AR) to make the exhibition dynamic and inclusive. People with and without a hearing impairment enjoy it on an equal footing. AR removes a barrier and enriches the art experience at the same time.

Designed for optimal accessibility

The project was developed specifically to give deaf visitors the best possible experience. A sign language interpreter standing next to the artwork forces visitors to keep looking away. With AR, their eyes stay on the artwork itself, while the extra information appears on top of it.

Artworks that sign

Orpheo and Arthemisia worked with four deaf actors. They brought iconic works by Warhol to life, such as Marilyn Monroe, Sitting Bull, Mick Jagger and Liz Taylor. Through AR, the portraits seem to move and tell their story in sign language. Passive viewing thus becomes an active dialogue with the artwork.

Image recognition as the foundation

The experience is built on image recognition. Visitors used the Orpheo Touch multimedia guide or an app on their own smartphone. When they point the device at an artwork, the AR layer appears automatically. The effect feels almost magical.

Why the Orpheo Touch?

The project was carried out by Orpheo Italy, in Italian, but the controls speak for themselves: choose an artwork and press play. With an app on the visitor's own smartphone, the experience depends on their device. With the Orpheo Touch you can be sure that everyone gets the same impressive AR experience.

Curious how to bring museum texts to life in this way? Also read From museum texts to museum stories.