Motivation and background

My sister was traumatised and suffered from hearing loss since the year 2021, which obstructs her from identifying the source of the sound correctly. She is not alone in this challenge - there are 1 in 6 people in the UK suffering from hearing loss and 448 million people worldwide who have hearing difficulties.

Sound localisation and engagement for Deaf people are the major problems in their daily life. 80% of the interviewees from the international Deaf community mentioned these issues limit their activities and sound experiences.

Concept

Beyond Hearing is an augmented reality interface that revolutionises the way individuals who are deaf or hard of hearing experience sound. This innovative system enhances safety, communication, and daily sound engagement by providing an intuitive display of surrounding sound information, including the location and type of sound. With the ability to detect and analyse sounds through sensors and advanced algorithms, Beyond Hearing offers a more inclusive and empowering experience for those with hearing difficulties.

The user-friendly interface features simple, easy-to-understand icons and animations that clearly display sound information, without overwhelming the user. Inspired by video games that present hidden sound in a visual way, Beyond Hearing transfers this concept to the real world, helping hard of hearing individuals navigate their surroundings with greater awareness. Whether they're walking on the street or communicating with others, Beyond Hearing offers a unique solution to the challenges faced by those with hearing difficulties, empowering them to fully engage with their environment.

Process

In order to understand the needs of individuals who are hard of hearing, I engaged with the international Deaf community to gather insights about their daily challenges and difficulties in approaching sound activities. Over 80% of the individuals I interviewed highlighted sound localization as a major issue in their lives. For example, while walking on the street, the sound of a car flashing by their back can make them feel insecure, and in group communication, it is difficult for them to instantly know who is talking, decreasing their participation.

To address these concerns, I conducted interviews with deaf community members and hard of hearing individuals to gain a deeper understanding of their needs. Based on these insights, I developed a first prototype that could distinguish between left and right sound, which received positive feedback from users.

Building on the success of the first prototype, I further developed the design to detect sound in 360 degrees, using sound sensors and transparent displays to show the location of sounds on the screen. Throughout the design process, I considered ergonomics, striving to find a balance between the necessary space for electronic components and comfort in wearing the device. After several iterations, I achieved a final prototype that met both functional and ergonomic criteria.

Impact

Beyond Hearing is an innovative augmented reality interface designed to enhance the lives of individuals who are deaf or hard of hearing. By enabling users to locate and identify sounds in their environment, Beyond Hearing empowers them to navigate their surroundings with greater awareness, independence, and safety. Whether it's walking on the street or communicating with others, Beyond Hearing offers a unique solution to the challenges faced by those with hearing difficulties. With its aim to change the perception of hearing aids, Beyond Hearing transforms a traditionally functional device into a stylish, empowering tool that enhances sound engagement and experiences for deaf individuals.