by Researchers at the University of Technology Sydney (UTS) have developed innovative smart glasses that utilize echolocation-inspired technology to convert visual information into unique sound representations. This groundbreaking technology aims to enhance the navigation skills of blind and vision-impaired individuals and has the potential to revolutionize the lives of the visually impaired community.
Assistive technology plays a crucial role in enabling individuals with sensory disabilities to overcome daily challenges. Blindness or low vision (BLV) significantly affects an individual’s ability to perform daily activities and engage in social interactions.
An important focus of assistive technology research involves exploring visual, haptic/tactile, and auditory feedback to enhance the senses. The UTS researchers have created next-generation smart glasses that translate visual information into distinct sound icons, referred to as “acoustic touch,” to assist BLV individuals in “seeing.”
Typically, smart glasses utilize computer vision and other sensory information to convert the wearer’s surroundings into synthesized speech. However, acoustic touch technology takes a different approach by sonifying objects, generating unique sound representations when they enter the wearer’s field of view. For example, the sound of rustling leaves could signify the presence of a plant, while a buzzing sound might represent a mobile phone.
Taking inspiration from bats and their ability to use echolocation to gather information about their surroundings, the researchers developed a Foveated Audio Device (FAD). This device consists of a pair of augmented reality glasses and an OPPO Find X3 Pro Android phone. The Unity Game Engine 2022 is used to manage audio input and camera/head tracking output, allowing the FAD to convert objects into distinct sound icons when they come into view.
To test the effectiveness of the smart glasses, the researchers conducted a study involving 14 adult participants, including seven BLV individuals and seven blindfolded sighted participants as a control group. The study consisted of a training stage, a seated task where the FAD was used to scan and sonify items on a table, and a standing task that assessed the FAD’s performance while participants navigated a cluttered environment in search of a specific item. The study utilized four common items: a bowl, book, cup, and bottle.
The results demonstrated that the wearable device significantly enhanced the ability of BLV individuals to recognize and reach for objects with ease. The auditory feedback provided by the smart glasses empowered users to identify and locate objects with remarkable accuracy, reducing mental effort.
Howe Yuan Zhu, the lead and corresponding author of the study, expressed optimism about the potential of acoustic touch technology as an effective method of sensory augmentation for the visually impaired community. With further refinements, this technology could become an integral part of assistive technologies, allowing BLV individuals to access their environment more effectively than ever before.
The development of bat-inspired smart glasses represents a significant advancement in assistive technology, offering new possibilities for individuals with visual impairments. By leveraging the power of sound, these innovative glasses have the potential to enhance the independence and quality of life for the visually impaired.
*Note:
1. Source: Coherent Market Insights, Public sources, Desk research
2. We have leveraged AI tools to mine information and compile it
Money Singh is a seasoned content writer with over four years of experience in the market research sector. Her expertise spans various industries, including food and beverages, biotechnology, chemicals and materials, defense and aerospace, consumer goods, etc.
