Virtual reality technology has allowed people with special needs, specifically the blind and visually impaired, to access important information. This technology focused on immersing these groups in a three-dimensional environment and providing tools and applications that facilitate their daily lives by providing an immersive experience and tactile and auditory feedback through the application of virtual reality technology to bridge the gap of the problem of visual disability between the blind and visually impaired category. This article reviews the most important needs of people with visual impairment in various fields. This paper also discusses the most important assistive devices in the virtual reality environment, their functions, and applications. The paper also discussed the most important research that applied virtual reality technology to the blind and visually impaired. The determinants that will be taken into consideration in the future and appropriate solutions were highlighted to develop the benefit of virtual reality and serve this important category more.
The World Health Organization announced that at least 2.2 billion people in the world from different age groups suffer from loss and impairment of vision, and the number is constantly increasing. It has become necessary to pay attention to this important segment of society and provide them with all means of assistance [1]. Civilized societies paid great attention to this segment of society and provided them with special care. Visual impairment affects people of all age groups and hinders the performance of their daily tasks, movement, and learning, in addition to psychological illnesses due to disability [2]. On this basis, researchers presented many pieces of research to find the most suitable and least expensive solutions. Research has provided virtual reality as an effective and helpful tool for this segment.
Virtual reality technology assists people with special needs by immersing them in an interactive three-dimensional virtual environment created through the computer. This technology has been used in many fields for a long time, such as communications, entertainment, games, education, and medicine. It is considered a multidisciplinary technology, and its capabilities depend on the development it has achieved over the years. So, the hardware and software used in virtual reality and user interaction in an immersive virtual experience are important factors and a major challenge in the success of any application [3].
Therefore, virtual reality uses interactive simulations to provide users with an immersive interactive experience like the real world. This experience creates a feeling in the user that helps the user navigate the virtual world. Through all these features, this technology has been employed for people with special needs and those who have functional impairment to compensate them for this lost disability through virtual scenarios through which specific tasks are performed [4].
This research presents a review of research in the field of virtual reality applications that help blind and visually impaired people improve their daily lives. The second section motivates writing this article. The third section presents the needs of the visually impaired. The fourth section reviews virtual reality assistive devices for people with visual impairment. The fifth section presents categories of people with visual impairment. The sixth section discusses the research that applied virtual reality technology to blind and visually impaired people and the results reached. The last section is the conclusions of this article.
With the use of virtual reality technology increasing significantly, it has become necessary for technology to quickly find its way to serve people with special needs, including the visually impaired. This target group faces many problems and difficulties in completing their daily tasks and integrating with society due to their visual impairment. However, the development and new digital technology, including virtual reality, has greatly increased interest in employing this technology to serve this segment, in a way that keeps pace with this development in the labor market. This group began to take its share of actual interest in providing appropriate facilities to practice their daily activities and tasks using virtual reality technology. Therefore, this research paper provides a review of the needs of this category, the modern devices, and the research that applied virtual reality technology to them. To help researchers and developers in this field.
Blind and visually impaired people have different needs in all domains of life, including education, social care, employment, and integration into society. Despite the progress in information technology, this segment of society continues to face major challenges, which can be highlighted in the following domains:
Education: Education is an important factor for blind and visually impaired people to develop their personality and skills. However, many of them face many obstacles in academic subjects, as well as in accessing their educational environment and participating in the classroom. There are means of assistance for this category, including loudspeakers and screen readers, which enhance the capabilities of this category of students. In addition to special methods for conducting tests for this category to ensure access to equal educational opportunities [5].
Health care: The process of obtaining health services is one of the most important factors in the well-being of civilized societies. That is why attention to the blind and visually impaired group in these societies has become important in this field. However, they face some challenges in some health facilities in terms of accessing them and facilitating movement and use of devices for people with visual impairment [6].
Social integration: Blind and visually impaired people often feel socially isolated and do not participate in social interactions. That is why they need to increase their awareness and enhance their compassion to build a more inclusive society. This is why social programs and social support networks must be accessible to facilitate their social integration [7].
Employment: Blind and visually impaired individuals find it extremely difficult to find job opportunities or advance in their professional lives. Therefore, employers must provide reasonable facilities to this segment by implementing technologies that they can easily access. These technologies enhance work culture by developing skills relevant to industries through which this group can obtain employment opportunities [8].
Overhead, the above elements summarize the needs of blind and visually impaired people in different areas of life. On this basis, researchers were interested in developing virtual reality applications that enhance these needs.
In the past, blind people relied on dogs to move from one place to another, and they used Braille to read and write. Today, humans need a kind of intellectual and motor independence to carry out their daily tasks without the help of others. Blind and visually impaired people are one of the major challenges facing societies [9]. It has become necessary for researchers and developers in the field of virtual reality to pay attention to this segment of society. In addition, needed to develop virtual reality devices and applications that keep pace with the needs of the blind and visually impaired group, and which play a major role in developing sensory and spatial awareness among users. This section will discuss the types of devices used in VR that are useful for this social segment.
Haptic Feedback: This technology used within virtual reality allows for tactile feedback and the transfer of spatial information to the user. These include tactile actions, such as vibration, as in video games, and the smartphone screen, which provides a reaction because of clicking a button, or vibrates to alert the user that he has received a message on the smartphone [10].
Audio systems: Virtual reality systems use sound to convey information to the user through audible audio reactions about the place and the surrounding environment. These spoken and audible responses help users gain spatial awareness and estimate distances and directions [11].
Wearable cameras: These cameras linked to virtual reality headsets or smart glasses transmit visual information to the user in real-time and transform it into tactile and auditory actions. These devices help blind and visually impaired people find objects, scan text, and provide descriptions of the scenes surrounding them [12].
Navigation Assistance: Navigation assistance for blind and visually impaired people based on real-time virtual reality technology. They rely on interactive maps, planning the routes used, and tactile and auditory directional signals to help them navigate in an unfamiliar environment [13].
Training and rehabilitation: Virtual reality applications are used to allow movement, exercise, and training by simulating a virtual environment. This cannot be accomplished without the help of these technologies, as the user is completely immersed in the virtual world provided by these tools to obtain the desired result. Virtual reality technology increases internal motivation and provides enjoyment that cannot be obtained through traditional methods [14].
The technological revolution in the systems greatly helps the blind and visually impaired in all segments, such as children at play and in kindergartens, students in their classes, the elderly in the home environment and outside it, and many important daily tasks that require information about the spatial world for the blind. Through it, blind people can move independently and gain an understanding of the surrounding environment by recognizing objects. These will help the blind and visually impaired to change the way they interact with the outside world.
Accordingly, virtual reality devices and their applications have many benefits, including:
Improving spatial awareness using virtual reality devices and applications. In addition to improving their ability to perform their daily tasks.
Navigation by providing guidance and maps in real time and in indoor and outdoor spaces independently.
Accessing visual information through wearable cameras and assistive devices that help users read and interpret information [4].
Obtaining educational and employment opportunities through training programs based on virtual reality technology. The user gets an immersive educational experience in various specializations and, as a result, obtains appropriate education and job opportunities [8].
Integrate with society and participate in social interactions using virtual reality technologies and applications. Where the user can immerse himself in recreational activities and unique social experiences [7].
Poor or absent vision indicates limited or absent activities and functions of the visual system. Where the inability to see light and objects partially or completely. This disease affects the patient's daily life. There are varying degrees of these cases, including:
Blindness: This condition refers to complete or almost complete loss of vision. They suffer from significant visual limitations that make them unable to carry out their daily lives and activities normally. In addition, individuals in this category rely on mobility aids or auditory cues.
Visual impairment: This is poor vision, as individuals may suffer from partial vision. This group cannot correct their vision with medications, glasses, contact lenses, or surgeries. In addition, this group finds it difficult to carry out their daily activities. There are varying degrees of visual impairment among members of this group[15].
For the success of any device or application, it must take into case the user’s situation when conducting the experiment or developing an application to serve this segment and finding the appropriate tools for them.
The relevant research was summarized, and the research was selected after the year 2018. The research, the environment in which the users worked, and what elements of the research were adopted in the system for blind and visually impaired people were described. In addition to the type of virtual reality technology that was used, the specific target group, and what are the limitations that faced the research at the end of the work.
Table 1: Related Research Works
Ref. | Description | Domain | Elements | VR Technology | Target Audience | Restrictions and limitations |
[16] | The system provides a multimedia interface that helps older people build a cognitive map and experience unknown locations of the surrounding environment through real-time walking.
| Training environment
| Haptic and audio | HMD | Blind And Low Vision People
| The environment in which the experiment was conducted contained some engineering problems, which led to the occurrence of some alarm sounds, which disturbed the participants. |
[17] | The prototype allows maps to be created and explored by users by combining projection, audio output, and the use of tactile tokens. | Education and interactive | Audio and tactile
| Augmented reality interactive maps | Blind And Low Vision | The need to apply it to a larger group |
[10] | The HOMERE system is designed for blind people to help them explore and navigate within a virtual environment. The system has been implemented through three main applications: preparation for a specific site visit, training in using a blind cane, and ludic exploration of virtual worlds. | Training and navigating inside a building.
| auditory sense and haptic sense | Haptic Device through a Blind Cane
| visually impaired and blind | The system needs further development to measure sensory feedback and simulate torque.
|
[18] | The system allows a visually impaired person to navigate between indoor and outdoor scenarios easily by loading a virtual path. The path is pre-recorded and provides automatic pathing along the loaded path. This is done through speech, sound, and haptic feedback. | Navigate | haptic, speech, and sound | Smartphone | haptic, speech, and sound feedback. | The system needs to be developed to include all types of mobile features that a visually impaired person needs. |
[14] | The tactile controller is designed for visually impaired people. The user can wear it and move around in the virtual world. In addition to providing a more immersive experience than the real world. | entertainment and training | Audio and haptic | Controller | visually impaired and blind | More tool design is needed to make virtual reality more inclusive and realistic. |
[19] | A smartphone application has been designed for virtual navigation for blind people. The user can gain knowledge of the route and become familiar with the environment before visiting a particular location. | Navigation | navigation tool | Smartphone | Blind | Needs to improve instructions for users when there are bends in the road. |
[20] | The ARIANNA system is designed to help visually impaired visitors navigate indoor spaces and experience cultural heritage independently. | Navigating Cultural Heritage
| Haptic | Smartphone | visually impaired | The application needs to be developed such as vibration feedback to correct the user's location. |
[21] | A low-cost virtual reality system using a smartphone for people with visual impairment. The system is used in class to teach and train students in classic Orientation and Mobility (O &M) tasks. It allows the user to move in space as if he were in the real world. | Learn and train | Audio and visual feedback | Smartphone and headphones | visually impaired | More research is needed to improve audio quality. |
[22] | A prototype exploring how virtual reality can be used to help non-visually impaired participants generate empathy for visually impaired people when interacting with public interactive displays (PID). | Interaction | VR headset | Prototype | visually impaired | The study sample of vision impairment was small and needed a broader population |
[23] | The use of three movement techniques in a virtual reality environment by blind people (arm swing, linear movement, point and Teleport) | Movement and Navigation | audio and haptic | VR Prototype
| Blind | There were no significant differences in overall performance between the three techniques. |
[24] | Developing a virtual reality platform to test electronic travel aids on people with varying degrees of visual impairment | Navigation | electronic travel aids (ETAs) | electronic travel aid prototypes | visually impaired | There is a need for more improvements to develop visual impairment simulation using virtual reality. In addition to adding other features to get a more realistic experience. |
[25] | Designing a virtual reality interface for the hearing impaired. The interface enables the user to interact with it with ease and accomplish many tasks on the computer system. | Interaction | audio and vibratory haptic feedback | [24]Glove device, a gesture-based control system, and an AR computer interface | Visually impaired | The system needs to be applied to a larger community |
From Table (1), virtual reality technology has been used in training, education, transportation, and entertainment environments for blind and visually impaired users. For instance, [10, 14, 16, 17, 21] studies have been applied in education and training environments for users through virtual reality technology and its tools and the addition of the senses of touch and hearing to compensate for the lost sense of sight. Likewise, the studies [10, 18, 19, 20, 23, 24] were applied in physical movement and navigation environments for the blind and hard of hearing, such as archaeological sites, airports, and movement inside and outside buildings. Likewise, the studies indicated the interaction of visually impaired people with interactive displays and computer interfaces to complete their daily tasks [22] and [25]. Users interact with virtual reality technology through the senses of touch and hearing and by using special devices that support the technology, such as smartphones, interactive maps, and special devices connected to virtual reality technology. Through reviewing previous research, some of the obstacles that researchers faced were identified. For example, some audio problems that may bother users. There is a need to design more comprehensive and realistic features and tools that are tested on blind people. In addition to more research to improve sound quality and user reactions. Also, to the need for larger samples when conducting studies.
In general, this study examines virtual reality technology designed for the blind and visually impaired, their needs, the problems faced by researchers in this field, and the most important devices used. This study will examine prospects for further research and development in this field.
Based on the research reviewed in this paper and when examining the impact of virtual reality technology on blind and visually impaired people. Virtual reality technology has been used to improve the quality of life of blind and visually impaired people and enhance their daily tasks. This technology provides an interactive environment and an immersive experience. However, there are still challenges and limitations to this technology.
The research also highlights the needs of the blind and visually impaired group to carry out their daily tasks in several areas such as education, training, navigation, health care, social integration, and employment. In addition, the most important modern and auxiliary devices that enable the user with visual impairment to interact in the virtual reality environment were reviewed, which strengthened this technology, made it more effective, and facilitated the user’s task to reach the goal for which the application was designed, or the system was created.
Moreover, the research reviewed and highlighted recent research that applied virtual reality technology to the blind and hard of hearing segment in different environments studied and determined the limits of each research so that researchers and developers in the future can overcome these limitations and provide research that best serves this segment. Given the promising and great potential of virtual reality technology, there is a very great opportunity to change the reality of people with visual disabilities, their view of the world around them, and their interactions with it.
Kar, Sarbeswar, and Ashok Kumar Panda. "Assessment of acceptance of Ayurveda Visual Science Medications: Revealing unmet needs." Journal of Ayurveda and Integrated Medical Sciences 9.1 (2024): 190-194, doi: 10.21760/jaims.9.1.28.
Jones, Nabila, Hannah Elizabeth Bartlett, and Richard Cooke. "An analysis of the impact of visual impairment on activities of daily living and vision-related quality of life in a visually impaired adult population." British Journal of Visual Impairment 37.1 (2019): 50-63, doi: 10.1177/0264619618814071.
T. L. Jeffs, ‘Virtual Reality and Special Needs’. [Online]. Available: http://www.ori.org/Research/scientists/inmanD.html#currentprojects
Ghali, Neveen I., et al. "Virtual reality technology for blind and visual impaired people: reviews and recent advances." Advances in Robotics and Virtual Reality (2012): 363-385. https://link.springer.com/chapter/10.1007/978-3-642-23363-0_15.
Manouchou, Elena, et al. "A feasibility study on using virtual reality for understanding deficiencies of high school students." 2016 18th Mediterranean Electrotechnical Conference (MELECON). IEEE, 2016. doi: 10.1109/MELCON.2016.7495418.
Moline, Judi. "Virtual reality for health care: a survey." Virtual reality in neuro-psycho-physiology (1997): 3-34. 10.3233/978-1-60750-888-5-3
Efremova, Galina I., et al. "Social Integration of Disabled People in Russia Using Virtual Computer Technologies." Modern Applied Science 9.12 (2015): 77. doi: 10.5539/mas.v9n12p77.
McDonnall, Michele Capella. "Employer attitudes toward blind or visually impaired employees: Initial development of a measurement instrument." Rehabilitation Counseling Bulletin 58.1 (2014): 29-36. doi: 10.1177/0034355213504140.
Kim, Seondae, et al. "Towards tangible vision for the visually impaired through 2d multiarray braille display." Sensors 19.23 (2019): 5319. doi: 10.3390/s19235319.
Lécuyer, Anatole, et al. "HOMERE: a multimodal system for visually impaired people to explore virtual environments." IEEE Virtual Reality, 2003. Proceedings.. IEEE, 2003. https://doi.org/10.1109/VR.2003.1191147
Todd, Catherine, et al. "VirtuNav: A Virtual Reality indoor navigation simulator with haptic and audio feedback for the visually impaired." 2014 IEEE Symposium on Computational Intelligence in Robotic Rehabilitation and Assistive Technologies (CIR2AT). IEEE, 2014. doi: 10.1109/CIRAT.2014.7009734.
Shukla, Vinod Kumar, and Amit Verma. "Model for User Customization in wearable Virtual Reality Devices with IoT for “Low Vision”." 2019 Amity International Conference on Artificial Intelligence (AICAI). IEEE, 2019. doi: 10.1109/AICAI.2019.8701386.
Katz, Brian FG, et al. "NAVIG: Guidance system for the visually impaired using virtual augmented reality." Technology and Disability 24.2 (2012): 163-178. doi: 10.3233/TAD-2012-0344.
Zhao, Yuhang, et al. "Enabling people with visual impairments to navigate virtual reality with a haptic and auditory cane simulation." Proceedings of the 2018 CHI conference on human factors in computing systems. 2018. doi: 10.1145/3173574.3173690.
Legood, Rosa, Paul Scuffham, and Caroline Cryer. "Are we blind to injuries in the visually impaired? A review of the literature." Injury prevention 8.2 (2002): 155-160. doi: 10.1136/ip.8.2.155.
Kunz, Andreas, et al. "Virtual navigation environment for blind and low vision people." International Conference on Computers Helping People with Special Needs. Cham: Springer International Publishing, 2018. doi: 10.1007/978-3-319-94274-2_17.
Albouys-Perrois, Jérémy, et al. "Towards a multisensory augmented reality map for blind and low vision people: A participatory design approach." Proceedings of the 2018 CHI conference on human factors in computing systems. (2018). https://doi.org/10.1145/3173574.3174203
Lo Valvo, Alice, et al. "A navigation and augmented reality system for visually impaired people." Sensors 21.9 (2021): 3061. doi: 10.3390/s21093061.
Guerreiro, João, et al. "Virtual navigation for blind people: Transferring route knowledge to the real-World." International Journal of Human-Computer Studies 135 (2020): 102369. doi: 10.1016/j.ijhcs.2019.102369.
Croce, Daniele, et al. "Supporting autonomous navigation of visually impaired people for experiencing cultural heritage." Rediscovering Heritage Through Technology: A Collection of Innovative Research Case Studies That Are Reworking the Way We Experience Heritage (2020): 25-46. doi: 10.1007/978-3-030-36107-5_2.
Thevin, Lauren, Carine Briant, and Anke M. Brock. "X-road: virtual reality glasses for orientation and mobility training of people with visual impairments." ACM Transactions on Accessible Computing (TACCESS) 13.2 (2020): 1-47. doi: 10.1145/3377879ï.
Yao, Tina, Soojeong Yoo, and Callum Parker. "Evaluating virtual reality as a tool for empathic modelling of vision impairment: insights from a simulated public interactive display experience." Proceedings of the 33rd Australian Conference on Human-Computer Interaction. 2021. doi: 10.1145/3520495.3520519.
Ribeiro, Renato Alexandre, et al. "Investigating Virtual Reality Locomotion Techniques with Blind People." Proceedings of the CHI Conference on Human Factors in Computing Systems. 2024. doi: 10.1145/3613904.3642088.
FRicci, Fabiana Sofia, et al. "Virtual reality as a means to explore assistive technologies for the visually impaired." PLOS Digital Health 2.6 (2023): e0000275. doi: 10.1371/journal.pdig.0000275.
Kalra, Siddharth, Sarika Jain, and Amit Agarwal. "Gesture controlled tactile augmented reality interface for the visually impaired." Journal of Information Technology Research (JITR) 14.2 (2021): 125-151. doi: 10.4018/JITR.2021040107.