e-space
Manchester Metropolitan University's Research Repository

Novel Framework for Outdoor Mobility Assistance and Auditory Display for Visually Impaired People

Khan, Wasiq and Hussain, Abir and Khan, Bilal and Nawaz, Raheel and Baker, Thar (2020) Novel Framework for Outdoor Mobility Assistance and Auditory Display for Visually Impaired People. In: 2019 12th International Conference on Developments in eSystems Engineering (DeSE), 07 October 2019 - 10 October 2019, Kazan, Russia.

[img]
Download (336kB)

Abstract

Outdoor mobility of Visually Impaired People (VIPs) has always been challenging due to the dynamically varying scenes and environmental states. Variety of systems have been introduced to assist VIPs’ mobility that include sensor mounted canes and use of machine intelligence. However, these systems are not reliable when used to navigate the VIPs in dynamically changing environments. The associated challenges are the robust sensing and avoiding diverse types of obstacles, dynamically modelling the changing environmental states (e.g. moving objects, road-works), and effective communication to interpret the environmental states and hazards. In this paper, we propose an intelligent wearable auditory display framework that will process real-time video and multi-sensor data streams to: a) identify the type of obstacles, b) recognize the surrounding scene/objects and corresponding attributes (e.g. geometry, size, shape, distance from user), c) automatically generate the descriptive information about the recognized obstacle/objects and attributes, d) produce accurate, precise and reliable spatial information and corresponding instructions in audio-visual form to assist and navigate VIPs safely with or without the assistance of traditional means.

Impact and Reach

Statistics

Downloads
Activity Overview
32Downloads
52Hits

Additional statistics for this dataset are available via IRStats2.

Altmetric

Actions (login required)

Edit Item Edit Item