Integrated Assistive System for Precise Indoor Navigation, Object Recognition, and Interaction for Visually Impaired Individuals

Abstract

Indoor navigation poses significant challenges for those with visual impairments. To address this, an integrated system is proposed, aiming to empower visually impaired individuals by enhancing their indoor navigation and object recognition capabilities, ultimately promoting independence and safety. This innovative system amalgamates cutting-edge technologies such as IoT, deep learning, and machine learning. It incorporates IoT for real-time object detection, precise distance estimation, and collision avoidance features, ensuring users are well-informed about their surroundings. Moreover, the system employs a Wi-Fi-based indoor positioning system, combining machine learning algorithms and triangulation techniques to provide accurate indoor localization data, a critical component for effective navigation. To further enhance user experience, an audio assistant integrated into a mobile application leverages machine learning. This assistant delivers real-time guidance, object descriptions, and contextual information, enabling users to interact naturally with the system. This comprehensive research paper thoroughly explores the system's components, the underlying technologies that power it, and the results of comprehensive evaluations. It holds the promise of significantly improving the indoor navigation experience and quality of life for individuals with visual impairments.

Country : Sri Lanka

1 Lakmal Rupasinghe2 Chethana Liyanapathirana3 Caldera H.P.Y.R4 Herath H.M.T.Y5 Dharmarathna T.O.M6 Heshan T.H.C

  1. Assistant Professor, Faculty of Computing, Computer Systems Engineering, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  2. Lecturer, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  3. Undergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  4. Undergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  5. Undergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  6. Undergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka

IRJIET, Volume 7, Issue 10, October 2023 pp. 177-184

doi.org/10.47001/IRJIET/2023.710023

References

  1. Siddharth Sagar Nijhawan; Aditi Kumar; Shubham Bhardwaj; Geeta Nijhawan “Real-time Object Detection for Visually Impaired with Optimal Combination of Scores”.
  2. Amlan Basu; KeeratiKaewrak; Lykourgos Petropoulakis; Gaetano Di Caterina; John J. Soraghan “Indoor Home Scene Recognition through Instance Segmentation Using a Combination of Neural Networks”.
  3. Behnaz Bahmei; Elina Birmingham; Siamak Arzanpour “CNN-RNN and Data Augmentation Using Deep Convolutional Generative Adversarial Network for Environmental Sound Classification”Bahl, P., & Padmanabhan, V. N. (2000). RADAR: An In-Building RF-based User Location and Tracking System. Proceedings IEEE INFOCOM 2000. doi:10.1109/infcom.2000.832252.
  4. Hightower, J., & Borriello, G. (2001). Location Systems for Ubiquitous Computing. Computer, 34(8), 57-66. doi:10.1109/2.940014.
  5. Ashraf, I., Hur, S., & Park, Y. (2018). BLocate: A building identification scheme in GPS denied environments using smartphone sensors. Gyeongbuk: Yeungnam University.
  6. Ashraf, I., Hur, S., & Park, Y. (2019). Indoor Positioning on Disparate Commercial.
  7. Youssef, M. A., Agrawala, A., & Ullah, S. (2007). The Horus WLAN Location Determination System. International Journal of Computer Science and Network Security, 7(12), 264-271.
  8. H. Z. A. C. Ye, "An Indoor Wayfinding System Based on Geometric Features Aided Graph SLAM for the Visually Impaired," IEEE, p. 13, 2017.
  9. A.L.F.B. Xiaojing Zhanga, "Optimization-Based Collision Avoidance," p. 27, 2018.
  10. R. K. K. S. T. B. A. L. G. D. R. Hsueh-Cheng Wang, "Enabling Independent Navigation for Visually Impaired People through a Wearable Vision-Based Feedback System," p. 8.
  11. S. M. Felix, S. Kumar and A. Veeramuthu, "A Smart Personal AI Assistant for Visually," in Proceedings of the 2nd International Conference on Trends in Electronics and Informatics, 2018.