A WEARABLE FACIAL RECOGNITION DEVICE FOR THE VISUALLY IMPAIRED

Authors
  • Ubochi, B. C

    Federal University of Technology Akure, Ondo State, Nigeria

  • Olawumi, A. E.,

    Yokohama National University, Yokohama, Japan

  • Shuiabu, A. O.

    Federal University of Technology Akure, Ondo State, Nigeria

  • Akingbade, K. F

    The Federal University of Technology Akure, Ondo State, Nigeria

Keywords:
Real-time face recognition,, open CV, deep (Metric) learning, machine learning, wearable device
Abstract

 

 

Among other challenges, the visually impaired face problems related to a real-time human facial identification and recognition. In this paper, the design of a wearable real-time facial recognition device is presented. The system uses an acquired video feed that is processed to identify and recognize a face in the feed. An accurate face identification of a selected video frame was achieved using the Haar cascade algorithm. The system performs a similarity test using the cosine similarity function by which the system compares a detected face to the other faces saved in the database, and then proceeds to recognize the face in the video feed. Subsequently, an audio output of a name of the identified person is generated. The experiments performed with the head-mounted wearable system show that it can function effectively within a wide illumination level (11 lux to 1039 lux) but fails to detect a face in the image for distances greater than 90cm. Additionally, the recognition rate for both known faces and labelled faces in the wild obtained at different times of the day showed the highest recognition rate in the afternoon of 88% and 90%, respectively and the lowest recognition rate at night of 58% and 66%, respectively.

 

 

Author Biographies
  1. Ubochi, B. C, Federal University of Technology Akure, Ondo State, Nigeria

    Department of Electrical and Electronics Engineering

  2. Olawumi, A. E., , Yokohama National University, Yokohama, Japan

    Department of Mathematics, Physics, Electrical Engineering and Computer Science

  3. Shuiabu, A. O. , Federal University of Technology Akure, Ondo State, Nigeria

    Department of Computer Engineering,

  4. Akingbade, K. F, The Federal University of Technology Akure, Ondo State, Nigeria

    Department of Information and Communication Technology

References

Adjabi, I., Quahabi, A., Benzaoui, A. and Taleb-Ahmed, A. (2020) Past, present, and future of face recognition: A Review. Electronics, 9 (8), 1-52.

Akinsiku, M., Ubochi, B. and Apena, W. (2020). Smart Walking Stick for the Blind with Text Image Recognition. Journal of Electrical Engineering, Electronics, Control and Computer Science, 6(22), 17–22.

Francis, G. A., Karthigaikumar, P. and Kumar, G. A. (2020). Face Recognition System for Visually Impaired People. Journal of Critical Reviews, 7 (17), 2760-2764.

Bai, J., Liu, D., Su, G., and Fu, Z. (2017). A Cloud and Vision-Based Navigation System Used for Blind People. Proceedings of the 2017 International Conference on Artificial Intelligence, Automation and Control Technologies, 1-6.

Chaithra, P. and Vadiraja A. (2015). I Recognise U Raspberry Pi based Wearable Face Recognition Device with Image Tagging Facility for Blind. International Journal Of Engineering Research & Technology (IJERT) NCRTS, 3(27), 1-5.

Sinhal K. (2017). ResNet, AlexNet, VGGNet, Inception: Understanding various architectures of Convolutional Networks. https://cv-tricks.com/cnn/understand-resnet-alexnet-vgg-inception/

Gamage, B., Do, T-T.,Price, N. S. C., Lowery, A., and Marriott, K. (2023). What do Blind and Low Vision People Really Want from Assistive Smart Devices? Comparison of the Literature with a Focus Study. Proceedings of the 25th International ACM SIGAACCESS Conference on Computers and Accessibility, 30, 1-21.

Jafri, R. and Ali, S. A. (2014). Exploring the Potential of Eyewear-Based Wearable Display Devices for Use by the Visually Impaired. 2014 3rd International Conference on User Science and Engineering (i-USEr), 119-124.

Jin, Y., Kim, J., Kim, B., Mallipeddi, R., and Lee, M. (2015). Smart Cane: Face Recognition System for Blind. Proceedings of the 3rd International Conference on Human-Agent Interaction, 145–148.

Kaya, M., and Bilge, H. ?. (2019). Deep Metric Learning: A Survey. Symmetry, 11(9), 1066.

Koul, A., Ganju, S., and Kasam, M. (2019). Practical Deep Learning for Cloud, Mobile, and Edge: Real-World AI & Computer-Vision Projects Using Python, Keras & TensorFlow (Ist). O’Reilly Media, 679-680.

Krishna, S., Little, G., Black, J., and Panchanathan, S. (2005). A Wearable Face Recognition System for Individuals with Visual Impairments. Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility, 106–113.

Kuriakose, B., Shrestha, R., and Sandnes, F. E. (2022). Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review. IETE Technical Review, 39 (1), 3-18.

Lapyko, A., Tung, L.-P., and Lin, B.-S. (2014). A cloud-based outdoor assistive navigation system for the blind and visually impaired. 2014 7th IFIP Wireless and Mobile Networking Conference, WMNC 2014, 1–8.

Mohana C., Ayush J. and Harsh J. (2018). Real Time Object Detection and Tracking Using Deep Learning and OpenCV. The 2013 International Conference on Information and Knowledge Engineering (IKE ’13), 1305–1308.

World Health Organization. (2020). WHO Facts Sheet 2020 on Blindness and vision impairment. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment

Owayjan, M., Hayek, A., Nassrallah, H., and Eldor, M. (2015). Smart Assistive Navigation System for Blind and Visually Impaired Individuals. 2015 International Conference on Advances in Biomedical Engineering (ICABME).

Patil, K., Jawadwala, Q., and Shu, F. C. (2018). Design and Construction of Electronic Aid for Visually Impaired People. IEEE Transactions on Human-Machine Systems, 48(2), 172–182.

Pissaloux, E., Velázquez, R., and Maingreaud, F. (2017). A New Framework for Cognitive Mobility of Visually Impaired Users in Using Tactile Device. IEEE Transactions on Human-Machine Systems, PP, 47 (6), 1040-1051.

Rahmad, C., Asmara, R. A., Putra, D. R. H., Dharma, I., Darmono, H., and Muhiqqin, I. (2020). Comparison of Viola-Jones Haar Cascade Classifier and Histogram of Oriented Gradients (HOG) for face detection. IOP Conference Series: Materials Science and Engineering, 732(1), 12038.

Schroff, F., Kalenichenko, D., and Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 7, 815–823.

Szegedy, C., Toshev, A., and Erhan, D. (2013). Deep Neural Networks for Object Detection. In Advances in Neural Information Processing Systems 26. Curran Associates, 2553-2561.

Utsumi, Y., Kato, Y., Kunze, K., Iwamura, M., and Kise, K. (2013). Who are you? - A wearable face recognition system to support human memory. 4th Augmented Human International Conference, AH 2013, 150–153.

Wheeler, F.W, Liu, X. and Tu P. H. (2011). Face Recognition at a Distance in Handbook of Face Recognition. Springer London, 353-381.

Wójcik, W., Gromaszek, K., and Junisbekov, M. (2016). Face Recognition: Issues, Methods and Alternative Applications, Face Recognition- Semisupervised Supervised Classification Subspace Projection and Evaluation Methods, 7-28.

Yi, Y., and Dong, L. (2015). A design of blind-guide crutch based on multi-sensors. Proceedings of the 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), 2288–2292.

Yustiawati, R., Husni, N. L., Evelina, E., Rasyad, S., Lutfi, I., Silvia, A., Alfarizal, N., and Rialita, A. (2019). Analyzing of Different Features Using Haar Cascade Classifier. Proceedings of 2018 International Conference on Electrical Engineering and Computer Science, ICECOS 2018, 129–134.

Zhang, P., Zhao, F., Liu, P., and Li, M. (2022). Efficient Lightweight Attention Network for Face Recognition. IEEE Access, 10, 31740-31750.

Zhao, Y., Wu, S., Reynolds, L., and Azenkot, S. (2018). A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–14.

Cover Image
Downloads
Published
2024-05-20
Section
Articles
License

Copyright (c) 2024 FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Copyright

With the submission of a manuscript, the corresponding author confirms that the manuscript is not under consideration by another journal. With the acceptance of a manuscript, the Journal reserves the exclusive right of publication and dissemination of the information contained in the article. The veracity of the paper and all the claims therein is solely the opinion of the authors not the journal.

How to Cite

A WEARABLE FACIAL RECOGNITION DEVICE FOR THE VISUALLY IMPAIRED. (2024). FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY, 18(1). https://doi.org/10.51459/futajeet.2024.18.1.514

Similar Articles

1-10 of 95

You may also start an advanced similarity search for this article.