A WEARABLE FACIAL RECOGNITION DEVICE FOR THE VISUALLY IMPAIRED
- Authors
-
-
Ubochi, B. C
Federal University of Technology Akure, Ondo State, Nigeria
-
Olawumi, A. E.,
Yokohama National University, Yokohama, Japan
-
Shuiabu, A. O.
Federal University of Technology Akure, Ondo State, Nigeria
-
Akingbade, K. F
The Federal University of Technology Akure, Ondo State, Nigeria
-
- Keywords:
- Real-time face recognition,, open CV, deep (Metric) learning, machine learning, wearable device
- Abstract
-
Among other challenges, the visually impaired face problems related to a real-time human facial identification and recognition. In this paper, the design of a wearable real-time facial recognition device is presented. The system uses an acquired video feed that is processed to identify and recognize a face in the feed. An accurate face identification of a selected video frame was achieved using the Haar cascade algorithm. The system performs a similarity test using the cosine similarity function by which the system compares a detected face to the other faces saved in the database, and then proceeds to recognize the face in the video feed. Subsequently, an audio output of a name of the identified person is generated. The experiments performed with the head-mounted wearable system show that it can function effectively within a wide illumination level (11 lux to 1039 lux) but fails to detect a face in the image for distances greater than 90cm. Additionally, the recognition rate for both known faces and labelled faces in the wild obtained at different times of the day showed the highest recognition rate in the afternoon of 88% and 90%, respectively and the lowest recognition rate at night of 58% and 66%, respectively.
- Author Biographies
- References
-
Adjabi, I., Quahabi, A., Benzaoui, A. and Taleb-Ahmed, A. (2020) Past, present, and future of face recognition: A Review. Electronics, 9 (8), 1-52.
Akinsiku, M., Ubochi, B. and Apena, W. (2020). Smart Walking Stick for the Blind with Text Image Recognition. Journal of Electrical Engineering, Electronics, Control and Computer Science, 6(22), 17–22.
Francis, G. A., Karthigaikumar, P. and Kumar, G. A. (2020). Face Recognition System for Visually Impaired People. Journal of Critical Reviews, 7 (17), 2760-2764.
Bai, J., Liu, D., Su, G., and Fu, Z. (2017). A Cloud and Vision-Based Navigation System Used for Blind People. Proceedings of the 2017 International Conference on Artificial Intelligence, Automation and Control Technologies, 1-6.
Chaithra, P. and Vadiraja A. (2015). I Recognise U Raspberry Pi based Wearable Face Recognition Device with Image Tagging Facility for Blind. International Journal Of Engineering Research & Technology (IJERT) NCRTS, 3(27), 1-5.
Sinhal K. (2017). ResNet, AlexNet, VGGNet, Inception: Understanding various architectures of Convolutional Networks. https://cv-tricks.com/cnn/understand-resnet-alexnet-vgg-inception/
Gamage, B., Do, T-T.,Price, N. S. C., Lowery, A., and Marriott, K. (2023). What do Blind and Low Vision People Really Want from Assistive Smart Devices? Comparison of the Literature with a Focus Study. Proceedings of the 25th International ACM SIGAACCESS Conference on Computers and Accessibility, 30, 1-21.
Jafri, R. and Ali, S. A. (2014). Exploring the Potential of Eyewear-Based Wearable Display Devices for Use by the Visually Impaired. 2014 3rd International Conference on User Science and Engineering (i-USEr), 119-124.
Jin, Y., Kim, J., Kim, B., Mallipeddi, R., and Lee, M. (2015). Smart Cane: Face Recognition System for Blind. Proceedings of the 3rd International Conference on Human-Agent Interaction, 145–148.
Kaya, M., and Bilge, H. ?. (2019). Deep Metric Learning: A Survey. Symmetry, 11(9), 1066.
Koul, A., Ganju, S., and Kasam, M. (2019). Practical Deep Learning for Cloud, Mobile, and Edge: Real-World AI & Computer-Vision Projects Using Python, Keras & TensorFlow (Ist). O’Reilly Media, 679-680.
Krishna, S., Little, G., Black, J., and Panchanathan, S. (2005). A Wearable Face Recognition System for Individuals with Visual Impairments. Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility, 106–113.
Kuriakose, B., Shrestha, R., and Sandnes, F. E. (2022). Tools and Technologies for Blind and Visually Impaired Navigation Support: A Review. IETE Technical Review, 39 (1), 3-18.
Lapyko, A., Tung, L.-P., and Lin, B.-S. (2014). A cloud-based outdoor assistive navigation system for the blind and visually impaired. 2014 7th IFIP Wireless and Mobile Networking Conference, WMNC 2014, 1–8.
Mohana C., Ayush J. and Harsh J. (2018). Real Time Object Detection and Tracking Using Deep Learning and OpenCV. The 2013 International Conference on Information and Knowledge Engineering (IKE ’13), 1305–1308.
World Health Organization. (2020). WHO Facts Sheet 2020 on Blindness and vision impairment. https://www.who.int/news-room/fact-sheets/detail/blindness-and-visual-impairment
Owayjan, M., Hayek, A., Nassrallah, H., and Eldor, M. (2015). Smart Assistive Navigation System for Blind and Visually Impaired Individuals. 2015 International Conference on Advances in Biomedical Engineering (ICABME).
Patil, K., Jawadwala, Q., and Shu, F. C. (2018). Design and Construction of Electronic Aid for Visually Impaired People. IEEE Transactions on Human-Machine Systems, 48(2), 172–182.
Pissaloux, E., Velázquez, R., and Maingreaud, F. (2017). A New Framework for Cognitive Mobility of Visually Impaired Users in Using Tactile Device. IEEE Transactions on Human-Machine Systems, PP, 47 (6), 1040-1051.
Rahmad, C., Asmara, R. A., Putra, D. R. H., Dharma, I., Darmono, H., and Muhiqqin, I. (2020). Comparison of Viola-Jones Haar Cascade Classifier and Histogram of Oriented Gradients (HOG) for face detection. IOP Conference Series: Materials Science and Engineering, 732(1), 12038.
Schroff, F., Kalenichenko, D., and Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 7, 815–823.
Szegedy, C., Toshev, A., and Erhan, D. (2013). Deep Neural Networks for Object Detection. In Advances in Neural Information Processing Systems 26. Curran Associates, 2553-2561.
Utsumi, Y., Kato, Y., Kunze, K., Iwamura, M., and Kise, K. (2013). Who are you? - A wearable face recognition system to support human memory. 4th Augmented Human International Conference, AH 2013, 150–153.
Wheeler, F.W, Liu, X. and Tu P. H. (2011). Face Recognition at a Distance in Handbook of Face Recognition. Springer London, 353-381.
Wójcik, W., Gromaszek, K., and Junisbekov, M. (2016). Face Recognition: Issues, Methods and Alternative Applications, Face Recognition- Semisupervised Supervised Classification Subspace Projection and Evaluation Methods, 7-28.
Yi, Y., and Dong, L. (2015). A design of blind-guide crutch based on multi-sensors. Proceedings of the 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), 2288–2292.
Yustiawati, R., Husni, N. L., Evelina, E., Rasyad, S., Lutfi, I., Silvia, A., Alfarizal, N., and Rialita, A. (2019). Analyzing of Different Features Using Haar Cascade Classifier. Proceedings of 2018 International Conference on Electrical Engineering and Computer Science, ICECOS 2018, 129–134.
Zhang, P., Zhao, F., Liu, P., and Li, M. (2022). Efficient Lightweight Attention Network for Face Recognition. IEEE Access, 10, 31740-31750.
Zhao, Y., Wu, S., Reynolds, L., and Azenkot, S. (2018). A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–14.
- Downloads
- Published
- 2024-05-20
- Section
- Articles
- License
-
Copyright (c) 2024 FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright
With the submission of a manuscript, the corresponding author confirms that the manuscript is not under consideration by another journal. With the acceptance of a manuscript, the Journal reserves the exclusive right of publication and dissemination of the information contained in the article. The veracity of the paper and all the claims therein is solely the opinion of the authors not the journal.
How to Cite
Similar Articles
- S. O. Balogun, S. A. Yaro, M. Abdulwahab, A. Kasim, PRODUCTION AND CHARACTERIZATION OF ALUMINA NANOPARTICLES FROM GIRO CLAY VIA ACID LEACHING WITH SOL GEL METHOD , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 15 No. 1 (2021): FUTA Journal of Engineering and Engineering Technology
- Olufemi Adeyemi Adetola, M. J. Odu, THE DEVELOPMENT OF A HAND-PUSH WEEDER FOR CUTTING WEEDS , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 15 No. 2 (2021): FUTA Journal of Engineering and Engineering Technology
- Oji, I. C., Ale, T. O, Odeyemi, C. S, MODELLING AND SIMULATION OF FAULTS AND FAULT LOCATION DETECTOR FOR RADIAL DISTRIBUTION SYSTEM , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 19 No. 1 (2025): FUTA Journal of Engineering and Engineering Technology
- J J POPOOLA, TECHNICAL AND ECONOMICAL CAMPAIGNS FOR OPPORTUNISTIC RADIO SPECTRUM ACCESS FOR EFFICIENT RADIO SPECTRUM UTILIZATION AND NATIONAL DEVELOPMENT , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 12 No. 1 (2018): FUTA Journal of Engineering and Engineering Technology
- Ochuko Mary Ojo, J O Babatola, A A Adesina, A O Akinola, Olurinde Lafe, SYNERGISTIC EFFECT OF CO-DIGESTING DIFFERENT MIX RATIOS OF WATER HYACINTH AND COW-DUNG FOR BIOGAS PRODUCTION. , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 12 No. 1 (2018): FUTA Journal of Engineering and Engineering Technology
- Arowojolu, E.O, Oniyide, G.O, AN ECONOMIC COMPARATIVE ANALYSIS OF EQUIPMENT OUTSOURCING AND OUTRIGHT PURCHASE FOR QUARRYING OPERATIONS AT FOUNTAIN COMPANY, AKURE, ONDO STATE , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 19 No. 1 (2025): FUTA Journal of Engineering and Engineering Technology
- C. N. Udekwe, A. A. Ponnle, A. O. Omolade, EXPERIMENTAL STUDY ON THE SYNERGISTIC EFFECTS OF COOLING METHODS AND HEAT SINK DESIGN ON THERMOELECTRIC GENERATOR PERFORMANCE , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 20 No. Special (2026): FUTA JEET: Special Issue on Innovative Solutions for Sustainable Living and Environmental Challenges: Engineering Perspectives
- Ijagbemi, C.O, Olabanji, O. M, Ashiru, A.R, Abdulmumuni, B, IJagbemi F.M, DEVELOPMENT OF ETHANOL GEL COOK STOVE , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 19 No. 1 (2025): FUTA Journal of Engineering and Engineering Technology
- A Amoko, S JUSTINAH, A Fehintola, O Ezekiel, I Oke, A Isaiah, EVALUATION OF EFFECTS OF SELECTED FACTORS ON ADSORPTION KINETICS OF LEAD ION REMOVAL FROM AQUEOUS SOLUTIONS , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 12 No. 2 (2018): FUTA Journal of Engineering and Engineering Technology
- W. O. Apena, K. F. Akingbade, Modelling of Electric Power Subsystem for a Weather Balloon Microsatellite , FUTA JOURNAL OF ENGINEERING AND ENGINEERING TECHNOLOGY: Vol. 11 No. 1 (2017): FUTA Journal of Engineering and Engineering Technology
You may also start an advanced similarity search for this article.
