A STATIC HAND GESTURE AND FACE RECOGNITION

SYSTEM FOR BLIND PEOPLE

ABSTRACT

This project presents a recognition system, which can be helpful for a blind person. Hand
using which various tasks can be performed. Dynamic images are being taken from a
dynamic video and is being processed according to certain algorithms. In the Hand gesture
system Skin color detection has been done in YCbCr color space and to discover hand
convex defect character point of hand is used where different features like fingertips, angle
between fingers are being extracted. According to gesture Recognized, various tasks can be
performed like turning on the fan or lights. While in face recognition, Haar Cascade
Classifiers and LBPH recognizer are being used for face detection and recognition
respectively.

PROPOSED SYSTEM
The input is taken from front facing Camera.

The proposed Recognition System is divided into two parts –

• Hand Gesture Recognition

• Facial Recognition
Figure 1: Proposed System Architecture for Hand Gesture Recognition
 Figure 2: Proposed System Architecture for Face Recognition

LBP, abbreviation for Local Binary Pattern, is the measure of fixed grey scale texture
obtained by thresholding the nearby area of each pixel and the result obtained is considered
as a binary number. The LBP operator is the ratios of the pixel intensities of the center and
the surrounding pixels and can be computed using the equation

LBP uses the following steps to identify the face

• Firstly, the image is converted to grayscale.

• Section of the image is obtained through 3*3 window.

• Central value of matrix used as threshold, which is used to define new values of other eight
neighbours.

• New value calculated is either 1 or 0 for values higher or lower than threshold respectively
and the concatenation of the Binary values is done.

• Conversion of Binary to Decimal is done in order to get the pixel from the original image.

• Histogram using the GridX and GridY parameters, which is the number of cells in
horizontal and vertical direction, is created which divides the image into multiple grids.
References

[1] Srinivas Ganapathyraju, “Hand Gesture Recognition Using Convexity Hull Defects to
Control an Industrial Robot” , 2013 3rd International Conference on Instrumentation Control
and Automation (ICA) Bali, Indonesia, pp. 63-67, 2013.

[2] Voila P, Jones M J. Rapid object detection using a boosted cascade of simple features
[C], Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and
Pattern Recognition (ICCVPR 2001), vol. 1, pp. I-511-I-518, 8-14 Dec. 2001, Kauai, USA.

[3] Kelvin Salton do Prado, “Face recognition: Understanding LBPH Algorithm”, 2017,
Towards Data Science. [Online]. Available : https://towardsdatascience.com/face-
recognition-how-lbph-works90ec258c3d6b. . [Accessed : 7th January 2018]

[4] Hsiang-Yueh. Lai, Han-Jheng. Lai, "Real-time dynamic hand gesture recognition", 2014
International Symposium on Computer Consumer and Control (IS3C, pp. 658-661, June
2014.

[5] Muh. Arif Rahman, , I Ketut Edy Purnama, Mauridhi Hery Purnomo,” Simple Method of
Human Skin Detection using HSV and YCbCr Color Spaces”, 2014 International Conference
on Intelligent Autonomous Agents, Networks and Systems Bandung, Indonesia, August 19-
21, 2014.

[6] Hanene Elleuch, Ali Wali, Anis Samet, Adel M. Alimi, “A static hand gesture
recognition system for real time mobile device monitoring”, 2015 15th International
Conference on Intelligent Systems Design and Applications (ISDA), pp. 195 – 200, 2015.

[7] Gaganpreet Singh, , “Training Haar Cascade”, 2012. [Online]. Available

:https://singhgaganpreet.wordpress.com/2012/10/14/traininghaar cascade/. [Accessed : 5th
January 2018].

[8] Sander Soo, “Object detection using Haar-cascade Classifier”, Institute of Computer
Science, University of Tartu.

[9] L. Cuimei, Q. Zhiliang, J. Nan, W. Jianhua, "Human face detection algorithm via Haar
cascade classifier combined with three additional classifiers", 2017 13th IEEE Int. Conf.
Electron. Meas. Instruments, pp. 483-487, 2017.
[10] Aftab Ahmed, Jiandong Guo, Fayaz Ali, Farha Deeba, Awais Ahmed, “LBPH Based
Improved Face Recognition At Low Resolution”, 2018 International Conference on Arifticial
Intelligence and Big data, pp. 144147, May 2018.

[11] XueMei Zhao, ChengBing Wei, A Real-time Face Recognition System Based on the
Improved LBPH Algorithm, 2017 IEEE 2nd International Conference on Signal and Image
Processing, pp. 72-76, 2017

[12] Hongshuai Zhang, Zhiyi Qu Liping, Yuan GangLi, A Face Recognition Method Based
on LBP Feature for CNN, 2017 IEEE 2nd Advanced Information Technology, Electronic and
Automation Control Conference (IAEAC), pp. 544-547, 2017.