Gesture Recognition using Convex Hull and Hull Defects Method to Control Electronic Appliances in Home

Gesture Recognition using Convex Hull and Hull Defects Method to Control Electronic Appliances in Home

Raswitha Bandi1, K.Anurag2, K.Siva teja 3, M.Snehith 4, R.Varun5

1Assistant Professor, 2,3,4,5 UG Scholar,

Department of Information Technology, VNR Vignan Jyothi Institute of Engineering and Technology, Hyderabad, India

Abstract:An essential objective of gesture recognition is to make a framework that can recognize explicit human motions and use them for control. In this paper, we use Interface with PCs utilizing gestures of the human body, and hand movements. In Gesture recognition innovation, a camera peruses the developments of the human body and conveys the information to a PC that utilizes the motions as a contribution to control appliances. for easy communication daily in our lives, we use physical gestures. A bunch of actual motions may establish a whole language, as in gesture-based communications. The goal of this paper is to classify images of different hand gestures, such as a one, two, three, and others. So that if we show any of the gesture it can control electronic devices like turning them on and off. For example we can allot one to fan, two to light and so on. The method well be using is hull convex and hull defects . In this paper, we'll be planning to order various pictures of hand motions, which implies that the system should "learn" the highlights of each motion and group them accurately. For example, if it is given an image of a hand showing one finger, the output of the model needs to be one So if we can classify different gestures we can then connect it to hardware to control the home appliances.

Keywords- Machine Learning, gesture recognition, Internet of Things.

1. INTRODUCTION

   There has been growing interest in development of new techniques and methods for Human Computer Interaction (HCI). Hand Gesture Recognition is one of the important areas of this technology. Gesture Recognition means interfacing with computer using motion of human body typically hand movements [1].

   As a Handicapped or old person cannot move easily and quickly to control the various electrical devices in the house or the person is unaware of controlling devices but the same task can be done easily with hand gesture recognition.

   CAUSES:

   dimensional frame in order to display an image. These pixels exhibits different colors with three primary colors known as RGB where R stands for Red, G stands for Green, B stands for Blue. Each of the three colors has 256 different intensities ranging from 0 to 255. For example, [ 0, 0, 255] indicates Green with high intensity. We can also get different colors by mixing with varying intensities of the three colors RGB in different combinations. For example, [255,255,0] indicates yellow color with high intensity. As two- dimensional array of RGB represents an image we can perform Relational and logical operations on each pixel [3].

   There are various reasons for a person to be not using various devices properly. These include the following main reasons in our daily routine.As a person is handicapped, he cannot move fast enough to control it. Lack of Knowledge of using it.As people get older, they may forget about how to use it.

   EFFECTS:

   Damage to devices Prone to accidents Loss of life Causalities Purpose:

   There are many instances where handicapped person has to depend on others even for their household works. They are unable to live the life by themselves. According to a report taken in 2018, over all 2.21% of Indian population has one or other kind of disability. This means 26.8 million people in India are disabled. These many people are always had to depend on others [2].

   This paper deals with how to control various devices using hand gestures. This problem was implemented in different ways such as neural networks, Open CV. In this we deal with Open CV in recognition of hand gesture. So, we recognize the hand gestures and control various devices according to it. The main task is to make the life of handicapped person easier.

2. LITERATURE SURVEY

In this chapter we discuss about various research papers which were referred while implementing this. Let us understand more about image processing techniques in detail.First, we need to know how an image is stored in digital format. In this digital world every bit of information is stored in 0s and 1s. It is same for image as well where every image is displayed with the help of pixels. Each pixel can represent 16,777,216 colors. These pixels form a two- There are different methods by which we can detect hand gesture.

• Glove-based analysis

• Vision-based analysis

  1. CNN

  2. Open CV

     Glove-based analysis:

     The glove-based approach employs sensors (mechanical or optical) attached to a glove that acts as transducer of finger flexion into electrical signals to determine hand posture Vision-based analysis:

     Vision based system has three main steps, namely, image capture, threshold application, and number recognition. By using Open CV we do vision- based analysis

     Open CV:

     Open CV (Open Source Computer Vision) is a library of programming functions mainly aimed at real-time computer vision. In simple language it is library used for Image Processing. It is mainly used to do all the operation related to Images.

     Convolution neural network (CNN):

     Convolution Neural Network (CNN) is a deep learning network used for classifying images. The basic premise behind CNN is using predefined convolving filters to identify patterns in image edges, parts of objects and the build on to this knowledge to detect complete objects like animals, human being, automobiles etc.

     2.1 PROPOSED SYSTEM

     In this proposed system we control various electrical devices by hand gestures using image processing techniques. The approach holds various stages of image processing with the help of Open CV python. The results will control electrical equipment with help of hand gestures [4].

     There are various steps used in image processing which include:

     Finding contours

     Morphological transformation

     HSV Conversion

     Convex Hull

     Obtain Region of Interest (ROI)

     We have different parameters that have to calculate for recognizing hand gestures properly. Some of parameters that calculated are:

     Calculating the area of figure formed by joining corners of given gesture

     Calculating the area of figure formed by image noises

     Calculating the height and angles in figure formed by joining corners of given gesture [5].

     The step in Outcome:

     Controls electrical devices Advantages:

     No physical contact is required between individual and gesture-recognition enabled device

     Various devices can be controlled using simple hand gestures

     Controlling devices using hand gestures makes life of handicapped easier

• In pandemic situation like covid-19 people are feared to touch devices which are used by someone. This system helps to control devices without even touching it.

Objective:

The main objective of this project is to control various devices by recognition of hand gestures with reasonable accuracy and makes the life of handicapped person easier.

The results include various gestures given by hand and they are tested out. It implies different hand gestures are properly used for different controls in a device.

1. DATA FLOW DIAGRAM FOR ACTION RECOGNITION FOR CONTROLLING ELECTRONIC

APPLIANCES IN HOME: