Gender Classification using Distance Classifier and Neural Network

Gender Classification using Distance Classifier and Neural Network

Ms. Sushree Silpika Pattanayak M.Tech Scholar, Dept of ECE CUTM, Bhubaneswar,Odisha, INDIA

Mr. Sujit Kumar Jena B.Tech Scholar, Dept of ECE CUTM, Bhubaneswar,Odisha, INDIA

Ms Sunita Dalai

Asst. Professor, Dept of ECE CUTM, Bhubaneswar,Odisha, INDIA

Abstract-The face recognition system with large sets of training sets for personal identification normally attains good accuracy. In this paper Gender Classification algorithm with only small training sets and it yields good results even with one image per person. This process involves four stages: Pre- processing, Feature Extraction, Feature Selection and Classification. Gender classification has become an essential task in human computer interaction (HCI). Gender classification is used in immense number of applications like passive surveillance, control in smart buildings (restricting access to certain areas based on gender) and supermarkets, gender advertising, security investigation. So far detection of gender using facial features is done by using the methods like Distance classifier and neural network. A radial basis function network is an artificial neural network that uses radial basis functions as activation functions. The output of the network is a linear combination of radial basis functions of the inputs and neuron parameters. Radial basis function networks have many uses, including function approximation, time series prediction, classification, and system control.

Keywords Feature Extraction, Feature Selection, Distance Classifier, Neural Network

1. INTRODUCTION

   Gender means the range of physical, biological, mental and behavioral characteristics which differentiates masculinity and femininity. Classification means categorization. Gender classification is a binary classification technique to classify male and female. This technique has become a most important task as it has many applications. So far the work is used to recognize the gender by visual observation but now the work is emphasized to a computer so that it can guess whether the given is a male or female.

   The general definition for gender classification is the genetic or environmental process which is used to specify an individual characteristic physically. Gender detection is one of the most interesting and challenging field in the biometrics. The recognition process can be more efficient if it is based on features that provide some information about the class to be detected. Generally it is defined as the genetic process by which the gender of an individual is determined based on their facial features [1]

   Most of these methods for gender classification are based on training processes using several samples for each person. They include Discrete Wavelet Transform. Discrete Cosine Transform Neural Networks, and Distance Classifier. Preparing multiple training image samples from different

   point of views or under different lightening conditions is usually difficult or even impossible [2]

   The difficulty we face while performing automatic gender classification is the difference in image quality, geometry and photometry. Gender classification has been studied less. Gender classification has been especially interesting for psychologists but demographic data collection are used by automatic gender classification .For classification of gender many types of methods are available appearance-based method or holistic approach, hybrid approach [7].

   To classify the facial images based on gender many techniques have been taken. This paper works out on the particular approach using Discrete Cosine Transform features are extracted then features are selected by using zigzag algorithm and Distance classifier are used to measure the distance and tells that the image belongs to which group whether belongs to male or female.

2. DISTANCE CLASSIFIER

   Fig.1 Minimum Distance Classifier

   Template matching can easily be expressed mathematically. Let x be the feature vector for the unknown input, and let m1, m2, …, mc be templates (i.e., perfect, noise- free feature vectors) for the c classes. Then the error in matching x against mk is given by ||x-mk||

   Here ||u|| is called the norm of the vector u. A minimum- error classifier computes ||x-mk|| for k = 1 to c and chooses the class for which this error is minimum. Since ||x-mk|| is also the distance from x to mk, we call this a minimum-distance classifier. Clearly, a template matching system is a minimum- distance classifier.

3. RADIAL BASIS FUNCTION

   The idea of Radial Basis Function (RBF) Networks derives from the theory of function approximation. We have already seen how Multi-Layer Perception (MLP) networks with a hidden layer of sigmoid units can learn to approximate functions. RBF

   Networks take a slightly different approach. Their main features are:

   1. They are two-layer feed-forward networks.

   2. The hidden nodes implement a set of radial basis functions (e.g. Gaussian functions).

   3. The output nodes implement linear summation functions as in an MLP.

   4. The network training is divided into two stages: first the weights from the input to hidden layer are determined, and then the weights from the hidden to output layer.

   5. The training/learning is very fast.

   6. The networks are very good at interpolation [MLP][4]

   A. Radial Basis Function Networks

   The basic architecture for a RBF is a 3-layer network, as shown in Fig. The input layer is simply a fan-out layer and does no processing. The second or hidden layer performs a non-linear mapping from the input space into a (usually) higher dimensional space in which the patterns become linearly separable.

   = exp[-[ -c ]2/ 2]

4. OVERVIEW OF THE APPROACH

   1. Gender Classification Using Distance Classifier

      INPUT IMAGE

      HISTOGRAM EQUALIZATION

      FEATURE EXTRACTION

      FEATURE SELECTION

      DISTANCE CLASSIFIER

      Fig.3 Flow Diagram of Distance Classifier method

      1. Feature Extraction

         Here we have used Discrete Cosine Transform to extract features of the input image. Like other transforms, the Discrete Cosine Transform (DCT) attempts to decorrelate the image data. After decorrelation each transform coefficient can be encoded independently without losing compression efficiency [5]

      2. The Two-Dimensional DCT

         The objective of this document is to study the efficacy of DCT on images. This necessitates the extension of ideas presented in the last section to a two-dimensional space. The 2-D DCT is a direct extension of the 1-D case [6] and the equation computes the i.jth entry of the DCT of an image

         i ji i i

         , 1

         1 1

         2+1

         2+1

         Y=wii

         2

         =0

         =0 ,

         cos

         2

         cos

         2

         (1)

         1

         C u, j = 2N

         = 0

         (2)

         1 if u > 0

         Input Layer

         Output Layer

         Hidden Layer

         Fig.2 Radial Basis Function Networks

         P=(x,y) is the x,yth element of the image represented by the matrix p. N is the size of the block that the DCT is done on. The equation calculates one entry (i,jth) of the transformed image from the pixel values of the original image matrix[6] Feature Selection

         Here we have used ZigZag algorithm for the highest coefficient selection from the feature set.

      3. Zigzag Algorithm

   The DCT coefficients with high variance are mainly located in he upper-left corner of the DCT matrix. Accordingly, we scan the DCT coefficient matrix in a zigzag manner starting from the upper-left corner and subsequently

   convert it to a one-dimensional (1-D) vector. This is similar to sorting according to importance. High importance coefficients are located in the top-left corner of the block. When a total of 16 coefficients are selected from an image, only 1st coefficient of each of 16 DCT blocks is selected. As the no. of selected coefficients increases so does the size of the feature vector. For 32 size feature vector first 2 coefficients from each DCT block are selected, and in the same manner 48, 64, 128 and 256 size feature vectors were created[8]

   the image is split into four sub-bands, namely HH1, HL1, LH1, and LL1, as shown in Figure . The HH1, HL1 and LH1 sub-bands represent the diagonal details, horizontal features and vertical structures of the image, respectively. The LL1 sub-band is the low resolution residual consisting of low frequency components and it is this sub-band which is further split at higher levels of decomposition.

   Fig. 6: The process of decomposing

   The DWT of a signal x is calculated by passing it through a series of filters. First the samples are passed through a low pass filter with impulse response g resulting in a convolution of the two heading

   k=

   y[n]=(x * g)[n]=

   x k g[n k]

   (3)

   Fig.4 ZigZag Algorithm for Feature selection

   B .Gender Classification Using RBFN

   INPUT IMAGE

   The signal is also decomposed simultaneously using a high- pass filter h. The outputs giving the detail coefficients (from the high-pass filter) and approximation coefficients (from the low-pass). It is important that the two filters are related to each other and they are known as a quadrature mirror filter. However, since half the frequencies of the signal have now been removed, half the samples can be discarded according to Nyquists rule. The filter outputs are then sub sampled by 2 (Mallat's and the common notation is the opposite, g- high pass and h- low pass):

   FEATURE EXTRACTION

   k=

   ylow[n]=

   x k g[2n k]

   (4)

   FEATURE SELECTION

   RBFN

   Fig.5 Flow Diagram of Neural Network Classifier method

   1. Feature Extraction: Here we have used 2D Discrete Wavelet Transform for the feature extraction of the given input image

   2. Discrete Wavelet Transform: A Discrete Wavelet Transform has played a significant role to reduce the dimension of an image and extract the features by decomposing an image in frequency domain into sub- bands at different scales. The DWT of an image is created as follows: In the first level of decomposition,

      This decomposition has halved the time resolution since only half of each filter output characterizes the signal. However, each output has half the frequency band of the input so the frequency resolution has been doubled.

      Approximation Coefficients Detail Coefficients

      With the sub sampling operator

      (y k)[n]=y[k n]

      The summation can be written more concisely ylow=(x *g) 2

      yhigh=(x* h) 2

      After getting the 2D Discrete Wavelet Transform of input image as the feature set, we select only the lower frequency components from the lower quadrant.

5. EXPERIMENTAL RESULTS

   1. Gender Classification using RBFN:

      For the experimental result we have executed the algorithm in MATLAB 7.9. We have used the FEI database

      [17] for the gender classification. The executed results are shown below.

      (a)

      (b)

      (a)

      (b)

      Fig. 7 Face Database (a) Female Set (b) Male Set

      Fig.10 (a) DWT of Test image (Male) (b) Classified Result

      (b)

      (a)

      (b)

      (a)

      Fig.8 (a) DWT of Test image (Female) (b) Classified Result

      Fig.11 (a) DWT of Test image (Male) (b) Classified Result

   2. Gender Classification Using Distance Classifier :

      (a)

      (b)

      Fig. 12 Face Database (a) Female Set (b) Male Set

      Fig.9 (a) DWT of Test image (Female) (b) Classified Result

      1. (b)

   (c) (d)

   Fig. 13 Classified Results

6. CONCLUSION

Gender classification becomes a real challenge in some cases of images. We have implemented the method of Distance Classifier and Neural Network Classifier for Gender Classification. Basically we have used FEI face image database. For gender classification we have tested the algorithm on 50 people both male and female. We have found around 92% results in case of neural network where as 90 % in case of distance classifier. Neural network classifier takes more time to execute as compared to distance classifier.

In future we have planned to extend the work for different network, and to have a comparative analysis among them.

REFERENCES:

1. Swathi Kalam et al., Gender Classification using Geometric Facial Features, International Journal of Computer Applications,Volume 85 No 7, January 2014, (0975 8887)

2. Dr. K. K. Bhoyar et al., A Neural Network Approach to Gender Classification using Facial Images, International Journal of Engineering Research and Applications (IJERA) ISSN, International Conference on Industrial Automation and Computing (ICIAC), 12-13th April 2014, 2248-9622

3. Sajid Ali Khan et al.,A Comparative Analysis of Gender Classification Techniques, International Journal of Bio-

   Science and Bio-Technology, Vol. 5, No. 4

4. John A. Bullinaria, Radial Basis Function Networks:

   Introduction, 2004

5. Syed Ali Khayam, The Discrete Cosine Transform (DCT):Theory and Application, Michigan State University,

6. ken cabeen and peter gent,image compression and the discrete cosine transform,math 45,college of the redwoods

7. Amjath Fareeth Basha, Face Gender Image Classification Using Various Wavelet

8. Transform and Support Vector Machine with various Kernels. IJCSI International Journal of Computer Science Issues, Vol. 9, Issue 6, 1694-0814

9. Muhammad Ishtiaq, Feature Selection for Efficient Gender Classification, National University of Computer and Emerging Science.

10. Fahim Mannan, Classification of Face Images Based on Gender using Dimensionality Reduction Techniques and SVM.

11. Prabartika Sahoo, Face Recognition Using Eigen Faces And Discrete Cosine Transform Approach

12. Ryszard S. Chora´s, Image Feature Extraction Techniques and Their Applications for CBIR and Biometrics Systems, International Journal Of Biology And Biomedical Engineering And Feature Fusion, International Journal of Optomechatronics, 2012, 6: 92119

13. Ramesha K1, Feature Extraction based Face Recognition, Gender and Age Classification, (IJCSE) International Journal on Computer Science and Engineering, Vol. 02, 2010, 14-23

14. M. Mozammel Hoque Chowdhury et al., Image Compression Using Discrete Wavelet Transform, IJCSI International Journal of Computer Science Issues, Vol. 9,

    Issue 4, No 1, July 2012

15. Omveer Singh et al., Pattern Based Gender Classification International Journal of Advanced Research in Computer Science and Software Engineering, Volume 3, Issue 10,

    October 2013

16. Baback Moghaddam Et Al., Gender Classification With Support Vector Machines, Mitsubishi Electric Research Laboratories, December 2000

17. Face Database–http://fei.edu.br/~cet/facedatabase .html