Testing Our Models

By -

Testing our Blink Detection models

We test the blink model (The differences method) and eye model ( Classifier) with multiple test cases. With respect to the blink model, we test our model with images of:
• Different eye colours
• Different sizes

The first method of finding differences works well with all the above cases as differences are noticed irrespective of the above conditions. The threshold values for the number of white pixels have to be changed for different types.
Colored eye bw binary image.

 In the second method of training a classifier, we initially have a test data set of only images of a particular eye colour and size.
 Results with only one type of image in dataset

This model gives us great results for different test cases of similar size and colour. The confusion matrix for this along with average accuracy for each run is displayed. Each run picks a random set of training and test data as mentioned previously. This reduces bias and overfitting. Taking the average of the runs, we get an accuracy of about 0.92. This works surprisingly well with images of different eye colours as well. 36/40 frames were classified correctly in the first run and 35/40 in the second run. When we feed in images of smaller eyes, 13 out of 30 were detected correctly in the first run and 16 out of 30 in the second run. This gives us a terrible accuracy and the model isn’t very reliable. After adding images of smaller eyes to our dataset, we get better results as displayed.Two runs are displayed in the image.
 Results with small eye type of image added dataset

With multiple runs, we get an average accuracy of 0.82. On adding images of different colours to the dataset too, we get an average accuracy of 0.80.

 Results with all eye types of image added dataset

Graphical Illustration of the differences in accuracy with additions to dataset 



Comments

Post a Comment

Popular posts from this blog

Yawn Detection

By -
Image
Yawn Detection using image processing We add a yawn detector to our system to provide a more complete evaluation process to detect sleepiness. Before we detect yawns, we need to detect the mouth region. To detect the mouth, we use 2 approaches: 1. Use the viola Jones algorithm as we did for the face and eye. This method can be used to detect the mouth but fails to detect yawns. 2.  Find the mouth area based on the colour of the lip. Segment out the red area as the mouth. extract the red plane and subtract it with the gray scale/blue plane/green plane image to get high-intensity values only around the lip region. This can then be labeled as the lip. Figure 6 shows how this works. The red Channel is subtracted with the green Channel in this case to localize the lip. This method doesn’t work unless there is such a drastic change. The other method we’ve used to detect yawns is to train a classifier: This is similar to training a classifier to classify blink. We use the sam...
Read more

Eye Detection

By -
Image
The next step in the workflow is Eye detection. CODE:     ed = vision.CascadeObjectDetector('EyePairBig');     BoundBox=step(ed,J);     figure,imshow(J);     for i = 1:size(BoundBox,1)         aaa = rectangle('Position',BoundBox(i,:),'LineWidth',4,'LineStyle','-','EdgeColor','r');     end      %Crop out eye area     for i = 1:size(BoundBox,1)         J= imcrop(J,BoundBox(i,:))         figure(3),subplot(2,2,i);imshow(J);     end    
Read more

Training a Classifier

By -
Using an SVM Classifier to detect sleepiness: This algorithm works primarily on the principle that if the person has kept his eyes closed for too long the driver is detected to be sleepy. After extracting each frame from a video, we manually classify each image as open or closed eye. We then separate our dataset of images into training and test data - with 30 percent being training-data and the rest 60 percent being test-data. We do this split randomly. This makes our training and test data different each time we run the program. Using SVM Classifier, we generate a model based on a bag of features. We find the accuracy of the model using confusion matrices. The next step is to feed the video and to get labels as open or closed  for each new frame. Whether the eyes are open or closed in each frame. We keep track of how long the eyes have been closed continuously by resetting a count variable (that counts the elapsed time ) each time the eye opens. If the count is beyond a certain...
Read more