17-06-2014, 04:48 PM
A VISION BASED APPLICATION FOR VIRTUAL MOUSE INTERFACE USING FINGER TIP
1386614271-synospsismousesimulation241013.ppt (Size: 762.5 KB / Downloads: 15)
Project objective
The objective is to manage computers and other devices with gestures rather than pointing and clicking a mouse or touching a display directly
Problem Statement
To design vision based mouse which detects hand gestures patterns instead of physical mouse.
Basically we use detection of finger tip which are captured by webcam.
The camera is positioned such that it recognizes the motion of finger tips and performs the operations of mouse.
Introduction
As computer technology continues to develop, people have smaller and smaller electronic devices.
Increasingly we are recognizing the importance of human computing interaction (HCI), and inparticular vision-based gesture and object recognition.
In our project, we propose a novel approach that uses a video device to control the mouse system(Mouse tasks).
We employ several image processing algorithms to implement this.
Application and Future work
control of cursor and clicking action in various devices.
In the future, we plan to add more features such as enlarging and shrinking windows, closing window, etc. by using the palm and multiple fingers.
We can also open the browser or any drives (C: /D:/E: etc)with the help of hand gestures instead of moving the cursor.
1.Image Resize
Map camera coordinates to screen coordinates
Segmentation
Separate the hand area from a complex
background.
we converted from RGB color space to
YCbCr color space, and then to binary
image.
Denoise
Need to delete noisy pixels from the image.
We use an image morphology algorithm
that performs image erosion and image
dilation to eliminate noise.
Erosion trims down the image area where
the hand is not present.
Dilation expands the area of the Image
pixels which are not eroded.
.Finding finger tip
The convex hull algorithm is used to solve
the problem of finding the biggest polygon
including all vertices.
we can detect finger tips on the hand.
We used this algorithm to recognize if a
finger is folded or not.
Check the distance between the center and
a pixel which is in convex hull set.
.Controlling Mouse
Weighted speed cursor control. We get a
difference of the finger of the current
image and the previous image and compute
the distance between the two.
Next, we move the mouse cursor if the gap
between the two finger images (current and
previous frame) is far then the mouse cursor
moves fast or, if the gap is close then the
cursor moves slow.
clicking
Scrolling
Hardware And Software Requirements
Web cam at least 30 frames/second, 640x480 resolution
MATLAB(DIP tool
Conclusion
We are developing a system to control the mouse cursor
using a real-time camera.
This system is based on computer vision algorithms and
can do all mouse tasks.
However, it is difficult to get stable results because of the
variety of lighting and skin colors of human races.
This system could be useful in presentations and to reduce
work space.
Features such as enlarging and shrinking windows, closing
window, etc. by using the palm and multiple fingers
Advantages
The main advantage of using hand gestures is to interact
with computer as a non-contact human computer input modality.
Reduce hardware cost by eliminating use of mouse.
Convenient for users not comfortable with touchpad.
The framework may be useful for controlling different
types of games and other applications dependent on the
controlled through user defined gestures.