19-12-2012, 02:56 PM
FINGER TRACKING IN REAL-TIME HUMAN COMPUTER INTERACTION
FINGER TRACKING.doc (Size: 594 KB / Downloads: 58)
ABSTRACT:
For a long time research on human-computer interaction (HCI) has
been restricted to techniques based on the use of monitor, keyboard
and mouse. Recently this paradigm has changed. Techniques such as vision, sound, speech recognition, projective displays and location aware devices allow for a much richer, multi-modal interaction between man and machine.
Finger-tracking is usage of bare hand to operate a computer in order to make human-computer interaction much more faster and easier.
Fingertip finding deals with extraction of information from hand features and positions. In this method we use the position and direction of the fingers in order to get the required segmented region of interest.
INTRODUCTION:
Finger pointing systems aim to replace pointing and clicking
devices like the mouse with the bare hand. These applications require
a robust localization of the fingertip plus the recognition of a limited
number of hand postures for “clicking-commands”.
Finger-tracking systems are considered as specialized type of hand
posture/gesture recognition system.
The typical Specializations are:
1) Only the most simple hand postures and recognized.
2) The hand usually covers a part of the on screen.
3) The finger positions are being found in real-time
4) Ideally, the system works with all kinds of backgrounds
5) The system does not restrict the speed of hand movements
Contour-Based Tracking Systems
Contour-based finger trackers are described in [Heap 95], [Hall 99]
and [MacCormick 00]. The work of MacCormick and Blake seems
to be the most advanced in this field. The presented tracker works
reliably in real-time over cluttered background with relatively fast
hand motions. Similar to the DrawBoard application from [Laptev
00], the tracked finger position is used to paint on the screen.
Extending the thumb from the hand generates mouse clicks and the
angle of the forefinger relative to the hand controls the thickness of
the line stroke (see Figure 3).
FingerMouse
The FingerMouse system makes it possible to control a standard11
mouse pointer with the bare hand. If the user moves an outstretched
forefinger in front of the camera, the mouse pointer follows the
finger in real-time. Keeping the finger in the same position for one
second generates a single mouse click. An outstretched thumb
invokes the double-click command; the mouse-wheel is activated by
stretching out all five fingers (see Figure 6.1).
The application mainly demonstrates the capabilities of the tracking
mechanism. The mouse pointer is a simple and well-known feedback
system that permits us to show the robustness and responsiveness of
the finger tracker. Also, it is interesting to compare the finger-based
mouse-pointer control with the standard mouse as a reference. This
way the usability of the system can easily be tested.
Conclusions
Finger-tracking system with the following properties:
•The system works on light background with small amounts of
clutter.
•The maximum size of the search area is about 1.5 x 1m but can
easily be increased with additional processing power.
•The system works with different light situations and adapts
automatically to changing conditions.
•No set-up stage is necessary. The user can just walk up to the
system and use it at any time.
•There are no restrictions on the speed of finger movements.
•No special hardware, markers or gloves are necessary.
•The system works at latencies of around 50ms, thus allowing
real-time interaction
•Multiple fingers and hands can be tracked simultaneously.