19-05-2012, 11:58 AM
FINGER TRACKING IN REAL-TIME HUMAN
COMPUTER INTERACTION
[attachment=22435]
ABSTRACT:
For a long time research on human-computer interaction (HCI) has
been restricted to techniques based on the use of monitor, keyboard
and mouse. Recently this paradigm has changed. Techniques such as vision, sound, speech recognition, projective displays and location aware devices allow for a much richer, multi-modal interaction between man and machine.
Finger-tracking is usage of bare hand to operate a computer in order to make human-computer interaction much more faster and easier.
Fingertip finding deals with extraction of information from hand features and positions. In this method we use the position and direction of the fingers in order to get the required segmented region of interest.
INTRODUCTION:
Finger pointing systems aim to replace pointing and clicking
devices like the mouse with the bare hand. These applications requirea robust localization of the fingertip plus the recognition of a limited
number of hand postures for “clicking-commands”.
Finger-tracking systems are considered as specialized type of hand
posture/gesture recognition system.
The typical Specializations are:
1) Only the most simple hand postures and recognized.
2) The hand usually covers a part of the on screen.
3) The finger positions are being found in real-time
4) Ideally, the system works with all kinds of backgrounds
5) The system does not restrict the speed of hand movements
In finger –tracking systems except that the real-time constraints currently do not allow sophisticated approaches such as 3D-model matching or Gabor wavelets.
Contour-Based Tracking Systems
Contour-based finger trackers are described in [Heap 95], [Hall 99]
and [MacCormick 00]. The work of MacCormick and Blake seems
to be the most advanced in this field. The presented tracker works
reliably in real-time over cluttered background with relatively fast
hand motions. Similar to the DrawBoard application from [Laptev
00], the tracked finger position is used to paint on the screen.
Extending the thumb from the hand generates mouse clicks and the
angle of the forefinger relative to the hand controls the thickness of
the line stroke (see Figure 3).
Fingertip Shape Finding
Figure 5.1 shows some typical finger shapes extracted by the imagedifferencing
process. Looking at these images, one can see two
overall properties of a fingertip:
1) A circle of filled pixels surrounds the center of the fingertips.9
The diameter d of the circle is defined by the finger width.
2) Along a square outside the inner circle, fingertips are surrounded
by a long chain of non-filled pixels and a shorter chain of filled
pixels (see Figure 5.2).
To build an algorithm, which searches these two features, several
parameters have to be derived first:
FingerMouse
The FingerMouse system makes it possible to control a standard11
mouse pointer with the bare hand. If the user moves an outstretched
forefinger in front of the camera, the mouse pointer follows the
finger in real-time. Keeping the finger in the same position for one
second generates a single mouse click. An outstretched thumb
invokes the double-click command; the mouse-wheel is activated by
stretching out all five fingers (see Figure 6.1).
The application mainly demonstrates the capabilities of the tracking
mechanism. The mouse pointer is a simple and well-known feedback
system that permits us to show the robustness and responsiveness of
the finger tracker. Also, it is interesting to compare the finger-based
mouse-pointer control with the standard mouse as a reference. This
way the usability of the system can easily be tested.
Projected Screens:
Similar to the popular touch-screens, projected
screens could become “touchable” with the FingerMouse. Several
persons could work simultaneously on one surface and logical
objects, such as buttons and sliders, could be manipulated directly
without the need for a physical object as intermediary.
Navigation:
For standard workplaces it is hard to beat the point-andclick
feature of the mouse. But for other mouse functions, such as
navigating a document, the FingerMouse could offer additional
Conclusions
Finger-tracking system with the following properties:
• The system works on light background with small amounts of
clutter.
• The maximum size of the search area is about 1.5 x 1m but can
easily be increased with additional processing power.
• The system works with different light situations and adapts
automatically to changing conditions.
• No set-up stage is necessary. The user can just walk up to the
system and use it at any time.
• There are no restrictions on the speed of finger movements.
• No special hardware, markers or gloves are necessary.
• The system works at latencies of around 50ms, thus allowingreal-time interaction
• Multiple fingers and hands can be tracked simultaneously.
Especially the BrainStorm system demonstrated, how finger tracking can be used to create “added value” for the user.
Other systems that allow bare-hand manipulation of items projected to a wall, as done with BrainStorm, or presentation control with hand postures, as done with
FreeHandPresent. It is possible, though, that the same applications
could have been built with other finger-tracking systems
COMPUTER INTERACTION
[attachment=22435]
ABSTRACT:
For a long time research on human-computer interaction (HCI) has
been restricted to techniques based on the use of monitor, keyboard
and mouse. Recently this paradigm has changed. Techniques such as vision, sound, speech recognition, projective displays and location aware devices allow for a much richer, multi-modal interaction between man and machine.
Finger-tracking is usage of bare hand to operate a computer in order to make human-computer interaction much more faster and easier.
Fingertip finding deals with extraction of information from hand features and positions. In this method we use the position and direction of the fingers in order to get the required segmented region of interest.
INTRODUCTION:
Finger pointing systems aim to replace pointing and clicking
devices like the mouse with the bare hand. These applications requirea robust localization of the fingertip plus the recognition of a limited
number of hand postures for “clicking-commands”.
Finger-tracking systems are considered as specialized type of hand
posture/gesture recognition system.
The typical Specializations are:
1) Only the most simple hand postures and recognized.
2) The hand usually covers a part of the on screen.
3) The finger positions are being found in real-time
4) Ideally, the system works with all kinds of backgrounds
5) The system does not restrict the speed of hand movements
In finger –tracking systems except that the real-time constraints currently do not allow sophisticated approaches such as 3D-model matching or Gabor wavelets.
Contour-Based Tracking Systems
Contour-based finger trackers are described in [Heap 95], [Hall 99]
and [MacCormick 00]. The work of MacCormick and Blake seems
to be the most advanced in this field. The presented tracker works
reliably in real-time over cluttered background with relatively fast
hand motions. Similar to the DrawBoard application from [Laptev
00], the tracked finger position is used to paint on the screen.
Extending the thumb from the hand generates mouse clicks and the
angle of the forefinger relative to the hand controls the thickness of
the line stroke (see Figure 3).
Fingertip Shape Finding
Figure 5.1 shows some typical finger shapes extracted by the imagedifferencing
process. Looking at these images, one can see two
overall properties of a fingertip:
1) A circle of filled pixels surrounds the center of the fingertips.9
The diameter d of the circle is defined by the finger width.
2) Along a square outside the inner circle, fingertips are surrounded
by a long chain of non-filled pixels and a shorter chain of filled
pixels (see Figure 5.2).
To build an algorithm, which searches these two features, several
parameters have to be derived first:
FingerMouse
The FingerMouse system makes it possible to control a standard11
mouse pointer with the bare hand. If the user moves an outstretched
forefinger in front of the camera, the mouse pointer follows the
finger in real-time. Keeping the finger in the same position for one
second generates a single mouse click. An outstretched thumb
invokes the double-click command; the mouse-wheel is activated by
stretching out all five fingers (see Figure 6.1).
The application mainly demonstrates the capabilities of the tracking
mechanism. The mouse pointer is a simple and well-known feedback
system that permits us to show the robustness and responsiveness of
the finger tracker. Also, it is interesting to compare the finger-based
mouse-pointer control with the standard mouse as a reference. This
way the usability of the system can easily be tested.
Projected Screens:
Similar to the popular touch-screens, projected
screens could become “touchable” with the FingerMouse. Several
persons could work simultaneously on one surface and logical
objects, such as buttons and sliders, could be manipulated directly
without the need for a physical object as intermediary.
Navigation:
For standard workplaces it is hard to beat the point-andclick
feature of the mouse. But for other mouse functions, such as
navigating a document, the FingerMouse could offer additional
Conclusions
Finger-tracking system with the following properties:
• The system works on light background with small amounts of
clutter.
• The maximum size of the search area is about 1.5 x 1m but can
easily be increased with additional processing power.
• The system works with different light situations and adapts
automatically to changing conditions.
• No set-up stage is necessary. The user can just walk up to the
system and use it at any time.
• There are no restrictions on the speed of finger movements.
• No special hardware, markers or gloves are necessary.
• The system works at latencies of around 50ms, thus allowingreal-time interaction
• Multiple fingers and hands can be tracked simultaneously.
Especially the BrainStorm system demonstrated, how finger tracking can be used to create “added value” for the user.
Other systems that allow bare-hand manipulation of items projected to a wall, as done with BrainStorm, or presentation control with hand postures, as done with
FreeHandPresent. It is possible, though, that the same applications
could have been built with other finger-tracking systems