15-11-2012, 02:04 PM
MOUSE MOVEMENT THROUGH FINGER BY IMAGE GRABBING USING SIXTH SENSE TECHNOLOGY
1MOUSE MOVEMENT THROUGH.pdf (Size: 677.13 KB / Downloads: 181)
Abstract
Abundant amount of input devices are used to interact with the computer world or more precisely saying to digital world and very less through gestures made by body movements. Concepts of assistive technology are one of them used for controlling the input from mouse movements, like by detecting the eye movements of a user with the help of eye tracking system, hand gestures through wearable devices, etc.
The gesture recognition devices are already developed but we focus on bridging the crevice between the two different worlds i.e. Physical and Digital world using sixth sense technology. Sixth Sense Technology is the technology in which the standard inputs get replaced with the wearable gesture interface that aggrandize physical world around us with digital world and lets us to use the natural hand gestures that interplay with the information related to it. Our focus is in moving mouse cursor on the screen without using any hardware which is used very often now-a-days i.e. mouse. We use the newly born technology named Sixth Sense Technology for this purpose. We implement computer mouse movement through finger by image grabbing using Sixth Sense Technology which gets processed in MATLAB without using gesture recognition.
INTRODUCTION
Sixth Sense Technology is a revolutionary way to augment the physical world directly without using dedicated electronic chips. Sixth Sense is a set of wearable devices that acts as a gestural interface and aggrandize the physical world around us with digital information and lets the users to use natural hand gestures to interact with the digital information through it. This technology gaining its popularity strength because of the usability, simplicity and ability to work independently in today’s scenario. Many other modern technologies are available which are widely used like touch screen that not only saves the utilization time but increases the ease of usability too.
Its implementation consists of five main components and a microphone which is optional and can be used for speech recognition purpose, that collectively acts as a system in itself and each device has its important role in the system. The devices include a webcam or digital camera, coloured caps or markers, a phone or laptop, a projector and a mirror.
PROPOSED METHOD
The methodology used is based on the Sixth Sense Technology where user have some devices which together acts as a system. Our aim is to move mouse cursor as the user moves his/her fingers. For this purpose, three components of Sixth Sense are used i.e. Camera, Coloured Caps and MATLAB installed in Laptop. The following figure shows the hardware devices we have used for experimental purpose.
IMPLEMENTATION & RESULTS
The image processing and colour recognition was simulated in the MATLAB to process the image from the live video from camera to obtain the final image showing required colours only. The image processing and colour recognition part was performed with the machine with i5 processor clocked at 2.40 GHz equipped with 4 MB cache memory, 4 GB RAM and standard on board graphics processing unit of Intel motherboard.
The algorithm returns the image showing the desired colours only that are placed at the fingertips of the user. For this purpose we use a sample image. The sample image and its output image after colour recognition are shown below.
CONCLUSION
The use of image processing and colour recognition in MATLAB for the implementation of our proposed approach proved to be practically successful and the movement of mouse cursor is achieved with a good precision. The approach has huge potential once it gets further optimized, as its time complexity is higher, with the help of hardware having better specifications. This approach has much high potential for future advanced applications which can have the ability to change the mobile world also. The overall cost of this method is within USD 150 but its commercial implementation can be easily made in affordable price range for the common man.