31-03-2011, 03:54 PM
Submitted By
Renjith.R
sixthsensetechnology-CJ7.docx (Size: 698.18 KB / Downloads: 161)
SIXTH SENSE TECHNOLOGY
Abstract
Every one of usare aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. These senses have evolved through millions of years. Whenever we encounter a new object/experience our natural senses tries to analysis that experience and the information that is obtained is used to modify our interaction with the environment. But in this new age of technologies the most important information that helps one to make right decision is something that cannot be perceived and analysed by our natural senses. That information is the data in the digital form, and it is available to everyone through sources like internet. The sixth sense technology concept is an effort to connect this data in the digital world in to the real world.
Introduction
Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there aren’t any device as of now which gives a direct link between the digital world and our physical interaction with the real world. Usually the information’s are stored traditionally on a paper or a digital storage device. Sixth sense technology helps to bridge this gap between tangible and non-tangible world.Sixth Sensedevice is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information .The sixth sense technology was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. The sixth sense technology has a Web 4.0 view of human and machine interactions.SixthSense integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs.It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cellphone—which acts as the computer and your connection to the Cloud, all the information stored on the web. The current prototype costs around $350. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system.
SIXTH SENSE DEVICES
'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that informationThe hardware components are coupled in a pendant like mobile wearable device.The SixthSense prototype is comprised of a pocket projector, a mirror,colord marker and a camera. The camera, mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user’s pocket.A software then processes the data that is collected by the capturing device and producesanalysis.The software that is used in sixth sense device is open source type.
Camera
It captures the image of the object in view and track the user’s hand gesture. The camera recognizes individuals, images, pictures, gestures that user makes with his hand. The camera then sends this data to a smart phone for processing. Basically the camera forms a digital eye which connects to the world of digital information.
Coloured Marker
There are colour markers placed at the tip of users finger. Marking the user’s fingers with red, yellow green and blue coloured tape helps the webcam to recognize the hand gestures.The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.
Mobile Component
The SixthSense device consists of a web enabled smart phone which process the data send by the camera. The smart phone searches the web and interprets the hand gestures with help of the coloured markers placed at the finger tips.
Projector
The information that is interpreted through the smart phone can be projected into any surface. The projector projects the visual information enabling surfaces and physical objects to be used as interfaces. The projector itself consists of a battery which have 3 hours of battery life .A tiny LED projector displays the data sent from the smart phone on any surface in view- object, wall or person. The downward facing projector projects the image on to a mirror.
Mirror
The usage of a mirror is important as the projector dangles pointing downwards from the neck. The mirror reflects the image on to a desire surface.Thus finally the digital image is freed from its confines and placed in the physical world.
Technologies that are related to Sixth Sense Devices
Augmented Reality
The augmented Reality is a visualization technology that allows the user to experience the virtual experience added over real world in real time.With the help of advanced AR technology the information about the surrounding real world of the user becomes interactive and digitally usable. Artificial information about the environment and the objects in it can be stored and retrieved as an information layer on top of the real world view. When we compare the spectrum between virtual reality, which creates immersive, computer-generated environments, and the real world, augmented reality is closer to the real world. Augmented reality adds graphics, sounds, haptic feedback and smell to the natural world as it exists. Both video games and cell phones are driving the development of augmented reality. Theaugmented systems will also superimpose graphics for every perspective available andtry adjust to every movement of the user's head and eyes.The three basic components of an augmented reality system are the head-mounted display, tracking system and mobile computer for the hardware. The main goal of this new technology is to merge these three components into a highly portable unit much like a combination of a high tech Walkman and an ordinary pair or eyeglasses.The head-mounted display used in augmented reality systems will enable the user to view superimposed graphics and text created by the system.Another component of an augmented reality system is its tracking and orientation system. This system pinpoints the user's location in reference to his surroundings and additionally tracks the user's eye and head movements.Augmented reality systems will need highly mobile computers. As of now many computers aren’t there to satisfy to provide this option.
Gesture Recognition
It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the SixthSense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognised using different technique’s. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique have an high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures.
Computer Vision
Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. It’s also used in autonomous vehicle like SUV’s. The computer vision technique basically includes four processes.
1. Recognition: One of the main task of computer vision technique is to determine whether the particular object contain the useful data or not.
2. Motion Analysis: Motion analysis includes several tasks related to estimation of motion where an image sequence is processed continuously to detect the velocity at each point of the image or in the 3D scene.
3. Scene Reconstruction: Computer vision technique employs several methods to recreate a 3D image from the available images of a scene.
4. Image Restoration: The main of aim of this step is to remove noise from an given image. The simplest method involves using simple filters like low pass or median filters. In order to get better quality images more complex methods like Inpainting are used.
Renjith.R
sixthsensetechnology-CJ7.docx (Size: 698.18 KB / Downloads: 161)
SIXTH SENSE TECHNOLOGY
Abstract
Every one of usare aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. These senses have evolved through millions of years. Whenever we encounter a new object/experience our natural senses tries to analysis that experience and the information that is obtained is used to modify our interaction with the environment. But in this new age of technologies the most important information that helps one to make right decision is something that cannot be perceived and analysed by our natural senses. That information is the data in the digital form, and it is available to everyone through sources like internet. The sixth sense technology concept is an effort to connect this data in the digital world in to the real world.
Introduction
Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there aren’t any device as of now which gives a direct link between the digital world and our physical interaction with the real world. Usually the information’s are stored traditionally on a paper or a digital storage device. Sixth sense technology helps to bridge this gap between tangible and non-tangible world.Sixth Sensedevice is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information .The sixth sense technology was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. The sixth sense technology has a Web 4.0 view of human and machine interactions.SixthSense integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs.It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cellphone—which acts as the computer and your connection to the Cloud, all the information stored on the web. The current prototype costs around $350. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system.
SIXTH SENSE DEVICES
'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that informationThe hardware components are coupled in a pendant like mobile wearable device.The SixthSense prototype is comprised of a pocket projector, a mirror,colord marker and a camera. The camera, mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user’s pocket.A software then processes the data that is collected by the capturing device and producesanalysis.The software that is used in sixth sense device is open source type.
Camera
It captures the image of the object in view and track the user’s hand gesture. The camera recognizes individuals, images, pictures, gestures that user makes with his hand. The camera then sends this data to a smart phone for processing. Basically the camera forms a digital eye which connects to the world of digital information.
Coloured Marker
There are colour markers placed at the tip of users finger. Marking the user’s fingers with red, yellow green and blue coloured tape helps the webcam to recognize the hand gestures.The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces.
Mobile Component
The SixthSense device consists of a web enabled smart phone which process the data send by the camera. The smart phone searches the web and interprets the hand gestures with help of the coloured markers placed at the finger tips.
Projector
The information that is interpreted through the smart phone can be projected into any surface. The projector projects the visual information enabling surfaces and physical objects to be used as interfaces. The projector itself consists of a battery which have 3 hours of battery life .A tiny LED projector displays the data sent from the smart phone on any surface in view- object, wall or person. The downward facing projector projects the image on to a mirror.
Mirror
The usage of a mirror is important as the projector dangles pointing downwards from the neck. The mirror reflects the image on to a desire surface.Thus finally the digital image is freed from its confines and placed in the physical world.
Technologies that are related to Sixth Sense Devices
Augmented Reality
The augmented Reality is a visualization technology that allows the user to experience the virtual experience added over real world in real time.With the help of advanced AR technology the information about the surrounding real world of the user becomes interactive and digitally usable. Artificial information about the environment and the objects in it can be stored and retrieved as an information layer on top of the real world view. When we compare the spectrum between virtual reality, which creates immersive, computer-generated environments, and the real world, augmented reality is closer to the real world. Augmented reality adds graphics, sounds, haptic feedback and smell to the natural world as it exists. Both video games and cell phones are driving the development of augmented reality. Theaugmented systems will also superimpose graphics for every perspective available andtry adjust to every movement of the user's head and eyes.The three basic components of an augmented reality system are the head-mounted display, tracking system and mobile computer for the hardware. The main goal of this new technology is to merge these three components into a highly portable unit much like a combination of a high tech Walkman and an ordinary pair or eyeglasses.The head-mounted display used in augmented reality systems will enable the user to view superimposed graphics and text created by the system.Another component of an augmented reality system is its tracking and orientation system. This system pinpoints the user's location in reference to his surroundings and additionally tracks the user's eye and head movements.Augmented reality systems will need highly mobile computers. As of now many computers aren’t there to satisfy to provide this option.
Gesture Recognition
It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. In the SixthSense devices coloured bands are used for this purpose. Once hand pose has been captured the gestures can be recognised using different technique’s. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. This technique have an high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures.
Computer Vision
Computer vision is the technology in which machines are able to interpret/extract necessary information from an image. Computer vision technology includes various fields like image processing, image analysis and machine vision. It includes certain aspect of artificial intelligence techniques like pattern recognition. The machines which implement computer vision techniques require image sensors which detect electromagnetic radiation which are usually in the form of ultraviolet rays or light rays. The computer vision find itself applicable in varies field of interest. One such field is bio medical image processing. It’s also used in autonomous vehicle like SUV’s. The computer vision technique basically includes four processes.
1. Recognition: One of the main task of computer vision technique is to determine whether the particular object contain the useful data or not.
2. Motion Analysis: Motion analysis includes several tasks related to estimation of motion where an image sequence is processed continuously to detect the velocity at each point of the image or in the 3D scene.
3. Scene Reconstruction: Computer vision technique employs several methods to recreate a 3D image from the available images of a scene.
4. Image Restoration: The main of aim of this step is to remove noise from an given image. The simplest method involves using simple filters like low pass or median filters. In order to get better quality images more complex methods like Inpainting are used.