11-10-2017, 11:15 AM
SixthSense is a usable gestural interface that enhances the physical world that surrounds us with digital information and allows us to use natural hand gestures to interact with that information. The SixthSense prototype consists of a pocket projector, a mirror and a camera. The hardware components are attached to a pendant as a mobile handheld device. Both the projector and the camera are connected to the mobile computing device in the user's pocket. The projector projects visual information that allows us to use surfaces, walls and physical objects around us as interfaces; while the camera recognizes and tracks user gestures and physical objects using techniques based on computer vision. The software program processes the video-flow data captured by the camera and tracks the locations of colour markers (visual reference points) at the user's fingertips using simple computer vision techniques. The movements and arrangements of these fiducials are interpreted in gestures that act as interaction instructions for the projected application interfaces. The maximum number of fingers checked is only limited by the number of unique references, so SixthSense also supports multi-touch and multiuser interaction.