08-09-2016, 12:25 PM
[attachment=70738]
ABSTRACT
Popularity of mobiles devices increasing day by day due to the advantages like portability, mobility and flexibility, but the limited size gives very less interactive surface area. We cannot just make the device large without losing benefit of small size. So the Microsoft company has developed Skinput, a technology that appropriates the human body for acoustic transmission, allowing the skin to be used as an input surface.Human body produces different vibrations when we tap on different body parts. With the help of this unique property of human body we can use different locations as different functions of small devices like mobile phones or music players. When we tap on our body some mechanical vibrations propagates through the bodythat vibrations are captured by sensor array and with the help of armband we send the signals produced by sensors to the mobile devices and the software can detect on which location of our body part the finger is tapped.So according to the location, desired operation is performed. When augmented with a Pico-projector, the device can provide a direct manipulation, graphical user interface on the body.This approach provides an always available, naturally portable, and on-body finger input system.
INTRODUCTION
The world is going crazy over an invention, which is known as mobile phones. The Mobile devices became popular in less time due some advantages they came up with,like portability, flexibility, mobility and responsiveness. These devices easily get fit in our pocket means we don’t need to carry any extra surface area with us.Devices with significant computational power and capabilities can now be easily carried on our bodies. However, their small size typically leads to limited interaction space (e.g. diminutive i.e. very small screens, buttons, and jog wheels) and consequently diminishes their usability and functionality. Since, we cannot simply make buttons and screens larger without losing the primary benefit of small size.
The alternative approaches that enhance interactions with small mobile systems. One option is to opportunistically appropriate surface area from the environment for interactive purposes. For example, a technique that allows a small mobile device to turn tables on which it rests into a gestural finger input canvas. However, tables are not always present so we cannot use these technique everywhere, and in a mobile context, users are unlikely to want to carry appropriated surfaces with them (at this point, one might as well just have a larger device). However, there is one surface that has been previous overlooked as an input canvas and one that happens to always travel with us: our skin.
Appropriating the human body as an input device is appealing not only because we have roughly two square meters of external surface area, but also because much of it is easily accessible by our hands (e.g., arms, upper legs, torso).We can use this without any visual contact. Furthermore, proprioception – our sense of how our body is configured in three-dimensional space – allows us to accurately interact with our bodies in an eyes-free manner. For example, we can readily flick each of our fingers, touch the tip of our nose, and clap our hands together without visual assistance. Few external input devices can claim this accurate, eyes-free input characteristic and provide such a large interaction area. We can use any part of our body as an input surface but the for comfortable operation we need to use our arm as an input. In this paper, we present our work on Skinput– a method that allows the body to be appropriated for finger input using a novel, non-invasive, wearable bio-acoustic sensor.
The technology was developed by Chris Harrison, Desney Tan, and Dan Morris, at Microsoft Research's Computational User Experiences Group. Skinput is a combination of three technologies which are pico-projector, bioacoustics sensors and Bluetooth. Pico-projector will display mobile screen on our skin. As according to our need we tap on our body. After tapping some vibrations are produced through our body, those ripples are captured by bioacoustics sensors which are mounted armband. These armband is connected to the mobile device by wireless connection i.e. Bluetooth. Mobile device consists of a software which matches these vibration signal with the store signals and desired operation is performed. We have use Support Vector Machine algorithm i.e. supervised learning algorithm to train our software. At initial stage we have to store the signal data from each location of our arm which is the reference signal for our software. Skinput employs acoustics, which take advantage of the human body's natural sound conductive properties (e.g., bone conduction). This allows the body to be annexed as an input surface without the need for the skin to be invasively instrumented with sensors, tracking markers, or other items.
The contributions of this paper are: The description of the design of a novel, wearable sensor for bio-acoustic signal acquisition. Also the description of an analysis approach that enables skinput system to resolve the location of finger taps on the body. In this paper, we present working on skinput—a method that allows the body to be appropriated for finger input using a novel, non-invasive, wearable bio-acoustic sensor. When coupled with a pico-projector, the skin can operate as an interactive canvas supporting both input and graphical output.
SKINPUT
2.1 What Is Skinput
Touch screenshave revolutionized the way we communicate with electronics, but sometimes they can get a little cramped — wouldn’t it be great if the iPhone’s screen was just a little bit bigger? One creative solution is Skinput, a device that uses a pico projector to beam graphics (keyboards, menus, etc.) onto a user’s palm and forearm, transforming the skin into a computer interface. Skinput is a combination of two words i.e Skin and Input. This technology uses largest part of o5ur body which is skin as an input surface for mobile gadgets.Chris Harrison and team of Microsoft research has developed Skinput, a way in which your skin can become a touch screen device or your fingers buttons on a MP3 controller.
Skinput represents one way to decouple input from electronic devices with the aim of allowing devices to become smaller without simultaneously shrinking the surface area on which input can be performed.
2.2 Principle Of Skinput
Due to a unique structure of the arm, along with varying bone thickness, muscle or fat tissue concentrations and the like, each tap in different places along the arm delivers a unique combination of transverse and longitudinal waves up the arm, to the torso. Transverse waves are the ripples of lose skin, expanding away from the point of impact. Longitudinal waves are vibrations emitted by the (recently struck) bone along its entire length, from the center of the arm towards the skin.
Skinput relies on an armband, currently worn around the biceps. It detects vibrations in the arm and compares them with predefined control commands (e.g. up, down, back, enter). Additionally, thanks for the sense of proprioception (the ability to sense the position of our body parts without looking), Skinput does not preoccupy the user's vision (much like touch typing).
Working OfSkinput
3.1 Pico-Projector
Pico projectors are tiny battery powered projectors - as small as a mobile phone - or even smaller: these projectors can even be embedded inside phones or digital cameras. Pico-projectors are small, but they can show large displays (sometimes up to 100"). While great for mobility and content sharing, pico-projectors offer low brightness and resolution compared to larger projectors. It is a new innovation, but pico-projectors are already selling at a rate of about a million units a year (in 2010), and the market is expected to continue growing quickly.
We are using DLP (Digital Light Processing) - pioneered by TI, the idea behind DLP is to use tiny mirrors on a chip that direct the light. Each mirror controls the amount of light each pixel on the target picture gets (the mirror has two states, on and off. It refreshes many times in a second - and if 50% of the times it is on, then the pixel appears at 50% the brightness). Color is achieved by a using a color wheel between the light source and the mirrors - this splits the light in red/green/blue, and each mirror controls all thee light beams for its designated pixel. So with the help of tiny projector we will display required menu bar on our arm.
3.2 Bio-Acoustics
Acoustics is the interdisciplinary science that deals with the study of all mechanical waves in gases, liquids, and solids including vibration, sound, ultrasound and infrasound. A scientist who works in the field of acoustics is an acoustician while someone working in the field of acoustics technology may be called an acoustical engineer. The application of acoustics can be seen in almost all aspects of modern society with the most obvious being the audio and noise control industries.Bioacoustics is a cross-disciplinary science that combines biology and acoustics. Usually it refers to the investigation of sound production, dispersion through elastic media, and reception in animals, including humans.
When a finger taps the skin, several distinct forms of acoustic energy are produced. Some energy is radiated into the air as sound waves; this energy is not captured by the Skinputsystem. Among the acoustic energy transmitted throughthe arm, the most readily visible are transverse waves, created by the displacement of the skin from a finger impact. When shot with a high-speed camera, these appear as ripples, which propagate outward from the point of contact. The amplitude of these ripples is correlatedto both the tapping force and to the volume and compliance of soft tissues under the impact area. In general, tapping on soft regions of the arm creates higher amplitudetransverse waves than tapping on boney areas (e.g., wrist, palm, fingers), which have negligible compliance.
In addition to the energy that propagates on the surface of the arm, some energy is transmitted inward, toward the skeleton. These longitudinal (compressive) waves travel through the soft tissues of the arm, exciting the bone, which is much less deformable then the soft tissue but can respond to mechanical excitation by rotating and translating as a rigid body. This excitation vibrates soft tissues surrounding the entire length of the bone, resulting in new longitudinal waves that propagate outward to the skin.
ABSTRACT
Popularity of mobiles devices increasing day by day due to the advantages like portability, mobility and flexibility, but the limited size gives very less interactive surface area. We cannot just make the device large without losing benefit of small size. So the Microsoft company has developed Skinput, a technology that appropriates the human body for acoustic transmission, allowing the skin to be used as an input surface.Human body produces different vibrations when we tap on different body parts. With the help of this unique property of human body we can use different locations as different functions of small devices like mobile phones or music players. When we tap on our body some mechanical vibrations propagates through the bodythat vibrations are captured by sensor array and with the help of armband we send the signals produced by sensors to the mobile devices and the software can detect on which location of our body part the finger is tapped.So according to the location, desired operation is performed. When augmented with a Pico-projector, the device can provide a direct manipulation, graphical user interface on the body.This approach provides an always available, naturally portable, and on-body finger input system.
INTRODUCTION
The world is going crazy over an invention, which is known as mobile phones. The Mobile devices became popular in less time due some advantages they came up with,like portability, flexibility, mobility and responsiveness. These devices easily get fit in our pocket means we don’t need to carry any extra surface area with us.Devices with significant computational power and capabilities can now be easily carried on our bodies. However, their small size typically leads to limited interaction space (e.g. diminutive i.e. very small screens, buttons, and jog wheels) and consequently diminishes their usability and functionality. Since, we cannot simply make buttons and screens larger without losing the primary benefit of small size.
The alternative approaches that enhance interactions with small mobile systems. One option is to opportunistically appropriate surface area from the environment for interactive purposes. For example, a technique that allows a small mobile device to turn tables on which it rests into a gestural finger input canvas. However, tables are not always present so we cannot use these technique everywhere, and in a mobile context, users are unlikely to want to carry appropriated surfaces with them (at this point, one might as well just have a larger device). However, there is one surface that has been previous overlooked as an input canvas and one that happens to always travel with us: our skin.
Appropriating the human body as an input device is appealing not only because we have roughly two square meters of external surface area, but also because much of it is easily accessible by our hands (e.g., arms, upper legs, torso).We can use this without any visual contact. Furthermore, proprioception – our sense of how our body is configured in three-dimensional space – allows us to accurately interact with our bodies in an eyes-free manner. For example, we can readily flick each of our fingers, touch the tip of our nose, and clap our hands together without visual assistance. Few external input devices can claim this accurate, eyes-free input characteristic and provide such a large interaction area. We can use any part of our body as an input surface but the for comfortable operation we need to use our arm as an input. In this paper, we present our work on Skinput– a method that allows the body to be appropriated for finger input using a novel, non-invasive, wearable bio-acoustic sensor.
The technology was developed by Chris Harrison, Desney Tan, and Dan Morris, at Microsoft Research's Computational User Experiences Group. Skinput is a combination of three technologies which are pico-projector, bioacoustics sensors and Bluetooth. Pico-projector will display mobile screen on our skin. As according to our need we tap on our body. After tapping some vibrations are produced through our body, those ripples are captured by bioacoustics sensors which are mounted armband. These armband is connected to the mobile device by wireless connection i.e. Bluetooth. Mobile device consists of a software which matches these vibration signal with the store signals and desired operation is performed. We have use Support Vector Machine algorithm i.e. supervised learning algorithm to train our software. At initial stage we have to store the signal data from each location of our arm which is the reference signal for our software. Skinput employs acoustics, which take advantage of the human body's natural sound conductive properties (e.g., bone conduction). This allows the body to be annexed as an input surface without the need for the skin to be invasively instrumented with sensors, tracking markers, or other items.
The contributions of this paper are: The description of the design of a novel, wearable sensor for bio-acoustic signal acquisition. Also the description of an analysis approach that enables skinput system to resolve the location of finger taps on the body. In this paper, we present working on skinput—a method that allows the body to be appropriated for finger input using a novel, non-invasive, wearable bio-acoustic sensor. When coupled with a pico-projector, the skin can operate as an interactive canvas supporting both input and graphical output.
SKINPUT
2.1 What Is Skinput
Touch screenshave revolutionized the way we communicate with electronics, but sometimes they can get a little cramped — wouldn’t it be great if the iPhone’s screen was just a little bit bigger? One creative solution is Skinput, a device that uses a pico projector to beam graphics (keyboards, menus, etc.) onto a user’s palm and forearm, transforming the skin into a computer interface. Skinput is a combination of two words i.e Skin and Input. This technology uses largest part of o5ur body which is skin as an input surface for mobile gadgets.Chris Harrison and team of Microsoft research has developed Skinput, a way in which your skin can become a touch screen device or your fingers buttons on a MP3 controller.
Skinput represents one way to decouple input from electronic devices with the aim of allowing devices to become smaller without simultaneously shrinking the surface area on which input can be performed.
2.2 Principle Of Skinput
Due to a unique structure of the arm, along with varying bone thickness, muscle or fat tissue concentrations and the like, each tap in different places along the arm delivers a unique combination of transverse and longitudinal waves up the arm, to the torso. Transverse waves are the ripples of lose skin, expanding away from the point of impact. Longitudinal waves are vibrations emitted by the (recently struck) bone along its entire length, from the center of the arm towards the skin.
Skinput relies on an armband, currently worn around the biceps. It detects vibrations in the arm and compares them with predefined control commands (e.g. up, down, back, enter). Additionally, thanks for the sense of proprioception (the ability to sense the position of our body parts without looking), Skinput does not preoccupy the user's vision (much like touch typing).
Working OfSkinput
3.1 Pico-Projector
Pico projectors are tiny battery powered projectors - as small as a mobile phone - or even smaller: these projectors can even be embedded inside phones or digital cameras. Pico-projectors are small, but they can show large displays (sometimes up to 100"). While great for mobility and content sharing, pico-projectors offer low brightness and resolution compared to larger projectors. It is a new innovation, but pico-projectors are already selling at a rate of about a million units a year (in 2010), and the market is expected to continue growing quickly.
We are using DLP (Digital Light Processing) - pioneered by TI, the idea behind DLP is to use tiny mirrors on a chip that direct the light. Each mirror controls the amount of light each pixel on the target picture gets (the mirror has two states, on and off. It refreshes many times in a second - and if 50% of the times it is on, then the pixel appears at 50% the brightness). Color is achieved by a using a color wheel between the light source and the mirrors - this splits the light in red/green/blue, and each mirror controls all thee light beams for its designated pixel. So with the help of tiny projector we will display required menu bar on our arm.
3.2 Bio-Acoustics
Acoustics is the interdisciplinary science that deals with the study of all mechanical waves in gases, liquids, and solids including vibration, sound, ultrasound and infrasound. A scientist who works in the field of acoustics is an acoustician while someone working in the field of acoustics technology may be called an acoustical engineer. The application of acoustics can be seen in almost all aspects of modern society with the most obvious being the audio and noise control industries.Bioacoustics is a cross-disciplinary science that combines biology and acoustics. Usually it refers to the investigation of sound production, dispersion through elastic media, and reception in animals, including humans.
When a finger taps the skin, several distinct forms of acoustic energy are produced. Some energy is radiated into the air as sound waves; this energy is not captured by the Skinputsystem. Among the acoustic energy transmitted throughthe arm, the most readily visible are transverse waves, created by the displacement of the skin from a finger impact. When shot with a high-speed camera, these appear as ripples, which propagate outward from the point of contact. The amplitude of these ripples is correlatedto both the tapping force and to the volume and compliance of soft tissues under the impact area. In general, tapping on soft regions of the arm creates higher amplitudetransverse waves than tapping on boney areas (e.g., wrist, palm, fingers), which have negligible compliance.
In addition to the energy that propagates on the surface of the arm, some energy is transmitted inward, toward the skeleton. These longitudinal (compressive) waves travel through the soft tissues of the arm, exciting the bone, which is much less deformable then the soft tissue but can respond to mechanical excitation by rotating and translating as a rigid body. This excitation vibrates soft tissues surrounding the entire length of the bone, resulting in new longitudinal waves that propagate outward to the skin.