21-05-2010, 11:13 PM
[attachment=3588]
ABSTRACT
Three-dimensional facial model coding can be employed in various mobile applications to provide an enhanced user experience. Instead of directly encoding the data using conventional coding techniques such as MPEG-2, a one-time 3D computer model of the caller is transmitted at the beginning of the telephone call. There after capturing 3D movements and mimicry parameters with the camera is all that required to continually see and hear a true -to-life, synchronized caller on the display. The 3Dmodels are interchangeable, which means that one person can be displayed on the screen with the movements of another, it is suitable for use in conjunction with various mobile networks from GSM to UMTS. However what is less clear is that sensitivity to channel errors of 3D -coded data.
CONTENTS
Chapter 1. INTRODUCTION
Chapter 2. SYSTEM OVERVIEW
Chapter 3. FACIAL ANIMATION AND SPECIFICATION
3.1 MPEG-4 standard
3.2 Face animation parameters
3.3 Facial animation parameter units
3.4 Face feature points
3.5 MPEG-4 facial animations delivery
Chapter 4. CODING OF FAP'S
4.1 Arithmetic coding OF FAP'S
4.2. DGT13.1 coding of FAPS
4.3. Interpolation and extrapolation
Chapter 5. SYSTEM ARCHITECTURE
5.1 Channel models for FAP
5.2 GPRS
5.3 EDGE
5.4 Results
Chapter 6. OTHER ERRORS IN MOBILE FACIAL ANIMATION
Chapter 7. APPLICATIONS
7.1 Embodied agents in spoken dialogue systems
7. 2 Language training with talking heads
7.3 Synthetic faces as aids in communication
Chapter 8. CONCLUSION
REFERECES
1. INTRODUCTION.
Facial animation and virtual human technology in computer graphics has made considerable advancements during past decades has been a research topic attracting an -increasing. Number of commercial applications such as mobile platforms, telecommunications, tele-presence via Internet end or digital entertainment. A number of mobile applications may benefit from the enhancement that 3-D video can bring including message services and e-commerce.
Despite of the possible advantages of such technologies, the effect of the mobile link on 3-D video has not considered in the design of it's syntax. Another issue is delivering the coded bit stream over the wireless network The bandwidth should be as narrow as possible.
MPEG-4 is the first international standard that standardizes-time multimedia communication- including natural and, synthetic audio, video and 3D graphics. In order to define face models there is BIFS for MPEG-4. Within BIFS the FAP coding provides, lower bit rate for face models.
In order to deliver the services, the possible channel models are GPRS and EDGE. But the coded data is sensitive to errors, so it should be considered.
In the next session, gives an overview of some relevant parts of FAP technology, coding of FAP, and discusses different mobile network technology. This is followed by some results when FAP is delivered through GPRS and EDGE channels and Comparing channel errors. Next are other noticeable issues involved on this technology. The applications of facial animation in mobile terminals are also discussed.
2. SYSTEM OVERVIEW
Figure 2.1 System overview
The mobile facial animation can be describe-'' using the above block diagram. Using a projection camera the 3D input surfaces or facial models are produced. Using facial animation technique the movements of the face can be tracked. MPEG-4 FAP encoder encodes the high-resolution facial models. Now this data stream is transmitted over wireless network. GPRS and EDGE channel models are preferred to use this due to data rate and bandwidth. In this error rate is small in EDGE. Now in the receiver the data stream is received using same protocol stack as in transmitter but in the inverse manner. Then it -s decoded using MPEG-4 FAP decoder. Now the face model is reconstructed.
3. FACIAL ANIMATION AND SPECIFICATION
3.1 MPEG-4 STANDARD
The MPEG-4 Systems standard
1) Contains a method of representing and encoding 3-D scenes, called Binary Information For Scenes (BIFS).
2) This standard is based on the Virtual Reality Modeling Language (VRML), which specifies a language for describing 3D scenes.
3) BIFS provides a method for compressing VRML type data, and animating the 3-D objects in a scene.
4) Within BIFS, MPEG-4 provides Facial Animation Parameter (FAP) encoding.
5) FAP encoding specifically lows the representation, animation, and binary encoding of facial models. This can be performed using techniques of varying complexity.
Like the VRML standard (3), MPEG-4 BIFS describes 3-D scenes using a series of nodes. Nodes can describe various scene aspects including object shape, rotation, and translation. They can also contain other nodes; it is common for scenes to contain hierarchical node trees. Although scenes are described using VRML type structures, BIFS includes a number of features that are not present in VRML:
ABSTRACT
Three-dimensional facial model coding can be employed in various mobile applications to provide an enhanced user experience. Instead of directly encoding the data using conventional coding techniques such as MPEG-2, a one-time 3D computer model of the caller is transmitted at the beginning of the telephone call. There after capturing 3D movements and mimicry parameters with the camera is all that required to continually see and hear a true -to-life, synchronized caller on the display. The 3Dmodels are interchangeable, which means that one person can be displayed on the screen with the movements of another, it is suitable for use in conjunction with various mobile networks from GSM to UMTS. However what is less clear is that sensitivity to channel errors of 3D -coded data.
CONTENTS
Chapter 1. INTRODUCTION
Chapter 2. SYSTEM OVERVIEW
Chapter 3. FACIAL ANIMATION AND SPECIFICATION
3.1 MPEG-4 standard
3.2 Face animation parameters
3.3 Facial animation parameter units
3.4 Face feature points
3.5 MPEG-4 facial animations delivery
Chapter 4. CODING OF FAP'S
4.1 Arithmetic coding OF FAP'S
4.2. DGT13.1 coding of FAPS
4.3. Interpolation and extrapolation
Chapter 5. SYSTEM ARCHITECTURE
5.1 Channel models for FAP
5.2 GPRS
5.3 EDGE
5.4 Results
Chapter 6. OTHER ERRORS IN MOBILE FACIAL ANIMATION
Chapter 7. APPLICATIONS
7.1 Embodied agents in spoken dialogue systems
7. 2 Language training with talking heads
7.3 Synthetic faces as aids in communication
Chapter 8. CONCLUSION
REFERECES
1. INTRODUCTION.
Facial animation and virtual human technology in computer graphics has made considerable advancements during past decades has been a research topic attracting an -increasing. Number of commercial applications such as mobile platforms, telecommunications, tele-presence via Internet end or digital entertainment. A number of mobile applications may benefit from the enhancement that 3-D video can bring including message services and e-commerce.
Despite of the possible advantages of such technologies, the effect of the mobile link on 3-D video has not considered in the design of it's syntax. Another issue is delivering the coded bit stream over the wireless network The bandwidth should be as narrow as possible.
MPEG-4 is the first international standard that standardizes-time multimedia communication- including natural and, synthetic audio, video and 3D graphics. In order to define face models there is BIFS for MPEG-4. Within BIFS the FAP coding provides, lower bit rate for face models.
In order to deliver the services, the possible channel models are GPRS and EDGE. But the coded data is sensitive to errors, so it should be considered.
In the next session, gives an overview of some relevant parts of FAP technology, coding of FAP, and discusses different mobile network technology. This is followed by some results when FAP is delivered through GPRS and EDGE channels and Comparing channel errors. Next are other noticeable issues involved on this technology. The applications of facial animation in mobile terminals are also discussed.
2. SYSTEM OVERVIEW
Figure 2.1 System overview
The mobile facial animation can be describe-'' using the above block diagram. Using a projection camera the 3D input surfaces or facial models are produced. Using facial animation technique the movements of the face can be tracked. MPEG-4 FAP encoder encodes the high-resolution facial models. Now this data stream is transmitted over wireless network. GPRS and EDGE channel models are preferred to use this due to data rate and bandwidth. In this error rate is small in EDGE. Now in the receiver the data stream is received using same protocol stack as in transmitter but in the inverse manner. Then it -s decoded using MPEG-4 FAP decoder. Now the face model is reconstructed.
3. FACIAL ANIMATION AND SPECIFICATION
3.1 MPEG-4 STANDARD
The MPEG-4 Systems standard
1) Contains a method of representing and encoding 3-D scenes, called Binary Information For Scenes (BIFS).
2) This standard is based on the Virtual Reality Modeling Language (VRML), which specifies a language for describing 3D scenes.
3) BIFS provides a method for compressing VRML type data, and animating the 3-D objects in a scene.
4) Within BIFS, MPEG-4 provides Facial Animation Parameter (FAP) encoding.
5) FAP encoding specifically lows the representation, animation, and binary encoding of facial models. This can be performed using techniques of varying complexity.
Like the VRML standard (3), MPEG-4 BIFS describes 3-D scenes using a series of nodes. Nodes can describe various scene aspects including object shape, rotation, and translation. They can also contain other nodes; it is common for scenes to contain hierarchical node trees. Although scenes are described using VRML type structures, BIFS includes a number of features that are not present in VRML: