13-09-2013, 04:03 PM
Automatic Creation of 3D Environments from a Single Sketch Using Content-Centric Networks
[attachment=58025]
ABSTRACT
In this article a complete and innovative sys-
tem for automatic creation of 3D environments
from multimedia content available in the network
is presented. The core application provides an
interface where the user sketches in 2D the scene
that s/he aims to build. Moreover, the GUI appli-
cation exploits the similarity search and retrieval
capabilities of search-enabled content-centric
networks to fetch 3D models that are similar to
the drawn 2D objects. The retrieved 3D models
act as the building components for the automati-
cally constructed 3D scene. Two CCN-based
applications are also described, which perform
the query routing and similarity search on each
node of the CCN network.
INTRODUCTION
In the new era of the media Internet where multi-
media content is overflowing the networks and
users are usually near a networked device, the
available forms of communication seem inade-
quate. IP has changed the way we communicate
and entertain ourselves, using voice over IP (VoIP),
videoconferencing, IPTV, email, instant messaging,
social networks, and so on. However, now is the
time users really need a completely new user expe-
rience that transcends these communication forms.
In this new form of communication, 3D virtu-
al environments will be the places for meeting,
conversation, and entertainment among friends
and colleagues. Moreover, these places will be
constructed dynamically from each user based
on the exact needs of the communication ses-
sion. In order to do so in an easy and intuitive
way, users should have the ability to search,
retrieve, and use the deluge of multimedia con-
tent available in the networks as building com-
ponents of a new 3D environment.
SYSTEM ARCHITECTURE
The main components of the proposed system
are an application named sketchTo3D, which
provides the sketch user interface and displays
the 3D virtual environment; the searchGateway
application, which acts as a gateway between
TCP/IP and the CCN network; and finally, the
searchProxy application that runs on every
search-enabled CCN party in order to perform a
similarity search in their local repository.
Figure 1 presents the overall architecture
with the search-enabled CCN, the CCN search
gateway, and the end user’s PC that hosts the
sketchTo3D application. All these components
are explained in detail in the following sections.
THE SKETCHTO3D APPLICATION
Querying by example (QBE) is a very common
technique for querying multimedia databases.
However, a prerequisite for the user is to have
an object that is similar to what s/he is looking
for. From this point of view, the QBE approach
may not be that practical for a single-modality
search. On the other hand, in a multimodal
setup where objects from one modality are
always available to the user (e.g., sketch) for the
formation of queries.
CONCLUSIONS AND FUTURE WORK
In this article we have presented a search and
retrieval scheme that uses a single sketch to
retrieve 3D models and compile a 3D environ-
ment by using the available multimedia content
traveling in a content-centric network. By expand-
ing the content-centric network to support multi-
media similarity content search, we provide users
the ability to retrieve multimedia content already
available in the network without knowing where
this content is stored or the name of each con-
tent in question. On the other hand, the sketch-
based user interface is an intuitive UI that
provides a greatly enhanced user experience for
multimedia content search while helping users
express in detail their thoughts and ideas.
For the future, as far as the user interface is
concerned, we plan to rebuild it in a web applica-
tion in order to have a wider group of testers and
extend the user’s actions available in the current
version. Also, we are considering inserting real 3D
video streams so as to create real-time on-the-fly
3D immersive environments from simple sketches.
[attachment=58025]
ABSTRACT
In this article a complete and innovative sys-
tem for automatic creation of 3D environments
from multimedia content available in the network
is presented. The core application provides an
interface where the user sketches in 2D the scene
that s/he aims to build. Moreover, the GUI appli-
cation exploits the similarity search and retrieval
capabilities of search-enabled content-centric
networks to fetch 3D models that are similar to
the drawn 2D objects. The retrieved 3D models
act as the building components for the automati-
cally constructed 3D scene. Two CCN-based
applications are also described, which perform
the query routing and similarity search on each
node of the CCN network.
INTRODUCTION
In the new era of the media Internet where multi-
media content is overflowing the networks and
users are usually near a networked device, the
available forms of communication seem inade-
quate. IP has changed the way we communicate
and entertain ourselves, using voice over IP (VoIP),
videoconferencing, IPTV, email, instant messaging,
social networks, and so on. However, now is the
time users really need a completely new user expe-
rience that transcends these communication forms.
In this new form of communication, 3D virtu-
al environments will be the places for meeting,
conversation, and entertainment among friends
and colleagues. Moreover, these places will be
constructed dynamically from each user based
on the exact needs of the communication ses-
sion. In order to do so in an easy and intuitive
way, users should have the ability to search,
retrieve, and use the deluge of multimedia con-
tent available in the networks as building com-
ponents of a new 3D environment.
SYSTEM ARCHITECTURE
The main components of the proposed system
are an application named sketchTo3D, which
provides the sketch user interface and displays
the 3D virtual environment; the searchGateway
application, which acts as a gateway between
TCP/IP and the CCN network; and finally, the
searchProxy application that runs on every
search-enabled CCN party in order to perform a
similarity search in their local repository.
Figure 1 presents the overall architecture
with the search-enabled CCN, the CCN search
gateway, and the end user’s PC that hosts the
sketchTo3D application. All these components
are explained in detail in the following sections.
THE SKETCHTO3D APPLICATION
Querying by example (QBE) is a very common
technique for querying multimedia databases.
However, a prerequisite for the user is to have
an object that is similar to what s/he is looking
for. From this point of view, the QBE approach
may not be that practical for a single-modality
search. On the other hand, in a multimodal
setup where objects from one modality are
always available to the user (e.g., sketch) for the
formation of queries.
CONCLUSIONS AND FUTURE WORK
In this article we have presented a search and
retrieval scheme that uses a single sketch to
retrieve 3D models and compile a 3D environ-
ment by using the available multimedia content
traveling in a content-centric network. By expand-
ing the content-centric network to support multi-
media similarity content search, we provide users
the ability to retrieve multimedia content already
available in the network without knowing where
this content is stored or the name of each con-
tent in question. On the other hand, the sketch-
based user interface is an intuitive UI that
provides a greatly enhanced user experience for
multimedia content search while helping users
express in detail their thoughts and ideas.
For the future, as far as the user interface is
concerned, we plan to rebuild it in a web applica-
tion in order to have a wider group of testers and
extend the user’s actions available in the current
version. Also, we are considering inserting real 3D
video streams so as to create real-time on-the-fly
3D immersive environments from simple sketches.