Seminar Topics & Project Ideas On Computer Science Electronics Electrical Mechanical Engineering Civil MBA Medicine Nursing Science Physics Mathematics Chemistry ppt pdf doc presentation downloads and Abstract

Full Version: Poster: Say It To See It: A Speech Based Immersive Model Retrieval System
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
ABSTRACT
Virtual spaces have proven to be a valuable means to visualize
and inspect 3D environments. Unfortunately, adding objects to 3D
scenes while inside of an immersive environment is often difficult
as the means used to acquire models from repositories are built for
standard computer interfaces and are generally not available during
a users session. We develop a novel interface for the insertion
of models into a virtual scene through the use of voice, 3D visuals,
and a 3D input device. Our interface seamlessly communicates
with external model repositories (Trimble 3D Warehouse) enabling
models to be acquired and inserted in the scene during a user’s virtual
session. We see the benefits of our pipeline and interface in the
fields of design, architecture, and simulation.
Index Terms: H.5.1 [Information Presentation]: Multimedia Information
Systems—Artificial, augmented, and virtual realities;
1 INTRODUCTION
This paper introduces an interface and automated pipeline for
preparing and exporting content from a 3D design application. The
pipeline is combined with a solution of searching for models from
an external repository, in our case the Trimble 3DWarehouse, from
within a virtual environment (VE). A user can search for a model
using speech and choose a model they wish to download to the environment
from a GUI showing the search results. The chosen models
are downloaded, converted, and automatically loaded into the immersive
VE application. This interface could provide benefits for
design, architecture, and simulation, particularly at the conceptual
stage.
The goal of our work is to develop a method for users to create
scenes while entirely inside of a VE. 3D environments are much
more difficult to interact with compared to standard 2D user interfaces
[5]. Unfortunately, standard methods for interfacing with virtual
environments do not work well for input technologies. Takala
et al. provide a survey of recent interfaces for 3D environments
[9]. Speech has been identified as an intuitive interface for Virtual
Environments [4]. Speech can often be used as an augmented interface
to direct manipulation [2, 7]. Kim provides a survey of speech
e-mail: rdtredinnick[at]wisc.edu
†e-mail: kbponto[at]wisc.edu
interfaces for 3D applications [6].
Model repositories and search engines for them have been available
since the early 2000’s with Min et al. providing a good listing
of several early 3D model databases [8]. Our system utilizes the
Trimble 3D Warehouse (formerly the Google Warehouse) inside of
SketchUp [3]. Boeykens and Bogani describe the difficulties in using
model repositories [1]. The design of our system takes these
difficulties into consideration.