Project No.: 5003-045399 01.03.96 - 31.12.99

Project leader: Prof. Nadia Magnenat-Thalmann, Centre Universitaire d’Informatique (CUI), University of Geneva
e-mail: thalmann@cui.unige.ch

Name of project: Distance communication using a networked virtual collaborative environment

Partners:
Prof. Daniel Thalmann, Laboratoire d’Infographie, Swiss Federal Institute of Technology at Lausanne (EPFL)
Tony Conde, Swisscom, Geneva
Bernard Haerri, Dell Computer SA, Geneva

Funding: Sfr 493,203.-

Summary: The main object of the project "Distance communication using a networked virtual collaborative environment" is to develop a system allowing several users to interact by means of a common networked environment in real time and to manipulate objects in virtual space. Typical applications are engineering and simulations, above all watch assembly. The system will be linked to a CAD system. The project will implement the following functions:

• realtime communication and telepresence in a common environment between distant locations;
• representation of the participants by virtual actors in the form of articulated figures;
• mechanisms for users to interact with each other via the natural demeanor (facial expressions, gestures) of the virtual actors representing them;
• mechanisms for the users to interact with the rest of the virtual environment through realistic behaviors such as walking about and grasping;
• user-customized tools for manipulating CAD models;
• autonomous actors to help and interact with the participants.

In phase one of this project, a system was developed which allows several users to interact in realtime by virtue of a common networked virtual environment and to manipulate object in virtual space. The participants are represented as three-dimensional virtual human-beings in a virtual common space.

In the continuation phase, the main thrust will be placed on developing applications with a high-performance PC as a run-time platform and a lower transmission bandwidth. The system will support the following functions:

• Calculation of three-dimensional, realistic face models of the participants in realtime;
• Realtime communication between people in different places with the help of clone faces;
• Natural interaction between the users and the surroundings in terms of body movements and speech;
• Autonomous actors cue the participants;
• Representation and manipulation of data using multimedia objects in images, text, sound and animation.

The project combines a variety of technologies (networks, virtual reality, animation) and will concentrate on communication in professional advisory situations involving an expert capable of moving and discussing topics in a realistic three-dimensional environment. This gives the participants greater freedom than in a conventional videoconference. Instead of a real advisor, an autonomous virtual advisor will coach the participants in simple tasks. The result will be shown as a demonstrator on a PC with an Internet connection.

Cooperation:
Cooperation with the UBS, Swisscom and Dell Computer Manufacturers is planned. The results will be demonstrated with pilot systems.