Skip to content | Change text size

 

ECSE Departmental Research Seminar, 12th April, 2006

Title:Finding the Correspondence of Audio-Visual Events by Object Manipulation


Speaker: Mr. Kento Nishibori, Nagoya University, Japan

Abstract:

A human being understands the objects in the environment by integrating information obtained by the senses of sight, hearing and touch. In this integration, active manipulation of objects plays an important role. This enables us to determine the correspondence of audio-visual events even in noisy and time variant environment. This research proposes a new method for determining the audio-visual correspondence by incorporating active manipulation. First, audio events (sound onset) and visual events (moving direction change) are detected. Next, the correlation between the motor command and both the audio and visual events are calculated. Finally, audio and visual events which have high correlations with motor command are integrated into the same object. The results of experiments in the real environment show the effectiveness of the proposed method.

About the speaker:

Kento Nishibori received his BS degree in Engineering (Mechanical Engineering) from Nihon University in 2002, and his Master of Arts (Human Informatics) from Nagoya University in 2004. Presently he is a doctoral student in the Department of Media Science, Graduate School of Information Science at Nagoya University. Also since 2004, he has been a Research Assistant for the 21st Century COE (Center of Excellence) Program titled "Intelligent Media Integration for Social Information Infrastructure" proposed by Nagoya University.

  
Visitors Information
A map of the Clayton Campus of Monash University indicates the venue, Building 72, and visitor parking on the top floor of the North carpark, Building 76.

Limited reserved parking spaces are available for visitors attending the seminar. (Requests for parking should be made in advance)