Read More:
The Multimodal Analysis Lab is a lab in the Interactive Digital Media Institute (IDMI), an interdisciplinary research institute to be established at the National University of Singapore in 2007.  The other labs are Mixed Reality, Social Robotics, Games, Ambient Intelligence, Multimedia Sensing, Social and Cognitive and Arts & Creativity. The IDMI’s research agenda is to undertake leading-edge, use-inspired basic research in emerging fields of interactive digital media (IDM) relevant to the future needs of Singapore.

 

The interdisciplinary Multimodal Analysis Lab team consisting of social scientists and computer scientists will develop prototype IDM software  for modelling, analyzing, storing and retrieving the meaning arising in print and electronic texts and interactive digital sites constructed through the use of multiple semiotic resources (e.g. language, visual imagery,  gesture, movement, music, sound, three-dimensional objects and so forth).  The specific aims of the three year research programme in the Multimodal Analysis Lab are  (a) to develop prototype IDM software for multimodal and multimedia analysis of visual images, video texts and interactive digital sites; (b)  to investigate the integrative dynamics of complex meaning-making practices; and (c) to critically examine the relative affordances and simultaneous constraints of different forms of technology. 

 

The research will advance existing computer-based techniques for multimedia analysis which depend on low-level feature information within specific domains of activity, and research in the humanities which requires specially designed tools and digital platforms to dynamically model and analyse meaning arising in multimodal discourses. The interdisciplinary research programme has downstream R&D applications for industry, business and government because searching, managing and retrieving information is a significant problem with the rapid advance of digital technology which has led to the profileration of visual images, video texts and interactive digital sites as standard formats for communication. In addition, the research will advance our understanding of  the relations between patterns of thinking and technology.  The 20+ member Multimodal Analysis Lab research team will be lead by Kay O’Halloran (Department of English Language & Literature)

 

For more comprehensive information on this project, For more comprehensive information on this project, please visit the Multimodal Analysis Lab