I-SEARCH - A unIfied framework for multimodal content SEARCH

- A unIfied framework for multimodal content SEARCH

FP7 LogoEU Logo

Rich Unified Content Description

The Rich Unified Content Description (RUCoD) consists of a multi-layered structure, which integrates content’s geometrical, topological, temporal, multisensory and multimodal information and meta-tags connected with the properties of the content.

Learn More

Sophisticated Mechanisms for Interaction

I-SEARCH will investigate novel, sophisticated mechanisms for interaction with content, with a main focus on multimodality, context-awareness, emotional/expressive, and social interaction.

Learn More

Presentation Utilizing Visual Analytics

I-SEARCH will develop methods for analytic reasoning of
search results, data representation mechanisms for the conversion of the RuCOD format to structured forms by using novel information visualisation algorithms.

Learn More


About the Project

The I-SEARCH project aims to provide a novel unified framework for multimodal content indexing, sharing, search and retrieval. The I-SEARCH framework will be able to handle specific types of multimedia and multimodal content (text, 2D image, sketch, video, 3D objects and audio) alongside with real world information, which can be used as queries and retrieve any available relevant content of any of the aforementioned types.

Objectives

The aim of the I-SEARCH project is the development of the first search engine able to handle a wide range of specific types of multimedia and multimodal content (text, 2D image, sketch, video, 3D objects, audio and combination of the above), which can be used as queries and retrieve any available relevant content of any of the aforementioned types.

Methodology

The I-SEARCH project covers research in multimedia search and retrieval, relevance feedback, multimodal interaction, personalization and visual analytics. These disciplines are combined with market research, technology assessment, valorisation and business modelling.

Expected Results

Despite the significant achievements in multimedia search technologies, the existing solutions still lack several important features, which could guarantee high-quality search services and improved enduser experience. More specifically the following technological/scientific research topics will be addressed by the I-SEARCH project:

  1. A unified framework for multimodal content search and retrieval.
  2. Sophisticated mechanisms for interaction with content.
  3. Efficient presentation of the retrieved results.

Partnership

The sheer amount of leading-edge technologies needed to implement the I-SEARCH project, requires a cross-border and cross-sectoral approach. The I-SEARCH project partners bring together a unique combination of both technical and business skills and expertise necessary to form an effective consortium.

« Jan iCalendar Mar »
February 2012
M T W T F S S
 12345
6789101112
13141516171819
20212223242526
272829EC

Events Calendar

Use the calendar on the left to access info on interesting upcoming events.

Project’s News & Activities

Publications during the third year

  1. A. Axenopoulos, S. Manolopoulou, P. Daras, “Optimizing Multimedia Retrieval using Multimodal Fusion and Relevance Feedback Techniques“, 18th International Conference on MultiMedia Modeling (MMM 2012), January 4-6, 2012, Klagenfurt, Austria.
  2. T. Steiner, L. Sutton, S. Spiller, M. Lazzaro, F. S. Nucci, V. C., A. Massari, A. Camurri, A. Verroust-Blondet, L. Joyeux, J., P. Grimm, A. Mademlis, S. Malassiotis, P. Daras, A. Axenopoulos and D. Tzovaras, “I-SEARCH – A Multimodal Search Engine based on Rich Unified Content Description (RUCoD)“, World Wide Web 2012, EU projects track, 16-20 April 2012, Lyon, France, accepted for publication.

The VIS-SENSE Project

VIS-SENSE is an EU-funded research project focused on the development of visual analytics technologies for the enhancement of international network security.
Read More »

I-SEARCH Use Case: Search for the Motorcycle of your Dreams

Motorcycle dealers and bikers could use I-SEARCH for retrieval of motorcycles using custom details, such as sketch of shape of fuel  tank or exaust pipes, color, or even engine sound.

For a visual realization of the scenario, please press here.

Please complete the online questionnaire.

© 2010 I-SEARCH Project Consortium