Multimedia Evaluation



One of the challenges of multimedia search is that images and video are not always clearly labeled with the text that might match the content with a user’s query. Often, the relevance is visual or auditory, not textual. Training search engines to correctly evaluate nontextual relevance and return the best results requires a complex understanding of user intent and experience.

We provide evaluators who are experts in their market’s language and culture and who are enthusiastic about the medium—whether image or video—they are evaluating. They use their expertise to determine what users in their market are looking for and to evaluate how well the images or videos returned will satisfy those users. This data is then used by our clients to train their search engines to return the best images and videos for every query.