Live Webinar - Optimize LLM performance through Human-AI Collaboration

Leading Search Engine Provider Enhances Ad Relevance

We provided in-market evaluators for multiple international markets to ensure accurate ad performance
September 8, 2022
Share

The Company

A leading multilingual search engine provider looking to serve the best possible ads to its visitors.

The Challenge

A leading multilingual search engine provider relied on algorithms supported by an in-house team to serve the best possible ads to its visitors, and the company’s bottom line depended on clicks. Knowing whether ads were performing optimally was critical to the provider’s success. This company needed in-market evaluators for multiple international markets to ensure accurate ad performance.

The Solution

The search engine provider turned to us for this effort, based on strong recommendations from other internal teams. The project required multiple in-market evaluators who reviewed, verified, cleaned and labeled data to ensure the client’s ads services were performing accurately. The ads were reviewed, along with the content that the ads linked to, and ratings were assigned based on a five-point scale. Our project managers ensured that the evaluation data flowed back to the client in a timely manner according to the client’s specifications.

The Result

The search engine provider successfully measured ad relevance for specific queries as a result of the labeling provided by our team. This not only gave it a trend over time to understand which experiments were driving up relevance, but also allowed it to analyze root causes on irrelevant ads. Once the root cause was fixed, the provider could perform additional experiments to ensure other queries weren’t negatively impacted. Our high-quality labeling data has become a crucial piece of the machine learning process, training algorithms to provide more relevant ads, which results in higher revenue for the client.

As the project ramped globally, the search engine provider expanded search advertising into several new markets with the confidence of knowing that ads had been evaluated, sorted, and ranked appropriately by in-market experts, increasing the opportunity for revenue. This confidence was achieved due to the high-quality data that was provided. The client has repeatedly commended our team for its strong quality and performance.

Access to in-market evaluators for all of the client’s requested countries resulted in ads that were much more highly relevant to users in those locations.

Our highly skilled project management team ensured that rating information was delivered on time and according to the client’s quality standards. The team was also able to assist the client in identifying the root cause for ads that were underperforming so that they could optimize their resources to make the right improvements. Overall, our ability to consistently deliver quality data cemented this successful partnership.