30 October 2007

Query the obscure

Be the first to share

Query the obscure
Gaining a better understanding of queries is a top priority of the search industry.

When it comes to common searches that repeat millions of times like “Britney Spears” or “Hybrid Cars,” returning the most appropriate results, or advertisements, is not difficult. But what about queries that are exceptionally rare and may never repeat more than a single time? Clearly, these queries are infinitely harder for the search engine to understand.

Andrei Broder, Yahoo! Research Fellow and Vice President of Search Technology and Computational Advertising, and a team of Yahoo! researchers set out to tackle this problem. Their work is outlined in a paper called Robust Classification of Rare Queries Using Web Knowledge, that appeared in SIGIR 2007.

To address the problem, the Yahoo! team proposed a methodology for using search results, as well as information available on the Web, as a source of external knowledge. To this end, they sent rare queries to a search engine and assumed that a majority of the highest-ranking search results were relevant to the query. Categorizing these results allowed the team to classify the original query with high accuracy.

The results definitively confirmed that using the Web as a repository of world knowledge contributes valuable information about the query, and aids in its correct classification. “We discovered the best source of information to understand what these rare queries are about is to look at the search results,” Broder explains. “If you look at each returned page as a vote on what the query is about, you find that the majority tends to be correct even though many individual pages are wrong.”

Read full story
Download paper

Be the first to share
31 July 2015
Service Design in Consumer Banking: the challenges and opportunities
Last month the people from Irish UX consultancy Frontend Design looked at the UX revolution in healthcare and how changes in that sector are moving towards putting the customer at the centre of the service. …
27 July 2015
New qualitative research on video consumption by UK youth
TV viewing (live, playback and Broadcaster VOD services) dominates the video viewing of all ages; however 16-24s have a more varied video diet, with TV accounting for two thirds of their total video viewing compared …
22 July 2015
How ethnographic research helped transform a US paint company
Almost all business leaders now acknowledge that they would love to engage in the deep learning that long-term customer observation can foster, but in practice such endeavors are methodically undermined in the fast paced corporate …
14 July 2015
Smart Cities will know everything about you
So, asks consultant Mike Weston, how can marketers cash in without becoming enemies of the people? Weston writes that the law will be too slow to catch up with digital innovations and that businesses in a …
4 July 2015
Videos online of KISD service design conference
On May 18th 2015 the Köln International School of Design (KISD) in Germany hosted the conference "Service Design – Redefining the Meaning of Design". Designers, companies and scientists shared insights on theory and practice of Service …
1 June 2015
Exploring the ‘next nature’ that people and technology are creating
The Next Nature website sets out to radically shift our notion of nature: Our image of nature as static, balanced and harmonic is naive and up for reconsideration. Where technology and nature are traditionally seen as …
28 May 2015
The driverless car push ignores challenges of people and context
Autonomous or driverless cars are based on a technology push strategy. Beyond statements like “freeing up time”, “reducing accidents” and some simple scenarios on “remote parking” or “vehicle sharing”, there is far too little thought …
17 May 2015
Design thinking without deep analysis is reckless. A more balanced approach is needed.
Larry Keeley, co-founder of innovation firm Doblin which is now a unit of Deloitte Consulting LLP, says that too often advocates of “design” regard it as an elixir that can somehow transform conservative companies into …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

2 July 2015
Getting citizens involved in protecting fragile energy environments

A new project funded under the FP7 European Commission framework is getting citizens involved in testing new tools for reducing energy consumption during peak loads, in the hope that its pilot program will set the new state of the art for protecting locations with fragile electricity supplies. One of France’s most fragile regions The Provence-Alpes-Côte […]

5 May 2015
Experientia designer Dohun YuLuck Jang 유록 in Design 4 Disaster

Design 4 Disaster features an engaging illustrated safety manual for ship passengers, a personal project by Experientia designer Dohun YuLuck Jang 유록. After the Korean ferry accident last year, Yuluck (who is Korean) wanted to find a way to make safety manuals more interesting to read. He spent one year designing an interactive safety guide […]

16 March 2015
Better Health and Wellbeing: Giving the elderly in Singapore sparkling golden years

Invitation: sharing session, Singapore, 30 March 2015   What are the hopes and fears of the elderly in Singapore? How can designers offer solutions that support the elderly in managing their health and wellness? What can healthcare professionals do to help them keep active? What role can technology play in the elderly’s daily lives? Design consultants […]

1 January 2015
Happy Playful New Year
21 December 2014
Experientia’s Twitter feed live

Experientia has now its own Twitter feed. Four months of Putting People First posts and other links have already been uploaded. If you followed Experientia on Twitter through the feed of its CEO, Mark Vanderbeeken, make sure to now also follow the company (but don’t unfollow Mark, who will keep on tweeting away). And while […]

19 December 2014
Putting People First blog redesigned

Experientia’s Putting People First blog has been redesigned. It is now entirely responsive, allows for easier browsing, searching, and filtering, and features larger images on the posts. The entire history of posts remains accessible as before. We are still tweaking things and welcome any feedback.

See all articles