30 October 2007

Query the obscure

Be the first to share

Query the obscure
Gaining a better understanding of queries is a top priority of the search industry.

When it comes to common searches that repeat millions of times like “Britney Spears” or “Hybrid Cars,” returning the most appropriate results, or advertisements, is not difficult. But what about queries that are exceptionally rare and may never repeat more than a single time? Clearly, these queries are infinitely harder for the search engine to understand.

Andrei Broder, Yahoo! Research Fellow and Vice President of Search Technology and Computational Advertising, and a team of Yahoo! researchers set out to tackle this problem. Their work is outlined in a paper called Robust Classification of Rare Queries Using Web Knowledge, that appeared in SIGIR 2007.

To address the problem, the Yahoo! team proposed a methodology for using search results, as well as information available on the Web, as a source of external knowledge. To this end, they sent rare queries to a search engine and assumed that a majority of the highest-ranking search results were relevant to the query. Categorizing these results allowed the team to classify the original query with high accuracy.

The results definitively confirmed that using the Web as a repository of world knowledge contributes valuable information about the query, and aids in its correct classification. “We discovered the best source of information to understand what these rare queries are about is to look at the search results,” Broder explains. “If you look at each returned page as a vote on what the query is about, you find that the majority tends to be correct even though many individual pages are wrong.”

Read full story
Download paper

Be the first to share
26 November 2015
50 important customer experience stats for business leaders
Esteban Kolsky is a customer strategist, researcher, keynote speaker, and a consultant (analyst for 15 years, 8 years with Gartner). He believes that research has become a commodity and value has shifted from discovery to …
26 November 2015
How brands design customer experiences of the future
In today’s digital age, consumers expect more from the business they support and the products they purchase. Consumers, Macala Wright writes, not only expect great brand experiences, they believe they’re entitled to them. This is …
10 November 2015
Why service design is luxury’s new battleground
Ana Andjelic writes in AdAge that most legacy luxury brands are failing at delivering service, especially online: The fact that most legacy luxury brands fail to successfully create and deliver service is unfortunate. The business of …
5 November 2015
Customer journey mapping is at the heart of digital transformation
Digital technologies such as analytics, mobility, social networks, cloud computing and the Internet of Things are making old ways of working redundant and forcing companies to transform. According to Raman Sapra, global head of Dell’s …
3 November 2015
Another book entitled “The Quantified Self”
The Quantified Self By Gina Neff and Dawn Nafus MIT Press, 264 pp. April 2016 Oops, that is confusing: two books by sociologists on the quantified self movement, both entitled "The Quantified Self" and both appearing in April 2016. …
23 October 2015
White paper: Design for aging
Designing the Second Half of Life: Innovation for Aging A visual white paper by Karten Design September 2015 The next 30 years will be a defining era for the American healthcare system, as the number of adults aged …
17 October 2015
[Book] The Quantified Self
The Quantified Self - A sociology of self-tracking by Deborah Lupton Polity Press April 2016 Description With the advent of digital devices and software, self-tracking practices have gained new adherents and have spread into a wide array of social domains. …
3 October 2015
Building a design-driven culture
It’s not enough to just sell a product or service—companies must truly engage with their customers. McKinsey & Company outlines four elements of a design-driven culture, necessary to embed experience design in an organization. Really understanding …

We are an international experience design consultancy helping companies and organisations to innovate their products, services and processes by putting people and their experiences first.

13 October 2015
Experientia report: Design for ageing gracefully

Design for Ageing Gracefully Rethinking Health and Wellness for the Elderly: Public Services Asian Insights & Design Innovation, DesignSingapore Council October 2015

29 September 2015
[Experientia book] Ethnography on elderly health and wellness

As we age, we increasingly depend on public services and the community for support. Well-designed public services can greatly affect the lives of the elderly and their experiences of healthcare. Experientia collaborated with DesignSingapore Council on understanding how the elderly interact with public services and how we can look towards improving their lives with design. […]

2 July 2015
Getting citizens involved in protecting fragile energy environments

A new project funded under the FP7 European Commission framework is getting citizens involved in testing new tools for reducing energy consumption during peak loads, in the hope that its pilot program will set the new state of the art for protecting locations with fragile electricity supplies. One of France’s most fragile regions The Provence-Alpes-Côte […]

5 May 2015
Experientia designer Dohun YuLuck Jang 유록 in Design 4 Disaster

Design 4 Disaster features an engaging illustrated safety manual for ship passengers, a personal project by Experientia designer Dohun YuLuck Jang 유록. After the Korean ferry accident last year, Yuluck (who is Korean) wanted to find a way to make safety manuals more interesting to read. He spent one year designing an interactive safety guide […]

16 March 2015
Better Health and Wellbeing: Giving the elderly in Singapore sparkling golden years

Invitation: sharing session, Singapore, 30 March 2015   What are the hopes and fears of the elderly in Singapore? How can designers offer solutions that support the elderly in managing their health and wellness? What can healthcare professionals do to help them keep active? What role can technology play in the elderly’s daily lives? Design consultants […]

1 January 2015
Happy Playful New Year
See all articles