A machine learning approach for result caching in web search engines

Tayfun Kucukyilmaz*, B. Barla Cambazoglu, Cevdet Aykanat, Ricardo Baeza-Yates

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

14 Citations (Scopus)

Abstract

A commonly used technique for improving search engine performance is result caching. In result caching, precomputed results (e.g., URLs and snippets of best matching pages) of certain queries are stored in a fast-access storage. The future occurrences of a query whose results are already stored in the cache can be directly served by the result cache, eliminating the need to process the query using costly computing resources. Although other performance metrics are possible, the main performance metric for evaluating the success of a result cache is hit rate. In this work, we present a machine learning approach to improve the hit rate of a result cache by facilitating a large number of features extracted from search engine query logs. We then apply the proposed machine learning approach to static, dynamic, and static-dynamic caching. Compared to the previous methods in the literature, the proposed approach improves the hit rate of the result cache up to 0.66%, which corresponds to 9.60% of the potential room for improvement.

Original languageEnglish
Pages (from-to)834-850
Number of pages17
JournalInformation Processing and Management
Volume53
Issue number4
DOIs
Publication statusPublished - 1 Jul 2017
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2017 Elsevier Ltd

Fingerprint

Dive into the research topics of 'A machine learning approach for result caching in web search engines'. Together they form a unique fingerprint.

Cite this