A Hybrid Model Words-Driven Approach for Web Product Duplicate Detection

M de Bakker, Flavius Frasincar, Damir Vandic

Research output: Chapter/Conference proceedingConference proceedingAcademicpeer-review

16 Citations (Scopus)

Abstract

The detection of product duplicates is one of the challenges that Web shop aggregators are currently facing. In this paper, we focus on solving the problem of product duplicate detection on the Web. Our proposed method extends a state-of-the-art solution that uses the model words in product titles to find duplicate products. First, we employ the aforementioned algorithm in order to find matching product titles. If no matching title is found, our method continues by computing similarities between the two product descriptions. These similarities are based on the product attribute keys and on the product attribute values. Furthermore, instead of only extracting model words from the title, our method also extracts model words from the product attribute values. Based on our experimental results on real-world data gathered from two existing Web shops, we show that the proposed method, in terms of F1-measure, significantly outperforms the existing state-of-the-art title model words method and the well-known TF-IDF method.
Original languageEnglish
Title of host publicationAdvanced Information Systems Engineering
PublisherSpringer-Verlag
Pages149-161
Number of pages13
Volume7908
DOIs
Publication statusPublished - 2013

Research programs

  • EUR ESE 32

Fingerprint

Dive into the research topics of 'A Hybrid Model Words-Driven Approach for Web Product Duplicate Detection'. Together they form a unique fingerprint.

Cite this