Memory resident parallel inverted index construction

Tayfun Kucukyilmaz, Ata Turk, Cevdet Aykanat*

*Corresponding author for this work

Research output: Contribution to conferencePaperAcademic

1 Citation (Scopus)

Abstract

Advances in cloud computing, 64-bit architectures and huge RAMs enable performing many search related tasks in memory.We argue that term-based partitioned parallel inverted index construction is among such tasks, and provide an efficient parallel framework that achieves this task. We show that by utilizing an efficient bucketing scheme we can eliminate the need for the generation of a global index and reduce the communication overhead without disturbing balancing constraint. We also propose and investigate assignment schemes that can further reduce communication overheads without disturbing balancing constraints. The conducted experiments indicate promising results.

Original languageEnglish
Pages99-105
Number of pages7
DOIs
Publication statusPublished - 2012
Externally publishedYes
Event26th Annual International Symposium on Computer and Information Science, ISCIS 2011 - London, United Kingdom
Duration: 26 Sept 201128 Sept 2011

Conference

Conference26th Annual International Symposium on Computer and Information Science, ISCIS 2011
Country/TerritoryUnited Kingdom
CityLondon
Period26/09/1128/09/11

Fingerprint

Dive into the research topics of 'Memory resident parallel inverted index construction'. Together they form a unique fingerprint.

Cite this