Enhancing Semantics-Driven Recommender Systems with Visual Features

Mounir M. Bendouch, Flavius Frasincar, Tarmo Robal*

*Corresponding author for this work

Research output: Chapter/Conference proceedingConference proceedingAcademicpeer-review


Content-based semantics-driven recommender systems are often used in the small-scale news recommendation domain, founded on the TF-IDF measure but also taking into account domain semantics through semantic lexicons or ontologies. This work explores the application of content-based semantics-driven recommender systems to large-scale recommendations on the example of movie domain. We propose methods to extract semantic features from various item descriptions, including images. In particular, we use computer vision to extract semantic features from images and use these for recommendation together with various features extracted from textual information. The semantics-driven approach is scaled up with pre-computation of the cosine similarities and gradient learning of the model. The results of the study on a large-scale MovieLens dataset of user ratings demonstrate that semantics-driven recommenders can be extended to more complex domains and outperform TF-IDF on ROC, PR, F1, and Kappa metrics.

Original languageEnglish
Title of host publicationAdvanced Information Systems Engineering (caise 2022)
EditorsXavier Franch, Geert Poels, Frederik Gailly, Monique Snoeck
PublisherSpringer Science+Business Media
Number of pages17
ISBN (Print)9783031074714
Publication statusPublished - 2022
Event34th International Conference on Advanced Information Systems Engineering, CAiSE 2022 - Leuven, Belgium
Duration: 6 Jun 202210 Jun 2022

Publication series

SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13295 LNCS


Conference34th International Conference on Advanced Information Systems Engineering, CAiSE 2022

Bibliographical note

Publisher Copyright:
© 2022, Springer Nature Switzerland AG.


Dive into the research topics of 'Enhancing Semantics-Driven Recommender Systems with Visual Features'. Together they form a unique fingerprint.

Cite this