Learning optimization models in the presence of unknown relations

S Verwer, Y Zhang, Charlie Ye

Research output: Contribution to journalArticleAcademicpeer-review

33 Citations (Scopus)
16 Downloads (Pure)


In a sequential auction with multiple bidding agents, the problem of determining the ordering of the items to sell in order to maximize the expected revenue is highly challenging. The challenge is largely due to the fact that the autonomy and private information of the agents heavily influence the outcome of the auction. The main contribution of this paper is two-fold. First, we demonstrate how to apply machine learning techniques to solve the optimal ordering problem in sequential auctions. We learn regression models from historical auctions, which are subsequently used to predict the expected value of orderings for new auctions. Given the learned models, we propose two types of optimization methods: a black-box best-first search approach, and a novel white-box approach that maps learned regression models to integer linear programs (ILP), which can then be solved by any ILP-solver. Although the studied auction design problem is hard, our proposed optimization methods obtain good orderings with high revenues. Our second main contribution is the insight that the internal structure of regression models can be efficiently evaluated inside an ILP solver for optimization purposes. To this end, we provide efficient encodings of regression trees and linear regression models as ILP constraints. This new way of using learned models for optimization is promising. As the experimental results show, it significantly outperforms the black-box best-first search in nearly all settings.
Original languageEnglish
Pages (from-to)368-395
Number of pages28
JournalArtificial Intelligence
Issue numberMarch
Publication statusPublished - 29 May 2015


Dive into the research topics of 'Learning optimization models in the presence of unknown relations'. Together they form a unique fingerprint.

Cite this