An experiment management framework for TAC SCM agent evaluation

John Collins, Wolf Ketter, Anuraag Pakanati

Research output: Chapter/Conference proceedingConference proceedingAcademicpeer-review

Abstract

We describe a web-based system for defining and running \tac experiments, and collecting results. It is a research tool, intended to support experimentation and evaluation of alternate agent configurations. With it, we are able to set up sets of experiments, each of which runs multiple games with a fixed set of competing agents. Game and agent logs are gathered together for later analysis. Experiment sets can be queued, and given enough hardware, multiple games can be run in parallel.
Original languageUndefined/Unknown
Title of host publicationWorkshop: Trading Agent Design and Analysis (TADA) at Twenty-First International Joint Conference on Artificial Intelligence (IJCAI 2009)
Pages9-13
Number of pages5
Publication statusPublished - 2009

Bibliographical note

Collins09TADA

Cite this