Books

Diederik M. Roijers and Shimon Whiteson - Multi-Objective Decision Making. In the series: Synthesis Lectures on Artificial Intelligence and Machine Learning 11:1, Morgan and Claypool, April 2017. ISBN: 9781627059602 (paperback) / 9781627056991 (e-book). [link]

Journal articles

Diederik Roijers, Shimon Whiteson, and Frans Oliehoek - Computing Convex Coverage Sets for Faster Multi-Objective Coordination. Journal of Artificial Intelligence Research, 52:399–443, 2015. [pdf] [bib]

Diederik M. Roijers, Peter Vamplew, Shimon Whiteson, and Richard Dazeley - A Survey of Multi-Objective Sequential Decision-Making. Journal of Artificial Intelligence Research, 48:67–113, 2013. [pdf] [bib]

Dissertation

Diederik M. Roijers - Multi-Objective Decision-Theoretic Planning, University of Amsterdam, 2016. [pdf] [bib]

Conference papers

Denis Steckelmacher, Diederik M. Roijers, Anna Harutyunyan, Peter Vrancx, Hélène Plisnier, Ann Nowé - Reinforcement Learning in POMDPs with Memoryless Options and Option-Observation Initiation Sets. In Proceedings of the 32th AAAI Conference on Artificial Intelligence, February 2018. (To appear.) [pdf]

Diederik M. Roijers, Luisa M. Zintgraf, and Ann Nowé - Interactive Thompson Sampling for Multi-Objective Multi-Armed Bandits. In Proceedings of the 5th International Conference on Algorithmic Decision Theory (ADT), October 2017. [pdf]

Ayumi Igarashi and Diederik M. Roijers - Multi-Criteria Coalition Formation Games. In Proceedings of the 5th International Conference on Algorithmic Decision Theory (ADT), October 2017. [pdf]

Luisa M. Zintgraf, Edgar A. Lopez-Rojas, Diederik M. Roijers, Ann Nowé - MultiMAuS: a Multi-modal Authentication Simulator for Fraud Detection Research. In Proceedings of the European Modeling and Simulation Symposium (EMSS), September 2017. [pdf]

Maarten de Waard, Diederik M. Roijers and Sander C.J. Bakkes - Monte Carlo Tree Search with Options for General Video Game Playing. In Proceedings of the 2016 IEEE Conference on Computational Intelligence and Games, September 2016. [pdf]

Joost van Doorn, Daan Odijk, Diederik M. Roijers, and Maarten de Rijke - Balancing Relevance Criteria through Multi-Objective Optimization. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, July 2016. [pdf] [bib]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan and Mathijs de Weerdt - Solving Transition-Independent Multi-agent MDPs with Sparse Interactions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence, May 2016. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans Oliehoek - Point-Based Planning for Multi-Objective POMDPs. In IJCAI 2015: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 1666-1672, July 2015. [pdf] [bib]

Luisa M. Zintgraf, Timon V. Kanters, Diederik M. Roijers, Frans A. Oliehoek, and Philipp Beau - Quality Assessment of MORL Algorithms: A Utility-Based Approach. In Benelearn 2015: Proceedings of the Twenty-Fourth Belgian-Dutch Conference on Machine Learning, June 2015. [pdf] [bib]

Mircea Traichioiu, Sander Bakkes and Diederik M. Roijers - Grammar-based Procedural Content Generation from Designer-provided Difficulty Curves. In FDG2015: Proceedings of the Foundations of Digital Games conference, June 2015. [pdf] [bib]

Alex Rietveld, Sander Bakkes, and Diederik M. Roijers - Circuit-Adaptive Challenge Balancing in Racing Games. In GEM 2014: IEEE Games, Entertainment, and Media, pp. 54-61, October 2014. [pdf] [bib]

Paris Mavromoustakos Blom, Sander Bakkes, Chek Tien Tan, Shimon Whiteson, Diederik M. Roijers, Roberto Valenti and Theo Gevers - Towards Personalised Gaming via Facial Expression Recognition. In AIIDE-14: Proceedings of the Tenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment , pp. 30-36, October 2014. [pdf] [bib]

Maarten Inja, Chiel Kooijman, Maarten de Waard, Diederik M. Roijers, and Shimon Whiteson - Queued Pareto Local Search for Multi-Objective Optimization. In PPSN 2014: Proceedings of the Thirteenth International Conference on Parallel Problem Solving from Nature, pp. 589–599, September 2014. [pdf] [bib]

Diederik M. Roijers, Joris Scharpff, Matthijs T.J. Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson - Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In ICAPS 2014: Proceedings of the Twenty-Fourth International Conference on Automated Planning and Scheduling, pp. 262–270, June 2014. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans Oliehoek - Linear Support for Multi-Objective Coordination Graphs. In AAMAS 2014: Proceedings of the Thirteenth International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 1297-1304, May 2014. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek - Computing Convex Coverage Sets for Multi-Objective Coordination Graphs. In ADT 2013: Proceedings of the Third International Conference on Algorithmic Decision Theory, pp. 309–323, November 2013. [pdf] [bib]

Diederik M. Roijers, Johan Jeuring and Ad Feelders - Probability estimation and a competence model for rule based e-tutoring systems, In Proceedings of LAK12: 2nd International Conference on Learning Analytics and Knowledge, pp. 255-258, April 29 - May 2, 2012. [pdf] [bib]

Workshop papers, Demonstrations and Extended Abstracts

Peter Vamplew, Dean Webb, Luisa M. Zintgraf, Diederik M. Roijers, Richard Dazeley, Rustam Issabekov, and Evan Dekker - MORL-Glue: A Benchmark Suite for Multi-Objective Reinforcement Learning. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper) [pdf]

Denis Steckelmacher, Hélène Plisnier, Diederik M. Roijers, and Ann Nowé - Hierarchical Reinforcement Learning for a Robotic Partially Observable Task. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper), 2 pages, November 2017. [pdf]

Manon Legrand, Roxana Rădulescu, Diederik M. Roijers, and Ann Nowé - Neural Network Reuse in Deep RL for Autonomous Vehicles among Human Drivers. In BNAIC 2017, 2 pages, November 2017. (Extended abstract) [pdf]

Manon Legrand, Roxana Rădulescu, Diederik M. Roijers, and Ann Nowé - The SimuLane Highway Traffic Simulator for Multi-Agent Reinforcement Learning. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper) [pdf]

Denis Steckelmacher, Hélène Plisnier, Diederik M. Roijers, and Ann Nowé - Hierarchical Reinforcement Learning for Robots in POMDPs with Option-Observation Initiation Sets. In Proceedings of Delft Workshop on Robot Learning (DWRL), 3 pages, September 2017. [pdf]

Ayumi Igarashi and Diederik M. Roijers - Multi-Criteria Coalition Formation Games. In Proceedings of 8th AAMAS Workshop on Cooperative Games in Multiagent Systems (CoopMAS), 15 pages, May 2017. [pdf]

Pieter Libin, Timothy Verstraeten, Kristof Theys, Diederik M. Roijers, Peter Vrancx, and Ann Nowé - Efficient evaluation of influenza mitigation strategies using preventive bandits. In Proceedings of the AAMAS workshop on Adaptive Learning Agents (ALA), 9 pages, May 2017.

Hossam Mossalam, Yannis Assael, Diederik M. Roijers, and Shimon Whiteson - Multi-Objective Deep Reinforcement Learning. In Proceedings of the NIPS workshop on Deep Reinforcement Workshop, Barcelona, December 2016.

Joost van Doorn, Daan Odijk, Diederik M. Roijers, and Maarten de Rijke - Multi-Objective Optimization for Information Retrieval, In Proceedings of the 28th Belgium-Netherlands Artificial Intelligence Conference, November 2016. (Extended Abstract) [pdf]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt - Conditional Return Policy Search for TI-MMDPs with Sparse Interactions, In Proceedings of the 28th Belgium-Netherlands Artificial Intelligence Conference, November 2016. (Extended Abstract) [pdf]

Diederik M. Roijers - Abstract: Multi-Objective Decision-Theoretic Planning. In AI Matters, page 11-12, Volume 2, Issue 4, Summer 2016. [pdf]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. In Proceedings of the 22nd European Conference on Artificial Intelligence, August 2016. (Extended Abstract) [pdf]

Diederik M. Roijers, Shimon Whiteson, Alex Ihler, and Frans A. Oliehoek - Variational Multi-Objective Coordination, In Proceedings of the 2015 NIPS workshop: Learning, Inference and Control of Multi-Agent Systems, December 2015. [pdf] [bib]

Maarten de Waard, Maarten Inja, Chiel Kooijman, Diederik M. Roijers, and Shimon Whiteson - Queued Pareto Local Search for Multi-objective Decision Making, In Proceedings of the 27th Belgium-Netherlands Artificial Intelligence Conference, November 2015. (Extended Abstract) [pdf] [bib]

Diederik M. Roijers‚ Shimon Whiteson‚ Peter Vamplew and Richard Dazeley - Why Multi−Objective Reinforcement Learning?. In EWRL 2015: Proceedings of the Twelfth European Workshop on Reinforcement Learning, July 2015. [pdf] [bib]

Diederik M. Roijers - Efficient Methods for Multi-Objective Decision-Theoretic Planning. In IJCAI 2015: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, July 2015. (Doctoral Consortium) [pdf]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan and Mathijs de Weerdt - Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015. [pdf] [bib]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the value function of zero-sum games of incomplete information. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015. [pdf] [bib]

Chiel Kooijman, Maarten de Waard, Maarten Inja, Diederik M. Roijers, and Shimon Whiteson - Pareto Local Policy Search for MOMDP Planning. In ESANN 2015: Special Session on Emerging Techniques and Applications in Multi-Objective Reinforcement Learning at the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning 2015, pp. 53-58, April 2015. [pdf] [bib]

Diederik M. Roijers, Joris Scharpff, Matthijs T.J. Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson - Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proceedings of the 26th Belgium-Netherlands Artificial Intelligence Conference, November 2014. (Extended Abstract) [pdf]

Paris Mavromoustakos Blom, Sander Bakkes and Diederik M. Roijers - Using Facial Expressions for Personalised Gaming. In Proceedings of the 26th Belgium-Netherlands Artificial Intelligence Conference, November 2014. (Demo) [pdf]

Diederik M. Roijers - Convex Coverage Set Methods for Multi-Objective Collaborative Decision Making. In AAMAS 2014: Proceedings of the Thirteenth International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 1727-1728, May 2014. (Doctoral Consortium) [pdf] [bib]

Eugenio Bargiacchi, Camiel R. Verschoor, Guangliang Li, and Diederik M. Roijers - Decentralized Solutions and Tactics for RTS, In Proceedings of the 25th Belgium-Netherlands Artificial Intelligence Conference, pp. 272-273, 7-8 November 2013. (Demo) [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek - Multi-Objective Variable Elimination for Collaborative Graphical Games, In Proceedings of the Twelfth International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1209–1210, May 2013. (Extended Abstract) [pdf] [bib]

Master's thesis

Diederik M. Roijers - Probability estimation and competence models for rule and strategy based e-tutoring systems, Master's thesis Applied Computing Science, Utrecht University, June 2011 [pdf] [bib]

ArXiv pre-prints

Hossam Mossalam, Yannis Assael, Diederik M. Roijers, and Shimon Whiteson - Multi-Objective Deep Reinforcement Learning [link]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. ArXiv e-prints, arXiv:1606.06888, June 2016. [link]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan, and Mathijs M. de Weerdt - Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version) [link]