Books

Diederik M. Roijers and Shimon Whiteson - Multi-Objective Decision Making. In the series: Synthesis Lectures on Artificial Intelligence and Machine Learning 11:1, Morgan and Claypool, April 2017. ISBN: 9781627059602 (paperback) / 9781627056991 (e-book). [link]

Journal articles

Stephane Doncieux, David Filliat, Natalia Diaz-Rodriguez, Tim Hospedales, Richard Duro, Alexandre Coninx, Diederik M. Roijers, Benoît Girard, Nicolas Perrin, Olivier Sigaud - Open-ended Learning: a Conceptual Framework based on Representational Redescription. Frontiers in Neurorobotics, 2018, (to appear).

Diederik Roijers, Shimon Whiteson, and Frans Oliehoek - Computing Convex Coverage Sets for Faster Multi-Objective Coordination. Journal of Artificial Intelligence Research, 52:399–443, 2015. [pdf] [bib]

Diederik M. Roijers, Peter Vamplew, Shimon Whiteson, and Richard Dazeley - A Survey of Multi-Objective Sequential Decision-Making. Journal of Artificial Intelligence Research, 48:67–113, 2013. [pdf] [bib]

Dissertation

Diederik M. Roijers - Multi-Objective Decision-Theoretic Planning, University of Amsterdam, 2016. [pdf] [bib]

Conference papers

Pieter Libin, Timothy Verstraeten, Diederik M. Roijers, Jelena Grujic, Kristof Theys, Philippe Lemey, and Ann Nowé - Bayesian Best-Arm Identification for Selecting Influenza Mitigation Strategies. In ECML-PKDD 2018, Dublin, September 2018. (To Appear.)

Eugenio Bargiacchi, Timothy Verstraeten, Diederik M. Roijers, Ann Nowé and Hado van Hasselt - Learning to Coordinate with Coordination Graphs in Repeated Single-Stage Multi-Agent Decision Problems. In ICML 2018, Stockholm, July 2018. (To Appear.) [pdf]

Jie Jiang, Mark Hoogendoorn, Qiuqiang Kong, Diederik M. Roijers and Nigel Gilbert - Predicting Appliance Usage Status In Home Like Environments. In 23rd International Conference on Digital Signal Processing (DSP 2018), 2018, (To Appear.)

Gongjin Lan, Milan Jelisavcic, Diederik M. Roijers, Evert Haasdijk, and A.E. Eiben - Directed Locomotion for Modular Robots with Evolvable Morphologies. In PPSN 2018, Coimbra, September 2018. (To Appear.) [pdf]

Milan Jelisavcic, Diederik M. Roijers, and A.E. Eiben - Analysing the Relative Importance of Robot Brains and Bodies. In ALIFE 2018 , July 2018. (To Appear.) [pdf]

Diederik M. Roijers, Erwin Walraven and Matthijs T.J. Spaan - Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs. In ICAPS 2018: Proceedings of the Twenty-Eighth International Conference on Automated Planning and Scheduling, June 2018. [pdf]

Luisa M. Zintgraf, Diederik M. Roijers, Sjoerd Linders, Catholijn M. Jonker, and Ann Nowé - Ordered Preference Elicitation Strategies for Supporting Multi-Objective Decision Making. In AAMAS 2018: Proceedings of the Seventeenth International Joint Conference on Autonomous Agents and Multi-Agent Systems, July 2018. [pdf]

Denis Steckelmacher, Diederik M. Roijers, Anna Harutyunyan, Peter Vrancx, Hélène Plisnier, Ann Nowé - Reinforcement Learning in POMDPs with Memoryless Options and Option-Observation Initiation Sets. In Proceedings of the 32th AAAI Conference on Artificial Intelligence, February 2018. [pdf]

Diederik M. Roijers, Luisa M. Zintgraf, and Ann Nowé - Interactive Thompson Sampling for Multi-Objective Multi-Armed Bandits. In Proceedings of the 5th International Conference on Algorithmic Decision Theory (ADT), October 2017. [pdf]

Ayumi Igarashi and Diederik M. Roijers - Multi-Criteria Coalition Formation Games. In Proceedings of the 5th International Conference on Algorithmic Decision Theory (ADT), October 2017. [pdf]

Luisa M. Zintgraf, Edgar A. Lopez-Rojas, Diederik M. Roijers, Ann Nowé - MultiMAuS: a Multi-modal Authentication Simulator for Fraud Detection Research. In Proceedings of the European Modeling and Simulation Symposium (EMSS), September 2017. [pdf]

Maarten de Waard, Diederik M. Roijers and Sander C.J. Bakkes - Monte Carlo Tree Search with Options for General Video Game Playing. In Proceedings of the 2016 IEEE Conference on Computational Intelligence and Games, September 2016. [pdf]

Joost van Doorn, Daan Odijk, Diederik M. Roijers, and Maarten de Rijke - Balancing Relevance Criteria through Multi-Objective Optimization. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, July 2016. [pdf] [bib]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan and Mathijs de Weerdt - Solving Transition-Independent Multi-agent MDPs with Sparse Interactions. In Proceedings of the 30th AAAI Conference on Artificial Intelligence, May 2016. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans Oliehoek - Point-Based Planning for Multi-Objective POMDPs. In IJCAI 2015: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 1666-1672, July 2015. [pdf] [bib]

Luisa M. Zintgraf, Timon V. Kanters, Diederik M. Roijers, Frans A. Oliehoek, and Philipp Beau - Quality Assessment of MORL Algorithms: A Utility-Based Approach. In Benelearn 2015: Proceedings of the Twenty-Fourth Belgian-Dutch Conference on Machine Learning, June 2015. [pdf] [bib]

Mircea Traichioiu, Sander Bakkes and Diederik M. Roijers - Grammar-based Procedural Content Generation from Designer-provided Difficulty Curves. In FDG2015: Proceedings of the Foundations of Digital Games conference, June 2015. [pdf] [bib]

Alex Rietveld, Sander Bakkes, and Diederik M. Roijers - Circuit-Adaptive Challenge Balancing in Racing Games. In GEM 2014: IEEE Games, Entertainment, and Media, pp. 54-61, October 2014. [pdf] [bib]

Paris Mavromoustakos Blom, Sander Bakkes, Chek Tien Tan, Shimon Whiteson, Diederik M. Roijers, Roberto Valenti and Theo Gevers - Towards Personalised Gaming via Facial Expression Recognition. In AIIDE-14: Proceedings of the Tenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment , pp. 30-36, October 2014. [pdf] [bib]

Maarten Inja, Chiel Kooijman, Maarten de Waard, Diederik M. Roijers, and Shimon Whiteson - Queued Pareto Local Search for Multi-Objective Optimization. In PPSN 2014: Proceedings of the Thirteenth International Conference on Parallel Problem Solving from Nature, pp. 589–599, September 2014. [pdf] [bib]

Diederik M. Roijers, Joris Scharpff, Matthijs T.J. Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson - Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In ICAPS 2014: Proceedings of the Twenty-Fourth International Conference on Automated Planning and Scheduling, pp. 262–270, June 2014. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans Oliehoek - Linear Support for Multi-Objective Coordination Graphs. In AAMAS 2014: Proceedings of the Thirteenth International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 1297-1304, May 2014. [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek - Computing Convex Coverage Sets for Multi-Objective Coordination Graphs. In ADT 2013: Proceedings of the Third International Conference on Algorithmic Decision Theory, pp. 309–323, November 2013. [pdf] [bib]

Diederik M. Roijers, Johan Jeuring and Ad Feelders - Probability estimation and a competence model for rule based e-tutoring systems, In Proceedings of LAK12: 2nd International Conference on Learning Analytics and Knowledge, pp. 255-258, April 29 - May 2, 2012. [pdf] [bib]

Workshop papers, Demonstrations and Extended Abstracts

Hélène Plisnier, Denis Steckelmacher, Tim Brys, Diederik M. Roijers and Ann Nowé - Directed Policy Gradient for Safe Reinforcement Learning with Human Advice, In EWRL 2018, Lille (to appear).

Denis Steckelmacher, Hélène Plisnier, Diederik M. Roijers and Ann Nowé - Stable, Practical and On-line Bootstrapped Conservative Policy Iteration, In EWRL 2018, Lille (to appear).

Diederik M. Roijers, Luisa M. Zintgraf, Pieter Libin, and Ann Nowé - Interactive Multi-Objective RL in Multi-Armed Bandits for Any Utility Function. In ALA workshop at ICML/AAMAS/IJCAI 2018, 8 pages, July 2018. [pdf] [Best Paper Award]

Diederik M. Roijers, Denis Steckelmacher, and Ann Nowé - Multi-objective Reinforcement Learning for the Expected Utility of the Return. In ALA workshop at ICML/AAMAS/IJCAI 2018, 8 pages, July 2018. [pdf]

Peter Vamplew, Dean Webb, Luisa M. Zintgraf, Diederik M. Roijers, Richard Dazeley, Rustam Issabekov, and Evan Dekker - MORL-Glue: A Benchmark Suite for Multi-Objective Reinforcement Learning. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper) [pdf]

Denis Steckelmacher, Hélène Plisnier, Diederik M. Roijers, and Ann Nowé - Hierarchical Reinforcement Learning for a Robotic Partially Observable Task. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper), 2 pages, November 2017. [pdf] [Best Demo Award]

Manon Legrand, Roxana Rădulescu, Diederik M. Roijers, and Ann Nowé - Neural Network Reuse in Deep RL for Autonomous Vehicles among Human Drivers. In BNAIC 2017, 2 pages, November 2017. (Extended abstract) [pdf]

Manon Legrand, Roxana Rădulescu, Diederik M. Roijers, and Ann Nowé - The SimuLane Highway Traffic Simulator for Multi-Agent Reinforcement Learning. In BNAIC 2017, 2 pages, November 2017. (Demonstration paper) [pdf]

Denis Steckelmacher, Hélène Plisnier, Diederik M. Roijers, and Ann Nowé - Hierarchical Reinforcement Learning for Robots in POMDPs with Option-Observation Initiation Sets. In Proceedings of Delft Workshop on Robot Learning (DWRL), 3 pages, September 2017. [pdf]

Ayumi Igarashi and Diederik M. Roijers - Multi-Criteria Coalition Formation Games. In Proceedings of 8th AAMAS Workshop on Cooperative Games in Multiagent Systems (CoopMAS), 15 pages, May 2017. [pdf]

Pieter Libin, Timothy Verstraeten, Kristof Theys, Diederik M. Roijers, Peter Vrancx, and Ann Nowé - Efficient evaluation of influenza mitigation strategies using preventive bandits. In Proceedings of the AAMAS workshop on Adaptive Learning Agents (ALA), 9 pages, May 2017.

Hossam Mossalam, Yannis Assael, Diederik M. Roijers, and Shimon Whiteson - Multi-Objective Deep Reinforcement Learning. In Proceedings of the NIPS workshop on Deep Reinforcement Workshop, Barcelona, December 2016.

Joost van Doorn, Daan Odijk, Diederik M. Roijers, and Maarten de Rijke - Multi-Objective Optimization for Information Retrieval, In Proceedings of the 28th Belgium-Netherlands Artificial Intelligence Conference, November 2016. (Extended Abstract) [pdf]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs M. de Weerdt - Conditional Return Policy Search for TI-MMDPs with Sparse Interactions, In Proceedings of the 28th Belgium-Netherlands Artificial Intelligence Conference, November 2016. (Extended Abstract) [pdf]

Diederik M. Roijers - Abstract: Multi-Objective Decision-Theoretic Planning. In AI Matters, page 11-12, Volume 2, Issue 4, Summer 2016. [pdf]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. In Proceedings of the 22nd European Conference on Artificial Intelligence, August 2016. (Extended Abstract) [pdf]

Diederik M. Roijers, Shimon Whiteson, Alex Ihler, and Frans A. Oliehoek - Variational Multi-Objective Coordination, In Proceedings of the 2015 NIPS workshop: Learning, Inference and Control of Multi-Agent Systems, December 2015. [pdf] [bib]

Maarten de Waard, Maarten Inja, Chiel Kooijman, Diederik M. Roijers, and Shimon Whiteson - Queued Pareto Local Search for Multi-objective Decision Making, In Proceedings of the 27th Belgium-Netherlands Artificial Intelligence Conference, November 2015. (Extended Abstract) [pdf] [bib]

Diederik M. Roijers‚ Shimon Whiteson‚ Peter Vamplew and Richard Dazeley - Why Multi−Objective Reinforcement Learning?. In EWRL 2015: Proceedings of the Twelfth European Workshop on Reinforcement Learning, July 2015. [pdf] [bib]

Diederik M. Roijers - Efficient Methods for Multi-Objective Decision-Theoretic Planning. In IJCAI 2015: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, July 2015. (Doctoral Consortium) [pdf]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan and Mathijs de Weerdt - Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015. [pdf] [bib]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the value function of zero-sum games of incomplete information. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015. [pdf] [bib]

Chiel Kooijman, Maarten de Waard, Maarten Inja, Diederik M. Roijers, and Shimon Whiteson - Pareto Local Policy Search for MOMDP Planning. In ESANN 2015: Special Session on Emerging Techniques and Applications in Multi-Objective Reinforcement Learning at the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning 2015, pp. 53-58, April 2015. [pdf] [bib]

Diederik M. Roijers, Joris Scharpff, Matthijs T.J. Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson - Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proceedings of the 26th Belgium-Netherlands Artificial Intelligence Conference, November 2014. (Extended Abstract) [pdf]

Paris Mavromoustakos Blom, Sander Bakkes and Diederik M. Roijers - Using Facial Expressions for Personalised Gaming. In Proceedings of the 26th Belgium-Netherlands Artificial Intelligence Conference, November 2014. (Demo) [pdf]

Diederik M. Roijers - Convex Coverage Set Methods for Multi-Objective Collaborative Decision Making. In AAMAS 2014: Proceedings of the Thirteenth International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 1727-1728, May 2014. (Doctoral Consortium) [pdf] [bib]

Eugenio Bargiacchi, Camiel R. Verschoor, Guangliang Li, and Diederik M. Roijers - Decentralized Solutions and Tactics for RTS, In Proceedings of the 25th Belgium-Netherlands Artificial Intelligence Conference, pp. 272-273, 7-8 November 2013. (Demo) [pdf] [bib]

Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek - Multi-Objective Variable Elimination for Collaborative Graphical Games, In Proceedings of the Twelfth International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1209–1210, May 2013. (Extended Abstract) [pdf] [bib]

Master's thesis

Diederik M. Roijers - Probability estimation and competence models for rule and strategy based e-tutoring systems, Master's thesis Applied Computing Science, Utrecht University, June 2011 [pdf] [bib]

ArXiv pre-prints

Hossam Mossalam, Yannis Assael, Diederik M. Roijers, and Shimon Whiteson - Multi-Objective Deep Reinforcement Learning [link]

Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers - Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. ArXiv e-prints, arXiv:1606.06888, June 2016. [link]

Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T.J. Spaan, and Mathijs M. de Weerdt - Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version) [link]