Publications

Sorted by DateClassified by Publication TypeClassified by Research Category

Classified by Publication Type

JournalBookBook ChapterRefereed Conference (International)Refereed Conference (Local)Refereed WorkshopTechnical ReportarXivPh.D. ThesisMaster's ThesisOther


Journal

  1. Frans A. Oliehoek, Matthijs T. J. Spaan, Bas Terwijn, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems. Journal of Machine Learning Research, 2017. Accepted for publication
    Details     Download: (unavailable)
  2. Nisar Ahmed, Paul Bello, Selmer Bringsjord, Micah Clark, Bradley Hayes, Andrey Kolobov, Christopher Miller, Frans Oliehoek, Frank Stein, and Matthijs Spaan. The 2015 AAAI Fall Symposium Series Reports. AI Magazine, 37(2):85–90, 2016.
    Details     Download: HTML 
  3. Christopher Amato, Ofra Amir, Joanna Bryson, Barbara Grosz, Bipin Indurkhya, Emre Kiciman, Takashi Kido, W. F. Lawless, Miao Liu, Braden McDorman, Ross Mead, Frans A. Oliehoek, Andrew Specian, Georgi Stojanov, and Keiki Takadama. Reports of the AAAI 2016 Spring Symposium Series. AI Magazine, 37(4):83–88, 2016.
    Details     Download: HTML 
  4. Diederik Roijers, Shimon Whiteson, and Frans A. Oliehoek. Computing Convex Coverage Sets for Faster Multi-Objective Coordination. Journal of Artificial Intelligence Research, 52:399–443, AI Access Foundation, Inc., March 2015.
    Details     Download: pdf [951.4kB]  ps.gz ps HTML 
  5. Frans A. Oliehoek, Matthijs T. J. Spaan, Christopher Amato, and Shimon Whiteson. Incremental Clustering and Expansion for Faster Optimal Planning in Decentralized POMDPs. Journal of Artificial Intelligence Research, 46:449–509, 2013.
    Details     Download: pdf [7.2MB]  ps [2.2MB]  
  6. Frans A. Oliehoek, Julian F. P. Kooij, and Nikos Vlassis. The Cross-Entropy Method for Policy Search in Decentralized POMDPs. Informatica, 32:341–357, 2008.
    Details     Download: pdf [322.2kB]  
  7. Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Optimal and Approximate Q-value Functions for Decentralized POMDPs. Journal of Artificial Intelligence Research, 32:289–353, 2008.
    Details     Download: pdf [613.0kB]  ps.gz [403.8kB]  

Book

  1. Frans A. Oliehoek and Christopher Amato. A Concise Introduction to Decentralized POMDPs, SpringerBriefs in Intelligent Systems, Springer, 2016. Authors' pre-print.
    [Final version availabe at Springer.]
    Details     Download: pdf [3.0MB]  

Book Chapter

  1. Julia Efremova, Bijan Ranjbar-Sahraei, Hossein Rahmani, Frans A. Oliehoek, Toon Calders, Karl Tuyls, and Gerhard Weiss. Multi-Source Entity Resolution for Genealogical Data. In Gerrit Bloothooft, Peter Christen, Kees Mandemakers, and Marijn Schraagen, editors, Population Reconstruction, pp. 129–154, Springer International Publishing, July 2015.
    Details     Download: pdf [1004.5kB]  ps.gz ps HTML 
  2. Frans A. Oliehoek. Decentralized POMDPs. In Marco Wiering and Martijn van Otterlo, editors, Reinforcement Learning: State of the Art, Adaptation, Learning, and Optimization, pp. 471–503, Springer, Berlin, Germany, 2012.
    Details     Download: pdf [3.0MB]  ps.gz ps HTML 
  3. Frans A. Oliehoek and Arnoud Visser. A Decision-Theoretic Approach to Collaboration: Principal Description Methods and Efficient Heuristic Approximation. In Robert Babu\vska and Frans C. A. Groen, editors, Interactive Collaborative Information Systems, Studies in Computational Intelligence, pp. 87–124, Springer Berlin Heidelberg, Berlin, Germany, 2010.
    Details     Download: pdf [4.8MB]  ps.gz ps HTML 

Refereed Conference (International)

  1. Zhiguang Cao, Hongliang Guo, Jie Zhang, Frans Oliehoek, and Ulrich Fastenrath. Maximizing the Probability of Arriving on Time: A Practical Q-Learning Method. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 2017. 4481--4487
    Details     Download: pdf [325.8kB]  
  2. Daniel Claes, Frans A. Oliehoek, Hendrik Baier, and Karl Tuyls. Decentralised Online Planning for Multi-Robot Warehouse Commisioning. In Proceedings of the Sixteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 492–500, May 2017.
    Details     Download: pdf [798.5kB]  
  3. Sammie Katt, Frans A. Oliehoek, and Christopher Amato. Learning in POMDPs with Monte Carlo Tree Search. In Proceedings of the Thirty-Fourth International Conference on Machine Learning, 2017. (To appear)
    Details     Download: pdf [478.4kB]  
  4. Frans A. Oliehoek, Rahul Savani, Elliot Adderton, Xia Cui, David Jackson, Phil Jimmieson, John Christopher Jones, Keith Kennedy, Ben Mason, Adam Plumbley, and Luke Dawson . LiftUpp: Support to Develop Learner Performance. In Proceedings of the 18th International Conference on Artificial Intelligence in Education (AIED 2017), 2017. To appear, long version available at arXiv: http://arxiv.org/abs/1704.06549v1
    Details     Download: pdf [871.9kB]  
  5. Yash Satsangi, Shimon Whiteson, Frans A. Oliehoek, and Henri Bouma. Real-Time Resource Allocation for Tracking Systems. In Proceedings of the Thirty-Third Conference on Uncertainty in Artificial Intelligence, 2017. (To appear)
    Details     Download: (unavailable)
  6. Athirai Irissappane, Frans A. Oliehoek, and Jie Zhang. A Scalable Framework to Choose Sellers in E-Marketplaces Using POMDPs. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 158–164, February 2016.
    Details     Download: pdf [341.2kB]  
  7. Timon V. Kanters, Frans A. Oliehoek, Michael Kaisers, Stan R. van den Bosch, Joep Grispen, and Jeroen Hermans. Energy- and Cost-Efficient Pumping Station Control. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 3842–3848, February 2016.
    Details     Download: pdf [908.0kB]  
  8. Philipp Robbel, Frans A. Oliehoek, and Mykel J. Kochenderfer. Exploiting Anonymity in Approximate Linear Programming: Scaling to Large Multiagent MDPs. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 2537–2543, February 2016.
    Details     Download: pdf [290.3kB]  
  9. Yash Satsangi, Shimon Whiteson, and Frans A. Oliehoek. PAC Greedy Maximization with Efficient Bounds on Information Gain for Sensor Selection. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 3220–3227, July 2016.
    Details     Download: pdf [257.2kB]  
  10. Yash Satsangi, Shimon Whiteson, and Frans A. Oliehoek. Probably Approximately Correct Greedy Maximization. In Proceedings of the Fifteenth International Conference on Autonomous Agents and Multiagent Systems, May 2016. Extended Abstract.
    [Please also see the extended version on arXiv, as well as the IJCAI version.]
    Details     Download: pdf [220.3kB]  
  11. Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, pp. 3174–3180, February 2016.
    Also see the extended version on arXiv.
    Details     Download: pdf [593.5kB]  
  12. Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers. Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. In ECAI 2016 - 22nd European Conference on Artificial Intelligence, pp. 1628–1629, August 2016. Short Paper.
    [Please also see the extended version on arXiv.
    Details     Download: pdf [171.8kB]  
  13. Christopher Amato and Frans A. Oliehoek. Scalable Planning and Learning for Multiagent POMDPs. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 1995–2002, January 2015.
    [Please see the extended version for pseudo code and proofs.]
    Details     Download: pdf [878.6kB]  
  14. Daniel Claes, Philipp Robbel, Frans A. Oliehoek, Daniel Hennes, Karl Tuyls, and Wiebe Van der Hoek. Effective Approximations for Multi-Robot Coordination in Spatially Distributed Tasks. In Proceedings of the Fourteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 881–890, May 2015.
    Details     Download: pdf [383.0kB]  
  15. Athirai Irissappane, Jie Zhang, Frans A. Oliehoek, and Partha S. Dutta. Secure Routing in Wireless Sensor Networks via POMDPs. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 2617–2623, July 2015.
    Details     Download: pdf [525.7kB]  
  16. Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 1645–1651, July 2015.
    [Please see the extended version for proofs.]
    Details     Download: pdf [391.5kB]  
  17. Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Proceedings of the Fourteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 1703–1704, May 2015. Extended Abstract.
    [Please see the extended version for details and proofs.]
    Details     Download: pdf [142.3kB]  
  18. Diederik Roijers, Shimon Whiteson, and Frans A. Oliehoek. Point-Based Planning for Multi-Objective POMDPs. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 1666–1672, July 2015.
    Details     Download: pdf [759.5kB]  
  19. Yash Satsangi, Shimon Whiteson, and Frans A. Oliehoek. Exploiting Submodular Value Functions for Faster Dynamic Sensor Selection. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 3356–3363, January 2015.
    Details     Download: pdf [676.0kB]  
  20. Athirai Irissappane, Frans A. Oliehoek, and Jie Zhang. A POMDP Based Approach to Optimally Select Sellers in Electronic Marketplaces. In Proceedings of the Thirteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 1329–1336, May 2014.
    Details     Download: pdf [532.9kB]  
  21. Diederik Roijers, Shimon Whiteson, and Frans A. Oliehoek. Linear Support for Multi-Objective Coordination Graphs. In Proceedings of the Thirteenth International Conference on Autonomous Agents and Multiagent Systems, pp. 1297–1304, May 2014.
    Details     Download: pdf [506.9kB]  
  22. Diederik Roijers, Joris Scharpff, Matthijs Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty. In Proceedings of the Twenty-Fourth International Conference on Automated Planning and Scheduling, pp. 262–270, June 2014.
    Details     Download: pdf [385.0kB]  
  23. Frans A. Oliehoek. Sufficient Plan-Time Statistics for Decentralized POMDPs. In Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, pp. 302–308, 2013.
    Details     Download: pdf [266.0kB]  
  24. Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems, pp. 563–570, 2013.
    Details     Download: pdf [238.2kB]  
  25. Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek. Computing Convex Coverage Sets for Multi-Objective Coordination Graphs. In Proceedings of the Third International Conference on Algorithmic Decision Theory, pp. 309–323, November 2013.
    Details     Download: pdf [1.2MB]  
  26. Diederik M. Roijers, Shimon Whiteson, and Frans A. Oliehoek. Multi-Objective Variable Elimination for Collaborative Graphical Games. In Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems, pp. 1209–1210, 2013. Extended Abstract
    Details     Download: pdf [315.5kB]  
  27. Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Structure in Cooperative Bayesian Games. In Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, pp. 654–664, August 2012.
    Details     Download: pdf [1.2MB]  
  28. Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-Based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, pp. 1415–1421, July 2012.
    Details     Download: pdf [145.0kB]  
  29. Frans A. Oliehoek, Stefan Witwicki, and Leslie P. Kaelbling. Influence-Based Abstraction for Multiagent Systems. In Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, pp. 1422–1428, July 2012.
    Details     Download: pdf [159.8kB]  
  30. Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-based Pruning for Multiagent POMDPs with Delayed Communication. In Proceedings of the Eleventh International Conference on Autonomous Agents and Multiagent Systems, pp. 1229–1230, June 2012. Extended abstract.
    Details     Download: pdf [95.6kB]  
  31. Stefan Witwicki, Frans A. Oliehoek, and Leslie P. Kaelbling. Heuristic Search of Multiagent Influence Space. In Proceedings of the Eleventh International Conference on Autonomous Agents and Multiagent Systems, pp. 973–981, June 2012.
    Details     Download: pdf [583.5kB]  
  32. Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, pp. 2027–2032, 2011.
    Details     Download: pdf [130.3kB]  
  33. Frans A. Oliehoek, Matthijs T. J. Spaan, Jilles Dibangoye, and Christopher Amato. Heuristic Search for Identical Payoff Bayesian Games. In Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, pp. 1115–1122, May 2010.
    Details     Download: pdf [179.3kB]  
  34. Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Lossless Clustering of Histories in Decentralized POMDPs. In Proceedings of the Eighth International Conference on Autonomous Agents and Multiagent Systems, pp. 577–584, May 2009.
    Details     Download: pdf [209.6kB]  
  35. Frans A. Oliehoek, Matthijs T. J. Spaan, Shimon Whiteson, and Nikos Vlassis. Exploiting Locality of Interaction in Factored Dec-POMDPs. In Proceedings of the Seventh Joint International Conference on Autonomous Agents and Multiagent Systems, pp. 517–524, May 2008.
    Details     Download: pdf [2.1MB]  ps.gz [375.3kB]  
  36. Matthijs T. J. Spaan, Frans A. Oliehoek, and Nikos Vlassis. Multiagent Planning under Uncertainty with Stochastic Communication Delays. In Proceedings of the Eighteenth International Conference on Automated Planning and Scheduling, pp. 338–345, September 2008.
    Details     Download: pdf [141.2kB]  
  37. Frans A. Oliehoek, Julian F. P. Kooij, and Nikos Vlassis. A Cross-Entropy Approach to Solving Dec-POMDPs. In Proceedings of the 1st International Symposium on Intelligent and Distributed Computing (IDC 2007), pp. 145–154, October 2007.
    Details     Download: pdf [146.8kB]  ps.gz [376.0kB]  
  38. Frans A. Oliehoek and Nikos Vlassis. Q-value Functions for Decentralized POMDPs. In Proceedings of the Sixth Joint International Conference on Autonomous Agents and Multiagent Systems, pp. 833–840, May 2007.
    Details     Download: pdf [171.2kB]  ps.gz [163.9kB]  
  39. Frans A. Oliehoek, Edwin D. de Jong, and Nikos Vlassis. The Parallel Nash Memory for Asymmetric Games. In Proceedings of the Genetic and Evolutionary Computation Conference, pp. 337–344, July 2006. (best paper nominee in coevolution track)
    Details     Download: pdf [174.6kB]  ps.gz [172.6kB]  

Refereed Conference (Local)

  1. Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Conditional Return Policy Search for TI-MMDPs with Sparse Interactions. In Proceedings of the 28th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2016), November 2016. Extended Abstract
    Details     Download: pdf [207.7kB]  
  2. Elise Van der Pol and Frans A. Oliehoek. Video Demo: Deep Reinforcement Learning for Coordination in Traffic Light Control. In Proceedings of the 28th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2016), 2016.
    See video at www.fransoliehoek.net/trafficvideo.
    Details     Download: pdf [91.8kB]  
  3. Luisa M. Zintgraf, Timon V. Kanters, Diederik M. Roijers, Frans A. Oliehoek, and Philipp Beau. Quality Assessment of MORL Algorithms: A Utility-Based Approach. In Benelearn 2015: Proceedings of the 24th Annual Machine Learning Conference of Belgium and the Netherlands, 2015.
    Details     Download: pdf [292.2kB]  
  4. Diederik Roijers, Joris Scharpff, Matthijs Spaan, Frans A. Oliehoek, Mathijs De Weerdt, and Shimon Whiteson. Bounded Approximations for Linear Multi-Objective Planning under Uncertainty (Extended Abstract). In Proceedings of the 26th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2014), pp. 168–169, November 2014. Extended Abstract.
    Details     Download: pdf [135.5kB]  
  5. Daniel Claes, Philipp Robbel, Frans A. Oliehoek, Daniel Hennes, and Karl Tuyls. Effective Approximations for Spatial Task Allocation Problems. In Proceedings of the 25th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2013), pp. 33–40, 2013. Best paper runner up.
    Details     Download: pdf [363.4kB]  
  6. Julia Efremova, Bijan Ranjbar-Sahraei, Frans A. Oliehoek, Toon Calders, and Karl Tuyls. An Interactive, Web-based Tool for Genealogical Entity Resolution. In Proceedings of the 25th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2013), pp. 376–377, 2013. Demo-track.
    Details     Download: pdf [132.2kB]  
  7. Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate Solutions for Factored Dec-POMDPs with Many Agents --- Extended Abstract. In Proceedings of the 25th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2013), pp. 340–341, 2013.
    Details     Download: pdf [451.2kB]  
  8. Frans A. Oliehoek, Stefan Witwicki, and Leslie P. Kaelbling. Influence-Based Abstraction for Multiagent Systems. In Proceedings of the 24th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2012), pp. 311–312, 2012. Extended Abstract.
    Details     Download: (unavailable)
  9. Matthijs T. J. Spaan and Frans A. Oliehoek. Tree-Based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proceedings of the 24th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2012), pp. 319–320, 2012. Extended Abstract.
    Details     Download: (unavailable)
  10. Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proceedings of the 23rd Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2011), pp. 433–434, 2011. Extended Abstract.
    Details     Download: pdf [32.0kB]  
  11. Frans A. Oliehoek, Nikos Vlassis, and Edwin de Jong. Coevolutionary Nash in Poker Games. In Proceedings of the 17th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2005), pp. 188–193, October 2005.
    Details     Download: pdf [139.2kB]  ps.gz [128.2kB]  
  12. Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Best-response Play in Partially Observable Card Games. In Benelearn 2005: Proceedings of the 14th Annual Machine Learning Conference of Belgium and the Netherlands, pp. 45–50, February 2005.
    Details     Download: pdf [115.6kB]  

Refereed Workshop

  1. Richard Klima, Karl Tuyls, and Frans A. Oliehoek. Markov Security Games: Learning in Spatial Security Problems. In NIPS'16 Workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.
    Details     Download: pdf [238.3kB]  
  2. Elise Van der Pol and Frans A. Oliehoek. Coordinated Deep Reinforcement Learners for Traffic Light Control. In NIPS'16 Workshop on Learning, Inference and Control of Multi-Agent Systems, 2016.
    Details     Download: pdf [341.5kB]  
  3. Daniel Claes, Philipp Robbel, Frans A. Oliehoek, Daniel Hennes, Karl Tuyls, and Wiebe Van der Hoek. Effective Approximations for Multi-Robot Coordination in Spatially Distributed Tasks. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015.
    Details     Download: pdf [382.0kB]  
  4. Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, and João V. Messias. The MADP Toolbox: An Open-Source Library for Planning and Learning in (Multi-)Agent Systems. In Sequential Decision Making for Intelligent Agents---Papers from the AAAI 2015 Fall Symposium, pp. 59–62, November 2015.
    Details     Download: pdf [124.7kB]  
  5. Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015.
    [Please see the extended version for proofs.]
    Details     Download: pdf [2.7MB]  
  6. Philipp Robbel, Frans A. Oliehoek, and Mykel J. Kochenderfer. Exploiting Anonymity in Approximate Linear Programming: Scaling to Large Multiagent MDPs. In Proceedings of the AAAI Fall Symposium on Sequential Decision Making in Intelligent Agents, November 2015.
    Details     Download: pdf [336.3kB]  
  7. Diederik M. Roijers, Shimon Whiteson, Alex Ihler, and Frans A. Oliehoek. Variational Multi-Objective Coordination. In NIPS Workshop on Learning, Inference and Control of Multi-Agent Systems, December 2015.
    Details     Download: pdf [1.1MB]  
  8. Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Solving Multi-agent MDPs Optimally with Conditional Return Graphs. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015.
    Details     Download: pdf [580.8kB]  
  9. Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers. Structure in the Value Function of Zero-Sum Games of Incomplete Information. In Proceedings of the Tenth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2015.
    Details     Download: pdf [296.2kB]  
  10. Julia Efremova, Bijan Ranjbar-Sahraei, Frans A. Oliehoek, Toon Calders, and Karl Tuyls. A Baseline Method for Genealogical Entity Resolution. In Proceedings of the Workshop on Population Reconstruction, January 2014.
    Details     Download: pdf [642.7kB]  
  11. Frans A. Oliehoek and Christopher Amato. Best Response Bayesian Reinforcement Learning for Multiagent Systems with State Uncertainty. In Proceedings of the Ninth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), 2014.
    Details     Download: pdf [231.1kB]  
  12. Christopher Amato, Frans A. Oliehoek, and Eric Shyu. Scalable Bayesian Reinforcement Learning for Multiagent POMDPs. In Proceedings of the First Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM), 2013.
    Details     Download: pdf [506.8kB]  
  13. Christopher Amato and Frans A. Oliehoek. Bayesian Reinforcement Learning for Multiagent Systems with State Uncertainty. In Proceedings of the Eighth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), pp. 76–83, 2013.
    Details     Download: pdf [177.5kB]  
  14. Frans A. Oliehoek, Ashwini A. Gokhale, and Jie Zhang. Reasoning about Advisors for Seller Selection in E-Marketplaces via POMDPs. In 15th International Workshop on Trust in Agent Societies (TRUST12), pp. 67–78, June 2012.
    Details     Download: pdf [227.3kB]  
  15. Frans A. Oliehoek and Matthijs T. J. Spaan. Tree-Based Solution Methods for Multiagent POMDPs with Delayed Communication. In Proceedings of the Seventh AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), pp. 48–55, June 2012. (longer version of AAAI)
    Details     Download: pdf [200.6kB]  
  16. Frans A. Oliehoek, Stefan Witwicki, and Leslie P. Kaelbling. Heuristic Search of Multiagent Influence Space. In Proceedings of the 9th European Workshop on Multi-agent Systems (EUMAS 2011), 2011.
    Details     Download: pdf [4.4MB]  
  17. Matthijs T. J. Spaan, Frans A. Oliehoek, and Christopher Amato. Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. In Proceedings of the Sixth AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), pp. 63–70, 2011.
    Details     Download: pdf [229.0kB]  
  18. Matthijs T. J. Spaan and Frans A. Oliehoek. The MultiAgent Decision Process Toolbox: Software for Decision-theoretic Planning in Multiagent Systems. In Proceedings of the Third AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), pp. 107–121, 2008.
    Details     Download: pdf [178.7kB]  
  19. Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Dec-POMDPs with delayed communication. In Proceedings of the Second AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM), May 2007.
    Details     Download: pdf [146.0kB]  ps.gz [107.9kB]  
  20. Frans A. Oliehoek and Nikos Vlassis. Q-value Heuristics for Approximate Solutions of Dec-POMDPs. In Proceedings of the AAAI Spring Symposium on Game Theoretic and Decision Theoretic Agents, pp. 31–37, March 2007.
    Details     Download: pdf [637.6kB]  ps.gz [99.9kB]  
  21. Frans A. Oliehoek and Arnoud Visser. A Hierarchical Model for Decentralized Fighting of Large Scale Urban Fires. In Proceedings of the AAMAS Workshop on Hierarchical Autonomous Agents and Multi-Agent Systems, pp. 14–21, May 2006.
    Details     Download: pdf [140.1kB]  ps.gz [145.2kB]  

Technical Report

  1. Frans A. Oliehoek and Christopher Amato. Dec-POMDPs as Non-Observable MDPs. IAS technical report IAS-UVA-14-01, Intelligent Systems Lab, University of Amsterdam, 2014.
    Details     Download: pdf [235.2kB]  
  2. Frans A. Oliehoek, Nikos Vlassis, and Matthijs T. J. Spaan. Properties of the QBG-value Function. IAS technical report IAS-UVA-07-04, Intelligent Systems Lab, University of Amsterdam, 2007.
    Details     Download: pdf [197.0kB]  ps.gz [203.0kB]  
  3. Frans A. Oliehoek and Nikos Vlassis. Dec-POMDPs and extensive form games: equivalence of models and algorithms. IAS technical report IAS-UVA-06-02, Intelligent Systems Lab, University of Amsterdam, 2006.
    Details     Download: pdf [404.3kB]  ps.gz [345.7kB]  

arXiv

  1. Philipp Robbel, Frans A. Oliehoek, and Mykel J. Kochenderfer. Exploiting Anonymity in Approximate Linear Programming: Scaling to Large Multiagent MDPs (Extended Version). ArXiv e-prints, arXiv:1511.09080, February 2016.
    Details     Download: pdf [392.8kB]  
  2. Yash Satsangi, Shimon Whiteson, and Frans A. Oliehoek. Probably Approximately Correct Greedy Maximization. ArXiv e-prints, arXiv:1602.07860, February 2016.
    Details     Download: pdf [319.1kB]  
  3. Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version). ArXiv e-prints, arXiv:1511.09047, February 2016.
    Details     Download: HTML 
  4. Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers. Structure in the Value Function of Two-Player Zero-Sum Games of Incomplete Information. ArXiv e-prints, arXiv:1606.06888, June 2016.
    Details     Download: pdf [183.0kB]  
  5. Athirai Irissappane, Frans A. Oliehoek, and Jie Zhang. Scaling POMDPs For Selecting Sellers in E-markets---Extended Version. ArXiv e-prints, arXiv:1511.09147, December 2015.
    Details     Download: pdf [588.2kB]  
  6. Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Influence-Optimistic Local Values for Multiagent Planning --- Extended Version. ArXiv e-prints, arXiv:1502.05443, February 2015.
    Details     Download: pdf [686.9kB]  
  7. Christopher Amato and Frans A. Oliehoek. Scalable Planning and Learning for Multiagent POMDPs: Extended Version. ArXiv e-prints, arXiv:1404.1140, December 2014. Extended version of the published AAAI'15 paper including proofs.
    Details     Download: pdf [1.2MB]  
  8. Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Exploiting Agent and Type Independence in Collaborative Graphical Bayesian Games. ArXiv e-prints, arXiv:1108.0404, 2011. http://arxiv.org/abs/1108.0404
    Details     Download: pdf [661.1kB]  

Ph.D. Thesis

  1. Frans A. Oliehoek. Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environments. Ph.D. Thesis, Informatics Institute, University of Amsterdam, 2010.
    Details     Download: pdf [4.7MB]  

Master's Thesis

  1. Frans A. Oliehoek. Game Theory and AI: a Unified Approach to Poker Games. Master's Thesis, University of Amsterdam,2005.
    Details     Download: pdf [2.5MB]  ps.gz [945.2kB]  

Other

  1. Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, and João V. Messias. The MADP Toolbox 0.4, May 2016.
    Details     Download: pdf [1.2MB]  
  2. Frans A. Oliehoek, Matthijs T. J. Spaan, Philipp Robbel, and João V. Messias. The MADP Toolbox 0.3.1, April 2015.
    Details     Download: pdf [898.3kB]  

Generated by bib2html.pl (written by Patrick Riley) on Thu Jun 15, 2017 20:40:31 UTC