Publications

• Sorted by Date • Classified by Publication Type • Classified by Research Category •

Scalable Planning and Learning for Multiagent POMDPs

Christopher Amato and Frans A. Oliehoek. Scalable Planning and Learning for Multiagent POMDPs. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI), pp. 1995–2002, January 2015.
[Please see the extended version for pseudo code and proofs.]

Download

pdf [878.6kB]  

Abstract

Online, sample-based planning algorithms for POMDPs have shown great promise in scaling to problems with large state spaces, but they become intractable for large action and observation spaces. This is particularly problematic in multiagent POMDPs where the action and observation space grows exponentially with the number of agents. To combat this intractability, we propose a novel scalable approach based on sample-based planning and factored value functions that exploits structure present in many multiagent settings. This approach applies not only in the planning case, but also the Bayesian reinforcement learning setting. Experimental results show that we are able to provide high quality solutions to large multiagent planning and learning problems.

BibTeX Entry

@inproceedings{Amato15AAAI,
    author =        {Christopher Amato and Frans A. Oliehoek},
    title =         {Scalable Planning and Learning for Multiagent {POMDPs}},
    booktitle =     AAAI15,
    month =         jan,
    year =          2015,
    pages =         {1995--2002},
    url =           {https://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/view/9889/9495},
    wwwnote =       {[Please see the <a href="b2hd-Amato15AAAI_extended.html">extended version</a> for pseudo code and proofs.]},
    abstract = {
    Online, sample-based planning algorithms for POMDPs have shown great promise 
    in scaling to problems with large state spaces, but they become intractable 
    for large action and observation spaces.  This is particularly problematic 
    in multiagent POMDPs where the action and observation space grows exponentially 
    with the number of agents.  To combat this intractability, we propose a novel 
    scalable approach based on sample-based planning and factored value functions 
    that exploits structure present in many multiagent settings.  This approach 
    applies not only in the planning case, but also the Bayesian reinforcement 
    learning setting.  Experimental results show that we are able to provide high 
    quality solutions to large multiagent planning and learning problems. 
    }
}

Generated by bib2html.pl (written by Patrick Riley) on Mon Apr 08, 2024 20:28:07 UTC