MultiAgentDecisionProcess
FactoredQLastTimeStepOrQPOMDP Class Reference

FactoredQLastTimeStepOrQPOMDP is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QPOMDP function for the earlier stages. More...

#include <FactoredQLastTimeStepOrQPOMDP.h>

Inheritance diagram for FactoredQLastTimeStepOrQPOMDP:
[legend]

Public Member Functions

void Compute ()
 Compute the heuristic. More...
 
void DeInitialize ()
 
 FactoredQLastTimeStepOrQPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
 (default) Constructor More...
 
 FactoredQLastTimeStepOrQPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
 
double GetQ (Index jaohI, Index jaI) const
 Returns Q(joint A-O history jaohI, jaI). More...
 
void Initialize ()
 
std::string SoftPrintBrief () const
 Returns a short description of the heuristic, can be used for constructing filenames. More...
 
 ~FactoredQLastTimeStepOrQPOMDP ()
 
- Public Member Functions inherited from FactoredQLastTimeStepOrElse
void DeInitialize ()
 
 FactoredQLastTimeStepOrElse (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
 (default) Constructor More...
 
 FactoredQLastTimeStepOrElse (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
 
const ScopeGetAgentScopeForLQF (Index e, Index stage) const
 Return the AgentScope for the lqf-th LQF at time-step stage. More...
 
double GetLocalQValue (Index LRF, Index stage, const std::vector< Index > &sfacValues, const std::vector< Index > &aoHistIs, Index agSc_jaI) const
 Get local Q-value using individual and group indices. More...
 
double GetLocalQValue (Index LRF, Index stage, Index sfSC_sI, Index agSC_aoHistI, Index agSc_jaI) const
 Get the Q for LRF, for local state, local aoh and local joint action only then with only 'joint' (i.e., group) indices. More...
 
double GetLocalQValue (Index LRF, Index aoHistI, Index jaI) const
 
size_t GetNrLQFs (Index stage) const
 Return the number of local Q value functions for stage. More...
 
const ScopeGetStateFactorScopeForLQF (Index lqf, Index stage) const
 Return the State factor Scope for the lqf-th LQF at time-step stage. More...
 
void Initialize ()
 
virtual ~FactoredQLastTimeStepOrElse ()
 Destructor. More...
 
- Public Member Functions inherited from FactoredQFunctionStateJAOHInterface
virtual double GetLocalQValue (Index e, Index stage, const std::vector< Index > &sfacValues_e, const std::vector< Index > &aoHistIs_e, const std::vector< Index > &acs_e) const
 Get local Q-value using individual indices. More...
 
virtual double GetLocalQValue (Index e, Index stage, Index sfSC_sI, const std::vector< Index > &aoHistIs_e, Index jaI_e) const
 Get local Q-value using individual and group indices. More...
 
virtual ~FactoredQFunctionStateJAOHInterface ()
 Destructor. More...
 
- Public Member Functions inherited from QFunctionJAOHInterface
 QFunctionJAOHInterface ()
 
virtual ~QFunctionJAOHInterface ()
 Destructor. More...
 
- Public Member Functions inherited from QFunctionForDecPOMDPInterface
 QFunctionForDecPOMDPInterface ()
 (default) Constructor More...
 
virtual ~QFunctionForDecPOMDPInterface ()
 Destructor. More...
 
- Public Member Functions inherited from QFunctionInterface
virtual void Load ()
 Load the Qvalues from disk. More...
 
virtual void Save () const
 Stores the Qvalues to disk. More...
 
virtual ~QFunctionInterface ()
 
- Public Member Functions inherited from QFunctionForFactoredDecPOMDP
virtual void ComputeWithCachedQValues (bool computeIfNotCached)
 Compute Qvalue function, while caching the Qvalues to disk. More...
 
virtual std::string GetCacheFilename () const
 Gets the filename where the Qvalues should be stored. More...
 
const
PlanningUnitFactoredDecPOMDPDiscrete
GetPU () const
 
const
PlanningUnitFactoredDecPOMDPDiscrete
GetPUF () const
 
virtual void Load (const std::string &filename)
 Load the Qvalues from disk from a file named filename. More...
 
 QFunctionForFactoredDecPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf)
 (default) Constructor More...
 
 QFunctionForFactoredDecPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf)
 
virtual void Save (const std::string &filename) const
 Stores the Qvalues to disk in file named filename. More...
 
void SetPU (const PlanningUnitDecPOMDPDiscrete *pu)
 
void SetPU (const boost::shared_ptr< const PlanningUnitDecPOMDPDiscrete > &pu)
 
void SetPUF (const PlanningUnitFactoredDecPOMDPDiscrete *pu)
 Changes the Planning unit pointed to. More...
 
void SetPUF (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &pu)
 
- Public Member Functions inherited from QFunctionForFactoredDecPOMDPInterface
virtual ~QFunctionForFactoredDecPOMDPInterface ()
 (default) Constructor More...
 

Private Attributes

bool _m_initialized
 
QPOMDP_m_QPOMDP
 

Detailed Description

FactoredQLastTimeStepOrQPOMDP is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QPOMDP function for the earlier stages.

Constructor & Destructor Documentation

FactoredQLastTimeStepOrQPOMDP::FactoredQLastTimeStepOrQPOMDP ( const PlanningUnitFactoredDecPOMDPDiscrete puf)

(default) Constructor

References _m_QPOMDP.

FactoredQLastTimeStepOrQPOMDP::FactoredQLastTimeStepOrQPOMDP ( const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &  puf)

References _m_QPOMDP.

FactoredQLastTimeStepOrQPOMDP::~FactoredQLastTimeStepOrQPOMDP ( )

References _m_QPOMDP.

Member Function Documentation

void FactoredQLastTimeStepOrQPOMDP::Compute ( )
virtual
void FactoredQLastTimeStepOrQPOMDP::DeInitialize ( )
double FactoredQLastTimeStepOrQPOMDP::GetQ ( Index  jaohI,
Index  jaI 
) const
virtual

Returns Q(joint A-O history jaohI, jaI).

Implements QFunctionJAOHInterface.

References _m_QPOMDP, and QFunctionJAOHTree::GetQ().

void FactoredQLastTimeStepOrQPOMDP::Initialize ( )
std::string FactoredQLastTimeStepOrQPOMDP::SoftPrintBrief ( ) const
inlinevirtual

Returns a short description of the heuristic, can be used for constructing filenames.

Implements QFunctionInterface.

Member Data Documentation

bool FactoredQLastTimeStepOrQPOMDP::_m_initialized
private

Referenced by Compute(), DeInitialize(), and Initialize().

QPOMDP* FactoredQLastTimeStepOrQPOMDP::_m_QPOMDP
private