|
MultiAgentDecisionProcess
|
FactoredQLastTimeStepOrQBG is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QBG function for the earlier stages. More...
#include <FactoredQLastTimeStepOrQBG.h>
Public Member Functions | |
| void | Compute () |
| Compute the heuristic. More... | |
| void | DeInitialize () |
| FactoredQLastTimeStepOrQBG (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
| (default) Constructor More... | |
| FactoredQLastTimeStepOrQBG (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
| double | GetQ (Index jaohI, Index jaI) const |
| Returns Q(joint A-O history jaohI, jaI). More... | |
| void | Initialize () |
| std::string | SoftPrintBrief () const |
| Returns a short description of the heuristic, can be used for constructing filenames. More... | |
| ~FactoredQLastTimeStepOrQBG () | |
Public Member Functions inherited from FactoredQLastTimeStepOrElse | |
| void | DeInitialize () |
| FactoredQLastTimeStepOrElse (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
| (default) Constructor More... | |
| FactoredQLastTimeStepOrElse (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
| const Scope & | GetAgentScopeForLQF (Index e, Index stage) const |
| Return the AgentScope for the lqf-th LQF at time-step stage. More... | |
| double | GetLocalQValue (Index LRF, Index stage, const std::vector< Index > &sfacValues, const std::vector< Index > &aoHistIs, Index agSc_jaI) const |
| Get local Q-value using individual and group indices. More... | |
| double | GetLocalQValue (Index LRF, Index stage, Index sfSC_sI, Index agSC_aoHistI, Index agSc_jaI) const |
| Get the Q for LRF, for local state, local aoh and local joint action only then with only 'joint' (i.e., group) indices. More... | |
| double | GetLocalQValue (Index LRF, Index aoHistI, Index jaI) const |
| size_t | GetNrLQFs (Index stage) const |
| Return the number of local Q value functions for stage. More... | |
| const Scope & | GetStateFactorScopeForLQF (Index lqf, Index stage) const |
| Return the State factor Scope for the lqf-th LQF at time-step stage. More... | |
| void | Initialize () |
| virtual | ~FactoredQLastTimeStepOrElse () |
| Destructor. More... | |
Public Member Functions inherited from FactoredQFunctionStateJAOHInterface | |
| virtual double | GetLocalQValue (Index e, Index stage, const std::vector< Index > &sfacValues_e, const std::vector< Index > &aoHistIs_e, const std::vector< Index > &acs_e) const |
| Get local Q-value using individual indices. More... | |
| virtual double | GetLocalQValue (Index e, Index stage, Index sfSC_sI, const std::vector< Index > &aoHistIs_e, Index jaI_e) const |
| Get local Q-value using individual and group indices. More... | |
| virtual | ~FactoredQFunctionStateJAOHInterface () |
| Destructor. More... | |
Public Member Functions inherited from QFunctionJAOHInterface | |
| QFunctionJAOHInterface () | |
| virtual | ~QFunctionJAOHInterface () |
| Destructor. More... | |
Public Member Functions inherited from QFunctionForDecPOMDPInterface | |
| QFunctionForDecPOMDPInterface () | |
| (default) Constructor More... | |
| virtual | ~QFunctionForDecPOMDPInterface () |
| Destructor. More... | |
Public Member Functions inherited from QFunctionInterface | |
| virtual void | Load () |
| Load the Qvalues from disk. More... | |
| virtual void | Save () const |
| Stores the Qvalues to disk. More... | |
| virtual | ~QFunctionInterface () |
Public Member Functions inherited from QFunctionForFactoredDecPOMDP | |
| virtual void | ComputeWithCachedQValues (bool computeIfNotCached) |
| Compute Qvalue function, while caching the Qvalues to disk. More... | |
| virtual std::string | GetCacheFilename () const |
| Gets the filename where the Qvalues should be stored. More... | |
| const PlanningUnitFactoredDecPOMDPDiscrete * | GetPU () const |
| const PlanningUnitFactoredDecPOMDPDiscrete * | GetPUF () const |
| virtual void | Load (const std::string &filename) |
| Load the Qvalues from disk from a file named filename. More... | |
| QFunctionForFactoredDecPOMDP (const PlanningUnitFactoredDecPOMDPDiscrete *puf) | |
| (default) Constructor More... | |
| QFunctionForFactoredDecPOMDP (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &puf) | |
| virtual void | Save (const std::string &filename) const |
| Stores the Qvalues to disk in file named filename. More... | |
| void | SetPU (const PlanningUnitDecPOMDPDiscrete *pu) |
| void | SetPU (const boost::shared_ptr< const PlanningUnitDecPOMDPDiscrete > &pu) |
| void | SetPUF (const PlanningUnitFactoredDecPOMDPDiscrete *pu) |
| Changes the Planning unit pointed to. More... | |
| void | SetPUF (const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > &pu) |
Public Member Functions inherited from QFunctionForFactoredDecPOMDPInterface | |
| virtual | ~QFunctionForFactoredDecPOMDPInterface () |
| (default) Constructor More... | |
Private Attributes | |
| bool | _m_initialized |
| QBG * | _m_QBG |
FactoredQLastTimeStepOrQBG is a class that represents a Q-Function that is factored for the last stage (i.e., the factored immediate reward function) and the (non-factored) QBG function for the earlier stages.
| FactoredQLastTimeStepOrQBG::FactoredQLastTimeStepOrQBG | ( | const PlanningUnitFactoredDecPOMDPDiscrete * | puf | ) |
(default) Constructor
References _m_initialized, and _m_QBG.
| FactoredQLastTimeStepOrQBG::FactoredQLastTimeStepOrQBG | ( | const boost::shared_ptr< const PlanningUnitFactoredDecPOMDPDiscrete > & | puf | ) |
References _m_initialized, and _m_QBG.
| FactoredQLastTimeStepOrQBG::~FactoredQLastTimeStepOrQBG | ( | ) |
References _m_QBG.
|
virtual |
Compute the heuristic.
Reimplemented from FactoredQLastTimeStepOrElse.
References _m_initialized, _m_QBG, FactoredQLastTimeStepOrElse::Compute(), QFunctionJAOHTree::Compute(), and Initialize().
| void FactoredQLastTimeStepOrQBG::DeInitialize | ( | ) |
References _m_initialized, and FactoredQLastTimeStepOrElse::DeInitialize().
Returns Q(joint A-O history jaohI, jaI).
Implements QFunctionJAOHInterface.
References _m_QBG, and QFunctionJAOHTree::GetQ().
| void FactoredQLastTimeStepOrQBG::Initialize | ( | ) |
References _m_initialized, and FactoredQLastTimeStepOrElse::Initialize().
Referenced by Compute().
|
inlinevirtual |
Returns a short description of the heuristic, can be used for constructing filenames.
Implements QFunctionInterface.
|
private |
Referenced by Compute(), DeInitialize(), FactoredQLastTimeStepOrQBG(), and Initialize().
|
private |
Referenced by Compute(), FactoredQLastTimeStepOrQBG(), GetQ(), and ~FactoredQLastTimeStepOrQBG().