MultiAgentDecisionProcess
|
BeliefValue is a namespace for functions that compute the value of a particular belief. More...
Functions | |
AlphaVector | GetMaximizingVector (const BeliefSet &S, int k, const ValueFunctionPOMDPDiscrete &V) |
Returns the alpha vector from V that maximizes the value of the k 'th belief in set S. More... | |
int | GetMaximizingVectorIndex (const BeliefInterface &b, const VectorSet &v) |
Returns the index of the vector in v that maximizes the value of b. More... | |
int | GetMaximizingVectorIndex (const BeliefInterface &b, const ValueFunctionPOMDPDiscrete &V) |
int | GetMaximizingVectorIndex (const BeliefInterface &b, const VectorSet &v, const std::vector< bool > &mask) |
Returns the index of the vector in v that maximizes the value of b. More... | |
int | GetMaximizingVectorIndexAndValue (const BeliefInterface &b, const VectorSet &v, const std::vector< bool > &mask, double &value) |
double | GetValue (const BeliefInterface &Belief, const AlphaVector &alpha) |
Get the value of a single Belief for alpha vecotr alpha. More... | |
double | GetValue (const BeliefInterface &Belief, const ValueFunctionPOMDPDiscrete &V) |
Get the value of a single Belief for value function V. More... | |
double | GetValue (const BeliefInterface &Belief, const QFunctionsDiscrete &Q) |
Get the value of a single Belief for q functions Q. More... | |
double | GetValue (const BeliefInterface &Belief, const QFunctionsDiscreteNonStationary &Q, Index t) |
Get the value of a single Belief for non-stationary q functions Q. More... | |
double | GetValue (const BeliefInterface &Belief, const ValueFunctionPOMDPDiscrete &V, const std::vector< bool > mask) |
Get the value of a single Belief for V given the mask. More... | |
double | GetValue (const BeliefInterface &Belief, const VectorSet &v, const std::vector< bool > mask) |
Get the value of a Belief for v given the mask. More... | |
std::vector< double > | GetValues (const BeliefSet &Beliefs, const ValueFunctionPOMDPDiscrete &V) |
Get the values of the Beliefs for value function V. More... | |
std::vector< double > | GetValues (const BeliefSet &Beliefs, const AlphaVector &alpha) |
Get the values of the Beliefs for alpha vector alpha. More... | |
std::vector< double > | GetValues (const BeliefSet &Beliefs, const QFunctionsDiscrete &Q) |
Get the values of the Beliefs for q functions Q. More... | |
std::vector< double > | GetValues (const BeliefSetNonStationary &Beliefs, const QFunctionsDiscreteNonStationary &Q) |
Get the values of the Beliefs for non-stationary q functions Q. More... | |
std::vector< double > | GetValues (const BeliefSetNonStationary &Beliefs, const ValueFunctionPOMDPDiscrete &V) |
Get the values of the Beliefs for value function V. More... | |
BeliefValue is a namespace for functions that compute the value of a particular belief.
AlphaVector BeliefValue::GetMaximizingVector | ( | const BeliefSet & | S, |
int | k, | ||
const ValueFunctionPOMDPDiscrete & | V | ||
) |
Returns the alpha vector from V that maximizes the value of the k 'th belief in set S.
References GetValues(), and AlphaVector::SetAction().
Referenced by PerseusPOMDPPlanner::BackupStage(), PerseusConstrainedPOMDPPlanner::BackupStage(), PerseusBGNSPlanner::BackupStageSampling(), PerseusBGPlanner::BackupStageSampling(), PerseusBGPOMDPPlanner::BackupStageSamplingAlt(), and PerseusBGPlanner::BackupStageSamplingAlt().
int BeliefValue::GetMaximizingVectorIndex | ( | const BeliefInterface & | b, |
const VectorSet & | v | ||
) |
Returns the index of the vector in v that maximizes the value of b.
References BeliefInterface::InnerProduct().
Referenced by AlphaVectorPOMDP::BeliefBackup(), AlphaVectorConstrainedPOMDP::BeliefBackup(), AlphaVectorBG::BeliefBackupExhaustiveOnlyKeepMax(), AlphaVectorBG::BeliefBackupExhaustiveStoreAll(), AlphaVectorConstrainedPOMDP::BeliefBackupQ(), PerseusNonStationary::GetQ(), PerseusStationary::GetQ(), and QAlphaVector::GetQ().
int BeliefValue::GetMaximizingVectorIndex | ( | const BeliefInterface & | b, |
const ValueFunctionPOMDPDiscrete & | V | ||
) |
References BeliefInterface::InnerProduct().
int BeliefValue::GetMaximizingVectorIndex | ( | const BeliefInterface & | b, |
const VectorSet & | v, | ||
const std::vector< bool > & | mask | ||
) |
Returns the index of the vector in v that maximizes the value of b.
If no vector has its mask enabled, the function returns -1.
Only vectors whose mask is true will be considered.
References BeliefInterface::InnerProduct().
int BeliefValue::GetMaximizingVectorIndexAndValue | ( | const BeliefInterface & | b, |
const VectorSet & | v, | ||
const std::vector< bool > & | mask, | ||
double & | value | ||
) |
References BeliefInterface::InnerProduct().
Referenced by AlphaVectorBG::BeliefBackupBGIP_Solver().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const AlphaVector & | alpha | ||
) |
Get the value of a single Belief for alpha vecotr alpha.
References AlphaVector::GetValues(), and BeliefInterface::InnerProduct().
Referenced by AlphaVectorWeighted::BeliefBackup(), GMAA_MAAstar::ConstructAndValuateNextPolicies(), GMAA_MAAstarCluster::ConstructAndValuateNextPolicies(), PerseusNonStationary::GetQ(), PerseusStationary::GetQ(), MonahanPlanner::GetQ(), QAlphaVector::GetQ(), GetValue(), MonahanPlanner::Plan(), PerseusNonStationaryQPlanner::PlanAll(), Perseus::PlanEndOfIteration(), PerseusNonStationaryQPlanner::PlanSampling(), and Perseus::PlanStartOfIteration().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const ValueFunctionPOMDPDiscrete & | V | ||
) |
Get the value of a single Belief for value function V.
References GetValues(), and BeliefInterface::InnerProduct().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const QFunctionsDiscrete & | Q | ||
) |
Get the value of a single Belief for q functions Q.
References GetValue().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const QFunctionsDiscreteNonStationary & | Q, | ||
Index | t | ||
) |
Get the value of a single Belief for non-stationary q functions Q.
References GetValue().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const ValueFunctionPOMDPDiscrete & | V, | ||
const std::vector< bool > | mask | ||
) |
Get the value of a single Belief for V given the mask.
References GetValues(), and BeliefInterface::InnerProduct().
double BeliefValue::GetValue | ( | const BeliefInterface & | Belief, |
const VectorSet & | v, | ||
const std::vector< bool > | mask | ||
) |
Get the value of a Belief for v given the mask.
References BeliefInterface::InnerProduct().
vector< double > BeliefValue::GetValues | ( | const BeliefSet & | Beliefs, |
const ValueFunctionPOMDPDiscrete & | V | ||
) |
Get the values of the Beliefs for value function V.
Implements equation (3.5) of PhD thesis Matthijs.
Referenced by PerseusPOMDPPlanner::BackupStage(), PerseusConstrainedPOMDPPlanner::BackupStage(), PerseusBGPOMDPPlanner::BackupStageAll(), PerseusBGNSPlanner::BackupStageAll(), PerseusBGPlanner::BackupStageAll(), PerseusBGNSPlanner::BackupStageSampling(), PerseusBGPlanner::BackupStageSampling(), PerseusBGPOMDPPlanner::BackupStageSamplingAlt(), PerseusBGPlanner::BackupStageSamplingAlt(), PerseusNonStationary::GetImmediateRewardBeliefSet(), PerseusStationary::GetImmediateRewardBeliefSet(), GetMaximizingVector(), GetValue(), GetValues(), PerseusQFunctionPlanner::Plan(), PerseusPOMDPPlanner::Plan(), PerseusNonStationaryQPlanner::PlanAll(), and PerseusNonStationaryQPlanner::PlanSampling().
vector< double > BeliefValue::GetValues | ( | const BeliefSet & | Beliefs, |
const AlphaVector & | alpha | ||
) |
Get the values of the Beliefs for alpha vector alpha.
References GetValues().
vector< double > BeliefValue::GetValues | ( | const BeliefSet & | Beliefs, |
const QFunctionsDiscrete & | Q | ||
) |
Get the values of the Beliefs for q functions Q.
References GetValues().
vector< double > BeliefValue::GetValues | ( | const BeliefSetNonStationary & | Beliefs, |
const QFunctionsDiscreteNonStationary & | Q | ||
) |
Get the values of the Beliefs for non-stationary q functions Q.
References BeliefSetNonStationary::Get(), GetValues(), and BeliefSetNonStationary::Size().
vector< double > BeliefValue::GetValues | ( | const BeliefSetNonStationary & | Beliefs, |
const ValueFunctionPOMDPDiscrete & | V | ||
) |
Get the values of the Beliefs for value function V.
References BeliefSetNonStationary::Get(), BeliefSetNonStationary::GetNumberOfTimeSteps(), GetValues(), and BeliefSetNonStationary::Size().