build based on 328c024

dev/.documenter-siteinfo.json

@@ -1 +1 @@
-{"documenter":{"julia_version":"1.9.3","generation_timestamp":"2023-10-22T18:26:56","documenter_version":"1.1.1"}}
+{"documenter":{"julia_version":"1.9.3","generation_timestamp":"2023-10-23T00:32:47","documenter_version":"1.1.1"}}

dev/def_pomdp/index.html

@@ -196,4 +196,4 @@
 R = [-1. -100. 10.; 
      -1. 10. -100.]
 
-m = TabularPOMDP(T, R, O, 0.95)</code></pre><p>Here <code>T</code> is a <span>$|S| \times |A| \times |S|$</span> array representing the transition probabilities, with <code>T[sp, a, s]</code> <span>$= T(s&#39; | s, a)$</span>. Similarly, <code>O</code> is an <span>$|O| \times |A| \times |S|$</span> encoding the observation distribution with <code>O[o, a, sp]</code> <span>$= Z(o | a, s&#39;)$</span>, and <code>R</code> is a <span>$|S| \times |A|$</span> matrix that encodes the reward function. 0.95 is the discount factor.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../concepts/">« Concepts and Architecture</a><a class="docs-footer-nextpage" href="../interfaces/">Spaces and Distributions »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Sunday 22 October 2023 18:26">Sunday 22 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+m = TabularPOMDP(T, R, O, 0.95)</code></pre><p>Here <code>T</code> is a <span>$|S| \times |A| \times |S|$</span> array representing the transition probabilities, with <code>T[sp, a, s]</code> <span>$= T(s&#39; | s, a)$</span>. Similarly, <code>O</code> is an <span>$|O| \times |A| \times |S|$</span> encoding the observation distribution with <code>O[o, a, sp]</code> <span>$= Z(o | a, s&#39;)$</span>, and <code>R</code> is a <span>$|S| \times |A|$</span> matrix that encodes the reward function. 0.95 is the discount factor.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../concepts/">« Concepts and Architecture</a><a class="docs-footer-nextpage" href="../interfaces/">Spaces and Distributions »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Monday 23 October 2023 00:32">Monday 23 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>

dev/def_updater/index.html

@@ -29,4 +29,4 @@
 b = Any[POMDPModels.BoolDistribution(0.0), false, false]
 b = Any[POMDPModels.BoolDistribution(0.0), false, false, false, false]
 b = Any[POMDPModels.BoolDistribution(0.0), false, false, false, false, true, false]
-b = Any[POMDPModels.BoolDistribution(0.0), false, false, false, false, true, false, true, false]</code></pre></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../online_solver/">« Example: Defining an online solver</a><a class="docs-footer-nextpage" href="../simulation/">Simulation Standard »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Sunday 22 October 2023 18:26">Sunday 22 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+b = Any[POMDPModels.BoolDistribution(0.0), false, false, false, false, true, false, true, false]</code></pre></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../online_solver/">« Example: Defining an online solver</a><a class="docs-footer-nextpage" href="../simulation/">Simulation Standard »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Monday 23 October 2023 00:32">Monday 23 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>

dev/faq/index.html

@@ -14,4 +14,4 @@
   end
 end
 
-POMDPs.reward(m, s, a) = rdict[(s, a)]</code></pre><h2 id="Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?"><a class="docs-heading-anchor" href="#Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?">Why do I need to put type assertions pomdp::POMDP into the function signature?</a><a id="Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?-1"></a><a class="docs-heading-anchor-permalink" href="#Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?" title="Permalink"></a></h2><p>Specifying the type in your function signature allows Julia to call the appropriate function when your custom type is passed into it. For example if a POMDPs.jl solver calls <code>states</code> on the POMDP that you passed into it, the correct <code>states</code> function will only get dispatched if you specified that the <code>states</code> function you wrote works with your POMDP type. Because Julia supports multiple-dispatch, these type assertion are a way for doing object-oriented programming in Julia.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../POMDPTools/testing/">« Testing</a><a class="docs-footer-nextpage" href="../api/">API Documentation »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Sunday 22 October 2023 18:26">Sunday 22 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+POMDPs.reward(m, s, a) = rdict[(s, a)]</code></pre><h2 id="Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?"><a class="docs-heading-anchor" href="#Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?">Why do I need to put type assertions pomdp::POMDP into the function signature?</a><a id="Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?-1"></a><a class="docs-heading-anchor-permalink" href="#Why-do-I-need-to-put-type-assertions-pomdp::POMDP-into-the-function-signature?" title="Permalink"></a></h2><p>Specifying the type in your function signature allows Julia to call the appropriate function when your custom type is passed into it. For example if a POMDPs.jl solver calls <code>states</code> on the POMDP that you passed into it, the correct <code>states</code> function will only get dispatched if you specified that the <code>states</code> function you wrote works with your POMDP type. Because Julia supports multiple-dispatch, these type assertion are a way for doing object-oriented programming in Julia.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../POMDPTools/testing/">« Testing</a><a class="docs-footer-nextpage" href="../api/">API Documentation »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Monday 23 October 2023 00:32">Monday 23 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>

dev/get_started/index.html

@@ -13,4 +13,4 @@
 init_dist = initialstate(pomdp) # from POMDPModels
 hr = HistoryRecorder(max_steps=100) # from POMDPTools
 hist = simulate(hr, pomdp, policy, belief_updater, init_dist) # run 100 step simulation
-println(&quot;reward: $(discounted_reward(hist))&quot;)</code></pre><p>The first part of the code loads the desired packages and initializes the problem and the solver. Next, we compute a POMDP policy. Lastly, we evaluate the results.</p><p>There are a few things to mention here. First, the TigerPOMDP type implements all the functions required by QMDPSolver to compute a policy. Second, each policy has a default updater (essentially a filter used to update the belief of the POMDP). To learn more about Updaters check out the <a href="http://juliapomdp.github.io/POMDPs.jl/latest/concepts/">Concepts</a> section.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../install/">« Installation</a><a class="docs-footer-nextpage" href="../concepts/">Concepts and Architecture »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Sunday 22 October 2023 18:26">Sunday 22 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>
+println(&quot;reward: $(discounted_reward(hist))&quot;)</code></pre><p>The first part of the code loads the desired packages and initializes the problem and the solver. Next, we compute a POMDP policy. Lastly, we evaluate the results.</p><p>There are a few things to mention here. First, the TigerPOMDP type implements all the functions required by QMDPSolver to compute a policy. Second, each policy has a default updater (essentially a filter used to update the belief of the POMDP). To learn more about Updaters check out the <a href="http://juliapomdp.github.io/POMDPs.jl/latest/concepts/">Concepts</a> section.</p></article><nav class="docs-footer"><a class="docs-footer-prevpage" href="../install/">« Installation</a><a class="docs-footer-nextpage" href="../concepts/">Concepts and Architecture »</a><div class="flexbox-break"></div><p class="footer-message">Powered by <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> and the <a href="https://julialang.org/">Julia Programming Language</a>.</p></nav></div><div class="modal" id="documenter-settings"><div class="modal-background"></div><div class="modal-card"><header class="modal-card-head"><p class="modal-card-title">Settings</p><button class="delete"></button></header><section class="modal-card-body"><p><label class="label">Theme</label><div class="select"><select id="documenter-themepicker"><option value="documenter-light">documenter-light</option><option value="documenter-dark">documenter-dark</option><option value="auto">Automatic (OS)</option></select></div></p><hr/><p>This document was generated with <a href="https://github.com/JuliaDocs/Documenter.jl">Documenter.jl</a> version 1.1.1 on <span class="colophon-date" title="Monday 23 October 2023 00:32">Monday 23 October 2023</span>. Using Julia version 1.9.3.</p></section><footer class="modal-card-foot"></footer></div></div></div></body></html>