$BENCH_HOME/bin/storm-pomdp --prism $BENCH_HOME/models/clean/clean.prism --prop $BENCH_HOME/models/clean/clean.props rbrmax2 -const N=6,B1=60,B2=5 --timemem --statistics --revised --reward-aware 5,0 --belief-exploration unfold --size-threshold 32768
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^15
Storm-POMDP 1.9.1 (dev)
Date: Mon Feb 10 10:24:16 2025
Command line arguments: --prism $BENCH_HOME/models/clean/clean.prism --prop $BENCH_HOME/models/clean/clean.props rbrmax2 -const 'N=6,B1=60,B2=5' --timemem --statistics --revised --reward-aware '5,0' --belief-exploration unfold --size-threshold 32768
Current working directory: $BENCH_HOME/experiments64gb
Time for model input parsing: 0.001s.
Time for model construction: 0.008s.
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 37
Transitions: 74
Choices: 50
Observations: 2
Reward Models: energy, clean
State Labels: 3 labels
* deadlock -> 0 item(s)
* init -> 1 item(s)
* goal -> 1 item(s)
Choice Labels: 3 labels
* clean -> 13 item(s)
* move -> 13 item(s)
* consume -> 24 item(s)
--------------------------------------------------------------
Analyzing property 'Pmax=? [true U^{rew{"energy"}<=60 , rew{"clean"}>5 }"goal"]'
Perform unfolding for observation levels.
bounded reachability processing done. POMDP Information:
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 777
Transitions: 1785
Choices: 1134
Observations: 5
Reward Models: dim0_levelReward
State Labels: 4 labels
* goal -> 42 item(s)
* dim1_active -> 6 item(s)
* deadlock -> 0 item(s)
* init -> 1 item(s)
Choice Labels: 3 labels
* move -> 357 item(s)
* consume -> 420 item(s)
* clean -> 357 item(s)
--------------------------------------------------------------
Transformed formula: Pmax=? [true Urew{"dim0_levelReward"}<=12 ("goal" & "dim1_active")]
Time for pre-processing: 0.000s.
Exploring the belief MDP...
Exploring the belief space...
Exploration stopped before all beliefs were explored. 32769 beliefs discovered. 25691 beliefs explored.
Constructing the belief MDP...
--------------------------------------------------------------
Model type: MDP (sparse)
States: 32770
Transitions: 60352
Choices: 47568
Reward Models: dim0_levelReward
State Labels: 3 labels
* target -> 26 item(s)
* init -> 1 item(s)
* bottom -> 1 item(s)
Choice Labels: none
--------------------------------------------------------------
Analyzing property 'Pmax=? [true Urew{"dim0_levelReward"}<=12 "target"]' on the belief MDP...
Transformation of transition rewards resulted in a model with 39695 states. 1.21132133 times more states than the original belief MDP.
Merging of sink states resulted in a model with 899 states.
---------------------------------
Statistics:
---------------------------------
#checked epochs: 14.
overall Time: 0.001s.
Epoch Model building Time: 0.000s.
Epoch Model checking Time: 0.000s.
---------------------------------
Time for exploring beliefs: 0.103s.
Time for building the belief MDP: 0.008s.
Time for analyzing the belief MDP: 0.010s.
##### POMDP Approximation Statistics ######
# Input model:
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 777
Transitions: 1785
Choices: 1134
Observations: 7
Reward Models: dim0_levelReward
State Labels: 4 labels
* goal -> 42 item(s)
* dim1_active -> 6 item(s)
* deadlock -> 0 item(s)
* init -> 1 item(s)
Choice Labels: 3 labels
* move -> 357 item(s)
* consume -> 420 item(s)
* clean -> 357 item(s)
--------------------------------------------------------------
# Max. Number of states with same observation: 420
# Total check time: 0.132s
##########################################
Result: ≥ 0.37748736
Time for POMDP analysis: 0.132s.
Performance statistics:
* peak memory usage: 70MB
* CPU time: 0.142s
* wallclock time: 0.143s
############################## Notes ##############################
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^15