storm.belseqc20

Benchmark
id:main_resrc_rbrmax3_B105-B205-B3060 (POMDP)
Invocation (belseqc20)
$BENCH_HOME/bin/storm-pomdp --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const B1=5,B2=5,B3=60 --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 1048576
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^20
Execution
Walltime:287.86827635765076s
Return code:0
Note(s):Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^20
Log
Storm-POMDP 1.9.1 (dev)

Date: Mon Feb 10 14:16:44 2025
Command line arguments: --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const 'B1=5,B2=5,B3=60' --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 1048576
Current working directory: $BENCH_HOME/experiments64gb

Time for model input parsing: 0.006s.

Time for model construction: 0.020s.

-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	721
Transitions: 	5041
Choices: 	2881
Observations: 	155
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * init -> 1 item(s)
   * ((x = 3) & (y = 1)) -> 16 item(s)
Choice Labels: 	5 labels
   * place -> 1 item(s)
   * right -> 720 item(s)
   * left -> 720 item(s)
   * up -> 720 item(s)
   * down -> 720 item(s)
-------------------------------------------------------------- 
Analyzing property 'Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }((x = 3) & (y = 1))]'
Extend observation function to become reward aware.
bounded reachability processing done. POMDP Information:
-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	746
Transitions: 	5217
Choices: 	2981
Observations: 	283
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * ((x = 3) & (y = 1)) -> 41 item(s)
   * init -> 1 item(s)
Choice Labels: 	5 labels
   * up -> 745 item(s)
   * right -> 745 item(s)
   * place -> 1 item(s)
   * left -> 745 item(s)
   * down -> 745 item(s)
-------------------------------------------------------------- 
Transformed formula: Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }((x = 3) & (y = 1))]
Time for pre-processing: 0.001s.
Exploring the belief MDP... 
Exploring the belief space...
Exploration stopped before all beliefs were explored. 1048577 beliefs discovered. 699424 beliefs explored.
Constructing the belief MDP...
-------------------------------------------------------------- 
Model type: 	MDP (sparse)
States: 	1048578
Transitions: 	4124208
Choices: 	3146847
Reward Models:  steps, gem, gold
State Labels: 	3 labels
   * target -> 68060 item(s)
   * init -> 1 item(s)
   * bottom -> 1 item(s)
Choice Labels: 	none
-------------------------------------------------------------- 
Analyzing property 'Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }"target"]' on the belief MDP...
Transformation of transition rewards resulted in a model with 1748000 states. 1.667019525 times more states than the original belief MDP.
Merging of sink states resulted in a model with 1309490 states.
Epoch model for epoch <_, _, _> is cyclic.
Epoch model for epoch <_, 0, _> is cyclic.
Epoch model for epoch <0, _, _> is cyclic.
Epoch model for epoch <0, 0, _> is cyclic.
---------------------------------
Statistics:
---------------------------------
          #checked epochs: 2107.
             overall Time: 267.011s.
Epoch Model building Time: 146.469s.
Epoch Model checking Time: 120.533s.
---------------------------------
Time for exploring beliefs: 3.588s.
Time for building the belief MDP: 1.118s.
Time for analyzing the belief MDP: 282.251s.
##### POMDP Approximation Statistics ######
# Input model: 
-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	746
Transitions: 	5217
Choices: 	2981
Observations: 	283
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * ((x = 3) & (y = 1)) -> 41 item(s)
   * init -> 1 item(s)
Choice Labels: 	5 labels
   * up -> 745 item(s)
   * right -> 745 item(s)
   * place -> 1 item(s)
   * left -> 745 item(s)
   * down -> 745 item(s)
-------------------------------------------------------------- 
# Max. Number of states with same observation: 8
# Total check time: 287.630s
##########################################

Result: ≥ 0.03125
Time for POMDP analysis: 287.631s.

Performance statistics:
  * peak memory usage: 5774MB
  * CPU time: 285.604s
  * wallclock time: 287.681s


############################## Notes ##############################
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^20