storm.belseqc22

Benchmark
id:main_resrc_rbrmax3_B105-B205-B3060 (POMDP)
Invocation (belseqc22)
$BENCH_HOME/bin/storm-pomdp --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const B1=5,B2=5,B3=60 --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 4194304
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^22
Execution
Walltime:1606.6630499362946s
Return code:0
Note(s):Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^22
Log
Storm-POMDP 1.9.1 (dev)

Date: Mon Feb 10 14:16:44 2025
Command line arguments: --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const 'B1=5,B2=5,B3=60' --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 4194304
Current working directory: $BENCH_HOME/experiments64gb

Time for model input parsing: 0.007s.

Time for model construction: 0.023s.

-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	721
Transitions: 	5041
Choices: 	2881
Observations: 	155
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * init -> 1 item(s)
   * ((x = 3) & (y = 1)) -> 16 item(s)
Choice Labels: 	5 labels
   * place -> 1 item(s)
   * right -> 720 item(s)
   * left -> 720 item(s)
   * up -> 720 item(s)
   * down -> 720 item(s)
-------------------------------------------------------------- 
Analyzing property 'Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }((x = 3) & (y = 1))]'
Extend observation function to become reward aware.
bounded reachability processing done. POMDP Information:
-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	746
Transitions: 	5217
Choices: 	2981
Observations: 	283
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * ((x = 3) & (y = 1)) -> 41 item(s)
   * init -> 1 item(s)
Choice Labels: 	5 labels
   * up -> 745 item(s)
   * right -> 745 item(s)
   * place -> 1 item(s)
   * left -> 745 item(s)
   * down -> 745 item(s)
-------------------------------------------------------------- 
Transformed formula: Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }((x = 3) & (y = 1))]
Time for pre-processing: 0.001s.
Exploring the belief MDP... 
Exploring the belief space...
Exploration stopped before all beliefs were explored. 4194305 beliefs discovered. 2559066 beliefs explored.
Constructing the belief MDP...
-------------------------------------------------------------- 
Model type: 	MDP (sparse)
States: 	4194306
Transitions: 	15749689
Choices: 	11871501
Reward Models:  steps, gem, gold
State Labels: 	3 labels
   * target -> 226821 item(s)
   * init -> 1 item(s)
   * bottom -> 1 item(s)
Choice Labels: 	none
-------------------------------------------------------------- 
Analyzing property 'Pmax=? [true U^{rew{"gold"}>=5 , rew{"gem"}>=5 , rew{"steps"}<=60 }"target"]' on the belief MDP...
Transformation of transition rewards resulted in a model with 6753370 states. 1.610128112 times more states than the original belief MDP.
Merging of sink states resulted in a model with 4781898 states.
Epoch model for epoch <_, _, _> is cyclic.
Epoch model for epoch <_, 0, _> is cyclic.
Epoch model for epoch <0, _, _> is cyclic.
Epoch model for epoch <0, 0, _> is cyclic.
---------------------------------
Statistics:
---------------------------------
          #checked epochs: 2107.
             overall Time: 1524.601s.
Epoch Model building Time: 549.410s.
Epoch Model checking Time: 975.182s.
---------------------------------
Time for exploring beliefs: 14.677s.
Time for building the belief MDP: 5.607s.
Time for analyzing the belief MDP: 1582.530s.
##### POMDP Approximation Statistics ######
# Input model: 
-------------------------------------------------------------- 
Model type: 	POMDP (sparse)
States: 	746
Transitions: 	5217
Choices: 	2981
Observations: 	283
Reward Models:  steps, gold, gem
State Labels: 	3 labels
   * deadlock -> 0 item(s)
   * ((x = 3) & (y = 1)) -> 41 item(s)
   * init -> 1 item(s)
Choice Labels: 	5 labels
   * up -> 745 item(s)
   * right -> 745 item(s)
   * place -> 1 item(s)
   * left -> 745 item(s)
   * down -> 745 item(s)
-------------------------------------------------------------- 
# Max. Number of states with same observation: 8
# Total check time: 1606.302s
##########################################

Result: ≥ 0.03125
Time for POMDP analysis: 1606.303s.

Performance statistics:
  * peak memory usage: 21216MB
  * CPU time: 1586.879s
  * wallclock time: 1606.345s


############################## Notes ##############################
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^22