$BENCH_HOME/bin/storm-pomdp --prism $BENCH_HOME/models/serv/serv.prism --prop $BENCH_HOME/models/serv/serv.props rbrmax1 -const B1=570 --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 4096
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^12
Storm-POMDP 1.9.1 (dev)
Date: Mon Feb 10 14:44:22 2025
Command line arguments: --prism $BENCH_HOME/models/serv/serv.prism --prop $BENCH_HOME/models/serv/serv.props rbrmax1 -const B1=570 --timemem --statistics --revised --reward-aware --belief-exploration unfold --size-threshold 4096
Current working directory: $BENCH_HOME/experiments64gb
Time for model input parsing: 0.018s.
Time for model construction: 0.713s.
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 76928
Transitions: 716800
Choices: 571264
Observations: 6016
Reward Models: time
State Labels: 3 labels
* deadlock -> 0 item(s)
* init -> 1 item(s)
* taskdone -> 384 item(s)
Choice Labels: 9 labels
* north -> 62208 item(s)
* east -> 62208 item(s)
* south -> 62208 item(s)
* wait_delay -> 14720 item(s)
* west -> 62208 item(s)
* check_water -> 76928 item(s)
* deliver_water -> 76928 item(s)
* get_water -> 76928 item(s)
* interact -> 76928 item(s)
--------------------------------------------------------------
Analyzing property 'Pmax=? [true Urew{"time"}<=570 "taskdone"]'
Extend observation function to become reward aware.
bounded reachability processing done. POMDP Information:
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 388865
Transitions: 3671316
Choices: 2890120
Observations: 33316
Reward Models: time
State Labels: 3 labels
* taskdone -> 1920 item(s)
* deadlock -> 0 item(s)
* init -> 1 item(s)
Choice Labels: 9 labels
* west -> 315265 item(s)
* wait_delay -> 73600 item(s)
* south -> 315265 item(s)
* north -> 315265 item(s)
* interact -> 388865 item(s)
* get_water -> 388865 item(s)
* east -> 315265 item(s)
* deliver_water -> 388865 item(s)
* check_water -> 388865 item(s)
--------------------------------------------------------------
Transformed formula: Pmax=? [true Urew{"time"}<=570 "taskdone"]
Time for pre-processing: 0.322s.
Exploring the belief MDP...
Exploring the belief space...
Exploration stopped before all beliefs were explored. 4104 beliefs discovered. 926 beliefs explored.
Constructing the belief MDP...
--------------------------------------------------------------
Model type: MDP (sparse)
States: 4105
Transitions: 15171
Choices: 10515
Reward Models: time
State Labels: 3 labels
* target -> 0 item(s)
* init -> 1 item(s)
* bottom -> 1 item(s)
Choice Labels: none
--------------------------------------------------------------
Analyzing property 'Pmax=? [true Urew{"time"}<=570 "target"]' on the belief MDP...
Transformation of transition rewards resulted in a model with 5030 states. 1.225334957 times more states than the original belief MDP.
Merging of sink states resulted in a model with 1 states.
---------------------------------
Statistics:
---------------------------------
#checked epochs: 1.
overall Time: 0.000s.
Epoch Model building Time: 0.000s.
Epoch Model checking Time: 0.000s.
---------------------------------
Time for exploring beliefs: 0.111s.
Time for building the belief MDP: 0.022s.
Time for analyzing the belief MDP: 0.001s.
##### POMDP Approximation Statistics ######
# Input model:
--------------------------------------------------------------
Model type: POMDP (sparse)
States: 388865
Transitions: 3671316
Choices: 2890120
Observations: 33316
Reward Models: time
State Labels: 3 labels
* taskdone -> 1920 item(s)
* deadlock -> 0 item(s)
* init -> 1 item(s)
Choice Labels: 9 labels
* west -> 315265 item(s)
* wait_delay -> 73600 item(s)
* south -> 315265 item(s)
* north -> 315265 item(s)
* interact -> 388865 item(s)
* get_water -> 388865 item(s)
* east -> 315265 item(s)
* deliver_water -> 388865 item(s)
* check_water -> 388865 item(s)
--------------------------------------------------------------
# Max. Number of states with same observation: 21
# Total check time: 0.318s
##########################################
Result: ≥ 0
Time for POMDP analysis: 0.361s.
Performance statistics:
* peak memory usage: 504MB
* CPU time: 1.488s
* wallclock time: 1.633s
############################## Notes ##############################
Storm-pomdp. Sequential approach, cost aware, with cutoffs and size threshold 2^12