# storm.belseqd25

Benchmark

id: | main_resrc_rbrmax3_B115-B215-B3180 (POMDP)

Invocation (belseqd25)

    $BENCH_HOME/bin/storm-pomdp --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const B1=15,B2=15,B3=180 --timemem --statistics --revised --reward-aware --belief-exploration discretize --resolution 25 --triangulationmode static

Storm-pomdp. Sequential approach, cost aware, with discretization and resolution 25
Execution

Walltime: | 37.71928954124451s
Return code: | 0
Note(s): | Storm-pomdp. Sequential approach, cost aware, with discretization and resolution 25

Log

    Storm-POMDP 1.9.1 (dev)

    Date: Mon Feb 10 14:43:17 2025
    Command line arguments: --prism $BENCH_HOME/models/resrc/resrc.prism --prop $BENCH_HOME/models/resrc/resrc.props rbrmax3 -const 'B1=15,B2=15,B3=180' --timemem --statistics --revised --reward-aware --belief-exploration discretize --resolution 25 --triangulationmode static
    Current working directory: $BENCH_HOME/experiments64gb

    Time for model input parsing: 0.007s.

    Time for model construction: 0.019s.

    --------------------------------------------------------------
    Model type: 	POMDP (sparse)
    States: 	721
    Transitions: 	5041
    Choices: 	2881
    Observations: 	155
    Reward Models:  steps, gold, gem
    State Labels: 	3 labels
       * deadlock -> 0 item(s)
       * init -> 1 item(s)
       * ((x = 3) & (y = 1)) -> 16 item(s)
    Choice Labels: 	5 labels
       * place -> 1 item(s)
       * right -> 720 item(s)
       * left -> 720 item(s)
       * up -> 720 item(s)
       * down -> 720 item(s)
    --------------------------------------------------------------
    Analyzing property 'Pmax=? [true U^{rew{"gold"}>=15 , rew{"gem"}>=15 , rew{"steps"}<=180 }((x = 3) & (y = 1))]'
    Extend observation function to become reward aware.
    bounded reachability processing done. POMDP Information:
    --------------------------------------------------------------
    Model type: 	POMDP (sparse)
    States: 	746
    Transitions: 	5217
    Choices: 	2981
    Observations: 	283
    Reward Models:  steps, gold, gem
    State Labels: 	3 labels
       * deadlock -> 0 item(s)
       * ((x = 3) & (y = 1)) -> 41 item(s)
       * init -> 1 item(s)
    Choice Labels: 	5 labels
       * up -> 745 item(s)
       * right -> 745 item(s)
       * place -> 1 item(s)
       * left -> 745 item(s)
       * down -> 745 item(s)
    --------------------------------------------------------------
    Transformed formula: Pmax=? [true U^{rew{"gold"}>=15 , rew{"gem"}>=15 , rew{"steps"}<=180 }((x = 3) & (y = 1))]
    Time for pre-processing: 0.001s.
    Exploring the belief MDP...
    Exploring the belief space...
    Constructing the belief MDP...
    --------------------------------------------------------------
    Model type: 	MDP (sparse)
    States: 	4748
    Transitions: 	47763
    Choices: 	18986
    Reward Models:  steps, gem, gold
    State Labels: 	3 labels
       * target -> 341 item(s)
       * init -> 1 item(s)
       * bottom -> 1 item(s)
    Choice Labels: 	none
    --------------------------------------------------------------
    Analyzing property 'Pmax=? [true U^{rew{"gold"}>=15 , rew{"gem"}>=15 , rew{"steps"}<=180 }"target"]' on the belief MDP...
    Transformation of transition rewards resulted in a model with 9493 states. 1.999368155 times more states than the original belief MDP.
    Merging of sink states resulted in a model with 9492 states.
    ---------------------------------
    Statistics:
    ---------------------------------
              #checked epochs: 43992.
                 overall Time: 37.343s.
    Epoch Model building Time: 24.023s.
    Epoch Model checking Time: 13.181s.
    ---------------------------------
    Time for exploring beliefs: 0.028s.
    Time for building the belief MDP: 0.003s.
    Time for analyzing the belief MDP: 37.531s.
    ##### POMDP Approximation Statistics ######
    # Input model:
    --------------------------------------------------------------
    Model type: 	POMDP (sparse)
    States: 	746
    Transitions: 	5217
    Choices: 	2981
    Observations: 	283
    Reward Models:  steps, gold, gem
    State Labels: 	3 labels
       * deadlock -> 0 item(s)
       * ((x = 3) & (y = 1)) -> 41 item(s)
       * init -> 1 item(s)
    Choice Labels: 	5 labels
       * up -> 745 item(s)
       * right -> 745 item(s)
       * place -> 1 item(s)
       * left -> 745 item(s)
       * down -> 745 item(s)
    --------------------------------------------------------------
    # Max. Number of states with same observation: 8
    # Total check time: 37.566s
    ##########################################

    Result: ≤ 4.107264216e-05
    Time for POMDP analysis: 37.566s.

    Performance statistics:
      * peak memory usage: 264MB
      * CPU time: 37.298s
      * wallclock time: 37.613s

    ############################## Notes ##############################
    Storm-pomdp. Sequential approach, cost aware, with discretization and resolution 25