Return to Video

09-25 Deterministic Question 3 Solution

  • 0:00 - 0:02
    And the answer is easily obtained if you just
  • 0:02 - 0:05
    subtract -3 for each step.
  • 0:05 - 0:08
    We get 88 and 85 over here.
  • 0:08 - 0:11
    We could also reach the same value going around here.
  • 0:11 - 0:13
    So, 85 would have been the right answer,
  • 0:13 - 0:16
    and this will be the value function after convergence.
  • 0:16 - 0:24
    It's beautiful to see that the value function is effective
  • 0:24 - 0:26
    the distance to the positive absorbing state times 3
  • 0:26 - 0:28
    subtracted from 100.
  • 0:28 - 0:32
    So, we have 97, 94, 91, 88, 85 and so on.
  • 0:32 - 0:34
    This is a degenerate case.
  • 0:34 - 0:36
    If we have a deterministic state transition function,
  • 0:36 -
    it gets more tricky to calculate for the stochastic case.
Title:
09-25 Deterministic Question 3 Solution
Description:

Unit 9 25 Deterministic Answer 3

more » « less
Team:
Udacity
Project:
CS271 - Intro to Artificial Intelligence
Duration:
0:41
Amara Bot added a translation

English subtitles

Revisions