## ← 10ps-03 Function Generalization

• 1 Follower
• 21 Lines

Homework 5 2 Function Generalization.mp4

### Get Embed Code x Embed video Use the following code to embed this video. See our usage guide for more details on embedding. Paste this in your document somewhere (closest to the closing body tag is preferable): ```<script type="text/javascript" src='https://amara.org/embedder-iframe'></script> ``` Paste this inside your HTML body, where you want to include the widget: ```<div class="amara-embed" data-url="http://www.youtube.com/watch?v=tpH7hp_pLqk" data-team="udacity"></div> ``` 2 Languages

Showing Revision 1 created 11/28/2012 by Amara Bot.

1. This question involves function generalization in reinforcement learning,
2. and we're operating in a 1-dimensional environment of squares,
3. and we're going to consider a state generalization function,
4. that is a function that takes a state such as this and condenses it into some features
5. to represent that state.
6. The first function we're going to consider F has these features--
7. f1 is the distance from the Agent represented by A to the goal represented by G,
8. and f2--the distance from the Agent to the closest Bad guy
9. which is represented by a B.
10. So that's the function F, and we also want to consider the function G
11. which has the same 2 features--f1 and f2--and adds a third feature
12. which is the distance of the closest Bad guy to the goal.
13. That is distance from the goal to the Bad guy--the minimum of that over