A robot that plans, tracks and learns

The problem

Build a grid-world robot that finds paths with A*, keeps track of its position from noisy sensor readings, plans under slippery moves with value iteration, and learns the same task with Q-learning.

Requirements

Technologies

Step by step

  1. Write the map loader and a function that prints maps with paths or policies on them.
  2. Implement A* and uniform-cost search and compare them on several maps.
  3. Add the histogram filter and test it on runs with known true positions.
  4. Implement value iteration with slippery moves and print the policy.
  5. Implement Q-learning with ε-greedy exploration and measure how many episodes it needs.

Expected result

A small robotics toolkit that shows planning, tracking and learning on the same maps.

How it is evaluated

Ways to improve it