This assignment is based on the concept of the Bellman equation on the basis of the value iteration algorithm for solving MDPs.