Probabilistic Reasoning and Learning Homework 8

In the last homework, I an calculating the results for a real application with both value iteration and policy iteration. In that application, I need to find a way to derive an algorithm to leave a dungeon made by obstacles `#`. Other than that, convergence for iterative policy evaluation is calculated. Codes are also attached

Probabilistic Reasoning and Learning Homework 5

This homework is mainly about gradient based learning, either first-order gradient or Newton’s Method. I am asked to derive the converging speed and error bounds. After that, two real applications — stock market prediction and handwritten digit classification problems — are given for us to practice. The experiment results and codes are written in report.

Computer Vision I Homework 4

For the written part, one is asked to work on nearest neighbor algorithm, and Principle Component Analysis (PCA). Later on, naive recognition, k-Nearest Neighbor (k-NN) recognition, Eigenfaces recognition, and Fisherfaces recognition are required separately. It is interesting that for eigenfaces recognition, dropping top four eigenvfaces actually induce better learning results. This might be caused by