In the written part, we are asked to solve some problems in our textbook, Bishop. Later on, we need to derive the updates for logistic regression and Softmax regression and run experiments on them to verify our derivations. Experiments results and codes are included in report.