Probabilistic Reasoning and Learning Homework 1

First homework in this course. It is about the basic probability knowledge, such as conditional probability, Bayesian rule, entropy, Kullback-Leibler (KL) distance, Mutual Information. Codes are attached in report.