Loss functions define what an honest prediction is and isn’t. In short, choosing the proper loss function dictates how well your estimator is going to be. This text will probe into loss functions, the role they play in validating predictions, and therefore the various loss functions used.