**6.4 Loss function**

Is from the name indicate loss function, it estimates the loss or the difference between the expected outcome and the actual outcome the formula for loss function is listed below.

$$\text{Floss} = \text{Expected outcome - actual outcome} \tag{2}$$

There are many different ways to calculate the loss function; choosing a loss function is also one of the essential and challenging tasks of deep learning
