Typo. The last layer is softmax. Typo is in the text only, the code is correct.

Original article can be found here (source): Deep Learning on Medium

I took ReLU as the activation function for hidden layers and sigmoid for the output layer (these are standards, didn’t experiment much on changing these). Also, I used the standard categor…