Source: Deep Learning on Medium
Deep Sparse Rectifier Neural Networks
This paper shows that rectifying neurons are an even better model of biological neurons and yield equal or better performance than hyperbolic tangent networks in spite of the hard non-linearity and non-differentiability at zero, creating sparse representations with true zeros, which seem remarkably suitable for naturally sparse data.
(Université de Montréal)
You May Also Like
Happy AI New Year! Global Researchers Reflect on 2019, Talk Trends for 2020
To welcome 2020 with some fresh AI perspectives, Synced spoke with global researchers from Google Brain, Sony AI, Alibaba affiliate Ant Financial (formerly known as Alipay) and other 8 organizations.