Swish: A self-gated Activation Function

Source: Deep Learning on Medium

Recently, Google Brain has proposed a new activation function called Swish. It is showing some remarkable performance in the networks like…

Continue reading on Techspace »