Deep Learning: Past, Present, and Future…

Source: Deep Learning on Medium

Deep Learning: Past, Present, and Future…


Deep Learning is a subset of Artificial Intelligence that falls under the umbrella of machine learning. It is inspired by the structure and function of the human brain. Deep Learning is a method of enabling computers to carry out specific tasks that require human intelligence without any human intervention. The human brain consists of a complex web of neurons connected together, this network of neurons (also called neural network) is responsible for complex functionalities of the human brain. Deep Learning was built on the core idea of mimicking the complex process of human brain to enable machines to think on their own i.e. machines with artificial intelligence.

Artificial Neural Networks

Artificial neural networks were at the center of the deep learning revolution, these algorithms are loosely based on the structure of biological brains, which consist of networks of neurons interconnected by signal-carrying synapses. An artificial neural network consists of an Input Layer (as the human brain takes input through the different senses), the number of hidden layers (where all the processing takes place) and an output layer (as the decision is conveyed through some actions). In Artificial Neural Network as data travels through this artificial mesh, each layer processes an aspect of the data, filters outliers, spots familiar entities, and produces the final output.

“Experience has shown, that a vast, portion of the truth arises from the seemingly irrelevant” — Edgar Allan Poe

Roots of Deep Learning

Deep learning has its roots back to the 1950s when the first neural network was invented. In the 1960s and 1970s, there has been a lot of excitement in this field resulting in various novel researches. In the decades of 1980s and 1990’s some breakthrough research in deep learning like the development of Convolutional Neural Network (For Image Processing and Computer Vision) and Recurrent Neural Network (For analyzing time series data) led to the further bifurcation of the field. This was the time when every year there is some new breakthrough research which changes the course of deep learning, the field was all set to explode and grow exponentially. But when deep learning was applied in real-life scenarios, soon people realized that there were two main challenges —

  • The first and most prominent challenge was the lack of computing power.
  • The other challenge was the limited availability of data.

This led to an AI winter, where research in the field has been dampened because of the above limitations, and people thought of it as an idea that is way ahead in the future.

Evolution of Deep Learning (Artificial Intelligence → Machine Learning → Deep Learning)

Major Breakthroughs

Again, after two decades, in 2010 with the launch of Image Net competition (A very large dataset of around 14 million labeled images were made available opensource with an aim towards developing state-of-the-art Image Classifier), the field of deep learning picked up the speed and this time with ample computational power and plethora of digital data available, it was all set to explode. In 2011, Alex-net was developed that kicked off a convolutional neural network renaissance in the deep learning community. In 2014, Generative Adversarial Networks (GAN’s) was developed which was the biggest breakthrough in the era of modern deep learning.

Generating Artificial Faces through Generative Adversarial Network (GAN)

Current Scenario

Currently, deep learning is all around us. It’s used to determine which online ads to display in real-time, identify and tag friends in photos, translate your voice to text, translate text into different languages on a Web page, and drive autonomous vehicles. It’s a key technology that is achieving results that were not possible before. Recent advances in deep learning have improved to the point where deep learning outperforms humans in some tasks like classifying objects in images.

Deep learning is also found in less visible places like credit card companies use deep learning for fraud detection, businesses use it to predict whether you will cancel a subscription and provide personalized customer recommendations, banks use it to predict bankruptcy and loan default risk, hospitals use it for detection, diagnosis, and treatment of diseases. It is being widely used to automate processes, improve performance, detect patterns, and solve problems and the range of its application is almost limitless.