What is the difference between Deep and Shallow networks?

A Deep Neural Network consists of two or more hidden layers. While a single layer perceptron can be used as a binary classifier for data that is linearly separable, a Neural Network with one hidden layer is the usual case in Traditional Machine Learning.  This is also the minimum number of layers required to be useful for such a case, and this configuration is called a ‘Shallow Network’. As more layers are added to the Neural Network, the model moves towards being a ‘Deep Network’. 

Author

Help us improve this post by suggesting in comments below:

– modifications to the text, and infographics
– video resources that offer clear explanations for this question
– code snippets and case studies relevant to this concept
– online blogs, and research publications that are a “must read” on this topic

Leave the first comment

Partner Ad
Find out all the ways that you can
Contribute