-
Book Overview & Buying
-
Table Of Contents
-
Feedback & Rating

Machine Learning Algorithms

In this section, we're going to briefly discuss the most important layer types employed in deep learning architectures. Clearly, as this is an introductory book, we are not presenting all the mathematical details, but we are focusing the attention on the specific applications. Further details and theoretical foundations can be found in Mastering Machine Learning Algorithms, Bonaccorso G, Packt Publishing, 2018.
A fully connectedlayer (sometimes called a dense layer) is made up of n neurons, and each of them receives all the output values coming from the previous layer (such as the hidden layer in a Multi-layer Perceptron (MLP)). It can be characterized by a weight matrix, a bias vector, and an activation function:
It's important to remember that an MLP must contain non-linear activations (for example, sigmoid, hyperbolic tangent, or ReLU). In fact, a network with n linear hidden layers is equivalent to a standard perceptron. In complex architectures...