Why is weight vector orthogonal to decision plane in neural networks

The weights are simply the coefficients that define a separating plane. For the moment, forget about neurons and just consider the geometric definition of a plane in N dimensions: w1*x1 + w2*x2 + … + wN*xN – w0 = 0 You can also think of this as being a dot product: w*x – w0 = … Read more

multi-layer perceptron (MLP) architecture: criteria for choosing number of hidden layers and size of the hidden layer? [closed]

how many hidden layers? a model with zero hidden layers will resolve linearly separable data. So unless you already know your data isn’t linearly separable, it doesn’t hurt to verify this–why use a more complex model than the task requires? If it is linearly separable then a simpler technique will work, but a Perceptron will … Read more

Hata!: SQLSTATE[HY000] [1045] Access denied for user 'divattrend_liink'@'localhost' (using password: YES)