Why is weight vector orthogonal to decision plane in neural networks
The weights are simply the coefficients that define a separating plane. For the moment, forget about neurons and just consider the geometric definition of a plane in N dimensions: w1*x1 + w2*x2 + … + wN*xN – w0 = 0 You can also think of this as being a dot product: w*x – w0 = … Read more