The loss decreases as the training process goes on, except for some fluctuation introduced by the mini-batch gradient descent and/or regularization techniques like dropout (that introduces random noise). If the loss decreases, the training process is going well. The (validation I suppose) accuracy, instead, it’s a measure of how good the predictions of your model … Read more
In your example you are treating output [0, 0, 0, 1] as probabilities as required by the mathematical definition of cross entropy. But PyTorch treats them as outputs, that don’t need to sum to 1, and need to be first converted into probabilities for which it uses the softmax function. So H(p, q) becomes: H(p, … Read more
When that option is enabled (and it is by default), Notepad++ keeps a backup copy of files you edit. You can find the backups in the directory %APPDATA%\Notepad++\backup under the format filename@datetime.