Why the cost function of logistic regression has a logarithmic expression?

Source: my own notes taken during Standford’s Machine Learning course in Coursera, by Andrew Ng. All credits to him and this organization. The course is freely available for anybody to be taken at their own pace. The images are made by myself using LaTeX (formulas) and R (graphics). Hypothesis function Logistic regression is used when … Read more

Difference between parameters, features and class in Machine Learning

Let’s use the example of classifying the gender of a person. Your understanding about class is correct! Given an input observation, our Naive Bayes Classifier should output a category. The class is that category. Features: Features in a Naive Bayes Classifier, or any general ML Classification Algorithm, are the data points we choose to define … Read more

Xgboost-How to use “mae” as objective function?

A little bit of theory first, sorry! You asked for the grad and hessian for MAE, however, the MAE is not continuously twice differentiable so trying to calculate the first and second derivatives becomes tricky. Below we can see the “kink” at x=0 which prevents the MAE from being continuously differentiable. Moreover, the second derivative … Read more

Altering trained images to train neural network

It is a very good way to increase the number of date you have. What you’ll do depends on your data. For example, if you are training on data obtained from a sensor, you may want to add some noise to the training data so that you can increase your dataset. After all, you can … Read more

Best machine learning technique for matching product strings

My first thought is to try to parse the names into a description of features (company LG, size 42 Inch, resolution 1080p, type LCD HDTV). Then you can match these descriptions against each other for compatibility; it’s okay to omit a product number but bad to have different sizes. Simple are-the-common-attributes-compatible might be enough, or … Read more

Early stopping with Keras and sklearn GridSearchCV cross-validation

[Answer after the question was edited & clarified:] Before rushing into implementation issues, it is always a good practice to take some time to think about the methodology and the task itself; arguably, intermingling early stopping with the cross validation procedure is not a good idea. Let’s make up an example to highlight the argument. … Read more