how to change size of point in ChartJS

You would have to set the pointRadius property to 1 as well (so the point becomes small initially), along with the pointHoverRadius (remains small on hover)

pointRadius: 1,
pointHoverRadius: 1