SliderThemeData(overlayShape: SliderComponentShape.noOverlay)
or
overlayShape: SliderComponentShape.noThumb
Default padding is caused by thumb painting and overlay painting, by specifying these properties you will remove them, but you will get zero padding
https://api.flutter.dev/flutter/material/SliderThemeData-class.html