It’s been almost a year since the question was asked. But I faced the problem now and got a solution. 🙂
May be it will help someone.
You can achieve this by setting android:minHeight="0dp" for the Button widget.
And I guess this behavior is because there is some default value (may be a 48dp) set for Button widgets by the framework considering a minimum touch area.