Add the following to your XML code (Or use the appropriate function)
android:adjustViewBounds="true"
I don’t know why this isn’t a default, because it seems like it would be required for a large number of items. Still, adding this simple logic to your XML file will make all of the difference.