It looks like you can dock or hide the debug tool bar:
To hide the debug tool bar change the “debug.toolBarLocation” setting to hidden.
Either floating in all views, docked in the debug view, or hidden.
Docking is better than floating and hidden. Adding the extension mentioned in the other answer is also helpful.