I am not sure that there is any out of box solution to make it works as you expect.
However, you can achieve the specified behavior by using windowSoftInputMode = adjustNothing
and setting focus listener to edit text, and scroll the scroll view, when edit text gets focus.
If it is not clear how to implement scrolling I can add an example.