Just check if the throwable is an instance of HttpException and then you can access the retrofit response
if (e instanceof HttpException) {
ResponseBody body = ((HttpException) e).response().errorBody();
...
}
Then you can use the converter to deserialize it (or do it yourself).