You should be able to set up the plugin to not use the default response messages. Follow below instructions for different versions.
For 1.0.2 or prior
new SwaggerSpringMvcPlugin(...)
//More config
.useDefaultResponseMessages(false) //<-- this should be false
...;
For 2.x
new Docket()
//More config
.useDefaultResponseMessages(false) //<-- this should be false
...;