How to remove default A B markers on google maps route direction

Try using the suppressMarkers option on the DirectionsRenderer to prevent the markers on the route from being displayed. This should leave the markers that you have added directly to the map in place but not show those associated with the route.

directionsDisplay.setMap(map);
directionsDisplay.setOptions( { suppressMarkers: true } );