Yes, this is correct behaviour. The reason is that you can have a null pointer, but not a null reference – any reference has to be bound to an object.
So when dynamic_cast for a pointer type fails it returns a null pointer and the caller can check for that, but when it fails for a reference type it can’t return a null reference, so an exception is the only reasonable way to signal a problem.