What’s the quickest way to remove an element from a Map by value in Java?

The correct and fast one-liner would actually be:

while (map.values().remove(valueObject));

Kind of strange that most examples above assume the valueObject to be unique.