Yes.
See: LinkedHashMap:
This linked list defines the iteration
ordering, which is normally the order
in which keys were inserted into the
map (insertion-order).
and from the HashMap#keySet documentation:
The set [returned] is backed by the map, so
changes to the map are reflected in
the set, and vice-versa.