" is on the official list of valid HTML 4 entities, but ' is not.
From C.16. The Named Character Reference ‘:
The named character reference
'
(the apostrophe, U+0027) was
introduced in XML 1.0 but does not
appear in HTML. Authors should
therefore use'instead of
'to work as expected in HTML 4
user agents.