Steve Taylor’s answer does indeed work, but there is a simpler way using the JSF EL pre-defined object initParam.
<h:outputText value="#{initParam['myconstantkey']}" />
Originally this wasn’t working for me because I forgot to put the single quotes around the key name and was getting back an empty string. This solution should also work with key values that contain dot characters.