Special characters work a little bit different with pseudo-elements. You can’t use HTML entities in CSS, but you can use Unicode hex escapes. Here is a tool to convert the numeric value of the special character to the CSS value.
http://www.evotech.net/articles/testjsentities.html
for example ► needs to be \25BA
working example:
http://jsfiddle.net/L6suy/
.right-arrow:after {
content:'\25BA'
}