You need to enable pushState
Backbone.history.start({pushState: true})
http://backbonejs.org/#Router
http://backbonejs.org/#History
Edit: As noted in the comments this will only work for browsers that support pushState, browsers that don’t will fall back to the hash method. There is no real way around this, you can enable for modern browser and fall back or just use hashes for all browsers.