That’s definitely will suffice in vast majority of cases.
Just keep in mind that the correct order of styles for links is:
a:link { color: #c00 } /* unvisited links */
a:visited { color: #0c0 } /* visited links */
a:hover, a:focus { color: #00c } /* user hovers, or focus */
a:active { color: #ccc } /* active links */
The outline might look “ugly” for you, but that’s a very important accessibility feature. If you remove that – please take care of providing an alternative way to properly distinguish the current element (bigger/bolder font, high contrast background etc.)