There may be better approaches, but there are also some frameworks that help implement benchmarking with JUnit. Some useful practices are warmup runs, statistical evaluations. Take a look at JUnitBenchmarks and JUnitPerf
EDIT looks like JUnitBenchmarks has been deprecated since the question has been stated. The project’s maintainers recommend moving on to JMH. Thank you, Barry NL for the heads-up.