Here’s a page describing the differences (basically you can put html into a <button></button>
And an other page describing why people avoid <button></button> (Hint: IE6)
Reference: <button> vs. <input type=”button” />. Which to use?
Also have a look at this slideshow about button.