After upgrading to Rails 4.2.4 on Ubuntu 14.04 using RVM I needed to do this:
sudo apt-get install libgmp-dev
or
sudo apt-get install libgmp3-dev
Full stacktrace: http://ruby-on-rails-eq8.blogspot.co.uk/2015/10/solving-ubuntu-1404-ruby-c-dependancy.html