I had the same problem on Mac OS X Lion with FF 23.
But the problem went away for me when I updated selenium-webdriver to 2.34.0
I added gem "selenium-webdriver", "~> 2.34.0"
into my Gemfile.
bundle update selenium-webdriver
bundle install
Cucumber works fine with selenium now.