Is there an “or” attribute selector, like input[type=button|text]?

Since you want to include everything except a few particular types, try this:

$('input:not([type=image],[type=button],[type=submit])')