If the value is hardcoded in the source of the page using the value attribute then you can
$('#attached_docs :input[value="123"]').remove();
If you want to target elements that have a value of 123, which was set by the user or programmatically then use
EDIT works both ways ..
or
$('#attached_docs :input').filter(function(){return this.value=='123'}).remove();
demo http://jsfiddle.net/gaby/RcwXh/2/