How to use sed to replace regex capture group?

In your regex change + with *:

sed -E "s/(.*)\.png/\/full\/path\/\1/g" <<< "lolsed_bulsh.png"

It prints:

/full/path/lolsed_bulsh

NOTE: The non standard -E option is to avoid escaping ( and )