If you set it, then you can only set it to DENY, SAMEORIGIN, or ALLOW-FROM (a specific origin).
Allowing all domains is the default. Don’t set the X-Frame-Options header at all if you want that.
Note that the successor to X-Frame-Options — CSP’s frame-ancestors directive — accepts a list of allowed origins so you can easily allow some origins instead of none, one or all.