In terms of relational algebra this would be a unary relation, meaning “this thing exists“
Yes, it’s fine to have a table defining such a relation: for instance, to define a domain.
The values of such a table should be natural primary keys of course.
A lookup table of prime numbers is what comes to my mind first.