“Core Java” is Sun’s term, used to refer to Java SE, the standard edition and a set of related technologies, like the Java VM, CORBA, et cetera. This is mostly to differentiate from, say, Java ME or Java EE.
Also note that they’re talking about a set of libraries rather than the programming language. That is, the underlying way you write Java doesn’t change, regardless of the libraries you’re using.