Are different ports on the same server considered cross-domain? (Ajax-wise)

For two documents to be considered to have the same origin, the protocol (http/https), the domain and the port (the default 80 or :xx) have to be indentical.
So no, you cannot use xhr against a different port.