Is a relative path in a CSS file relative to the CSS file?

Yes, it’s relative to the .css

Here’s an example layout:

Page:  page.htm ... does not matter where
CSS:   /resources/css/styles.css  
Image: /resources/images/image.jpg

CSS in styles.css:

div { background-image: url('../images/image.jpg');