When new versions of android are published, Google will have to support the older versions of android. So AppCompat is a set of support libraries which can be used to make the apps developed with newer versions work with older versions.
For example: When you create an android project with minimum Api level 9, and target api level 21, The newer features like ActionBar, Drawer Menu (Newer in the sense that they were not present in Api 9) etc should also be supported in Api Level 10 phones. Then, you can use the appCompat library. So the android actionbar will become androidsupport actionbar/ supportFragment etc.