Building Matplotlib requires libpng (and freetype, as well) which isn’t a python library, so pip doesn’t handle installing it (or freetype).
You’ll need to install something along the lines of libpng-devel and freetype-devel (or whatever the equivalent is for your OS).
See the building requirements/instructions for matplotlib.