Use LaTeX Style. For Example: $^\circ$ Text
would produce °Text
See the matplotlib documentation for more information about printing (especially mathematical expression).
In your case the code has to be: plt.xlabel('Manufactured Ply Angle $^\circ$')
The TeX part of the expression must be enclosed by dollar signs “$”.