Can I program Nvidia’s CUDA using only Python or do I have to learn C?

You should take a look at CUDAmat and Theano. Both are approaches to writing code that executes on the GPU without really having to know much about GPU programming.