Using findspark is expected to solve the problem:
Install findspark
$pip install findspark
In you code use:
import findspark
findspark.init()
Optionally you can specify “/path/to/spark” in the init method above; findspark.init("/path/to/spark")