pyspark show dataframe as table with horizontal scroll in ipython notebook

this is a workaround

spark_df.limit(5).toPandas().head()

although, I do not know the computational burden of this query. I am thinking limit() is not expensive. corrections welcome.