Quantopian's community platform is shutting down. Please read this post for more information and download your code.
Back to Community
ImportError on pyspark.sql.functions

Hi,

Using:
from pyspark.sql.functions import col

I'm receiving the warning:
InputRejected:
Importing col from pyspark.sql.functions raised an ImportError. No modules or attributes with a similar name were found. Our security system is concerned. If you continue to have import errors, your account will be suspended until a human can talk to you.

I'm not sure what the security concern is here, but isn't col a rather common function to use?

Thanks, Jeroen

1 response

Never mind, my mistake, this is a pandas DataFrame and not Spark.