Add PySpark backend #11
Description
In addition to pandas, add PySpark as a computational backend. This way all processing can directly be performed in Spark without copying data from Spark to Python memory and back.
{{ message }}
In addition to pandas, add PySpark as a computational backend. This way all processing can directly be performed in Spark without copying data from Spark to Python memory and back.