Multithreading/Parallel Jobs in AWS Glue

https://medium.com/analytics-vidhya/multithreading-parallel-job-in-aws-glue-a291219123fb

How to execute arbitrary python code on spark cluster distributed to workers

https://stackoverflow.com/questions/54792164/how-to-execute-arbitrary-python-code-on-spark-cluster-distributed-to-workers

https://github.com/joblib/joblib-spark/blob/master/joblibspark/backend.py