Livy is an open source REST interface
for interacting with Spark. pylivy
is a
Python client for Livy, enabling easy remote code execution on a Spark cluster.
$ pip install -U livy
Documentation for pylivy
is available at https://pylivy.readthedocs.io/.