New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ModuleNotFoundError when using cluster based on docker image #4

Open

svenw3 opened this issue May 13, 2022 · 1 comment

svenw3 commented May 13, 2022

Hi!

I have issues executing the provided notebook on databricks with a cluster which is based on a docker image.

I have the following two clusters:

The ppa cluster is based on a docker image, which was created using FROM databricksruntime/standard:latest

This is the output executed on ppa cluster (docker image based):

And on the general-purpose cluster (standard cluster):

PawaritL commented Oct 9, 2022 •

edited

Loading

@svenw3 @felixDulys
This should solve it :)
https://kb.databricks.com/en_US/libraries/use-databricks-repos-with-docker-container-services

PawaritL mentioned this issue

update to pyspark.pandas, provides solution link for Docker Container Services #7

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment