diff --git a/faq/data-lab.mdx b/faq/data-lab.mdx index 9c2fb7e418..1f69292090 100644 --- a/faq/data-lab.mdx +++ b/faq/data-lab.mdx @@ -25,3 +25,9 @@ Apache Spark processes data in memory, which allows it to perform tasks up to 10 ## How am I billed for Distributed Data Lab? During the private beta, Scaleway Distributed Data Lab is free. + +## Can I upscale or downscale a Distributed Data Lab? + +Yes, you can upscale a Data Lab cluster to distribute your workloads across a greater number of worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context. + +You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculation. You can resume the activity of your cluster by provisioning at least one worker node. \ No newline at end of file diff --git a/managed-services/data-lab/how-to/manage-delete-data-lab.mdx b/managed-services/data-lab/how-to/manage-delete-data-lab.mdx index c4cdfd7040..a5d32651e0 100644 --- a/managed-services/data-lab/how-to/manage-delete-data-lab.mdx +++ b/managed-services/data-lab/how-to/manage-delete-data-lab.mdx @@ -34,6 +34,10 @@ This page explains how to manage and delete your Distributed Data Lab. 4. From this view, you can: - Add, consult, or delete tags for your cluster. + - Update the number of worker nodes provisioned for your cluster. + + Provisioning zero worker nodes lets you retain and access you cluster and notebook configurations, but will not allow you to run calculations. + - [Delete your Data Lab cluster](/managed-services/data-lab/how-to/manage-delete-data-lab/#how-to-delete-a-distributed-data-lab). diff --git a/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx new file mode 100644 index 0000000000..91db8d27e1 --- /dev/null +++ b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx @@ -0,0 +1,39 @@ +--- +meta: + title: Troubleshooting Distributed Data Lab execution issues + description: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster +content: + h1: Troubleshooting Distributed Data Lab execution issues + paragraph: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster +tags: execution run distributed data-lab worker-node error cannot process issue troubleshooting solution +dates: + validation: 2024-10-08 + posted: 2024-10-08 +categories: + - managed-services +--- + + + +- A Scaleway account logged into the [console](https://console.scaleway.com) +- [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization +- A [Distributed Data Lab](/managed-services/data-lab/how-to/create-data-lab/) + +## Timeout errors + +### Problem + +Executing calculations within the notebook returns a timeout error after a few minutes. + +### Cause + +The Distributed Data Lab cluster has zero worker nodes provisioned and cannot raise any resource to perform the required operations. + +### Solution + +[Edit your cluster configuration](/managed-services/data-lab/how-to/manage-delete-data-lab/) by provisioning at least one worker node to be able to run calculations with it. + + +You can provision zero worker nodes again to retain you cluster and notebook configurations while minimizing its cost. + +