Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][linkis-engineconn-plugins] Feature title #5198

Closed
2 tasks done
zyyBjtu opened this issue Nov 7, 2024 · 1 comment
Closed
2 tasks done

[Feature][linkis-engineconn-plugins] Feature title #5198

zyyBjtu opened this issue Nov 7, 2024 · 1 comment
Labels

Comments

@zyyBjtu
Copy link
Contributor

zyyBjtu commented Nov 7, 2024

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Problem Description

目前ECM容器化后,在使用spark引擎时可能会有以下问题:

  1. 当spark使用client模式提交任务是,集群会和driver端有通信,涉及如下几个网络配置信息:
  • spark.driver.host
  • spark.driver.port
  • spark.driver.blockManager.port
  1. 在对ECM进行容器化部署时,需要通过配置好的vnc访问,且开放端口是有限的
  2. 可能会有其他大数据组件有这个问题,所以希望能够在ECM中实现这个功能,并在引擎启动时,为引擎分配可以外接通信的ip和端口

Description

No response

Use case

No response

Solutions

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@zyyBjtu zyyBjtu added the feature label Nov 7, 2024
Copy link

github-actions bot commented Nov 7, 2024

😊 Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context.
We will be here shortly.

If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
👉 How to Participate in Project Contribution.

Community

WeChat Assistant WeChat Public Account

Mailing Lists

Name Description Subscribe Unsubscribe Archive
[email protected] community activity information subscribe unsubscribe archive

@zyyBjtu zyyBjtu changed the title [Feature][ECM] 增加对ECM以及SPARK引擎在容器化环境下的支持 [Feature][linkis-engineconn-plugins] Feature title Nov 7, 2024
@zyyBjtu zyyBjtu closed this as completed Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant