Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problems with injecting the profiler to Spark Application #53

Open
gevago01 opened this issue Feb 21, 2019 · 1 comment
Open

Problems with injecting the profiler to Spark Application #53

gevago01 opened this issue Feb 21, 2019 · 1 comment

Comments

@gevago01
Copy link

gevago01 commented Feb 21, 2019

Hello,

I am running spark-submit as follows

spark-submit --packages com.etsy:statsd-jvm-profiler:2.1.0 --deploy-mode cluster --master spark://14.16.47.27:7077 --class par.met.TS --conf spark.executor.extraJavaOptions=-Xss100m --conf "spark.executor.extraJavaOptions=-javaagent:statsd-jvm-profiler-2.1.0-jar-with-dependencies.jar=server=myInfluxServer,port=8086,reporter=InfluxDBReporter,database=profiler,username=profiler,password=profiler" --num-executors 3 myAppJar

but executors keep failing with the following messages:

stderr:
Error opening zip file or JAR manifest missing : statsd-jvm-profiler-2.1.0-jar-with-dependencies.jar

stdout:
Error occurred during initialization of VM
agent library failed to init: instrument

Any help appreciated.
Thank you,
Giannis

@gevago01 gevago01 changed the title Problems with injecting the profiler Problems with injecting the profiler to Spark Application Feb 21, 2019
@NoamShaish
Copy link
Contributor

I had the same issue when downloading this jar.
two options:

  1. try downloading again
  2. clone source and pack locally

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants