Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] detect if spark.dynamicAllocation.enabled is set true and exit gracefully #171

Closed
xwu99 opened this issue Jan 26, 2022 · 1 comment · Fixed by #201
Closed

[Core] detect if spark.dynamicAllocation.enabled is set true and exit gracefully #171

xwu99 opened this issue Jan 26, 2022 · 1 comment · Fixed by #201
Labels
bug Something isn't working

Comments

@xwu99
Copy link
Collaborator

xwu99 commented Jan 26, 2022

OAP MLlib does not support dynamic allocation. spark.dynamicAllocation.enabled should be set to false

@xwu99 xwu99 changed the title detect if spark.dynamicAllocation.enabled is set true and exit gracefully [Core] detect if spark.dynamicAllocation.enabled is set true and exit gracefully Jan 26, 2022
@xwu99
Copy link
Collaborator Author

xwu99 commented Mar 22, 2022

@minmingzhu could you add a check for spark.dynamicAllocation.enabled in isOAPEnabled (https://github.com/oap-project/oap-mllib/blob/master/mllib-dal/src/main/scala/com/intel/oap/mllib/Utils.scala#L29) for dynamic allocation and output an error and exit when dynamic allocation and OAP run at the same time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment