This repository was archived by the owner on Jan 9, 2020. It is now read-only.
v2.1.0-kubernetes-0.1.0-alpha.1
Pre-release
Pre-release
·
2 commits
to branch-2.1-kubernetes-release
since this release
First alpha release of Spark with Kubernetes support.
Based off Spark upstream at version 2.1.0
What works:
- Basic functionality (submission, aggregating/streaming logs, etc.)
- Submission of local files
- Custom images for driver/executor
- Spark Jobs can use a fixed number of executors
Limitations:
- Dynamic allocation is not supported.
- Applications can only run in cluster mode.
- Only Scala and Java applications can be run.