This repository was archived by the owner on Jan 9, 2020. It is now read-only.
  
  
  
  
  
Description
Currently we have been developing the V2 submission logic in separate files so that we could build the feature incrementally. Now that we've built everything in version 2 of submission that was available to us in version 1 of submission, we should remove all of the v1 submission code and make spark-submit use version 2 of the submission.
This involves:
- Change this line in SparkSubmit to point to the v2 submission client class,
- Remove all code paths for v1 submission,
- Remove the v1 driver docker file from our repository and publish the driver docker image as corresponding to this Dockerfile,
- Rewrite all the documentation so that the instructions are for submission with the new logic.