Skip to content
This repository was archived by the owner on Jan 9, 2020. It is now read-only.
This repository was archived by the owner on Jan 9, 2020. It is now read-only.

Remove V1 Submission and replace with V2 only #285

@mccheah

Description

@mccheah

Currently we have been developing the V2 submission logic in separate files so that we could build the feature incrementally. Now that we've built everything in version 2 of submission that was available to us in version 1 of submission, we should remove all of the v1 submission code and make spark-submit use version 2 of the submission.

This involves:

  1. Change this line in SparkSubmit to point to the v2 submission client class,
  2. Remove all code paths for v1 submission,
  3. Remove the v1 driver docker file from our repository and publish the driver docker image as corresponding to this Dockerfile,
  4. Rewrite all the documentation so that the instructions are for submission with the new logic.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions