[SPARK-3026][SQL] Report better error message when running JDBC/CLI without hive profile enabled

[liancheng]

This PR tries to catch ClassNotFoundException within SparkSubmit and exit with a special status code. Then we check the exit status within scripts to provide more friendly error message.

[SparkQA]

QA tests have started for PR 1944. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/18539/consoleFull

[liancheng]

@patrick This PR conflicts with #1886, we can merge #1886 first, and then I'll rebase mine.

[pwendell]

Sounds good - it will also conflict (logically) with #2006

[marmbrus]

@liancheng, can you please update this to fix the conflict and say -Phive now that #2006 has been merged?

[SparkQA]

QA tests have started for PR 1944 at commit 9c894d3.

• This patch merges cleanly.

[SparkQA]

QA tests have started for PR 1944 at commit 81b43a8.

• This patch merges cleanly.

[liancheng]

@marmbrus Rebased. Also included the -S command line option fix in #1886, since we should include this in 1.1 release and unfortunately #1886 conflicts with master again (@sarutak I'm sorry...).

[SparkQA]

QA tests have finished for PR 1944 at commit 9c894d3.

• This patch fails unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • eval "$FWDIR"/bin/spark-submit --class $CLASS $
  • eval "$FWDIR"/bin/spark-submit --class $CLASS $

[SparkQA]

QA tests have finished for PR 1944 at commit 81b43a8.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • "$FWDIR"/bin/spark-submit --class $CLASS "$
  • "$FWDIR"/bin/spark-submit --class $CLASS "$

[sarutak]

I'll rebase this PR to #1886 after merging this PR.

[liancheng]

@marmbrus @pwendell I think this is good to go.

[marmbrus]

@liancheng can you fix the merge problems?

[liancheng]

@marmbrus Please merge #1886 first, otherwise it has to be rebased for the 3rd time. Then I'll rebase this one.

[liancheng]

@marmbrus Just realized we don't need to merge this PR anymore, since @sarutak has already merged this one into #1886. Closing.