[SPARK-3571] Spark standalone cluster mode doesn't work.

[sarutak]

I think, this issue is caused by #1106

[SparkQA]

QA tests have started for PR 2436 at commit 4817ecd.

• This patch merges cleanly.

[andrewor14]

Oops, good catch...

[andrewor14]

Won't this result in an infinite loop if no workers are available? curPos is never equal to aliveWorkerNum

[SparkQA]

QA tests have started for PR 2436 at commit 4e51e35.

• This patch merges cleanly.

[andrewor14]

As I mentioned before, this is not correct. curPos != stopPos will always be true since curPos is always mod aliveWorkerNum.

[sarutak]

Ah, yes. I'll modify.

[SparkQA]

QA tests have finished for PR 2436 at commit 4817ecd.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • class JavaSparkContext(val sc: SparkContext)
  • class ArrayConstructor extends net.razorvine.pickle.objects.ArrayConstructor
  • throw new IllegalStateException("The main method in the given main class must be static")
  • class TaskCompletionListenerException(errorMessages: Seq[String]) extends Exception
  • class NonASCIICharacterChecker extends ScalariformChecker
  • class Dummy(object):
  • class RatingDeserializer(FramedSerializer):
  • class SCCallSiteSync(object):
  • case class CreateTableAsSelect(
  • class Encoder[T <: NativeType](columnType: NativeColumnType[T]) extends compression.Encoder[T]
  • class Encoder[T <: NativeType](columnType: NativeColumnType[T]) extends compression.Encoder[T]
  • class Encoder[T <: NativeType](columnType: NativeColumnType[T]) extends compression.Encoder[T]
  • class Encoder extends compression.Encoder[IntegerType.type]
  • class Decoder(buffer: ByteBuffer, columnType: NativeColumnType[IntegerType.type])
  • class Encoder extends compression.Encoder[LongType.type]
  • class Decoder(buffer: ByteBuffer, columnType: NativeColumnType[LongType.type])
  • case class CreateTableAsSelect(
  • class JavaStreamingContext(val ssc: StreamingContext) extends Closeable

[SparkQA]

QA tests have started for PR 2436 at commit 118c031.

• This patch merges cleanly.

[SparkQA]

QA tests have started for PR 2436 at commit 7a4deea.

• This patch merges cleanly.

[SparkQA]

QA tests have finished for PR 2436 at commit 4e51e35.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

QA tests have finished for PR 2436 at commit 118c031.

• This patch fails unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[sarutak]

retest this please.

[SparkQA]

QA tests have finished for PR 2436 at commit 7a4deea.

• This patch passes unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[andrewor14]

Ok, LGTM... I tested this locally. Merging into master.