Skip to content

[SPARK-19379][CORE] SparkAppHandle.getState not registering FAILED state upon Spark app failure in Local mode #16743

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 19 commits into from
Closed

[SPARK-19379][CORE] SparkAppHandle.getState not registering FAILED state upon Spark app failure in Local mode #16743

Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
52ac008
Adding new test suite for [SPARK-12941][SQL]
thomastechs Feb 22, 2016
b711688
Update pom.xml for [SPARK-12941] docker test suite addition
thomastechs Feb 22, 2016
c2c6d14
Update DockerJDBCIntegrationSuite.scala for [SPARK-12941] docker test…
thomastechs Feb 22, 2016
54b2d4e
Update OracleDialect.scala for [SPARK-12941] docker test suite addition
thomastechs Feb 22, 2016
bde06fa
Update OracleIntegrationSuite.scala for [SPARK-12941] docker test sui…
thomastechs Feb 22, 2016
0861d72
Update OracleIntegrationSuite.scala for [SPARK-12941] Style check fix…
thomastechs Feb 23, 2016
ca7ef4e
Update OracleIntegrationSuite.scala for [SPARK-12941] Style check fixes
thomastechs Feb 23, 2016
28a9e9f
Update OracleIntegrationSuite.scala for [SPARK-12941] Style check fixes
thomastechs Feb 23, 2016
87e3d7f
Update pom.xml
thomastechs Feb 23, 2016
7b12418
Update OracleIntegrationSuite.scala
thomastechs Feb 23, 2016
250591d
Update OracleIntegrationSuite.scala
thomastechs Feb 23, 2016
d77d585
Update OracleIntegrationSuite.scala for [SPARK-12941] Style check fixes
thomastechs Feb 23, 2016
7fcb16c
Update OracleIntegrationSuite.scala for [SPARK-12941] Updated Comments
thomastechs Feb 24, 2016
b3de7f4
Update pom.xml for [SPARK-12941] added comments
thomastechs Feb 24, 2016
345555f
Update DockerJDBCIntegrationSuite.scala
thomastechs Feb 24, 2016
3f0f3b8
Updated OracleIntegrationSuite.scala
thomastechs Feb 24, 2016
5683dca
Merge remote-tracking branch 'upstream/master'
thomastechs Mar 3, 2016
154e104
Merge remote-tracking branch 'upstream/master'
thomastechs Nov 24, 2016
e6d4317
Updated LocalSchedulerBackend.scala for fix of JIRA:19379
thomastechs Jan 30, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions core/src/main/scala/org/apache/spark/scheduler/local/LocalSchedulerBackend.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,12 @@ private[spark] class LocalSchedulerBackend(
}

override def statusUpdate(taskId: Long, state: TaskState, serializedData: ByteBuffer) {
if (TaskState.isFailed(state)) {
launcherBackend.setState(SparkAppHandle.State.FAILED)
}
else if (TaskState.isFinished(state)) {
launcherBackend.setState(SparkAppHandle.State.FINISHED)
}
localEndpoint.send(StatusUpdate(taskId, state, serializedData))
}

Expand Down