Merge Apache branch-1.5 and drop "candidate" from version #84
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…rting results Author: robbins <[email protected]> Closes apache#8589 from robbinspg/InputStreamSuite-fix. (cherry picked from commit 754f853) Signed-off-by: Andrew Or <[email protected]>
…eue to be clear Author: robbins <[email protected]> Closes apache#8582 from robbinspg/InputOutputMetricsSuite.
Author: robbins <[email protected]> Closes apache#8605 from robbinspg/DAGSchedulerSuite-fix. (cherry picked from commit 2e1c175) Signed-off-by: Andrew Or <[email protected]>
…with checkpoint file in cluster mode Author: xutingjun <[email protected]> Closes apache#8477 from XuTingjun/streaming-attempt.
We should make sure the scaladoc for params includes their default values through the models in ml/ Author: Holden Karau <[email protected]> Closes apache#8591 from holdenk/SPARK-10402-add-scaladoc-for-default-values-of-params-in-ml. (cherry picked from commit 22eab70) Signed-off-by: Joseph K. Bradley <[email protected]>
…amming guides and python docs - Fixed information around Python API tags in streaming programming guides - Added missing stuff in python docs Author: Tathagata Das <[email protected]> Closes apache#8595 from tdas/SPARK-10440. (cherry picked from commit 7a4f326) Signed-off-by: Reynold Xin <[email protected]>
To keep full compatibility of Parquet write path with Spark 1.4, we should rename the innermost field name of arrays that may contain null from "array_element" to "array". Please refer to [SPARK-10434] [1] for more details. [1]: https://issues.apache.org/jira/browse/SPARK-10434 Author: Cheng Lian <[email protected]> Closes apache#8586 from liancheng/spark-10434/fix-parquet-array-type. (cherry picked from commit bca8c07) Signed-off-by: Cheng Lian <[email protected]>
…in the… … main README. Author: Stephen Hopper <[email protected]> Closes apache#8646 from enragedginger/master. (cherry picked from commit 9d8e838) Signed-off-by: Sean Owen <[email protected]>
Author: Jacek Laskowski <[email protected]> Closes apache#8629 from jaceklaskowski/docs-fixes. (cherry picked from commit 6ceed85) Signed-off-by: Sean Owen <[email protected]>
Copied model must have the same parent, but ml.IsotonicRegressionModel.copy did not set parent. Here fix it and add test case. Author: Yanbo Liang <[email protected]> Closes apache#8637 from yanboliang/spark-10470. (cherry picked from commit f7b55db) Signed-off-by: Xiangrui Meng <[email protected]>
https://issues.apache.org/jira/browse/SPARK-10441 This is the backport of apache#8597 for 1.5 branch. Author: Yin Huai <[email protected]> Closes apache#8655 from yhuai/timestampJson-1.5.
…ion about rate limiting and backpressure Author: Tathagata Das <[email protected]> Closes apache#8656 from tdas/SPARK-10492 and squashes the following commits: 986cdd6 [Tathagata Das] Added information on backpressure (cherry picked from commit 52b24a6) Signed-off-by: Tathagata Das <[email protected]>
…or nested structs We used to workaround SPARK-10301 with a quick fix in branch-1.5 (PR apache#8515), but it doesn't cover the case described in SPARK-10428. So this PR backports PR apache#8509, which had once been considered too big a change to be merged into branch-1.5 in the last minute, to fix both SPARK-10301 and SPARK-10428 for Spark 1.5. Also added more test cases for SPARK-10428. This PR looks big, but the essential change is only ~200 loc. All other changes are for testing. Especially, PR apache#8454 is also backported here because the `ParquetInteroperabilitySuite` introduced in PR apache#8515 depends on it. This should be safe since apache#8454 only touches testing code. Author: Cheng Lian <[email protected]> Closes apache#8583 from liancheng/spark-10301/for-1.5.
…ream and throw a better exception when reading QueueInputDStream Output a warning when serializing QueueInputDStream rather than throwing an exception to allow unit tests use it. Moreover, this PR also throws an better exception when deserializing QueueInputDStream to make the user find out the problem easily. The previous exception is hard to understand: https://issues.apache.org/jira/browse/SPARK-8553 Author: zsxwing <[email protected]> Closes apache#8624 from zsxwing/SPARK-10071 and squashes the following commits: 847cfa8 [zsxwing] Output a warning when writing QueueInputDStream and throw a better exception when reading QueueInputDStream (cherry picked from commit 820913f) Signed-off-by: Tathagata Das <[email protected]>
mbautin
added a commit
that referenced
this pull request
Sep 9, 2015
Merge Apache branch-1.5 and drop "candidate" from version
markhamstra
pushed a commit
to markhamstra/spark
that referenced
this pull request
Nov 7, 2017
Since the example job are patched to never finish.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
11 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
cc @mbautin