Skip to content

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Nov 4, 2015

  1. Renamed localSort -> sortWithinPartitions to avoid ambiguity in "local"
  2. distributeBy -> repartition to match the existing repartition.

@rxin
Copy link
Contributor Author

rxin commented Nov 4, 2015

cc @nongli @yhuai

@yhuai
Copy link
Contributor

yhuai commented Nov 4, 2015

LGTM pending jenkins.

@yhuai
Copy link
Contributor

yhuai commented Nov 4, 2015

test this please

@SparkQA
Copy link

SparkQA commented Nov 4, 2015

Test build #45030 has finished for PR 9470 at commit 0c7e1cd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * public class JavaAssociationRulesExample\n * public class JavaPrefixSpanExample\n * public class JavaSimpleFPGrowth\n * class StreamInterceptor implements TransportFrameDecoder.Interceptor\n * public final class ChunkFetchSuccess extends ResponseWithBody\n * public abstract class ResponseWithBody implements ResponseMessage\n * public final class StreamFailure implements ResponseMessage\n * public final class StreamRequest implements RequestMessage\n * public final class StreamResponse extends ResponseWithBody\n * public class TransportFrameDecoder extends ChannelInboundHandlerAdapter\n

@yhuai
Copy link
Contributor

yhuai commented Nov 4, 2015

Merging to master.

@asfgit asfgit closed this in abf5e42 Nov 4, 2015
@SparkQA
Copy link

SparkQA commented Nov 4, 2015

Test build #45031 has finished for PR 9470 at commit 0c7e1cd.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):\n * public class JavaAssociationRulesExample\n * public class JavaPrefixSpanExample\n * public class JavaSimpleFPGrowth\n * class StreamInterceptor implements TransportFrameDecoder.Interceptor\n * public final class ChunkFetchSuccess extends ResponseWithBody\n * public abstract class ResponseWithBody implements ResponseMessage\n * public final class StreamFailure implements ResponseMessage\n * public final class StreamRequest implements RequestMessage\n * public final class StreamResponse extends ResponseWithBody\n * public class TransportFrameDecoder extends ChannelInboundHandlerAdapter\n

markhamstra pushed a commit to markhamstra/spark that referenced this pull request Nov 11, 2015
1. Renamed localSort -> sortWithinPartitions to avoid ambiguity in "local"
2. distributeBy -> repartition to match the existing repartition.

Author: Reynold Xin <[email protected]>

Closes apache#9470 from rxin/SPARK-11504.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rxin This causes an infinite loop, which isn't caught by the unit tests since DataFrameSuite only tests the Column* overload.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ankurdave can you create a jira?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants