Skip to content

Conversation

yhuai
Copy link
Contributor

@yhuai yhuai commented Aug 5, 2014

This PR aims to finalize accepted data value types in Python RDDs provided to Python applySchema.

JIRA: https://issues.apache.org/jira/browse/SPARK-2854

@yhuai
Copy link
Contributor Author

yhuai commented Aug 5, 2014

@davies @marmbrus

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line is too long, it could be "...2010...1, 2, [1, 2, 3], None)"

@davies
Copy link
Contributor

davies commented Aug 5, 2014

LGTM

@SparkQA
Copy link

SparkQA commented Aug 5, 2014

QA tests have started for PR 1793. This patch merges cleanly.
View progress: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17943/consoleFull

@SparkQA
Copy link

SparkQA commented Aug 5, 2014

QA results for PR 1793:
- This patch PASSES unit tests.
- This patch merges cleanly
- This patch adds no public classes

For more information see test ouptut:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/17943/consoleFull

@marmbrus
Copy link
Contributor

marmbrus commented Aug 6, 2014

Thanks! I've merged this into master and 1.1

asfgit pushed a commit that referenced this pull request Aug 6, 2014
This PR aims to finalize accepted data value types in Python RDDs provided to Python `applySchema`.

JIRA: https://issues.apache.org/jira/browse/SPARK-2854

Author: Yin Huai <[email protected]>

Closes #1793 from yhuai/SPARK-2854 and squashes the following commits:

32f0708 [Yin Huai] LongType only accepts long values.
c2b23dd [Yin Huai] Do data type conversions based on the specified Spark SQL data type.

(cherry picked from commit 69ec678)
Signed-off-by: Michael Armbrust <[email protected]>
@asfgit asfgit closed this in 69ec678 Aug 6, 2014
xiliu82 pushed a commit to xiliu82/spark that referenced this pull request Sep 4, 2014
This PR aims to finalize accepted data value types in Python RDDs provided to Python `applySchema`.

JIRA: https://issues.apache.org/jira/browse/SPARK-2854

Author: Yin Huai <[email protected]>

Closes apache#1793 from yhuai/SPARK-2854 and squashes the following commits:

32f0708 [Yin Huai] LongType only accepts long values.
c2b23dd [Yin Huai] Do data type conversions based on the specified Spark SQL data type.
@yhuai yhuai deleted the SPARK-2854 branch October 6, 2014 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants