Skip to content

Conversation

mengxr
Copy link
Contributor

@mengxr mengxr commented Nov 20, 2015

We used the name Dataset to refer to SchemaRDD in 1.2 in ML pipelines and created this example file. Since Dataset has a new meaning in Spark 1.6, we should rename it to avoid confusion. This PR also removes support for dense format to simplify the example code.

cc: @yinxusen

@yinxusen
Copy link
Contributor

LGTM

@SparkQA
Copy link

SparkQA commented Nov 23, 2015

Test build #2096 has finished for PR 9873 at commit 95f7b6d.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@mengxr
Copy link
Contributor Author

mengxr commented Nov 23, 2015

Merged into master and branch-1.6.

@asfgit asfgit closed this in fe89c18 Nov 23, 2015
asfgit pushed a commit that referenced this pull request Nov 23, 2015
…ples

We used the name `Dataset` to refer to `SchemaRDD` in 1.2 in ML pipelines and created this example file. Since `Dataset` has a new meaning in Spark 1.6, we should rename it to avoid confusion. This PR also removes support for dense format to simplify the example code.

cc: yinxusen

Author: Xiangrui Meng <[email protected]>

Closes #9873 from mengxr/SPARK-11895.

(cherry picked from commit fe89c18)
Signed-off-by: Xiangrui Meng <[email protected]>
asfgit pushed a commit that referenced this pull request Dec 12, 2015
…o dataframe_example.py

Since ```Dataset``` has a new meaning in Spark 1.6, we should rename it to avoid confusion.
#9873 finished the work of Scala example, here we focus on the Python one.
Move dataset_example.py to ```examples/ml``` and rename to ```dataframe_example.py```.
BTW, fix minor missing issues of #9873.
cc mengxr

Author: Yanbo Liang <[email protected]>

Closes #9957 from yanboliang/SPARK-11978.

(cherry picked from commit a0ff6d1)
Signed-off-by: Joseph K. Bradley <[email protected]>
asfgit pushed a commit that referenced this pull request Dec 12, 2015
…o dataframe_example.py

Since ```Dataset``` has a new meaning in Spark 1.6, we should rename it to avoid confusion.
#9873 finished the work of Scala example, here we focus on the Python one.
Move dataset_example.py to ```examples/ml``` and rename to ```dataframe_example.py```.
BTW, fix minor missing issues of #9873.
cc mengxr

Author: Yanbo Liang <[email protected]>

Closes #9957 from yanboliang/SPARK-11978.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants