Skip to content

Conversation

assafmendelson
Copy link

What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by @tdas and @lw-lin

Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe you're correct. CC @tdas @lw-lin

@SparkQA
Copy link

SparkQA commented Jun 18, 2017

Test build #3801 has finished for PR 18342 at commit 13ff475.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@assafmendelson assafmendelson changed the title [Spark 21123][Docs][Structured Streaming] Options for file stream source are in a wrong table [Spark-21123][Docs][Structured Streaming] Options for file stream source are in a wrong table Jun 18, 2017
@lw-lin
Copy link
Contributor

lw-lin commented Jun 19, 2017

This lgtm; @zsxwing please also take a look

@zsxwing
Copy link
Member

zsxwing commented Jun 19, 2017

LGTM. Merging to master and 2.2. @assafmendelson could you also submit a PR to fix branch-2.1? Thanks!

asfgit pushed a commit that referenced this pull request Jun 19, 2017
…rce are in a wrong table

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by tdas and lw-lin

Author: assafmendelson <[email protected]>

Closes #18342 from assafmendelson/spark-21123.

(cherry picked from commit 66a792c)
Signed-off-by: Shixiong Zhu <[email protected]>
@zsxwing
Copy link
Member

zsxwing commented Jun 19, 2017

@assafmendelson do you have an Apache JIRA account? I'm going to assign this ticket to you.

@asfgit asfgit closed this in 66a792c Jun 19, 2017
@assafmendelson
Copy link
Author

@zsxwing My jira account is assaf.mendelson.

asfgit pushed a commit that referenced this pull request Jun 20, 2017
…rce are in a wrong table - version to fix 2.1

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This commit continues on PR #18342 and targets the fixes for the documentation of version spark version 2.1

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

zsxwing This is the PR to fix version 2.1 as discussed in PR #18342

Author: assafmendelson <[email protected]>

Closes #18363 from assafmendelson/spark-21123-for-spark2.1.
robert3005 pushed a commit to palantir/spark that referenced this pull request Jun 29, 2017
…rce are in a wrong table

## What changes were proposed in this pull request?

The description for several options of File Source for structured streaming appeared in the File Sink description instead.

This pull request has two commits: The first includes changes to the version as it appeared in spark 2.1 and the second handled an additional option added for spark 2.2

## How was this patch tested?

Built the documentation by SKIP_API=1 jekyll build and visually inspected the structured streaming programming guide.

The original documentation was written by tdas and lw-lin

Author: assafmendelson <[email protected]>

Closes apache#18342 from assafmendelson/spark-21123.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants