-
Couldn't load subscription status.
- Fork 28.9k
[SPARK-19886] Fix reportDataLoss if statement in SS KafkaSource #17228
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Test build #74275 has finished for PR 17228 at commit
|
|
Test build #74276 has finished for PR 17228 at commit
|
|
LGTM too |
|
Test build #74277 has finished for PR 17228 at commit
|
|
Test build #74279 has finished for PR 17228 at commit
|
| } | ||
| } | ||
|
|
||
| private def reportDataLoss0( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why not just move reportDataLoss here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The additionalInfo requires passing a lot more variables. I can pass all of it, but yeah
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I see. Then LGTM.
|
Merging to master and 2.1. |
## What changes were proposed in this pull request? Fix the `throw new IllegalStateException` if statement part. ## How is this patch tested Regression test Author: Burak Yavuz <[email protected]> Closes #17228 from brkyvz/kafka-cause-fix. (cherry picked from commit 82138e0) Signed-off-by: Shixiong Zhu <[email protected]>
What changes were proposed in this pull request?
Fix the
throw new IllegalStateExceptionif statement part.How is this patch tested
Regression test