Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 7, 2019

What changes were proposed in this pull request?

This aims to exclude the preview release to recover HiveExternalCatalogVersionsSuite. Currently, new preview release breaks branch-2.4 PRBuilder since yesterday. New release (especially preview) should not affect branch-2.4.

Why are the changes needed?

BEFORE

scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
java.util.NoSuchElementException: None.get

AFTER

scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).filterNot(_.contains("preview")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
res5: Array[String] = Array(2.3.4, 2.4.4)

Does this PR introduce any user-facing change?

No.

How was this patch tested?

This should pass the PRBuilder.

@dongjoon-hyun
Copy link
Member Author

Hi, @cloud-fan and @jiangxb1987 .
Could you review this PR?

@dongjoon-hyun dongjoon-hyun changed the title [HOTFIX][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release [SPARK-29796][SQL][TESTS] HiveExternalCatalogVersionsSuite should ignore preview release Nov 7, 2019
Copy link
Contributor

@jiangxb1987 jiangxb1987 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for fixing this @dongjoon-hyun !

@dongjoon-hyun
Copy link
Member Author

Thank you, @jiangxb1987 .
This is tested locally. Merged to master/2.4.

dongjoon-hyun added a commit that referenced this pull request Nov 7, 2019
…gnore preview release

### What changes were proposed in this pull request?

This aims to exclude the `preview` release to recover `HiveExternalCatalogVersionsSuite`. Currently, new preview release breaks `branch-2.4` PRBuilder since yesterday. New release (especially `preview`) should not affect `branch-2.4`.
- #26417 (Failed 4 times)

### Why are the changes needed?

**BEFORE**
```scala
scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
java.util.NoSuchElementException: None.get
```

**AFTER**
```scala
scala> scala.io.Source.fromURL("https://dist.apache.org/repos/dist/release/spark/").mkString.split("\n").filter(_.contains("""<li><a href="spark-""")).filterNot(_.contains("preview")).map("""<a href="spark-(\d.\d.\d)/">""".r.findFirstMatchIn(_).get.group(1))
res5: Array[String] = Array(2.3.4, 2.4.4)
```

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

This should pass the PRBuilder.

Closes #26428 from dongjoon-hyun/SPARK-HiveExternalCatalogVersionsSuite.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit da848b1)
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-HiveExternalCatalogVersionsSuite branch November 7, 2019 18:29
@srowen
Copy link
Member

srowen commented Nov 7, 2019

Nice, I was wondering why that was failing suddenly.

@SparkQA
Copy link

SparkQA commented Nov 7, 2019

Test build #113396 has finished for PR 26428 at commit 67cc8e4.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm!

@dongjoon-hyun
Copy link
Member Author

Thank you, @srowen and @HyukjinKwon .

@gatorsmile
Copy link
Member

Thanks for fixing it very quickly!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants