Skip to content

Commit a70e849

Browse files
Marcelo Vanzinpwendell
authored andcommitted
[minor] [build] Set java options when generating mima ignores.
The default java options make the call to GenerateMIMAIgnore take forever to run since it's gc'ing all the time. Improve things by setting the perm gen size / max heap size to larger values. Author: Marcelo Vanzin <[email protected]> Closes #5615 from vanzin/gen-mima-fix and squashes the following commits: f44e921 [Marcelo Vanzin] [minor] [build] Set java options when generating mima ignores.
1 parent f83c0f1 commit a70e849

File tree

1 file changed

+7
-2
lines changed

1 file changed

+7
-2
lines changed

dev/mima

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,16 +27,21 @@ cd "$FWDIR"
2727
echo -e "q\n" | build/sbt oldDeps/update
2828
rm -f .generated-mima*
2929

30+
generate_mima_ignore() {
31+
SPARK_JAVA_OPTS="-XX:MaxPermSize=1g -Xmx2g" \
32+
./bin/spark-class org.apache.spark.tools.GenerateMIMAIgnore
33+
}
34+
3035
# Generate Mima Ignore is called twice, first with latest built jars
3136
# on the classpath and then again with previous version jars on the classpath.
3237
# Because of a bug in GenerateMIMAIgnore that when old jars are ahead on classpath
3338
# it did not process the new classes (which are in assembly jar).
34-
./bin/spark-class org.apache.spark.tools.GenerateMIMAIgnore
39+
generate_mima_ignore
3540

3641
export SPARK_CLASSPATH="`find lib_managed \( -name '*spark*jar' -a -type f \) | tr "\\n" ":"`"
3742
echo "SPARK_CLASSPATH=$SPARK_CLASSPATH"
3843

39-
./bin/spark-class org.apache.spark.tools.GenerateMIMAIgnore
44+
generate_mima_ignore
4045

4146
echo -e "q\n" | build/sbt mima-report-binary-issues | grep -v -e "info.*Resolving"
4247
ret_val=$?

0 commit comments

Comments
 (0)