Skip to content

Conversation

@iwasakims
Copy link
Member

https://issues.apache.org/jira/browse/BIGTOP-4421

We need python2 for rebuilding native libraries required for old node-spss by node-gyp on the architecture for which pre-built native libraries are not provided. Since recent OS distributions do not provide python2, we need another solution here.

[INFO] gyp ERR! configure error
[INFO] gyp ERR! stack Error: Can't find Python executable "python", you can set the PYTHON env variable.
[INFO] gyp ERR! stack     at PythonFinder.failNoPython (/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/node-sass/node_modules/node-gyp/lib/configure.js:484:19)
[INFO] gyp ERR! stack     at PythonFinder.<anonymous> (/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/node-sass/node_modules/node-gyp/lib/configure.js:406:16)
[INFO] gyp ERR! stack     at F (/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/which/which.js:68:16)
[INFO] gyp ERR! stack     at E (/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/which/which.js:80:29)
[INFO] gyp ERR! stack     at /bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/which/which.js:89:16
[INFO] gyp ERR! stack     at /bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/isexe/index.js:42:5
[INFO] gyp ERR! stack     at /bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/isexe/mode.js:8:5
[INFO] gyp ERR! stack     at FSReqCallback.oncomplete (fs.js:168:21)
[INFO] gyp ERR! System Linux 6.10.14-linuxkit
[INFO] gyp ERR! command "/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node/node" "/bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/node-sass/node_module\
s/node-gyp/bin/node-gyp.js" "rebuild" "--verbose" "--libsass_ext=" "--libsass_cflags=" "--libsass_ldflags=" "--libsass_library="
[INFO] gyp ERR! cwd /bigtop-home/build/hadoop/rpm/BUILD/hadoop-3.3.6-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp/node_modules/node-sass
[INFO] gyp ERR! node -v v12.22.1
[INFO] gyp ERR! node-gyp -v v3.8.0
[INFO] gyp ERR! not ok

I'm bringing back the manifest to install Python 2 from source code removed by BIGTOP-4098(#1262). Previously it was for specific combination of OS and architecture. Now we need this for all OS distributions (supported on Bigtop 3.4.0) on aarch64.

@sekikn sekikn mentioned this pull request May 17, 2025
2 tasks
@iwasakims
Copy link
Member Author

@sekikn Thanks for your comments. I updated the PR and ./gradlew toolchain worked as expected on all of fedora-40, openeuler-22.03, rockylinux-9, debian-12 and ubuntu-24.04 (aarch64).

@iwasakims
Copy link
Member Author

And packaging of Alluxio and Hadoop succeeded.

@sekikn
Copy link
Contributor

sekikn commented May 17, 2025

@iwasakims Sorry that I missed it, but the first ln should have the -nf option as the second one, since it's not idempotent without that.
+1 otherwise, so you can merge this once you fix it.

@iwasakims iwasakims merged commit 0aad1a7 into apache:master May 17, 2025
iwasakims added a commit that referenced this pull request May 17, 2025
@iwasakims
Copy link
Member Author

Thanks, @sekikn. I updated the option and merged this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants