System image from a system image

[ranjanan]

I want to create a system image using my system image but I run into the following issue. First I create a system image with just PackageCompiler in it like follows:

               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.11.7 (2025-10-06)
 _/ |\__'_|_|_|\__'_|  |  gb/nogplcompression1,11/c96e1cc6c83 (fork: 744 commits, 602 days)
|__/                   |


julia> using PackageCompiler

julia> PackageCompiler.create_library(".", "test_lib"; lib_name = "test")
PackageCompiler: bundled libraries:
  ├── Base:
  │    ├── libLLVM-16jl.so - 101.440 MiB
  │    ├── libatomic.so.1.2.0 - 160.023 KiB
  │    ├── libdSFMT.so - 21.602 KiB
  │    ├── libgcc_s.so.1 - 714.164 KiB
  │    ├── libgfortran.so.5.0.0 - 9.078 MiB
  │    ├── libgmp.so.10.5.0 - 707.688 KiB
  │    ├── libgmpxx.so.4.7.0 - 36.445 KiB
  │    ├── libgomp.so.1.0.0 - 1.410 MiB
  │    ├── libjulia-codegen.so.1.11.7 - 73.184 MiB
  │    ├── libjulia-internal.so.1.11.7 - 13.255 MiB
  │    ├── libmpfr.so.6.2.1 - 2.410 MiB
  │    ├── libopenlibm.so.4.0 - 248.109 KiB
  │    ├── libpcre2-8.so.0.11.2 - 652.771 KiB
  │    ├── libquadmath.so.0.0.0 - 980.492 KiB
  │    ├── libssp.so.0.0.0 - 35.531 KiB
  │    ├── libstdc++.so.6.0.32 - 20.010 MiB
  │    ├── libunwind.so.8.0.1 - 512.164 KiB
  │    ├── libuv.so.2.0.0 - 653.641 KiB
  │    ├── libz.so.1.2.13 - 116.028 KiB
  │    ├── libzstd.so.1.5.7 - 991.673 KiB
  │    ├── libjulia.so.1.11.7 - 257.148 KiB
  ├── Stdlibs:
  │   ├── LibSSH2_jll
  │   │   ├── libssh2.so.1.0.1 - 311.484 KiB
  │   ├── MbedTLS_jll
  │   │   ├── libmbedcrypto.so.2.28.6 - 641.504 KiB
  │   │   ├── libmbedtls.so.2.28.6 - 287.055 KiB
  │   │   ├── libmbedx509.so.2.28.6 - 174.648 KiB
  │   ├── nghttp2_jll
  │   │   ├── libnghttp2.so.14.26.0 - 740.215 KiB
  │   ├── LibCURL_jll
  │   │   ├── libcurl.so.4.8.0 - 742.367 KiB
  │   ├── LibGit2_jll
  │   │   ├── libgit2.so.1.7.2 - 1.639 MiB
  │   ├── OpenBLAS_jll
  │   │   ├── libopenblas64_.0.3.27.so - 34.036 MiB
  │   ├── libblastrampoline_jll
  │   │   ├── libblastrampoline.so.5 - 2.837 MiB
  Total library file size: 268.073 MiB
✔ [02m:39s] PackageCompiler: creating compiler .ji image (incremental=false)
⢰ [01m:37s] PackageCompiler: compiling fresh sysimage (incremental=false)
✔ [00m:42s] PackageCompiler: compiling nonincremental system image
Precompiling Pkg...
  23 dependencies successfully precompiled in 36 seconds
Precompiling project...
  5 dependencies successfully precompiled in 3 seconds. 23 already precompiled.
✔ [00m:54s] PackageCompiler: compiling incremental system image

Now I invoked julia with the system image in the following manner, giving me this strange Base.IOError.

JULIA_DEPOT_PATH=test_lib/share/julia julia -J test_lib/lib/libtest.so -e 'using .PackageCompiler; PackageC
ompiler.create_library(".", "test_lib2"; lib_name = "test2")'
  Installing known registries into `test_lib/share/julia`
       Added `General` registry to test_lib/share/julia/registries
   Installed Glob ─────────────── v1.3.1
   Installed Scratch ──────────── v1.3.0
   Installed RelocatableFolders ─ v1.0.1
   Installed PackageCompiler ──── v2.2.2
PackageCompiler: bundled libraries:
  ├── Base:
  │    ├── libLLVM-16jl.so - 101.440 MiB
  │    ├── libatomic.so.1.2.0 - 160.023 KiB
  │    ├── libdSFMT.so - 21.602 KiB
  │    ├── libgcc_s.so.1 - 714.164 KiB
  │    ├── libgfortran.so.5.0.0 - 9.078 MiB
  │    ├── libgmp.so.10.5.0 - 707.688 KiB
  │    ├── libgmpxx.so.4.7.0 - 36.445 KiB
  │    ├── libgomp.so.1.0.0 - 1.410 MiB
  │    ├── libjulia-codegen.so.1.11.7 - 73.184 MiB
  │    ├── libjulia-internal.so.1.11.7 - 13.255 MiB
  │    ├── libmpfr.so.6.2.1 - 2.410 MiB
  │    ├── libopenlibm.so.4.0 - 248.109 KiB
  │    ├── libpcre2-8.so.0.11.2 - 652.771 KiB
  │    ├── libquadmath.so.0.0.0 - 980.492 KiB
  │    ├── libssp.so.0.0.0 - 35.531 KiB
  │    ├── libstdc++.so.6.0.32 - 20.010 MiB
  │    ├── libunwind.so.8.0.1 - 512.164 KiB
  │    ├── libuv.so.2.0.0 - 653.641 KiB
  │    ├── libz.so.1.2.13 - 116.028 KiB
  │    ├── libzstd.so.1.5.7 - 991.673 KiB
  │    ├── libjulia.so.1.11.7 - 257.148 KiB
  ├── Stdlibs:
  │   ├── LibSSH2_jll
  │   │   ├── libssh2.so.1.0.1 - 311.484 KiB
  │   ├── MbedTLS_jll
  │   │   ├── libmbedcrypto.so.2.28.6 - 641.504 KiB
  │   │   ├── libmbedtls.so.2.28.6 - 287.055 KiB
  │   │   ├── libmbedx509.so.2.28.6 - 174.648 KiB
  │   ├── nghttp2_jll
  │   │   ├── libnghttp2.so.14.26.0 - 740.215 KiB
  │   ├── LibCURL_jll
  │   │   ├── libcurl.so.4.8.0 - 742.367 KiB
  │   ├── LibGit2_jll
  │   │   ├── libgit2.so.1.7.2 - 1.639 MiB
  │   ├── OpenBLAS_jll
  │   │   ├── libopenblas64_.0.3.27.so - 34.036 MiB
  │   ├── libblastrampoline_jll
  │   │   ├── libblastrampoline.so.5 - 2.837 MiB
  Total library file size: 268.073 MiB
✔ [02m:40s] PackageCompiler: creating compiler .ji image (incremental=false)
⠸ [01m:31s] PackageCompiler: compiling fresh sysimage (incremental=false)error during bootstrap:
⡆ [01m:31s] PackageCompiler: compiling fresh sysimage (incremental=false)LoadError("/tmp/jl_KjjbNZ/sysimage_packagecompiler_dbbf2480-a618-11f0-156e-275402b67c9
⠋ [01m:31s] PackageCompiler: compiling fresh sysimage (incremental=false)LoadError("/home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/LazyArtifacts/src/LazyArtifacts.jl", 3, LoadError("/home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/Pkg.jl", 3, LoadError("/home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl", 101, Base.IOError("could not spawn setenv(`'' a registries/Registry.tar.gz -tgzip registries/Registry.tar`,[\"PATH=:/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/bin/remote-cli:/home/ranjanan/.local/bin:/home/ranjanan/.nvm/versions/node/v20.0.0/bin:/home/ranjanan/.juliaup/bin:/home/ranjanan/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin\", \"LD_LIBRARY_PATH=\", \"GIT_ASKPASS=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/extensions/git/dist/askpass.sh\", \"DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/18202754/bus\", \"BROWSER=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/bin/helpers/browser.sh\", \"LANG=en_US.UTF-8\", \"LOGNAME=ranjanan\", \"SHLVL=2\", \"NVM_CD_FLAGS=\", \"XDG_RUNTIME_DIR=/run/user/18202754\", \"OLDPWD=/home/ranjanan/SystemImage/MinimalSystemImage/test_lib\", \"XDG_SESSION_TYPE=tty\", \"SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt\", \"_=/home/ranjanan/.juliaup/bin/julia\", \"OPENBLAS_DEFAULT_NUM_THREADS=1\", \"USER=ranjanan\", \"LESSCLOSE=/usr/bin/lesspipe %s %s\", \"TERM_PROGRAM_VERSION=1.104.3\", \"JULIA_DEPOT_PATH=test_lib/share/julia\", \"PWD=/home/ranjanan/SystemImage/MinimalSystemImage\", \"XDG_SESSION_CLASS=user\", \"TERM_PROGRAM=vscode\", \"VSCODE_GIT_ASKPASS_NODE=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/node\", \"LESSOPEN=| /usr/bin/lesspipe %s\", \"XDG_DATA_DIRS=/usr/local/share:/usr/share:/var/lib/snapd/desktop\", \"SHELL=/bin/bash\", \"VSCODE_PYTHON_AUTOACTIVATE_GUARD=1\", \"SSH_CONNECTION=100.64.0.18 53215 100.64.0.4 22\", \"VSCODE_GIT_ASKPASS_MAIN=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/extensions/git/dist/askpass-main.js\", \"VSCODE_IPC_HOOK_CLI=/run/user/18202754/vscode-ipc-4ab2e4a0-9812-490a-8068-9ac5c67dc986.sock\", \"NVM_INC=/home/ranjanan/.nvm/versions/node/v20.0.0/include/node\", \"VSCODE_GIT_ASKPASS_EXTRA_ARGS=\", \"VSCODE_GIT_IPC_HANDLE=/run/user/18202754/vscode-git-458afc4c2b.sock\", \"NVM_DIR=/home/ranjanan/.nvm\", \"MOTD_SHOWN=pam\", \"XDG_SESSION_ID=96133\", \"NVM_BIN=/home/ranjanan/.nvm/versions/node/v20.0.0/bin\", \"SSH_CLIENT=100.64.0.18 53215 22\", \"JULIA_LOAD_PATH=@stdlib\", \"SSL_CERT_DIR=/usr/lib/ssl/certs\", \"HOME=/home/ranjanan\", \"TERM=xterm-256color\", \"LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:\", \"COLORTERM=truecolor\", \"OPENBLAS_MAIN_FREE=1\"]): permission denied (EACCES)", -13)))))
_spawn_primitive at ./process.jl:140
_spawn at ./process.jl:157 [inlined]
_spawn at ./process.jl:179
_spawn at ./process.jl:179
#885 at ./process.jl:149 [inlined]
setup_stdios at ./process.jl:236
_spawn at ./process.jl:148 [inlined]
#run#899 at ./process.jl:512
run at ./process.jl:510 [inlined]
#5 at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl:87
cd at ./file.jl:112
_run_precompilation_script_setup at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl:8 [inlined]
#9 at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl:113
withenv at ./env.jl:265
pkg_precompile at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl:112
unknown function (ip: 0x7fe3567952cf)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
do_call at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_value at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:223
eval_stmt_value at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:174 [inlined]
eval_body at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:666
jl_interpret_toplevel_thunk at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:824
top-level scope at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/precompile.jl:171
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval_in at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:430 [inlined]
include_string at ./loading.jl:2734
_include at ./loading.jl:2794
include at ./Base.jl:562
unknown function (ip: 0x7fe35b5f9a86)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
jl_f__call_latest at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/builtins.c:875
include at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/Pkg.jl:3
unknown function (ip: 0x7fe356b67492)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
do_call at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_value at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:223
eval_stmt_value at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:174 [inlined]
eval_body at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:666
jl_interpret_toplevel_thunk at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/interpreter.c:824
top-level scope at /home/ranjanan/.julia/juliaup/julia-pr59699/share/julia/stdlib/v1.11/Pkg/src/Pkg.jl:850
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_eval_module_expr at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:215 [inlined]
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:743
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval_in at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:430 [inlined]
include_string at ./loading.jl:2734
_include at ./loading.jl:2794
include at ./Base.jl:562
unknown function (ip: 0x7fe35b5f9a86)
_require at ./loading.jl:2618
__require_prelocked at ./loading.jl:2388
unknown function (ip: 0x7fe35713ad06)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
jl_f__call_latest at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/builtins.c:875
#invokelatest#2 at ./essentials.jl:1055 [inlined]
invokelatest at ./essentials.jl:1052 [inlined]
_require_prelocked at ./loading.jl:2377
unknown function (ip: 0x7fe35b2d8fc6)
macro expansion at ./loading.jl:2314 [inlined]
macro expansion at ./lock.jl:273 [inlined]
__require at ./loading.jl:2271
unknown function (ip: 0x7fe35b2d8426)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
jl_f__call_latest at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/builtins.c:875
#invokelatest#2 at ./essentials.jl:1055 [inlined]
invokelatest at ./essentials.jl:1052 [inlined]
require at ./loading.jl:2262
unknown function (ip: 0x7fe35b25de76)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
call_require at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:486 [inlined]
eval_import_path at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:523
eval_import_from at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:642 [inlined]
eval_import_from at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:633
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:749
jl_eval_module_expr at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:215 [inlined]
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:743
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval_in at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:430 [inlined]
include_string at ./loading.jl:2734
_include at ./loading.jl:2794
include at ./Base.jl:562
unknown function (ip: 0x7fe35b5f9a86)
_require at ./loading.jl:2618
__require_prelocked at ./loading.jl:2388
unknown function (ip: 0x7fe35713ad06)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
jl_f__call_latest at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/builtins.c:875
#invokelatest#2 at ./essentials.jl:1055 [inlined]
invokelatest at ./essentials.jl:1052 [inlined]
_require_prelocked at ./loading.jl:2377
unknown function (ip: 0x7fe35b2d8fc6)
macro expansion at ./loading.jl:2314 [inlined]
macro expansion at ./lock.jl:273 [inlined]
__require at ./loading.jl:2271
unknown function (ip: 0x7fe35b2d8426)
jl_apply at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/julia.h:2175 [inlined]
jl_f__call_latest at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/builtins.c:875
#invokelatest#2 at ./essentials.jl:1055 [inlined]
invokelatest at ./essentials.jl:1052 [inlined]
require at ./loading.jl:2262
unknown function (ip: 0x7fe35b25de76)
macro expansion at ./timing.jl:421 [inlined]
macro expansion at /tmp/jl_KjjbNZ/sysimage_packagecompiler_dbbf2480-a618-11f0-156e-275402b67c95.jl:118 [inlined]
macro expansion at ./timing.jl:421 [inlined]
top-level scope at /tmp/jl_KjjbNZ/sysimage_packagecompiler_dbbf2480-a618-11f0-156e-275402b67c95.jl:117
jl_toplevel_eval_flex at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:934
jl_parse_eval_all at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:1067
ijl_load_ at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:1114
ijl_load at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/toplevel.c:1127
exec_program at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/jlapi.c:858
true_main at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/jlapi.c:915
jl_repl_entrypoint at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/src/jlapi.c:1059
main at /cache/build/builder-amdci4-2/julialang/julia-release-1-dot-11/cli/loader_exe.c:58
unknown function (ip: 0x7fe36b33cd8f)
__libc_start_main at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x4010b8)

✖ [01m:32s] PackageCompiler: compiling fresh sysimage (incremental=false)
ERROR: failed process: Process(setenv(`/home/ranjanan/.julia/juliaup/julia-pr59699/bin/julia --color=yes --startup-file=no --pkgimages=no --cpu-target 'generic;sandybridge,-xsaveopt,clone_all;haswell,-rdrnd,base(1)' --sysimage=/tmp/jl_KjjbNZ/corecompiler.ji --output-o=/tmp/jl_KjjbNZ/sys-o.a /tmp/jl_KjjbNZ/sysimage_packagecompiler_dbbf2480-a618-11f0-156e-275402b67c95.jl`,["PATH=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/bin/remote-cli:/home/ranjanan/.local/bin:/home/ranjanan/.nvm/versions/node/v20.0.0/bin:/home/ranjanan/.juliaup/bin:/home/ranjanan/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin", "GIT_ASKPASS=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/extensions/git/dist/askpass.sh", "DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/18202754/bus", "BROWSER=/home/ranjanan/.vscode-server/cli/servers/Stable-385651c938df8a906869babee516bffd0ddb9829/server/bin/helpers/browser.sh", "LANG=en_US.UTF-8", "LOGNAME=ranjanan", "SHLVL=2", "NVM_CD_FLAGS=", "XDG_RUNTIME_DIR=/run/user/18202754", "OLDPWD=/home/ranjanan/SystemImage/MinimalSystemImage/test_lib"  …  "XDG_SESSION_ID=96133", "NVM_BIN=/home/ranjanan/.nvm/versions/node/v20.0.0/bin", "SSH_CLIENT=100.64.0.18 53215 22", "JULIA_LOAD_PATH=@stdlib", "SSL_CERT_DIR=/usr/lib/ssl/certs", "HOME=/home/ranjanan", "TERM=xterm-256color", "LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=00:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arc=01;31:*.arj=01;31:*.taz=01;31:*.lha=01;31:*.lz4=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.tzo=01;31:*.t7z=01;31:*.zip=01;31:*.z=01;31:*.dz=01;31:*.gz=01;31:*.lrz=01;31:*.lz=01;31:*.lzo=01;31:*.xz=01;31:*.zst=01;31:*.tzst=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.alz=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.cab=01;31:*.wim=01;31:*.swm=01;31:*.dwm=01;31:*.esd=01;31:*.jpg=01;35:*.jpeg=01;35:*.mjpg=01;35:*.mjpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.webp=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.m4a=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.oga=00;36:*.opus=00;36:*.spx=00;36:*.xspf=00;36:", "COLORTERM=truecolor", "OPENBLAS_MAIN_FREE=1"]), ProcessExited(1)) [1]

Stacktrace:
  [1] pipeline_error
    @ ./process.jl:598 [inlined]
  [2] read(cmd::Cmd)
    @ Base ./process.jl:482
  [3] macro expansion
    @ ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:274 [inlined]
  [4] (::PackageCompiler.var"#12#17"{String, Cmd, Vector{String}, Cmd, String, String, String, String})()
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/ext/TerminalSpinners.jl:157
  [5] spin(f::PackageCompiler.var"#12#17"{String, Cmd, Vector{String}, Cmd, String, String, String, String}, s::PackageCompiler.TerminalSpinners.Spinner{Base.TTY})
    @ PackageCompiler.TerminalSpinners ~/.julia/packages/PackageCompiler/FtDNu/ext/TerminalSpinners.jl:164
  [6] macro expansion
    @ ~/.julia/packages/PackageCompiler/FtDNu/ext/TerminalSpinners.jl:157 [inlined]
  [7] (::PackageCompiler.var"#10#15"{String, Cmd, Vector{String}, Cmd, String, String, String, String, String})()
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:260
  [8] cd(f::PackageCompiler.var"#10#15"{String, Cmd, Vector{String}, Cmd, String, String, String, String, String}, dir::String)
    @ Base.Filesystem ./file.jl:112
  [9] create_fresh_base_sysimage(stdlibs::Vector{String}; cpu_target::String, sysimage_build_args::Cmd)
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:247
 [10] create_fresh_base_sysimage
    @ ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:219 [inlined]
 [11] create_sysimage(packages::Vector{String}; sysimage_path::String, project::String, precompile_execution_file::Vector{String}, precompile_statements_file::Vector{String}, incremental::Bool, filter_stdlibs::Bool, cpu_target::String, script::Nothing, sysimage_build_args::Cmd, include_transitive_dependencies::Bool, base_sysimage::Nothing, julia_init_c_file::Nothing, julia_init_h_file::Nothing, version::Nothing, soname::Nothing, compat_level::String, extra_precompiles::String, import_into_main::Bool)
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:590
 [12] create_sysimage
    @ ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:532 [inlined]
 [13] create_sysimage_workaround(ctx::Pkg.Types.Context, sysimage_path::String, precompile_execution_file::Vector{String}, precompile_statements_file::Vector{String}, incremental::Bool, filter_stdlibs::Bool, cpu_target::String; sysimage_build_args::Cmd, include_transitive_dependencies::Bool, julia_init_c_file::String, julia_init_h_file::Vector{String}, version::Nothing, soname::String, script::Nothing, base_sysimage::Nothing)
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:1175
 [14] create_sysimage_workaround
    @ ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:1153 [inlined]
 [15] create_library(package_or_project::String, dest_dir::String; lib_name::String, precompile_execution_file::Vector{String}, precompile_statements_file::Vector{String}, incremental::Bool, filter_stdlibs::Bool, force::Bool, header_files::Vector{String}, julia_init_c_file::String, julia_init_h_file::String, version::Nothing, compat_level::String, cpu_target::String, include_lazy_artifacts::Bool, sysimage_build_args::Cmd, include_transitive_dependencies::Bool, include_preferences::Bool, script::Nothing, base_sysimage::Nothing)
    @ PackageCompiler ~/.julia/packages/PackageCompiler/FtDNu/src/PackageCompiler.jl:1100
 [16] top-level scope
    @ none:1

[topolarity]

Here's my $.02:

The particular issue here is that the __init__ for p7zip_jll has not run, but Pkg's precompile workload is trying to use it anyway.

However, this is an instance of a more fundamental issue with Julia's pre-compilation model. In order to preserve the behavior of existing code, Julia has to preserve / emulate the __init__ side effects of a "standard" execution flow.

This means Julia must:

1. Avoid tainting the sysimage with unexpected __init__ side effects
2. Allow pre-compilation workloads to rely on __init__() execution as normal

The alternative is that we have to make a widespread array of package-specific PR's to make packages agnostic to sysimage vs. pkgimage builds (see JuliaLang/julia#59232, JuliaLang/julia#59233, and JuliaLang/LinearAlgebra.jl#1407)

Typically we emulate the "standard" __init__ side effects by going through a two-step process where we first compile all packages in a normal pkgimage flow (allows top-level code execution and discards __init__ side effects as required) and then link these pkgimages into a sysimage (involves almost no top-level code execution and triggers no __init__ operations, to preserve the intended global state).

The problem here is that once a sysimage is built, it changes the compilation boundaries in that first step. Julia with a custom sysimage is incapable of emulating the "standard" pkgimage flow, because it has a different set of pkgimages. Many are hard-coded in the sysimage and cannot be split out into a pkgimage for compilation as "normal", as is the case with Pkg here.

[topolarity]

A sufficient workaround for now is probably to add a sysimage build script that @ranjanan can use to provide overrides to manually edit packages to be compatible with this execution flow.

[KristofferC]

Try run with filter_stdlibs=true