Running julia from multiple machines sharing the same home folder

[iceblue25]

Hi all,

I am trying to run julia from multiple machines (bash launches multiple julia instances from various machines) and all share the same home dir.

The issue is that each machine recompiles the stale cache. (All are share the same package dir). Is this an issue? Is this a known issue? Is there a solution?

Thanks

[tkelman]

Best to manually call using or Base.compilecache on any packages you're going to need from a single node, and wait to launch other jobs until the precompilation is finished.

[iceblue25]

Seems like a messy solution.

Can precompilation happen in memory? So that I launch all processes without waiting? (Might be a big problem especially when trying to launch multiple small julia programs.)
Also launching processes sequentially requires additional logic and also delays the execution.

Can one precompile the packages for a very general cpu architecture so that is compatible with all machines?

[tkelman]

precompilation in memory was how it used to work, and you can patch the packages you're using to turn __precompile__(false)

Alternately you can tell each worker to write to a separate local location, using independent copies of the package directory. Is this causing a real error, or a theoretical concern?

[iceblue25]

It is a real concern but not real error yet. I am trying some toy examples before scaling things up.
No error yet but If multiple compilations happen in parallel I guess a race condition will happen.

Also, is there a way to precompile for a common cpu architecture (for example pentium 4 arch) which is common across all machines?

Thanks for all the quick replies and help!

[tkelman]

You can start julia with -C pentium4 and it looks like that should propagate to the precompile task. Are all workers running the same build of julia? Are you seeing precompilation happening every time you run something, or just the first time?

[stevengj]

You could use a different LOAD_CACHE_PATH on each machine. e.g. add the following to your .juliarc:

push!(Base.LOAD_CACHE_PATH, joinpath(Base.LOAD_CACHE_PATH[1], gethostname()))

(Though you might want to use a local, non-network path instead.) That way, the different machines won't share a cache.

[iceblue25]

@tkelman and @stevengj thanks for your replies. I will try the separate caches solution. Not very clean solution but I guess it will work.

[anriseth]

I have the same issue (on my university computers). push! did not help, but unshift works:

unshift!(Base.LOAD_CACHE_PATH, joinpath(Base.LOAD_CACHE_PATH[1], gethostname()))

[stevengj]

Right, sorry; you need the new path to be first, via unshift!.

[stevengj]

It seems like it might be reasonable to include gethostname() in the default cache path. It's not too uncommon to share home directories between machines.

[eschnett]

+1

[iceblue25]

+1 for default cache path