ArtifactWrappers is not multi-process safe

[kpamnany]

Description

See this failure.

There was a similar problem with the compile cache in Julia, see this for how it was solved (and the problem with the solution).

[kpamnany]

Cc: @charleskawczynski

[charleskawczynski]

Looks like #1684 didn't actually fix this issue. Seeing

ERROR: LoadError: ArgumentError: '/central/scratchio/esm/climaci/climatemachine-ci/717/depot/gpu/artifacts/ff73fa6a0b6a807e71a6921f7ef7d0befe776edd' exists. `force=true` is required to remove '/central/scratchio/esm/climaci/climatemachine-ci/717/depot/gpu/artifacts/ff73fa6a0b6a807e71a6921f7ef7d0befe776edd' before copying.
  | Stacktrace:
  | [1] checkfor_mv_cp_cptree(::String, ::String, ::String; force::Bool) at ./file.jl:308
  | [2] cp(::String, ::String; force::Bool, follow_symlinks::Bool) at ./file.jl:345
  | [3] rename(::String, ::String; force::Bool) at ./file.jl:897
  | [4] rename at ./file.jl:894 [inlined]
  | [5] #mv#13 at ./file.jl:393 [inlined]
  | [6] mv at ./file.jl:392 [inlined]
  | [7] create_artifact(::ClimateMachine.ArtifactWrappers.var"#2#5"{ArtifactWrapper}) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.5/Pkg/src/Artifacts.jl:229
  | [8] get_data_folder(::ArtifactWrapper) at /central/scratchio/esm/climaci/climatemachine-ci/717/climatemachine-ci/src/InputOutput/ArtifactWrappers/ArtifactWrappers.jl:79
  | [9] top-level scope at /central/scratchio/esm/climaci/climatemachine-ci/717/climatemachine-ci/test/Land/Model/haverkamp_implicit_test.jl:42
  | [10] include(::Function, ::Module, ::String) at ./Base.jl:380
  | [11] include(::Module, ::String) at ./Base.jl:368
  | [12] exec_options(::Base.JLOptions) at ./client.jl:296
  | [13] _start() at ./client.jl:506

in this build.

[charleskawczynski]

Is this another manifestation of the same problem? Or a separate issue? It also seems flakey.