cligen break nim important_packages

[timotheecour]

https://github.com/nim-lang/Nim/pull/15695/checks?check_run_id=1299438437

PASS: status-im/nim-chronicles C                (27.06 sec)
  FAIL: c-blake/cligen.git C
  Test "c-blake/cligen.git" in category "nimble-packages-1"
  Failure: reBuildFailed
  package test failed
  $ nim c -o:cligenn -r cligen.nim
  Hint: used config file '/Users/runner/work/Nim/Nim/config/nim.cfg' [Conf]
  Hint: used config file '/Users/runner/work/Nim/Nim/config/config.nims' [Conf]
  ..............................
  /Users/runner/work/Nim/Nim/pkgstemp/cligen/cligen/mslice.nim(8, 14) Error: cannot open file: cligen/prefetch
  
  PASS: PMunch/combparser C                       ( 2.55 sec)

wouldn't cligen's own CI prevent this?

[c-blake]

There is no actual bug other than some kind of staleness thing going on in the nim CI. I added a new module to the git VC head in the very same git commit as adding that import for mslice. It works fine locally.

Somehow the nim CI is partially updating mslice (presumably via git pull maybe indirectly via some broken nimble thing since I have not punched a new release) but did not pull the new module. Shrug. If it will fix the borked Nim CI, I can punch a new cligen release. Personally, it seems a Bad Property not under my own control is afoot here.

[c-blake]

It does not only work locally on merely nim-devel either..but on my whole usual panel of nim-(devel, 1.4, 1.2, 1.0, 0.20.2, 0.19.2).

[timotheecour]

I'm wondering if it's timotheecour/Nim#167 all over again; I thought nim-lang/Nim#14770 was supposed to fix that? /cc @Clyybber

[c-blake]

I am not sure how publicly visible this is, but I can also see all recent commits passing with green checks (under my Actions tab) which runs sh test.sh in the cligen CI, far more extensive (though yes, still incomplete/only help messages) than nim c -o:cligenn cligen. I'm not really in a mood to debug the Nim CI or nimble, but am happy to do whatever you tell me to in order to unblock packages testing.

[c-blake]

Personally, if it is that test-against-different-than-install then it should really be fixed. Otherwise no one can add anything new without punching releases under pretty heavy constraints which is bad, not good, for the package ecosystem, but then I think that is also true of nimble's src/ defaults. Maybe the Nim CI should just bypass nimble completely? My nimp is like 300 lines of code. It just does '#head' all the way down which would test the transitive closure of all VC heads. (Not sure if that is better or worse..pros & cons.)

Anyway, let me know if you want me to punch some patch release or if you want to debug the broken CI "as-is".

[timotheecour]

would be good to have a reproducing bug though, if you punch a patch release the problem will once again disappear under the rug without underyling issue fixed in nim CI; maybe disabling cligen in important_packages might be a better fix (temporarily ) so we can always come back to that broken state by uncommenting it

[c-blake]

I guess it's up to @Clyybber what he wants to do, if he's going to work on that again. It's no big deal to me to either punch a release, nor be un-auto-tested-against-Nim-core-shenanigans for a while. Let us know, @Clyybber.

[Clyybber]

Hmm, sorry I don't know exactly what caused this issue, possibly a nimble bug?
I created nim-lang/Nim#15701, which should make only cligen's latest release get tested until I fix the root cause (I have a suspicion its the combination of nimble pkgs having cligen as a dependency and us cloning cligen but not doing nimble develop, I'll follow up with a proper fix tomorrow hopefully).
Even if this doesn't fix it, its clear that its not an issue on your side, so I this can be closed

[timotheecour]

@Clyybber indeed, that's what I observed in timotheecour/Nim#167

the bug is that there's a mismatch between what's installed by nimble (latest git tag, or perhaps another version if installed already by another package [that's another bug! should be isolated from other packages and not order dependant]) and what's tested via nimble test or the test cmd provided (which uses git HEAD)

can you try adding nimble develop ?

[c-blake]

Closing as not really my issue. Leave a comment if you want me to punch a release.

[Clyybber]

Just a small update, this can be reproduced by fresh cloning cligen and running nim c -r cligen.nim; the failure stems from import cligen/prefetch referencing the cligen package itself, and since we didn't use nimble develop on the package this didn't work.