Intermittent failures in CI in `test_files/limit.slt`

[alamb]

Describe the bug

The extended tests are failing intermittently on main (mostly pass, but sometimes fail)

Here is an example failure:
https://github.com/apache/datafusion/actions/runs/15208072624/job/42775700898

External error: 1 errors in file /__w/datafusion/datafusion/datafusion/sqllogictest/test_files/limit.slt

1. query result mismatch:
[SQL] with selection as (
    select *
    from test_limit_with_partitions
    limit 1
)
select 1 as foo
from selection
order by part_key
limit 1000;
[Diff] (-expected|+actual)
-   1
at /__w/datafusion/datafusion/datafusion/sqllogictest/test_files/limit.slt:859

To Reproduce

Not sure -- it is happening intermittently on main

Expected behavior

No response

Additional context

No response

[Adez017]

@alamb i think we could review the test jobs closely to figure out what's happening . i think this issue persist a long time by now and every time we need to restructure it . what you think ?

[alamb]

@alamb i think we could review the test jobs closely to figure out what's happening . i think this issue persist a long time by now and every time we need to restructure it . what you think ?

I am not sure what you mean by "restructure it"

To begin debugging this issue, I would personally suggest running limit.slt in a loop locally and see if it fails after a while (e.g. run cargo run --test sqllogictests -- limit in a loop 100 times)