Apache Superset: Use Python 3.12 on CI

[amotl]

About

Probing Apache Superset with Python 3.12.

-- https://devguide.python.org/versions/

[amotl]

Hi @villebro,

may I humbly ask you if you have any idea why this job, that aims to start using Python 3.12 on the test matrix, fails on CI/GHA with ModuleNotFoundError: No module named 'distutils' ¹? Is it something related to our CI setup, or is Apache Superset not compatible with Python 3.12 yet?

With kind regards,
Andreas.

Footnotes

1. https://github.com/crate/cratedb-examples/actions/runs/11940819371/job/33284315049?pr=336#step:6:197 ↩

[amotl]

Apparently, the job is failing when trying to install NumPy 1.23.5, which does not install well on Python 3.12.

Collecting numpy==1.23.5 (from apache-superset==3.*)

-- https://github.com/crate/cratedb-examples/actions/runs/11940819371/job/33284315049?pr=336#step:6:87

Details

$ python -V
Python 3.12.7

$ uv pip install numpy==1.23.5

Resolved 1 package in 5ms
error: Failed to prepare distributions
  Caused by: Failed to download and build `numpy==1.23.5`
  Caused by: Build backend failed to determine requirements with `build_wheel()` (exit status: 1)

[stderr]
Traceback (most recent call last):
  File "<string>", line 8, in <module>
  File "/Users/amo/.cache/uv/builds-v0/.tmpUqrhkg/lib/python3.12/site-packages/setuptools/__init__.py", line 10, in <module>
    import distutils.core
ModuleNotFoundError: No module named 'distutils'
  Caused by: distutils was removed from the standard library in Python 3.12. Consider adding a constraint (like `numpy >1.23.5`) to avoid building a version of numpy that depends on distutils.

[amotl]

We have been able to dig out the corresponding ticket.

• When trying to install Superset on python3.12 I get the error: apache/superset#27585

[amotl]

NumPy 1.26 is available for Python 3.12, so maybe upgrading to that version from NumPy 1.23 might be feasible, because it's not too different?

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch amo/superset-py312

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}