24.8.11 Altinity Stable Pre-release (2)

[Enmk]

Changes compared to upstream's v24.8.11.5-lts

Bug Fixes (user-visible misbehavior in an official stable release)

• Fix crash on drop or rename a role that is used in LDAP external user directory (Some fixes for LDAP ClickHouse/ClickHouse#68355 by @zvonand via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)
• Fix advanced SSL configuration for Keeper's internal communication (Fix advanced SSL configuration for Keeper's internal communication ClickHouse/ClickHouse#72730 and Update NuRaft ClickHouse/ClickHouse#72584 by @antonio2368 via 24.8 Backport of #72730 - Fix advanced SSL configuration for Keeper's internal communication #579)
• Fix for S3 Express Disk Initialization Issue (Fix for S3 Express Disk Initialisation Issue ClickHouse/ClickHouse#73777 by @stamsekar via 24.8 Backport of #73777 - Fix for S3 Express Disk Initialisation Issue #580)

Performance improvements

• Add support for parquet bloom filters (Add parquet bloom filters support ClickHouse/ClickHouse#62966 by @arthurpassos via 24.8.8 Backport of #62966 - Add parquet bloom filters support #556)
• Optimized thread creation in the ThreadPool to minimize lock contention. (Thread pool: move thread creation out of lock ClickHouse/ClickHouse#68694 by @filimonov via 24.8.8 Backport PR #68694 Thread pool: move thread creation out of lock #573)
• Adaptive mark_segment_size for parallel replicas (Adaptive mark_segment_size for parallel replicas ClickHouse/ClickHouse#68424, Fix parallel replicas protocol after #68424 ClickHouse/ClickHouse#69744 by @nickitat via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

Improvements

• Added a new set of metrics for Thread Pool introspection, providing deeper insights into thread pool performance and behavior. (Thread pool metrics ClickHouse/ClickHouse#68674 by @filimonov via 24.8.8 Backport PR #68674 Thread pool metrics #567)
• Support for Parquet page V2 on native reader (Support for Parquet page V2 on native reader ClickHouse/ClickHouse#70807 by @arthurpassos via 24.8.8 Backport of #70807 parquet page header v2 native reader #558)
• Fix the issue where ClickHouse in Docker containers printed "get_mempolicy: Operation not permitted" into stderr due to restricted syscalls. (ClickHouse#70900 by @filimonov via 24.8 Backport of #70900 - make numactl respect EPERM error, when get_mempolicy is is restricted by seccomp #568)
• Support more advanced SSL options for Keeper internal communication (ClickHouse#69582 by @antonio2368 via 24.8 Backport of #69582 - Support more advanced SSL options for Keeper internal communication #566)
• Read output_format_compression_level on Parquet output (Compression level for parquet output format ClickHouse/ClickHouse#73651 and Set parquet compression level only if compression codec supports it ClickHouse/ClickHouse#74659 by @arthurpassos via 24.8 Backport of #73651and #74659 - Compression level for parquet output format #593)
• Multiple parallel replicas improvements (Rework parallel replicas settings ClickHouse/ClickHouse#63151 by @alexey-milovidov, Local plan for parallel replicas ClickHouse/ClickHouse#64448 by @devcrafter, Remove explicit announce from local replica in ReadFromMergeTree ClickHouse/ClickHouse#69602 by @nickitat, New profile events for parallel replicas ClickHouse/ClickHouse#69706 by @nickitat -- all via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

New features

• Push external user roles from query originator to other nodes in cluster. Helpful when only originator has access to the external authenticator (like LDAP). (Passing external user roles from query originator to other nodes ClickHouse/ClickHouse#70332, Fix exception in RemoteQueryExecutor when user does not exist locally ClickHouse/ClickHouse#72759, by @zvonand via 24.8 Backport of #70332 - Passing external user roles from query originator to other nodes #542)

Build/Testing/Packaging Improvement

• Port CI/CD to Altinity's infrastructure
• Fixed tests
• Changed version number generation

[altinity-robot]

This is an automated comment for commit 07c1db1 with description of existing statuses. It's updated for the latest CI running

❌ Click here to open a full report in a separate page

Check name	Description	Status
Sign aarch64	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	❌ error
Sign release	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	❌ error

Successful checks

Check name	Description	Status
Builds	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	✅ success
Ready for release	There's no description for the check yet, please add it to tests/ci/ci_config.py:CHECK_DESCRIPTIONS	✅ success