22.3.15.34 Altinity Stable

Based on upstream/v22.3.15.33-lts

Changes Compared to upstream v22.3.15.33-lts

Bug fixes

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Reverted: 'Fix seeking while reading from encrypted disk' ClickHouse#39687, known to cause issues in 22.3 (via #193)
• Reverted: 'Enable using constants from with and select in aggregate function parameters.' ClickHouse#27531, causes problems on 22.3 (via #194)
• Fix memory leak while pushing to MVs w/o query context (from Kafka/...) ClickHouse#40732 by @azat (via #202)
• Fix arrow column dictionary to ch lc ClickHouse#40037 by @arthurpassos (via #209)

Improvements

• Improvement: Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Improvement: Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)
• Add support for extended (chunked) arrays for Parquet format (ClickHouse#40485, ClickHouse#43297) by @arthurpassos (via #203, #211)

changes in upstream

Packages

https://builds.altinity.cloud/

22.3.12.20 Altinity Stable

Based on upstream/v22.3.12.19-lts

Changes Compared to Community Build v22.3.12.19-lts

Bug fix

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Fix unused unknown columns introduced by WITH statement ClickHouse#39131 by @amosbird
• Fix memory leak while pushing to MVs w/o query context (from Kafka/...) by @azat

Improvement

• Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)
• Add support for extended (chunked) arrays for Parquet format ClickHouse#40485 by @arthurpassos

Build/Testing/Packaging Improvement

• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure

Changes in upstream from v22.3.10.22-lts to v22.3.12.19-lts

Bug fix

• Fix clickhouse-server doinst.sh. ClickHouse#40681 by @Felixoid.
• fix heap buffer overflow by limiting http chunk size. ClickHouse#40292 by @CheSema.
• Fix possible segfault in CapnProto input format'. ClickHouse#40241 by @Avogar.
• Fix insufficient argument check for encryption functions'. ClickHouse#40194 by @alexey-milovidov.
• Fix HashMethodOneNumber with const column. ClickHouse#40020 by @canhld94.
• Fix seeking while reading from encrypted disk. ClickHouse#39687 by @vitlibar.
• Fix number of threads for pushing to views'. ClickHouse#39253 by @azat.

Other

• collectFilesToSkip() in MutateTask now supports new index file extension .idx2 for MinMax. ClickHouse#40122 by @robot-ch-test-poll2.
• Clean out clickhouse-server.service from /etc. ClickHouse#39323 by @Felixoid.

Full list of changes

Packages

https://builds.altinity.cloud/

22.3.10.24 Altinity Stable

Based on upstream/v22.3.10.22-lts

Changes Compared to Community Build v22.3.10.22-lts

Bug fix

• Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Fixed Unknown identifier (aggregate-function) exception ClickHouse#39762 by @quickhouse (via #189)
• Fixed point of origin for exponential decay window functions ClickHouse#39593 by @quickhouse (via #190)
• Reverted 'Fix seeking while reading from encrypted disk' ClickHouse#39687, known to cause issues in 22.3 (via ##193)
• Reverted: 'Enable using constants from with and select in aggregate function parameters.' ClickHouse#27531, causes problems on 22.3 (via #194)

Improvement

• Improvement: Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Improvement: Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)

Build/Testing/Packaging Improvement

• Build/Testing/Packaging Improvement: Allow Github workflows to run on Altinity's infrastructure

Changes in upstream from v22.3.8.39-lts to v22.3.10.22-lts

Bug fix

• Fix CANNOT_READ_ALL_DATA with pread_threadpool.. #39800 (Anton Popov).
• Fix seeking while reading from encrypted disk. #39687 (Vitaly Baranov).
• Fix bug with maxsplit in the splitByChar. #39552 (filimonov).
• Fix data race and possible heap-buffer-overflow in Avro format. #39498 (Kruglov Pavel).
• Fix incorrect postgresql query which fetches tables list. #39283 (Kseniia Sumarokova).
• Fix segfault in materialised postgresql. #39272 (Kseniia Sumarokova).
• removed default queue arguments. #39259 (rnbondarenko).
• Fix reading of sparse columns from s3 #37978 via #39206 (robot-ch-test-poll).
• Fix reading from s3 in some corner cases #38239. via #39206 (robot-ch-test-poll).
• prewhere action should preserve sorting columns. #39157 (Yakov Olkhovskiy).
• Fix insert into MV with enabled extremes.. #39125 (Nikolai Kochetov).
• Fix for fs cache. #39070 (Kseniia Sumarokova).
• Remove logging from OvercommitTracker to avoid deadlocks. #39030 (Dmitry Novik).
• Fix reading of sparse columns from s3. #37978 (Anton Popov).
• Fix some issues with low cardinality and async reads from remote fs. #36763 (Kseniia Sumarokova).
• Fix performance regression of scalar query. #35986 (Amos Bird).

Other

• Change mysql-odbc url. #39702 (Mikhail f. Shiryaev).
• Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread. #39619 (Nikolai Kochetov).
• Add docker_server.py running to backport and release CIs. #39011 (Mikhail f. Shiryaev).
• Retry docker buildx commands with progressive sleep in between. #38898 (Mikhail f. Shiryaev).

Full list of changes

Packages

https://builds.altinity.cloud/

22.3.8 Altinity Stable

Based on upstream/v22.3.8.39-lts

Changes Compared to Community Build v22.3.8.39-lts

• Bug fix: Fix for exponential time decaying window functions. Now respecting boundaries of the window ClickHouse#36944 by @excitoon (via #164)
• Bug fix: Fixes for objects removal in S3ObjectStorage ClickHouse#37882 by @excitoon (via #164)
• Improvement: Optimized processing of ORDER BY in window functions ClickHouse#34632 by @excitoon (via #164)
• Improvement: Support batch_delete capability for GCS ClickHouse#37659 by @frew (via #164)

Packages

https://builds.altinity.cloud/

21.1.11 Altinity Stable

Based on upstream/v21.1.9.41-stable

Changes Compared to Community Build v21.1.9.41-stable

• Security fix: CVE-2021-43304, CVE-2021-43305 (ClickHouse#27743)
• Security fix: CVE-2021-42387, CVE-2021-42388, CVE-2021-42389, CVE-2021-42390, CVE-2021-42391 (ClickHouse#27136)
• background_fetches_pool_size is set to 8. This is better for production usage with frequent small insertions or slow ZooKeeper clusters. (via 579bf72)
• Bug fix: Fixed the error ‘Cannot find column in ActionsDAG result', which may happen if subquery uses untuple. ClickHouse#22290 (via 9f3e0b1)
• Bug fix: Fixed quantile(s)TDigest that could produce non-accurate results in some edge cases: ClickHouse#22408 (via 312180e)
• Bug fix: Fixed a bug with accessing S3 buckets when the object URL contained ‘+’ sign: ClickHouse#23822 (via a0418cb)

Packages

https://builds.altinity.cloud/

22.3 Altinity Stable

Based on upstream v22.3.5-lts

Changes compared to Community Build v22.3.5-lts

• Building/Packaging fixes

21.8.15 Altinity Stable

Based on upstream/v21.8.15.7-lts

Changes Compared to Community Build v21.8.15.7-lts

• Bug Fix: Fixed issue with merging configs that have and root XML tags. (backport of ClickHouse@213ecae) (via #114)
• Bug Fix: Backport of ClickHouse#31823 to 21.8: Fix invalid cast of nullable type when nullable primary key is used (via #110)
• Build/Testing/Packaging Improvement: Various macOS compilation and packaging fixes/backporting (via #108)
• Build/Testing/Packaging Improvement: Minor test improvements (via afb4a0a, 4c35386)

Changes compared to Altinity Stable 21.8.13.1

Bug Fixes


* Fix segfault while parsing ORC file with corrupted footer. Closes ClickHouse#33797 via ClickHouse#33984 (Kruglov Pavel).

• Fix usage of functions array and tuple with literal arguments in distributed queries. Previously it could lead to Not found columns exception. ClickHouse#33938 (Anton Popov).
• Fix s3 table function reading empty file. Closes ClickHouse#33008 via ClickHouse#33037 (Kseniia Sumarokova).
• Fix hdfs url check that didn't allow using HA namenode address. Bug was introduced in ClickHouse#31042. ClickHouse#32976 (Kruglov Pavel).
• Server might fail to start if database with MySQL engine cannot connect to MySQL server, it's fixed. Fixes ClickHouse#14441 via ClickHouse#32802 (tavplubix).

Test Results

• QA Software Build Report
• Altinity Test Reports for v21.8.15.15 x86_64

Packages

• https://builds.altinity.cloud/

21.3 Altinity Stable with backports

Based on upstream/v21.3.20.1-lts

Changes Compared to Community Build 21.3.20.1-lts

• Bug Fix: Fixed a bug with accessing S3 buckets when the object URL contained '+' sign (ClickHouse#23822)
• Bug Fix: Fixed possible error 'Cannot read from istream at offset 0' when reading a file from DiskS3 (ClickHouse#24885)
• Improvement: Retries on HTTP connection drops in S3 (ClickHouse#22988)
• Improvement: Don't silently ignore errors and don't count delays in ReadBufferFromS3 (ClickHouse#27484)
• Not for changelog: fixed tests (ClickHouse#27176, ClickHouse#23976 ClickHouse#26249).

Via #113 (Vasily Nemkov).

Changes compared to Altinity Stable 21.3.17.3

Bug Fixes

• Integer overflow to resize the arrays causes heap corrupt. #33024 (Rajkumar Varada).
• fix crash when used fuzzBits with multiply same FixedString, Close #32737. #32755 (SuperDJY).
• Number of active replicas might be determined incorrectly when inserting with quorum if setting replicated_can_become_leader is disabled on some replicas. It's fixed. #32157 (tavplubix).
• Fix possible assertion ../src/IO/ReadBuffer.h:58: bool DB::ReadBuffer::next(): Assertion '!hasPendingData()' failed. in TSKV format. #31804 (Kruglov Pavel).
• Fix crash when function dictGet with type is used for dictionary attribute when type is Nullable. Fixes #30980. #31800 (Maksim Kita).
• Fix usage of Buffer table engine with type Map. Fixes #30546. #31742 (Anton Popov).
• Fix race in JSONEachRowWithProgress output format when data and lines with progress are mixed in output. #31736 (Kruglov Pavel).
• Settings input_format_allow_errors_num and input_format_allow_errors_ratio did not work for parsing of domain types, such as IPv4, it's fixed. Fixes #31686. #31697 (tavplubix).
• Remove not like function into RPNElement. #31169 (sundyli).
• Using formatRow function with not row formats led to segfault. Don't allow to use this function with such formats (because it doesn't make sense). #31001 (Kruglov Pavel).
• Functions for case-insensitive search in UTF8 strings like positionCaseInsensitiveUTF8 and countSubstringsCaseInsensitiveUTF8 might find substrings that actually does not match, it's fixed. #30663 (tavplubix).
• Fixed segfault which might happen if session expired during execution of REPLACE PARTITION. #30432 (tavplubix).
• Fix [I]LIKE function. Closes #28661. #30244 (Nikolay Degterinsky).
• FlatDictionary, HashedDictionary fix bytes_allocated calculation for nullable attributes. #30238 (Maksim Kita).
• Support nullable arguments in function initializeAggregation. #30177 (Anton Popov).
• Fix crash of sample by tuple(), closes #30004. #30016 (flynn).
• Fix concurrent access to LowCardinality during GROUP BY (leads to SIGSEGV). #29782 (Azat Khuzhin).
• Condition in filter predicate could be lost after push-down optimisation. #29625 (Nikolai Kochetov).
• Fix null deference for GROUP BY WITH TOTALS HAVING (when the column from HAVING wasn't selected). #29553 (Azat Khuzhin).
• Fix connection timeouts (send_timeout/receive_timeout). #29282 (Azat Khuzhin).
• Fix possible Table columns structure in ZooKeeper is different from local table structure exception while recreating or creating new replicas of ReplicatedMergeTree, when one of table columns have default expressions with case-insensitive functions. #29266 (Anton Popov).
• Fix segfault while inserting into column with type LowCardinality(Nullable) in Avro input format. #29132 (Kruglov Pavel).
• Fix the number of threads used in GLOBAL IN subquery (it was executed in single threads since #19414 bugfix). #28997 (Nikolai Kochetov).
• Fix invalid constant type conversion when nullable or lowcardinality primary key is used. #28636 (Amos Bird).
• Fix ORDER BY ... WITH FILL with set TO and FROM and no rows in result set. #30888 (Anton Popov).
• Fixed Apache Avro Union type index out of boundary issue in Apache Avro binary format. #33022 (Harry Lee).
• Fix null pointer dereference in low cardinality data when deserializing LowCardinality data in the Native format. #33021 (Harry Lee).
• Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31656 (sunny).
• Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31337 (sunny).
• Fix shutdown of AccessControlManager. Now there can't be reloading of the configuration after AccessControlManager has been destroyed. This PR fixes the flaky test test_user_directories/test.py::test_relative_path. #29951 (Vitaly Baranov).

Performance Improvements

• Improved performance of JSON and XML output formats. #31673 (alexey-milovidov).

Other Improvements

• Updated zoneinfo files to 2021c. #29925 (alexey-milovidov).
• Use real tmp file instead of predefined "rows_sources" for vertical merges. This avoids generating garbage directories in tmp disks. #28299 (Amos Bird).
• Use separate clickhouse-bridge group and user for bridge processes. Set oom_score_adj so the bridges will be first subjects for OOM killer. Set set maximum RSS to 1 GiB. Closes #23861. #25280 (Kseniia Sumarokova).

Test Results

• QA Software Build Report
• Altinity Test Reports for v21.3.20.2 x86_64

Packages

• https://builds.altinity.cloud/

21.8 Altinity Stable

Community build v21.8.13.6-lts, with customizations:

• Backport of ClickHouse#31823 to 21.8: Fix invalid cast of nullable type when nullable primary key is used (via #110)
• Various macOS compilation and packaging fixes/backporting (via #108)

You can find packages here:

• https://builds.altinity.cloud/

21.8.12 Altinity Stable

Same as community-build v21.8.12.29-lts

You can find packages here:

• https://builds.altinity.cloud/