Skip to content

Conversation

alesapin
Copy link
Member

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Removed experimental send_metadata logic related to experimental zero-copy replication. It wasn't ever used and nobody supports this code. Since there were even no tests related to it, there is a high chance that it's broken long time ago.

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

Copy link

clickhouse-gh bot commented Jun 24, 2025

Workflow [PR], commit [80de4fc]

Summary:

@clickhouse-gh clickhouse-gh bot added the pr-improvement Pull request with some product improvements label Jun 24, 2025
@kssenii kssenii self-assigned this Jun 24, 2025
@alexey-milovidov
Copy link
Member

alexey-milovidov commented Jun 24, 2025

Thanks!

The main reason is to fix the architectural problem in the implementation of "root_path" for disks. The right way to do it is to make sure the "root_path" is not exposed in the disk's interface, and the disks with different "chroots" have the same interface.

When people implemented "send_metadata" they messed up with the interface, preventing clean architecture.

@alesapin
Copy link
Member Author

alesapin commented Jun 25, 2025

> The main reason is to fix the architectural problem in the implementation of "root_path" for disks
What exactly do you mean? If it's getPath() method, than I agree that it looks weird. However it was introduced together with IDisk interface and used widely across our codebase :(. How is it related to send_metadata?

@alesapin alesapin added this pull request to the merge queue Jun 25, 2025
Merged via the queue into master with commit af81fee Jun 25, 2025
121 checks passed
@alesapin alesapin deleted the remove_zero_copy_metadata branch June 25, 2025 15:11
@robot-ch-test-poll3 robot-ch-test-poll3 added the pr-synced-to-cloud The PR is synced to the cloud repo label Jun 25, 2025
@alexey-milovidov
Copy link
Member

alexey-milovidov commented Jun 25, 2025

Alexey Milovidov
Feb 20th at 21:43
virtual std::string getCommonKeyPrefix() const = 0;
Missing comments.
It's strange to have this method - the "chroot" should be not exposed from Object Storage.

Kseniia
Feb 20th at 22:39
It’s strange to have this method - the “chroot” should be not exposed from Object Storage.
I agree, I can try to remove it from everywhere.
Its exposure from object storage started because of DiskObjectStorageRemoteMetadataRestoreHelper (I would vote for deleting this code btw, I think it does not make sense to have now that we have plain-rewritable disk).

Alexey Milovidov
Feb 20th at 22:47
Yes, let's do it. We can start with deleting the "metadata restore" feature, then get rid of getCommonKeyPrefix as well.

Alexey Milovidov
Apr 23rd at 13:51
Yes, let’s remove this code and reorganize.
julia.kartseva found a bug related to “getCommonKeyPrefix”

julia.kartseva
This method is used to set the chroot for plain disks' metadata, as the metadata is stored in the object storage.
Also, chroot is exposed in some of our system tables, e.g., system.disks and system.tables: ...

Alexey Milovidov
Apr 24th at 10:24
It’s a matter of code organization, so chroot is encapsulated, and the users of the interfaces use abstracted paths.

Alexey Milovidov
Jun 7th at 01:00
Kseniia, let's finish removing the exposure of chroot from disks and send_metadata feature! Thank you

baibaichen pushed a commit to Kyligence/gluten that referenced this pull request Jun 26, 2025
baibaichen pushed a commit to Kyligence/gluten that referenced this pull request Jun 27, 2025
baibaichen pushed a commit to Kyligence/gluten that referenced this pull request Jun 28, 2025
baibaichen pushed a commit to Kyligence/gluten that referenced this pull request Jun 29, 2025
baibaichen pushed a commit to apache/incubator-gluten that referenced this pull request Jun 29, 2025
* [GLUTEN-1632][CH]Daily Update Clickhouse Version (20250629)

* Fix Build due to ClickHouse/ClickHouse#80931

* Fix Build due to ClickHouse/ClickHouse#81976

* Fix Build due to  ClickHouse/ClickHouse#82508

* Try to Fix issue caused by ClickHouse/ClickHouse#81754

see ClickHouse/ClickHouse#82379

* Fix UT due to ClickHouse/ClickHouse#82358

---------

Co-authored-by: kyligence-git <[email protected]>
Co-authored-by: Chang chen <[email protected]>
@alexey-milovidov alexey-milovidov mentioned this pull request Jul 13, 2025
76 tasks
zvonand pushed a commit to Altinity/ClickHouse that referenced this pull request Aug 31, 2025
…metadata

Remove send_metadata logic related to zero-copy replication
zvonand pushed a commit to Altinity/ClickHouse that referenced this pull request Sep 2, 2025
…metadata

Remove send_metadata logic related to zero-copy replication
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-improvement Pull request with some product improvements pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants