feat: Allow COPY and CREATE STAGE from public read buckets without credentials

[Xuanwo]

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

feat: Allow COPY and CREATE STAGE from public read buckets without credentials

This PR will make the following query works:

COPY INTO ontime_mini FROM 's3://repo.databend.rs/dataset/stateful/ontime_2006_100000.csv' 
    FILE_FORMAT = ( type = 'CSV' field_delimiter = ',' record_delimiter = '\n' skip_header = 1 );

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Updated
databend	⬜️ Ignored (Inspect)		Jul 14, 2022 at 6:39AM (UTC)

[BohuTANG]

Can we add a stateful test for it with minio?

[Xuanwo]

Can we add a stateful test for it with minio?

We will continue those work after #6599

I plan to introduce better and fine-grained stateful test cases that covers all COPY and STAGE related cases.