-
Notifications
You must be signed in to change notification settings - Fork 89
Updated commit hash in ceph tests #9152
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
WalkthroughThe changes update the Ceph S3 test configuration to include new IAM-related sections and keys, adjust the setup scripts to use placeholder substitution for access/secret keys via Changes
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~40 minutes Possibly related PRs
Suggested labels
Suggested reviewers
Note ⚡️ Unit Test Generation is now available in beta!Learn more here, or try it out under "Finishing Touches" below. 📜 Recent review detailsConfiguration used: .coderabbit.yaml 📒 Files selected for processing (10)
✅ Files skipped from review due to trivial changes (2)
🚧 Files skipped from review as they are similar to previous changes (7)
🧰 Additional context used📓 Path-based instructions (1)src/test/**/*.*⚙️ CodeRabbit Configuration File
Files:
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (3)
✨ Finishing Touches
🧪 Generate unit tests
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
SupportNeed help? Create a ticket on our support page for assistance with any issues or questions. Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
Documentation and Community
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 3
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (3)
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
(2 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
(1 hunks)
📓 Path-based instructions (1)
src/test/**/*.*
⚙️ CodeRabbit Configuration File
src/test/**/*.*
: Ensure that the PR includes tests for the changes.
Files:
src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
🧰 Additional context used
📓 Path-based instructions (1)
src/test/**/*.*
⚙️ CodeRabbit Configuration File
src/test/**/*.*
: Ensure that the PR includes tests for the changes.
Files:
src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (2)
- GitHub Check: Build Noobaa Image
- GitHub Check: run-jest-unit-tests
🔇 Additional comments (4)
src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh (1)
20-20
: Validated new CEPH_TESTS_VERSION hash
- The commit aafacab2017bec1dd1ce3159105455bb7e9447b1 exists in the ceph/s3-tests repository on master.
- It is only 4 days old, well within the 600-day limit.
No further changes required.
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js (1)
95-96
: Good improvement in credential injection consistency.The change from appending keys to replacing placeholders using
sed
improves consistency and aligns well with the updated config file structure. The OS-specific handling for macOS is correctly implemented.Also applies to: 101-102
src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf (2)
22-28
: LGTM: IAM naming configuration added.The new IAM naming prefixes support the enhanced IAM functionality mentioned in the PR objectives.
62-63
: LGTM: Tenant name configuration added.The tenant field addition supports enhanced tenant testing capabilities.
eb679ea
to
39279b8
Compare
e59a8e5
to
2c0d694
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
🧹 Nitpick comments (2)
src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt (2)
435-471
: Collapse the bucket-logging suite with a wildcard entryLines 435-471 list 37 separate
test_bucket_logging_*
cases.
If the blacklist parser accepts pytest-style globs, replace them with one line:s3tests_boto3/functional/test_s3.py::test_bucket_logging*
This keeps the file short and automatically covers new variants that may appear.
426-434
: Wildcard the checksum tests to avoid future omissionsThe checksum-related tests (426-434) could similarly be collapsed to:
s3tests_boto3/functional/test_s3.py::test_*checksum*
Should more checksum variants be added upstream, they will be blacklisted automatically.
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (10)
docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
(2 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
(1 hunks)
✅ Files skipped from review due to trivial changes (2)
- src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
🚧 Files skipped from review as they are similar to previous changes (7)
- docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
- src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
🧰 Additional context used
📓 Path-based instructions (1)
src/test/**/*.*
⚙️ CodeRabbit Configuration File
src/test/**/*.*
: Ensure that the PR includes tests for the changes.
Files:
src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
2c0d694
to
8ed1709
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's quite a lot of black listed tests.
Is there a recurring pattern in their failure?
Also, I see that tests still failing.
Annoyingly, I am unable to get the log of the run, it's too long and Chrome hangs.
8ed1709
to
063231c
Compare
|
063231c
to
869ca67
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
♻️ Duplicate comments (1)
src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt (1)
47-50
: Duplicate test entries – issue already raised earlierThe four
TestFileValidator
/TestFiles
items at Lines 47-50 already exist (see Lines 283-286).
They should appear only once in the blacklist.Because this exact problem was pointed out in the previous review and still persists, I’m tagging this as a duplicate remark.
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (10)
docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
(2 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
(2 hunks)
✅ Files skipped from review due to trivial changes (1)
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
🚧 Files skipped from review as they are similar to previous changes (7)
- src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
- docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
- src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
🧰 Additional context used
📓 Path-based instructions (1)
src/test/**/*.*
⚙️ CodeRabbit Configuration File
src/test/**/*.*
: Ensure that the PR includes tests for the changes.
Files:
src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (3)
- GitHub Check: Build Noobaa Image
- GitHub Check: run-jest-unit-tests
- GitHub Check: run-package-lock-validation
🔇 Additional comments (1)
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt (1)
352-437
: Sorted and Deduplicated s3_tests_black_list.txt
- The file
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
has been run throughsort -u
, integrating the appended block into the main body.- Verified with a duplicate check script: no duplicate entries remain.
File is now alphabetically sorted, unique, and in a single canonical form.
src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
Show resolved
Hide resolved
869ca67
to
b5dcd74
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 1
🔭 Outside diff range comments (1)
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt (1)
1-437
: De-duplicate s3_tests_black_list.txt entriesFound the following duplicate lines in
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt:• test_realistic/TestFileValidator.py::test_new_file_is_valid
• test_realistic/TestFileValidator.py::test_new_file_is_valid_on_several_calls
• test_realistic/TestFileValidator.py::test_new_file_is_valid_when_size_is_1
• test_realistic/TestFiles/test_random_file_validThese duplicates:
- Add noise to diffs
- Risk diverging comments/reasons if metadata is added later
- Indicate that list maintenance is error-prone
Please remove the repeated lines and add a CI check to prevent future duplicates. For example:
#!/bin/bash set -e dups=$(sort src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt | uniq -d) if [ -n "$dups" ]; then echo "❌ Duplicate entries found:" >&2 echo "$dups" >&2 exit 1 fi echo "✅ No duplicates."[file to fix]
• src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (10)
docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
(2 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
(1 hunks)src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
(2 hunks)
✅ Files skipped from review due to trivial changes (1)
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_pending_list.txt
🚧 Files skipped from review as they are similar to previous changes (8)
- src/test/external_tests/ceph_s3_tests/test_ceph_s3.js
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_pending_list.txt
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_deploy.sh
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/s3-tests-lists/nsfs_s3_tests_black_list.txt
- docs/dev_guide/ceph_s3_tests/ceph_s3_tests_pending_list_status.md
- src/test/external_tests/ceph_s3_tests/test_ceph_nsfs_s3_config_setup.js
- src/test/external_tests/ceph_s3_tests/test_ceph_s3_config.conf
🧰 Additional context used
📓 Path-based instructions (1)
src/test/**/*.*
⚙️ CodeRabbit Configuration File
src/test/**/*.*
: Ensure that the PR includes tests for the changes.
Files:
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
🔇 Additional comments (1)
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt (1)
365-371
: Overlap with pending lists – ensure tests are not excluded twiceTests such as
test_bucket_policy_multipart
andtest_bucket_policy_tenanted_bucket
were just black-listed, but they were also moved to pending in the same PR according to the description.
A test should live in exactly one list; otherwise it is unclear whether it is being skipped for “known failure” or “under investigation”.
Please cross-checks3_tests_pending_list.txt
andnsfs_s3_tests_pending_list.txt
for duplicates before merging.
src/test/external_tests/ceph_s3_tests/s3-tests-lists/s3_tests_black_list.txt
Show resolved
Hide resolved
b5dcd74
to
e47cc28
Compare
… list Signed-off-by: Aayush <[email protected]>
e47cc28
to
d02507b
Compare
Describe the Problem
After updating the ceph commit hash, s3 tests were failing for both NSFS and non-NSFS configurations. The failures were caused by missing required configuration fields that the updated ceph test suite expects.
Explain the Changes
nsfs-ceph-s3 output:
ceph-s3 output:
GAP: There are more ceph-tests (regression) which are failing and moved to pending list, but not sure about the root cause need to investigate.
Issues: Fixed #xxx / Gap #xxx
Testing Instructions:
make test-cephs3
andmake test-nsfs-cephs3
Summary by CodeRabbit
Summary by CodeRabbit
New Features
Chores
Documentation