feature/duplicate-granule-751 #4071
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…4066) * first commit - new PR * small fix * small addition * CHANGELOG + some other changes * fixing migration/indexes * removing index from add_table_indexes * fixing index * PR feedback * db schema pic update * index PR feedback * PR feedback * PR feedback - db schema
…4081) (#4082) * CI fix * changelog * sns fix * removing any type * pinning version * pinning all aws-sdk to 3.621 and also fixing lzards collection api issue * changing types to 3.609 and removing status from lzards reqs * fixing typo * update errorify to remove circular reference * unpinning versions * updated changelog for errorify * move errorify to errors package * using errors/errorify instead of api/errorify * re-adding status * mv errorify test to errors * fix lint additional errorify * test:ci * rename test file --------- Co-authored-by: Naga Nages <[email protected]>
…ranules (#4077) * CUMULUS-4147:duplicate detection function * update function result * add granule_group_id_seq and unit tests * fix lint simplify db patch * unit test no double array * doc rename function and type export type * unit test group_state check add export to db index * rename testfile * add test for invalid collection * add more tests
* CUMULUS-4254: Pin AWS-SDK version to circumvent circular JSON issue (#4081) * CI fix * changelog * sns fix * removing any type * pinning version * pinning all aws-sdk to 3.621 and also fixing lzards collection api issue * changing types to 3.609 and removing status from lzards reqs * fixing typo * update errorify to remove circular reference * unpinning versions * updated changelog for errorify * move errorify to errors package * using errors/errorify instead of api/errorify * re-adding status * mv errorify test to errors * fix lint additional errorify * test:ci * rename test file --------- Co-authored-by: jennyhliu <[email protected]> * CUMULUS-4241: Release 20.2.2 changelog (#4088) * changelog for release 20.2.2 * updating links at bottom * CUMULUS-4241: Changelog updates for 20.3.1 backport release to master (#4092) * changelog updates for 20.3.1 * changing links at bottom * Improve S3 permission error logging * Improve S3 permission error logging * Updated CHANGELOG.md * CUMULUS-4241: Release 21.0.1 back to master (#4095) * CUMULUS-4191: Update lambdas to filter rules based on provider in message (#4062) * CUMULUS-4191: Update lambdas to filter rules based on provider in message * add int test checking rule provider * add unit tests * add unit tests * remove serial * remove some comments * convert messageConsumer handler to new style * update changelog * PR feedback * CUMULUS-4252: Fix S3 unit test failures caused by stricter validation introduced in aws-sdk 3.896.0 (#4079) * fix test-multipartCopyObject failures caused by stricter validation introduced in aws-sdk 3.896.0 * update related unit tests * update changelog * remove unused import * Update lzards test client to use provider, add 'status' global to int… (#4080) * Update lzards test client to use provider, add 'status' global to int tests * Fix additional broken tests * Update CHANGELOG * Re-enable tests * Update tests to use collection param over metadata collection query * Fix unit tests * cherry-picking * CUMULUS-4254: Pin AWS-SDK version to circumvent circular JSON issue (#4081) * CI fix * changelog * sns fix * removing any type * pinning version * pinning all aws-sdk to 3.621 and also fixing lzards collection api issue * changing types to 3.609 and removing status from lzards reqs * fixing typo * update errorify to remove circular reference * unpinning versions * updated changelog for errorify * move errorify to errors package * using errors/errorify instead of api/errorify * re-adding status * mv errorify test to errors * fix lint additional errorify * test:ci * rename test file --------- Co-authored-by: jennyhliu <[email protected]> * updating version number * upating links at bottom --------- Co-authored-by: jennyhliu <[email protected]> Co-authored-by: Jonathan Kovarik <[email protected]> Co-authored-by: jennyhliu <[email protected]> * CUMULUS-4032 Reduce S3 Slowdown error messages in SyncGranules (#4084) * add s3-jitter to packages * apply s3-jitter to common s3 functions * add s3-jitter tf variable * add s3-jitter tests * add s3-jitter to changelog * fix eslint errors * add s3-jitter integration tests * fix eslint errors * fix failing CI unit test * fix failing CI unit test 2 * remove log for S3 jitter disabled * apply jitter to getObjectSize, remove comment * removed sleep --------- Co-authored-by: Tim Clark <[email protected]> * Added test for 401 * Added specific check for 401 status code * CUMULUS-4275: Fix unit tests broken by updated HTTP error messages in got (#4102) * fix send-pan unit test http error * fix test-HttpsProviderClient ci unit test * CUMULUS-3574:write all files for a granule in a single batch (#4101) * CUMULUS-3574:write all files for a granule in a single batch * lint * fix payload * update changelog * add test for empty files * update writeGranulesFromMessage perf unit test * PR template * update changelog * fix test-HttpsProviderClient ci unit test --------- Co-authored-by: Naga Nages <[email protected]> Co-authored-by: Curtis Banh <[email protected]> Co-authored-by: Curtis Banh <[email protected]> Co-authored-by: Jonathan Kovarik <[email protected]> Co-authored-by: Tim Clark <[email protected]> Co-authored-by: Tim Clark <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary: Summary of changes
Addresses CUMULUS-XX: Develop amazing new feature
Changes
PR Checklist