Quotation denormalization#203

Merged

benjaminking merged 31 commits intomainfrom

quotation_denormalization

Aug 1, 2025

Commits on Jul 22, 2025

Some tests pass

johnml1135
authored and
Ben King
committed
Added more test framework

johnml1135
authored and
Ben King
committed
Basic implementation and tests for quote convention detection
Ben King
committed
Initial working version of quotation denormalization
Ben King
committed
I want to process the data in segments that correspond to individual translations. These updates make it happen.

johnml1135
authored and
Ben King
committed
Updates for reviewer comments

johnml1135
authored and
Ben King
committed
Respond to reviewer comments

johnml1135
authored and
Ben King
committed
Additional denormalization tests (not all passing)
Ben King
committed
Rebase + additional denormalization tests
Ben King
committed
Improved handling for NLLB-produced quote errors
Ben King
committed
Unit tests for basic quotation mark resolver
Ben King
committed
Unit tests for UsfmStructureExtractor
Ben King
committed
Unit tests for several quotation mark analysis classes
Ben King
committed
Fix a bug related to verse markers before quotation marks
Ben King
committed
Refactoring to allow arbitrary quote convention changes + more unit tests
Ben King
committed
Remaining unit tests
Ben King
committed
Change update_usfm_parser_handler.py to match main branch
Ben King
committed
Fix linting for test_quote_convention_detector.py
Ben King
committed
Address reviewer comments + refactor
Ben King
committed
Correct TextSegment equality function
Ben King
committed
Damien's requested code-review changes
Ben King
committed
Eli's requested code-review changes
Ben King
committed
One code review change that was left out of the previous commit
Ben King
committed
Fixes for Eli's hopefully final code review comments
Ben King
committed
Fix typing issue in tests for QuotationMarkUpdateFirstPass
Ben King
committed
Bug fix for multi-character quotation marks
Ben King
committed
Use is_at_start_of_segment for consistency
Ben King
committed
Include analysis details in QuoteConventionAnalysis
Ben King
committed

Commits on Jul 25, 2025

Better guesses for ambiguous quotation marks + quote continuer edge case fix
Ben King
committed

Commits on Jul 30, 2025

Code review changes requested for tests
Ben King
committed

Commits on Jul 31, 2025

Fix fallback denormalization logic + line endings in a test
Ben King
committed