Start PyThaiNLP v3.1.0-dev0

[wannaphong]

This is the first development release for PyThaiNLP v3.1.

You can install by pip install --pre pythainlp==3.1.0.dev0.

Documentation: https://pythainlp.github.io/dev-docs/

Report bug: https://github.com/PyThaiNLP/pythainlp/issues

See PyThaiNLP 3.1 change log

See 3.1 Milestone.

What is new?

Deprecation and other API changes

#687 Remove deprecated function

• pythainlp.word_vector; doesnt_match, get_model, most_similar_cosmul, sentence_vectorizer, similarity. use WordVector class instead
• pythainlp.util.delete_tone. use pythainlp.util.remove_tonemark instead
• Remove pythainlp.util.time_time. use pythainlp.util.time_to_thaiword instead
• pythainlp.tokenize.syllable_tokenize. use pythainlp.tokenize.subword_tokenize instead

Name Entity Tagging

• Add Thai-NNER #665 Add Thai-NNER pythainlp.tag.NNER
• Add LST20NER onnx model #658 Add LST20NER onnx model. It is LST20NER model to onnx model from fine-turning by WangchanBERTa model.

Transliteration

• Add ISO 11940 transliteration #659 Add ISO 11940 transliteration
• Add Thai W2P v0.2 and PyThaiNLP v3.0.6dev0 #660 Add Thai W2P v0.2
• Add wunsen #686 Add wunsen

PyThaiNLP Corpus downloader

• Add support zip/tar.gz to download corpus #656 Add support zip/tar.gz to download corpus

Text normalization

• Normalise Lakkhangyao #673 Add a normalising rule for Lakkhangyao ๅ

Translate

• add gpu option #674 add gpu option

Text summarize

• Add mt5 cpe kmutt thai sentence sum #679 Add mt5 cpe kmutt thai sentence sum

Util

• Add live-dead syllable classification #682 Add live-dead syllable classification
• Add live dead syllable classify #684 Add live dead syllable classify
• Add tone detector #690 Add tone detector

Other

• map NG tag to PART #689 map NG tag to PART
• Remove TinyDB as a dependency #691 Remove TinyDB as a dependency
• Fix notifications that newer versions of corpora are available #692 Fix notifications that newer versions of corpora are available

Contributors

Thanks all the contributors. (Image made with contributors-img)

[sonarqubecloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
0.0% Duplication

[coveralls]

Coverage remained the same at 95.618% when pulling 4862cf1 on 3.1 into 9124ab3 on dev.