bug: the romanize function removes spaces from results

[free-bug]

Description

Version: "5.1.1"

from pythainlp.transliterate import romanize

print(romanize("สามารถ สามารถ", "thai2rom"))

Expected output: samat samat

Received output: samatsamat

Expected results

Function romanize shouldn't remove spaces if source string contains them.

Current results

Function romanize removes spaces from result string if source string contains them.

Steps to reproduce

Just run code from the description.

PyThaiNLP version

5.1.1

Python version

3.12.7

Operating system and version

Ubuntu 24.10

More info

Host system, docker wasn't used for this case.

Possible solution

No response

Files

No response

[github-actions]

Hello @free-bug, thank you for your interest in our work!

If this is a bug report, please provide screenshots and minimum viable code to reproduce your issue, otherwise we can not help you.

สวัสดี @free-bug ขอบคุณที่สนใจงานของเรา

ถ้านี่เป็นรายงานข้อผิดพลาด กรุณาแนบภาพหน้าจอ ข้อความแสดงข้อผิดพลาด และ โค้ดที่สั้นที่สุดเท่าที่จะทำให้เกิดปัญหา เพื่อที่เราจะสามารถช่วยเหลือได้

[wannaphong]

Thank you for reporting!

It isn't bug. romanize function support a word only. We will update the romanize docs.

Sorry for the documentation.

[free-bug]

@wannaphong Didn't know that. Thank you.

[bact]

It isn't bug. romanize function support a word only. We will update the romanize docs.

This is up to an implementation.

pythainlp.transliterate.royin.romanize() does support multiwords input.
BUT it also has this bug.

from pythainlp.transliterate import romanize

romanize("สามารถ สามารถ", "royin")

Got "samantsamant", also no word delimiter.

[wannaphong]

It isn't bug. romanize function support a word only. We will update the romanize docs.

This is up to an implementation.

pythainlp.transliterate.royin.romanize() does support multiwords input.
BUT it also has this bug.

from pythainlp.transliterate import romanize

romanize("สามารถ สามารถ", "royin")

Got "samantsamant", also no word delimiter.

It's from https://github.com/PyThaiNLP/pythainlp/blob/dev/pythainlp/transliterate/core.py line 90 but it isn't for tokenize word. It's used to inputs word that split syllables by space from other syllable tokenizer. Or we should change this?