error[cxxbridge]: unsupported type: char
┌─ tokenizers-cpp/pre_tokenizers.rs:56:52
│
56 │ fn char_delimiter_pre_tokenizer(delimiter: char) -> Box<PreTokenizer>;
│ ^^^^ unsupported type
Is the reason that some u32 values are not valid chars? If so, this could be specified in the error message.