Support for piper models

[danemadsen]

It would be helpful to add support for piper models into bark.cpp

there is already a c++ library for piper but it is difficult to compile and does not work well cross platform. Piper is currently running on the onnx runtime.

https://github.com/rhasspy/piper

[PABannier]

Hi @danemadsen ! The piper model looks indeed really nice. Would you like to try to implement it? I'm happy to guide you in the process.

[danemadsen]

Hi @danemadsen ! The piper model looks indeed really nice. Would you like to try to implement it? I'm happy to guide you in the process.

Haha, I'd love to help implement it but I'm afraid I'm not educated on the topic to be able to pull it off.

I've looked into vits.cpp (an incomplete GGML implementation of vits / piper models) , it compiles but crashes instantly.

My understanding is the main challenge of a vits implementation will be finding a way to handle phonemization without using espeak-ng.

I'm wanting an implementation without espeak-ng as I'm wanting to use a vits model in my llama.cpp android frontend maid and espeak-ng struggles to compile for android.

Thanks for any advice.

[lumpidu]

How about implementing a version of https://github.com/lingjzhu/CharsiuG2P ? This is a G2P model for 100 languages. License is MIT. Certainly a bigger canoon than espeak-ng, though :)