Isn't StatelessExecutor missing eos check?

[Camel-RD]

I tried to use StatelessExecutor and it looks like it is producing more text when it should have stopped. And i could not find check for eos token in StatelessExecutor source.

[martindevans]

Yes it is.

Ideally the antiprompt system would handle this (i.e. you could just add <eos> to the antiprompts). However, that doesn't actually work because the antiprompts work entirely in text (not tokens) and there is no text for an EOS token!

I'll have a look at adding an explicit EOS check in somewhere.