Update server.cpp with min_p after it was introduced in #3841 #3877
Conversation
|
I think it works? While testing I realized that the "show probabilities" feature is totally bonkers. It not only shows only the split between the configured probabilities, and thus making 1 show 100% all the time, it also forces to have atleast N samples at sampling time -> if 2nd token has a 1% probability, it can still be picked, even with "you need to be at least 90%" min p.... |
... after first 4 samplers and penalties that are enabled by default |
|
@Green-Sky Can you show an example? It seems the "show probabilities" works fine (testing on
|
|
I disable everthing else: top-k to 0, top-p to 1.0 and since temp is applied after min-p and the other samplers, i set it to 1.0.
|
* Update server.cpp with min_p after it was introduced in ggml-org#3841 * Use spaces instead of tabs * Update index.html.hpp after running deps.sh * Fix test - fix line ending
5 participants
Update server code after #3841 was merged.