New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Temperature slider not working #6676
Comments
I did a few tests and it seems the slider does do something. If i set it to zero the output is the same every time. If I set to 2 the output is always different. So I think recently the behavior of the temperature slider was toned down. I'll try to tweak the javascript in the frontend files to increase it past 2. |
Reopening this issue as even using the API directly, which allows for any arbitrary value, the response from server.exe is still coherent even at temperature=100:
Response:
|
Tried in version b2671. The temperature slider doesn't seem to do anything no matter the model, even when cranked all the way to 2 which should produce gibberish but the model behaves coherently instead. All other frontend params are set to default using the button on the top.
.\bin\server.exe --model .\mistral-7b-instruct-v0.2.Q4_0.gguf --ctx-size 2048 --n-gpu-layers 99 --log-disable --path .\frontend
The frontend folder is also updated to the latest as of today in examples/server/public.
The text was updated successfully, but these errors were encountered: