Very good, it now works for me too.
Indeed, special characters and German umlauts are transmitted webcoded, but apparently this does not bother the AI very much.
Thanks idle, for the libs and your effort!
The calculation with the model I use "ggml-model-gpt4all-falcon-q4_0" (about 4 GB) runs amazingly fast. i don't have to wait much longer than with chatgptx on the web.
It's a pity that today is the day when I have to prepare my tax return, otherwise I would have dealt with it more intensively right away. I would first see if one can do it without the web server.
PB 6.12 x64, OS: Win 11 24H2 x64, Desktopscaling: 150%, CPU: I7 12700 H, RAM: 32 GB, GPU: Intel(R) Iris(R) Xe Graphics | NVIDIA GeForce RTX 3070, User age in 2025: 57y "Happiness is a pet." | "Never run a changing system!"
@Kurzer
It's easy enough to remove the web server part, I ran it for an evening in place of the yacht clubs race server. It was quite amusing.. watching the writing on the wall