I just switched to KoboldCpp from Text Geb UI 2 days ago.
The OpenAI extension wouldn’t install for me and it was causing issues with SillyTavern which I use as a frontend.
I’m actually really happy now that I’ve switched.
KoboldCpp is so simple is great. I’ve written a simple batch file to launch both KoboldCpp and SillyTavern. All I have to do if I want to try a new model is edit the part of the batch pointing to the name of the model and it just works.
On top of that I can load more layers onto my GPU with KoboldCpp than Text Gen UI so I’m getting faster speeds.
I just switched to KoboldCpp from Text Geb UI 2 days ago.
The OpenAI extension wouldn’t install for me and it was causing issues with SillyTavern which I use as a frontend.
I’m actually really happy now that I’ve switched.
KoboldCpp is so simple is great. I’ve written a simple batch file to launch both KoboldCpp and SillyTavern. All I have to do if I want to try a new model is edit the part of the batch pointing to the name of the model and it just works.
On top of that I can load more layers onto my GPU with KoboldCpp than Text Gen UI so I’m getting faster speeds.