• a_beautiful_rhindB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Text Generation UI as the backend and sillytavern as the front end.

    KoboldCPP where proper transformers/cuda isn’t supported.

    • iChristB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Yep pretty good combo! I also use ooba+Silly and for internet query and pdf ingestion I use LolLLMs Great stuff!