So far, I have experimented with the following projects:

https://github.com/huggingface/chat-ui - Amazing clean UI with very good web search, my go to currently.

https://github.com/oobabooga/text-generation-webui - Best overall, supports any model format and has many extensions

https://github.com/ParisNeo/lollms-webui/ - Has PDF, stable diffusion and web search integration

https://github.com/h2oai/h2ogpt - Has PDF, Web search, best for files ingestion (supports many file formats)

https://github.com/SillyTavern/SillyTavern - Best for custom characters and roleplay

https://github.com/NimbleBoxAI/ChainFury - Has great UI and web search (experimental)

https://github.com/nomic-ai/gpt4all - Basic UI that replicated ChatGPT

https://github.com/imartinez/privateGPT - Basic UI that replicated ChatGPT with PDF integration

LM Studio - Clean UI, focuses on GGUF format

-

Really love them and wondering if there are any other great projects,

Some of them include full web search and PDF integrations, some are more about characters, or for example oobabooga is the best at trying every single model format there is as it supports anything.

What is your favorite project to interact with your large language models ?

Share your findings and il add them!

      • XhoniShollajB
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Thank you - I submitted a pull request to add it there. Hopefully gets approved. Let me know if there are other lists you would like me to add it to.

      • XhoniShollajB
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Actually will need 30 more days to get approved. Feel free to contribute additional projects to it at the meantime :)!

      • itsuka_dev
        cake
        B
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        I have two kind of lists, one for OpenAI API-powered UIs (source, last updated this July), and another for one for local UIs (I’ll update this with the list from XhoniShollaj). I feel like a better organization is needed, e.g. whether the UI is open source or not, model backend and architecture, differentiating feature, etc. Otherwise, the list is impossible to navigate (at least for me).

        • XhoniShollajB
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Thats a very neat layout u/itsuka_dev - love your project. I think we can keep both at the meantime (I want to add my mine to other Awesome lists for more exposure) - let me know what breakdown makes more sense from your end so I can improve my repo.

          • itsuka_dev
            cake
            B
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            Thank you for the kind words! I stopped maintaining OAI UIs because things got a bit stagnant a few months ago (there were literally no new UIs for weeks, I think). But with the new features announced at DevDay, I’m expecting to see a surge in new UIs, especially those that leverages multi-modality. As a maintainer of list projects, this is such an exciting time.

            I think we can keep both at the meantime

            Absolutely. Someone needs to maintain an awesome list for local UIs, and I don’t think my projects fall into that category. Besides, my list got a mix of native UIs in there too, which is important to me since I’m building both web and native UIs.

            let me know what breakdown makes more sense from your end

            For local UIs, sorting/grouping by model backend (e.g. llama.cpp, ollama, ExLlama) makes the most sense, IMO - and the rest of what I mentioned above is optional.

  • itsuka_dev
    cake
    B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    What is your favorite project to interact with

    I still don’t have a favorite, tbh. I’ve tried a few of the UIs you shared, and I found them to be either too complicated or lacking in certain areas I need. Like many others, I ended up building my own.

    Share your findings

    Recently, I started collecting local UIs and this is what I’ve gathered so far: UI list.

  • faldoreB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    How chat-ui local? Last I tried they still require mongo.

    • iChristOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I had some struggles with it, it works best for me in combination with llamacpp, and you need to run a docker command to start a mongo DB for you chats locally.

      Even the search results can be queried on your device instead of API.

  • No-Belt7582B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I use kobold cpp for local llm deployment. It’s clean, it’s easy and allows for sliding context. Can interact with drop in replacement for OpenAI.

  • mcmoose1900B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    No exui?

    https://github.com/turboderp/exui

    Its blazing fast, vram efficient, supports minp and has a notebook mode… what else could I ask for.

    I was using ooba before, but I have dumped it because its so much slower.

    • FPhamB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      That looks very clean for sure.