With high-end Android phones now packing upwards of 24GB of RAM, I think there’s huge potential for an app like this. It would be amazing to have something as powerful as the future Mistral 13B model running natively on smartphones!

You could interact with it privately without an internet connection. The convenience and capabilities would be incredible.

  • GermanK20B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Well, I’ve just tested a few models for my workflows and found out only 70B cuts it.

    • Winter_Tension5432OPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      For now, but you will have 13b models as good as 70b models by the end of next year.