NousResearch/Nous-Capybara-34B · Hugging Face
huggingface.co
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
    • mcmoose1900OPBEnglish
      1·
      10 months ago

      Precisely 47K fits in 24GB at 4bpw.

      I have not tried 3.5, but I think it could be much more.