Alien Top
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
mcmoose1900B to LocalLLaMA@poweruser.forumEnglish · 2 years ago

Nouse-Capybara-34B 200K

huggingface.co

external-link
message-square
16
link
fedilink
1
external-link

Nouse-Capybara-34B 200K

huggingface.co

mcmoose1900B to LocalLLaMA@poweruser.forumEnglish · 2 years ago
message-square
16
link
fedilink
NousResearch/Nous-Capybara-34B · Hugging Face
huggingface.co
external-link
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
alert-triangle
You must log in or register to comment.
  • mcmoose1900OPB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    Based on the 200K Context Yi 34B.

    https://i.redd.it/t914lpuyb80c1.gif

  • metalman123B
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    Can’t wait to see the benchmarks on these things.

  • vasileerB
    link
    fedilink
    arrow-up
    1
    ·
    2 years ago

    200K context!!

    • mcmoose1900OPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      Precisely 47K fits in 24GB at 4bpw.

      I have not tried 3.5, but I think it could be much more.

LocalLLaMA@poweruser.forum

localllama@poweruser.forum

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 4 users / 6 months
  • 3 local subscribers
  • 11 subscribers
  • 1.03K Posts
  • 5.96K Comments
  • Modlog
  • mods:
  • communick@poweruser.forum
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org