Alien Top
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Dry_Long3157B to LocalLLaMA@poweruser.forumEnglish · 1 year ago

Error while loading deepseek 67b gguf on ooba

message-square
message-square
1
fedilink
1
message-square

Error while loading deepseek 67b gguf on ooba

Dry_Long3157B to LocalLLaMA@poweruser.forumEnglish · 1 year ago
message-square
1
fedilink

Hey,

I’m trying to load TheBloke/deepseek-llm-67b-chat-GGUF 4_K_M with the llama.cpp loader and I keep running into this error. Please let me know how to fix. TIA.

https://preview.redd.it/4qymemytpb3c1.png?width=889&format=png&auto=webp&s=ee97cbe31b3625ef9b1bcc21ba74407a90651f8d

LocalLLaMA@poweruser.forum

localllama@poweruser.forum

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 1 user / week
  • 1 user / month
  • 1 user / 6 months
  • 3 local subscribers
  • 3 subscribers
  • 1.02K Posts
  • 5.96K Comments
  • Modlog
  • mods:
  • communick@poweruser.forum
  • BE: 0.19.5
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org