Looking for any model that can run with 20 GB VRAM. Thanks!

  • flossraptorB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    For some people “uncensored” means it hasn’t been lobotomized, but for others it means it can write porn.

  • nero10578B
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Wonder what card you have that’s 20GB?

  • AbsorbingCrocodileB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    That’s actually so funny, the 2 times I’ve asked this before, I get downvoted to shit.

  • Herr_DrosselmeyerB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    What are you looking for?

    With a 3090, you can run any 13b model in 8 bit, group size 128, act order true, at decent speed.

    Go-tos for the more spicy stuff would be Mythomax and Tie fighter.

  • BlueMetaMindB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Best experience I had was with TheBloke/Wizard-Vicuna-30B- Uncensored-GGML

    Best 30B llm so far in general. Censorship kill’s capabilities