• Majestical-psycheOPB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Sorry I was playing around with it for the last day… So far I prefer it over 34B Dolphin Yi (GGUF Q4_K_m)… As for context size I only used 8k and it was pretty good with going far back. It might be able to do 12K, idk… Haven’t tried it.