• panchovixB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Try at FP16 or 8bit at most, probably a 13B models suffers too much at 4bits.