• a_beautiful_rhindB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    From the issue about this in the exllamav2 repo, quip was using more memory and slower than exl. How much context can you fit?