I’m having some trouble getting good results with an Exl2 4 bpw model. Is it simply worse than GPTQ 4 bit or maybe there’s something wrong I’m doing?
You must log in or register to comment.
I’m having some trouble getting good results with an Exl2 4 bpw model. Is it simply worse than GPTQ 4 bit or maybe there’s something wrong I’m doing?