You must log in or register to comment.
Based on the 200K Context Yi 34B.
Can’t wait to see the benchmarks on these things.
200K context!!
Precisely 47K fits in 24GB at 4bpw.
I have not tried 3.5, but I think it could be much more.
Based on the 200K Context Yi 34B.
Can’t wait to see the benchmarks on these things.
200K context!!
Precisely 47K fits in 24GB at 4bpw.
I have not tried 3.5, but I think it could be much more.