Amazon has the Acer A770 on sale for $250. That’s a lot of compute with 16GB of VRAM for $250. There is no better value. It does have it’s challenges. Somethings like MLC Chat run with no fuss just like on any other card. Other things need some effort like Oob, Fastchat and BigDL. But support for it is getting better and better everyday. At this price, I’m tempted to get another. I have seen some reports of running multi-GPU setups with the A770.
It also comes with Assassins Mirage for those people that still use their GPUs to game.
With Oob, I’ve tried, but haven’t been successful. But I wasn’t successful getting it to work with my 2070 either months ago. I gave up on it, switched to llama.cpp and didn’t look back. Until now. So I have tried getting it to work with the A770. But as pointed out in the discussion, there’s that issue. But I haven’t tried the workaround posted a couple of days ago.