Amazon has the Acer A770 on sale for $250. That’s a lot of compute with 16GB of VRAM for $250. There is no better value. It does have it’s challenges. Somethings like MLC Chat run with no fuss just like on any other card. Other things need some effort like Oob, Fastchat and BigDL. But support for it is getting better and better everyday. At this price, I’m tempted to get another. I have seen some reports of running multi-GPU setups with the A770.
It also comes with Assassins Mirage for those people that still use their GPUs to game.
It’s just the normal OpenCL and Vulkan compile flags. So “make LLAMA_CLBLAST=1” and “make LLAMA_VULKAN=1”. You will have to download the Vulkan PR for Vulkan. Bu as I said, it’s painfully slow. Like slower than the CPU. So not worth it. Both are equally as slow so there seems to be something in common that is not A770 friendly. Although I haven’t tried Vulkan in a couple of weeks so that might be better. I even tried giving it the Intel specific OpenCL more than 4GB option but that didn’t make any difference at all.