Sorry for the noob question. I’m building out a new server and as I love playing with new tech, I thought I would throw in a GPU so I can try learn to integrate AI with things like Private GPT, document generation, meeting transcription, maybe some integrations with Obsidian, or even Home Assistant for automation. I like the idea of it being able to crawl all my information and offer suggestion, rather than me having to copy and paste snippets as I do now with Chat GPT. I’m a solo IT consultant by trade, so I’m really hoping it will help me augment my work.
Budget isn’t super important, it more that it’s fit for purpose, but to stop the people suggesting a £30,000 GPU, I cap it at ~£1000!
Thanks!
Even if you get a 3090 with 24gb of vram, you’re going to load the biggest model you can and realize it is useless for most tasks. Less than that and I don’t even know what you would use it for.
Ok, you make a really good point. I’m starting out, you know a thing or two. How would you start out, knowing what you know now?