We’ve put together an article using some guesstimates of what it would be like for an enterprise to deploy LLM’s on prem.

https://bionic-gpt.com/blog/llm-hardware/

In short, I’m estimating $20,000 in hardware costs per 1000 users, minimum.

I’d be grateful if people could give me some feedback on the numbers and whether my assumptions look realistic.

Thanks