Dell’s LLM-for-businesses plan is a joke, btw. They seem to not know that quantized models even exist, or perhaps they are pretending to so that their customers have to buy more Dell hardware.
Half of the regulars in this sub could set up a business with a better in-house LLM inference system than what Dell’s offering.
Dell’s LLM-for-businesses plan is a joke, btw. They seem to not know that quantized models even exist, or perhaps they are pretending to so that their customers have to buy more Dell hardware.
Half of the regulars in this sub could set up a business with a better in-house LLM inference system than what Dell’s offering.