I’ve been having a hell of time getting notebooks running and finding A100 80GB (like everyone else). I’d like to train 30B at 16 or 8 Bit. I need to use this model in an early version of our new product, and 4bit just isn’t going to cut it.

Anyone know of a point and click service that I can use… I don’t need an enterprise class service with a ton of MLops capabilities for big $$. I just need some automation to get models built quickly.

I just need recommendations on severices to consider… No need for any philosophical or political debate.

Much appreciated!!