Microsoft doesn’t seem to advertise the acceleration capabilities of SPR in these instances. I’ve heard good things about AMX for inference. Here’s VMWare accelerating a 7b model, but in the scope of large scale training and inference, I don’t think there’s a role to be played by SPR’s accelerators.

I think it’s just a difference of platform validation time.

We’re beginning to see Genoa AI platforms roll out now from several CSPs.