Afaik, gpu cores a very stripped down cpu cores that do basic math, but what sort of math can cpus do that gpus can’t
I’m talking, cpu core vs Tensor/Cuda cores.
what sort of math can cpus do that gpus can’t
that’s really restricting the problem space. Obviously (?) math wise it’s the same thing: both of them can flip bits and arrange this bit flipping in ways useful for mathematics.
But CPUs are not just math. They always had I/O, almost always had interrupts, for many decades now they had protection rings and virtualization is now really common (Intel/AMD released support in 2005/2006). These are all supported in the instruction set.
to echo others, it’s not what, but how.
cpus do execution reordering and speculation to run one thread really fast. gpus have mostly avoided that and execute threads in large groups called “warps” (analogous to lanes of a SIMD unit).