From what I’ve read mac somehow uses system ram and windows uses the gpu? It doesn’t make any sense to me. Any help appreciated.
In general, you have two options:
Running the model on your graphics card, or running it using your CPU.
On your graphics card, you put the model in your VRAM, and your graphics card does the processing.
If you use your CPU, you put the model in your normal RAM and the cpu does all the processing.
The graphics card will be faster, but graphics cards are more expensive.
You can even mix the two if you can’t fit your model in your VRAM, where you put as much as possible on your VRAM and whatever left over on RAM and CPU. But this won’t be as fast as running it fully on your graphics card.
Mac has a different kind of architecture where it’s a mix of the two, and can be incredibly fast, but I haven’t used it so can’t speak too much on it.