In my masters degree I always ran many computations as did all my peers
The reality is that more of us are than not are using huge HPC clusters / cloud computing for many hours on each project
The industry is just GPUs going BRRR
I’m wondering if this has potential implications for ML in society as AI/ML becomes more mainstream
I could see this narrative being easily played in legacy media
Ps - yeah while there are researchers trying to make things more efficient, the general trend is that we are using more GPU hours per year in order to continue innovation at the forefront of artificial inference
After training AI actually emits less CO2 emissions than humans working on the same thing. So the initial power draw is just a sacrifice for longer term eco friendly. This isn’t dumping GPU into ponds like manufacturing that actually decimates ecosystems sources of water.