Hello
x-posting from t/askprogramming : Original here.
There was a comment stating I might ask here as well.
Hi all
I am looking for a comparison of known AI models method of handling arithmetic operations.
How do these AI compute 2+2 ? That is to ask :
Do they perform a gradient descent, and figure out that (2+1) < (2+2) < (2+3) hence 2+2 must be between 3 and 5 ? Or do they actually invoke an arithmetic operation in the host language.
I understand that some popular AI model is closed source, and we will not know. But for the rest, is there an already compiled meta study / publications comparing how they tokenize numbers, and handle arithmetic?
Thank you.