This is kinda specific but it’s my first new phone in 5 yrs so im still going to ask.

I have a 15pro and noticed that there was some dust and stuff on the lens. I twisted the soft part on my hoodie into a small ball and wiped my lens moderately hard. ive done it a couple of times now but Is this damaging to the lens?