I have no YouTube account, and it can figure out my viewing history with just watching a few of my favorite channels usually... including specific videos I watched years ago.

So I wouldn't worry about it.