This also happens to me in reverse. I get half a sentence out, the other person nods and says "yup" or "K", and then i say "yeah k so then anyway" and on to the next point
You'd go crazy in places like Japan where it can be common to use these verbal confirmations they're listening. Even considered rude or that you're not paying attention if you don't...