Is that a devil's-advocate question? Anyway, I don't know, but I suspect. I'm not their customer, I'm their product. The more access they have to data, the more money they make.
I doubt they'll use your data to train Bard. At least not right now. What they're doing here is probably just pulling some data from your emails/calendar/etc. and put it into the context of your current chat.