Very few time travel stories every address this and other detriments to the past. For most of history, the past has been a pretty horrible place compared to today unless you are rich and usually male. Even you are those, you don't have to go far back to be victims of disease or injury commonly cured today. Depending on what part of the world you are in, and how far you are going back, your skin color, spoken language, or physical features may also put you in a world of hurt.
We still have a long way to go to be better, but as crazy as it seems, right now, is a really really good time for most of us compared to most of history with regard to freedom and health.
I wouldn't mind the chance to occasionally go back in the past and talk to long lost loved ones, let them know I miss them and that everything's alright.
Even if it was just limited to a time bubble and nothing I did in the past would change the present or future.
disease might be a particular issue beyond just that. Last thing you want is to give the past COVID or modern strains of the flu or whatever else, and in reverse, you dont want to bring back smallpox