Would more men be open to going to therapy if they had resources tailored specifically for them, and if the office had Emotional Support Animals for appointment use?
"Where were you? Why do you need time off every single week? Aren't you going to the dentist a lot? Are you seeing someone else?"
People like bosses and spouses don't take kindly to "my whereabouts are none of your business."
Your employer should not have to know anything more than that you have a medical appointment. Any more is none of their business.
If you don't want to tell your spouse that you're seeing a therapist, your spouse may have issues to deal with and your relationship may also need a therapist. But it should be possible to go during work and they should never know.