I have been in some pagan veiling online circles and have discovered that a lot of non-Muslims use Muslim-style veils and it usually is not considered offensive, so I think that it would be okay for an irreligious person to use one.
It's not a bad idea, it's just really useless, especially since you don't even live here. The dresses are pretty though, I used to have one that I wore at home pretty often, as a non-Muslim person in France. It's definitely not a bad thing. It's just a dress.