The key is to also have long head hair. The chuds keep it face only. But yeah it's a bit annoying. I just wear a lot of purple / pink so no one gets any ideas.
You're absolutely right. When I had a ponytail I could sometimes get by forgetting to shave. Now that it's cut short I gotta be diligent or end up looking like a creep.