They can get caught in the conveyor and pieces could get into the sandwiches. I don't wear gloves when milling metals with harsh coolants cause the loose material can get caught and rip a finger off suddenly.
Hands sweat so you get moist and closed environment perfect for bacteria growth. Any chef that had to wear gloves at work will tell you they had issues with nail infections and similar.