Is it just me or does your face and or hair suddenly become unbearably itchy as soon as your hands are to busy to do anything about it?

Every time I put on rubber gloves to do something gross or prepare food, start to wash dishes or anything similar my nose, cheeks, eyes and scalp become so itchy. Does my brain just hate me? I know I have a latex allergy so I buy the correct gloves for that, but sometimes I’m not even wearing gloves.