Other than someone freaking out and smacking your head reflexively, one other concern is they might smack it hard enough to rip it out of your ear.