Post a picture of you standing in your gear in front of a mirror so we can see the clearance? Can be your wearing a jacket with unusually large shoulder pads, a helmet that is lower than average or your neck is a tad bit shorter than the average user. Or do you maybe tense your shoulders up when you are riding?
Can be any number of things. I personally don't have a problem with the jog wheel on my Sena.
You just described every issue I have