If it is too big, the risks could be;
1. Excessive flapping in the wind at high speeds - very annoying and potentially dangerous.
2. The armour moving around during a get off - but there is a lot of debate on how effective armour is anyway, and it is very difficult in my opinion to predict if the armour will be in the right spot at the exact time of impact anyway.