Assign normal state a border with 100% color transparency
Then apply border to hover state. Keep in mind that the border width should be the same for both states.
I hope this will solve the issue.
