Unfortunately, that’s what borders do, they’re counted as part of the space an element takes up. Allow me to introduce border’s less commonly known cousin: outline. It is virtually identical to border. Only difference is that it behaves more like box-shadow in that it doesn’t take up space in your layout and it has to be on all 4 sides of the element.
.foo {
outline: 1px solid orange;
}