How do we know that "space" is bending, and not just the stuff in space?

Under Einstein we believe that time and space bend with gravity. But since "space" is made of nothing that we can detect, how do we know that space bends, and not just the stuff in space, including light, etc?