The universe that we know (all the inhabitants of the world) knows that there is an infinity but the human mind is unable to comprehend the most mysterious and complex idea of something like the infinite. How any one can imagine that any direction or reference point is impossible to follow because from any point to any other point is 360 degrees.
Astronomers with the most powerful telescopes have reached objects thousand of light years away and yet your comparison with the infinite is just few inches away!
I believe that it is better not to think about it because you do reach any place!