While the universe may be close to infinite, the number of habitable (or reasonably terraformable) planets we can get to is a far smaller number.

A number statistically similar to zero. (assuming travel times counted in less than a human livespan)