I think part of the issue is that, you are right in a way, but your timescale is just so off. The earth did start off very small, and over the course of the entire life of the universe, it’s changed into what you see today. Obviously there’s no photos of Pangaea, but we have the plates themselves as evidence.