Martha Jones and the Doctor visited the moon landing three times . Add to that the Moon Landing was a central location for the opener for Series 6 and that counts as one location 4 times. It is possible that the Doctor went to different spots but unlikely. The first three times he was sight seeing with Martha Jones and had no way of knowing about The Silence. It stands to reason that given the nature of his character he would have been very close to the scene.