Cropping an image square cuts down on the perceived horizontal-ness or vertical-ness of an image. When the dominating line of a horizontal image is the horizon, someone looking at it will just follow that line. Same thing with a vertical image. Square images allow the eye to wander around a bit.