Never turn a horse loose with its halter on. A halter left on a horse can result in disaster if the animal gets a hoof or leg entangled in it.