There could be a number of reasons your cat is eliminating outside of his litter box. If it is an ongoing problem, rule out a physical issue first by taking your cat to the vet. Some conditions like urinary tract inflammation and thyroid disorders could lead to this behavior.