I don't want to sell myself short. You hurt your spouse, not so much by the infidelity, but by the negative feelings about yourself that you bring home.
It is necessary to the happiness of man that he be mentally faithful to himself. Infidelity does not consist in believing, or in disbelieving, it consists in professing to believe what he does not believe.