NEW YORK, Aug 4 (Reuters) - A U.S. judge on Tuesday rejected a proposed class action settlement between American Express Co and merchants who sued the company over swipe fees, ruling that a lawyer for the merchants compromised the fairness of the agreement.