The FA have decided there is "no case to answer" over the allegation the referee said "shut up you monkey" to midfielder John Obi Mikel.
The FA said the evidence had been considered by independent QC David Waters who ruled Ramires' claim was not supported by any other evidence and disputed by the other match officials.
An FA statement added: "Moreover it was contradicted by other witnesses and does not cross the evidential threshold required to bring a charge against Mark Clattenburg.
"Having considered Counsel's opinion, and in view of all the circumstances of the case, The FA does not believe that there is a case for Mr Clattenburg to answer."
The statement also said the complaint by Mikel's team-mate Ramires was "made in good faith".