He tried to weaken the bond between the US and Israel, he didn't demand the release of the the hostages during the Iranian hostage crisis and he let a lot of bad controversies happen.
While he was general during the Civil War, President Grant passed very anti-Semitic military orders. It took many rabbis to ask Lincoln to get these orders removed. Plus, Grant had a thing against the Jewish people.