There certainly seems to be, in my experience, a pretty fair number of people who have deep, deep hostility toward Mormons. I've met several people who seem preoccupied by it, and it's practically all they wanna talk about. There are tons of anti-Mormon books too.
Personally, I was raised Catholic, and I freely acknowledge the Church has done pretty rotten things throughout history ... and a pretty fair number of both lapsed and observant Catholics seem very troubled indeed.
On the other hand, I've been in Provo twice as a reporter, I've twice visited the Mormon Polynesian Cultural Center on the north side of Oahu, and have met and encounted several Mormons elsewhere in my life - including here on the Mane. On the whole, they seem to me to have a special kind of 'aura' about them for lack of a better word. There's a 'cleanliness' to them (again, metaphorical and for lack of a better word.) Even that guy on Jeopardy seem to have something special.
Can't say I'm ready to convert (I love coffee too much), but there is something there.