A Chapman University study found that men are more affected by physical infidelity than emotional infidelity, and vice versa for women. It's reasoned that a physical affair threatens a man's sexual prowess, while an emotional affair threatens a woman's sense of self.