Why do women tend to be better than men at recognizing faces? Two recent studies give a clue, and also explain inconsistencies in previous research, some of which has found that face recognition mainly happens in the right hemisphere part of the face fusiform area, and some that face recognition occurs bilaterally. One study found that, while men tended to process face recognition in the right hemisphere only, women tended to process the information in both hemispheres. Another study found that both women and gay men tended to use both sides of the brain to process faces (making them faster at retrieving faces), while heterosexual men tended to use only the right. It also found that homosexual males have better face recognition memory than heterosexual males and homosexual women, and that women have better face processing than men. Additionally, left-handed heterosexual participants had better face recognition abilities than left-handed homosexuals, and also tended to be better than right-handed heterosexuals. In other words, bilaterality (using both sides of your brain) seems to make you faster and more accurate at recognizing people, and bilaterality is less likely in right-handers and heterosexual males (and perhaps homosexual women). Previous research has shown that homosexual individuals are 39% more likely to be left-handed.
Face coding varies by gender, sexual orientation, & handedness
Proverbio AM, Riva F, Martin E, Zani A (2010) Face Coding Is Bilateral in the Female Brain. PLoS ONE 5(6): e11242. doi:10.1371/journal.pone.0011242
 Sex differences in face processing are mediated by handedness and sexual orientation. Laterality: Asymmetries of Body, Brain and Cognition.(2010).