According to this article, Homo Sapien males were having sex with female Neanderthals. So since the beginning of our species, some men will have sex with anyone female. Even if she is a different species. Here's what we know sex with Neanderthals was like