I've always believed that cats and other animals have a speical ability
to read humans. My cats have always seemed to automatically know if
strangers were cat lovers or not. If they were, they'd be specially
affectionate. If they weren't, they would back off. It's just an
instinct they have.
I think babies may have that same instinct.