He's had an EXTREMELY rough time in general, causing him to have melt downs at everything,
but during his time as a slave, he had it ESPECIALLY rough with women, suffering a lot of sexual abuse....
So he has a deep seeded mistrust for pretty much all females at first glance and it takes forever to gain his trust