I’m I over reacting? Kid sleeping arrangements.

My daughter is always at her grandmas (father side) or her fathers girlfriends house. At the grandparents house she sleeps in bed with her grandmother and grandmothers boyfriend. She has her own bed and room, but does not sleep there. When she’s at her father’s girlfriend’s house she’s sleeping in bed with him and the woman. I have no clue who these people are and they have not been in the kids life for very long. He flipped shit out on me because my husband slept under the same roof as my daughter and threatened to do so much, he won’t even let me and my husband life together without threatening to take the kid away. (His family has plenty of money to do so, and we don’t have money to hire a lawyer) Am I over reacting being pissed over how my daughter has to sleep at their house? She complains about having to sleep with him and his girlfriend.