If the father of my child showed up for his visitation do i have to let his girlfriend in my home?

i am a single mother of a 6 month old child. her father and i had been together for a couple years but he hasnt been around much since her birth. he would visit with her about once a month. so in an effort to build a relationship between them i hired a lawyer and took him to court to set up visitation. our agreement was that he would visit her in my home once a week for a couple hours (i thought he should come over more frequently but he only wanted this one day). today he wanted to bring his girlfriend of ONE WEEK to meet our daughter and i said no to her coming in my home because i dont know anything about her, not even a name. is that wrong of me? i dont think it is because he doesnt have much of a relationship with her to begin with. my daughter looks at him like a stranger. this was supposed to be my daughters time with her father, not time for him and his girlfriend to play house. i just think he should build a relationship with our daughter before his girlfriend is ever brought in the picture. i told him she could drop him off or she could sit in my driveway during his visitation but she wouldnt be entering my home. when it came time for his visitation he didnt show up and he said it was my fault he didnt come over (even though i never said he couldnt come see her). but would a judge ever tell me i have to let her in my home? was it my fault he didnt show up? and fyi his visitation is in my home because he has a neglect charge with his first child that he pled guilty too and he spends alot of his weekends in jail for various reasons. hes completely untrustworthy