Do you have to send your child on visitation?

My daughter lives with me, and she has visitation with her mother in maine. I live in virginia. Her mother and I were never married and I just got custody of my daughter a little over a year ago. I have an attorney, but he is extremly hard to reach lately and is located in maine so I can't just stop by the office to see him. My daughter goes here in VA to counseling every week and has recently been telling her counselor and me that she doesn't want to go back to her mom's house. When she is asked why she doesn't want to go, she spills out a laundry list of reasons from issues that happend during her summer visitation. Such as, her mother and her borfriend leaving she and her younger half sister alone in their trailor all night long so they could go to a party at the neighboor's house, maggots crawling around in my daughter and her half sister's room because it was so dirty, being left unfed and beinkg allowed to be grabbed by the arm and screamed at by a friend of her mom's while her mom watched, she is scared because her mom made her watch the movie the orphan with her, the list goes on and on and on. These are only a few of my 8 year old daughter's worries. I am supposed to take her for christmas visitation on dec. 19th, but if her counselor says its not safe for her to go and I don't feel its safe do I have the right to keep her here? I am trying and trying to get in touch with my lawyer, but with the holiday and his other cases its really hard. I don't have money to get a new lawyer, so that its an option. What should I do?