Just curious...why did you ask for your balance back from your lawyer? Situation aside, does part of you still love the man you married? Are you really ready to leave? Could it be a defense mechanism to avoid dealing with the pain of being deceived and feeling unwanted?
It's a tough situation but ask yourself the tough questions and be prepared to deal with the decisions you make based on your answers. Divorce is tough. Though many parents can go through it peacefully, it still hurts, even for the kids (yes, I've been one of those kids). However, being lied to and deceived by your spouse is not acceptable behavior either. It is time to sit down and have a real heart to heart talk with him. You made a vow to each other, for better or worst and that deserves at least one good conversation before you both decide to call it quits. I would suggest starting out by writing out your feelings in a letter first. Try not to be accusatory. Avoid using phrases like, "You always," or "You never." That only makes the other person feel defenive. You can use words like, "It hurts me when you go to a place to seek attention from another woman. I'm at a loss for how we got here. Where did we go wrong? In what ways have I failed you? How have I hurt you that has made you feel how you do now? What could we have done differently to not be where we are now? I loved you so much and I am feeling so hurt right now. I want us to have resolution one way or another....." Taking the approach of telling him how you feel and asking him what your role was in the situation will bring down his defenses and hopefully get him to open up to what he feels. Hopefully he too will accept responsibility for his part in the situation.
I think if more people took the time to really try and at least talk about their deepest, darkest feelings and face them head on, no matter how difficult, there might just be a few more couples still married. Marriages have survived worst situations.
Good luck and God bless.