M.S.
You may not need more time away from your kids, but you probably could use some girl bonding time. It is only once a year, and it is a great opportunity to brag about how wonderful your family is and get some advice.
You husband is wrong to feel offended that you would go, but he can't help how he feels. Your love it strong enough to last one weekend apart, and imagine how happy you will be to see eachother when you get back (wink wink). Try to help him understand why you might want to go, and try to reassure him that you will miss him while he is gone. Maybe he can plan a guys night while you are gone.