My soon to be ex travels 95% of the time for work (touring musician). On years where his work travel was lighter, he would often travel for "pleasure" because while he was out on the road all around the world, he would make all these plans for people's weddings and getaways.....ugh. I eventually put the kabash on the "leisure" traveling because it was just too insane to have him booking trips with friends during his rare time off once we had three kids. We didn't have the budget to haul the whole family around, and they were always trips with childless buddies etc...
Other than that, the work travel was OK with me (even though our budget was super tight), but of course, I unearthed ALL KINDS of cheating and basically realized that while I'm self-sufficient and able to handle ALL house and kid duties with no help...he's not able to behave, so, THE END. Next time, I'll get a guy who stays home.
In your case, I would make it clear he is not home enough and you are not happy with the leisure travel. See if he'll compromise. If not it shows lack of character imo to put his own private vacations above his family if you are feeling overwhelmed. It certainly proved to be true with my relationship anyway....Plus, those luxury vacation spots are TROUBLE. They are DESIGNED for everyone to relax, hang out, and socialize and there are ALWAYS ladies around wanting to "have some fun". I could tell you STORIES...not trying to make you feel worse, but HANDLE it. Even on trips with friends, if he's got his own private phone, etc, you just don't know who he's meeting or what's happening. Maybe nothing, but really, the sky is the limit. BAHAMAS on his own just for fun? He's not a bachelor. They have family resorts there.
The only way this would be OK is if you were perfectly happy with it and happy at home without him. Otherwise, he needs to respect you as his wife and mother of his kids ABOVE the fun vacations.