I'm a college student myself, and it's rough! One thing that has helped me is online schooling. I'm able to do my courses at 2 am if need be. Now, your schooling might not be so flexible, but point being, if it will bring you personal satisfaction and aid your family financially down the road, it's a fantastic idea. I've just finished my associates, almost entirely online, and I'm now transferring to OSU Tulsa for my bachelors. OSU will not provide online courses, so I too will be sacrificing time at home, but I truly feel it's worth it. My daughter knows how much I love her, and though the time away from her makes me feel horrible at times, it's only temporary. I don't love her any less, I just have to manage my time better...
Best of luck...and go for it. You will be happy that you did.