I'm in a very similar situation. The job I want is with a university, and it means working until 6:30 pm Mon - Thurs, but I'd be off Fridays. I didn't like the late hour, but my husband said he would change his hours so he'd be home with the kids in the late afternoon. He said we would find a way to make it work.
It's a unique job, so I might not have another opportunity for quite some time. If I didn't have my husband's support, I would not be considering it.
If you and your husband have a plan, I think you have to go for it. You do still have the option of turning it down if you are offered the job and don't feel right about it.
At this point, you have to go for it!!!