One thing jumps out at me: Is he being treated for his ADHD? I assume you say ADHD because he has an actual medical diagnosis--?? If so, shouldn't he be getting treatment? As in, meds and/or some kind of therapy so he can cope with the ADHD side of things - this is not the same as marriage/parenting counseling or couples therapy. Is any treatment happening?
If yes -- then that's a good thing but it's not enough. If yes -- did someone counsel him to cut back on anything that's not essential, and that's why he wants to say "give me only MY tasks on your list"?
If he's not getting any treatment, then he should take responsibility for getting treatment for his adult ADHD. If he has the diagnosis but has done nothing about it, and especially IF he hides behind it -- as in, "I can't help the way I am! I have ADHD! Just deal with it, I can't change!" -- then he's using it to manipulate you and the situation.
I see why you want everything on the list. It allows you to make just one list for both of you rather than a master list and then his special little list tailored just for him. And more importantly, if something happens (your car breaks down, a kid gets sick and you have to rush to the doctor, whatever) then HE needs to know where the other kids are located at any given time. The fact that he can't understand that, or just assumes you are supposed to juggle everything that comes up even in emergencies -- well, that's pretty telling, isn't it? I guess he expects you'd call and tell him what to do and where to go if something happened out of the ordinary. Lucky him, he has a secretary and it's you!
I know you're venting, but I hope you're telling the counselor all that you are saying here.
The way I handle maddening people is I don't have them in my life or (in the case of my brother whom I love but who is very different from me) I limit the time I'm with them, and the result has been just fine. In your case, it sounds like you have a rather lopsided partnership revolving around logistics, not a marriage.