M.O.
I did that with my son, and he never fully outgrew his dairy sensitivity. Even trace amounts of dairy triggered all kind of reactions (chronic [i.e., constant] ear infections, preschool-style clinical depression). Off dairy, however, he's a gifted, joyful, confident kid. Just about never gets sick. The only difference is I did get every single drop of dairy out of my diet. It was 100% worth it, and really healthy for me too.