K.P.
I am doing this with my son too. He really likes his milk warmed up too. I have been starting to heat it less and less and that slowly gets him used to cold milk.
However long you usually heat it, take 10 to 15 seconds off and keep doing that through the week until she drinks it cold.