Hi D.! I JUST went through this with my daughter. As for the formula to milk situation, I started by mixing a little milk in with the formula and gradually increased it. This actually wasn't hard at all, turns out, my daughter preferred the milk. The bottle was harder. My daughter did not need a bottle to go to bed, but she WOULD NOT drink milk out of the sippy cup. We tried a few different cups, nothing worked. The pediatrician told us for one day, do not offer the bottle. She said it's hard, but she will get thirsty enough to drink out of the sippy cup. And sure enough, about halfway through the first day she started drinking out of it, and hasn't had a bottle since. (It was important for my daughter to get off the bottle as soon as possible as she has a history of ear infections.) My pediatrician also told me that once they go to whole milk, they should not have more than 24 oz in one day. Whole milk does not have all the nutrients formula does, and they have to get the nutrients from food. If they are relying on the whole milk, they can quickly develop anemia. We started feeding my daughter more, offering more healthy snacks and so far, she hasn't missed the more ounces of milk. Things have changed in that she now sips from the sippy cup all day long. No more taking a whole bottle in one sitting. But she gets about 18-20oz a day of milk. Good luck with everything!
Oh, may I also recommend Gerber Banana Cookies? It has to be Gerber, because they crumble in the mouth. I break off pieces for my daughter as a snack, and it makes her thirsty! Therefore, she grabs the sippy cup of milk and drinks!