J.B.
I found that zapping a mug of hot water in the microwave and putting the full bottle in the cup did the trick.
Also, if you are using powder (which is WAY cheaper) you can warm up the water that you will use to make the formula in a small pot before you mix it.