This is such a commmon problem that I think we all face at one time .I have 3, my oldest 7 and youngest 2 . I have dealt with this issue with each one. The oldest we just let come sleep with us when he got up and came in there in the middle of the night. With one , its easier. When I got pregnant with number two and number one was kicking me in the middle of the night and I was tired the whole next day I knew I had to make changes. We began by walking him back to his room . He was about 27 months old.We did it as many times as it took . Yes exhausting but consistency is the key. After a few nights he still came in but went back without a fight. I kept number 2 in a crip as long as possible. When I got pregnant with number 3, number 2 was 22 months old. Gosh we were busy looking back, ha!! My husband got a new job and moved before us when number 3 was born. So I was home with a 5 , 2 and 2 month. The 2 year old had a pacifer that he began to talk behind. I had 3 or 4 because if we lost one it was devastating. We had to put him in bunk beds with older brother when little sister arrived. At the same time I told him the trash man came and got his pacifer. We went cold turkey. Thats the only way to do it. He cried for 3 nights and that was it.
He would sleep all night but going to sleep was the battle with this one. Each child is so different. Since my husband was away during the week and I was nursing a newborn I was so tired and had to get creative with getting this guy to go to bed. I got a poster board and made a chart with magazine cut outs of different activities. Starting from supper time on our evening was planned out. I did not change it unless we had church or ball games. They ate, got to watch 30 min. of TV, take a bath, read books , snack, bed. No Exceptions.
I put stickers by each activity they did without griping. If they went to sleep without me coming back and forth 100 times, they got another sticker. IF they had so many stickers in 2 weeks they got a prize.I let there be 3 mess ups I think!!
It worked so well even for a two year old.
Number 3 is now 2. From the beginning , since I knew better, she never slept with us unless she was sick. She always went to bed awake and put herself to sleep. She is now in a toddler bed and sleeps from 9-8. Its heaven.
Sorry to keep rambling, I just know how frustrated you are.
Make sure you do something and stick with it, he will get the point and begin to give up the fight. It may take a week or two ,just keep doing it. Plan to have a set plan when the new one arrives to avoid the same pattern!! Good luck!!D.