Hi J.,
I live in Logan too! :)
I know how stressed out you feel trying to keep things under control at church. I have a four-year-old daughter who generally does a pretty good job, but not always. Church can be stressful for parents! Here are some tricks that I have found work for us.
I usually try to get to church early enough to be able to sit on a side bench with a wall. Then I give my daughter enough space between me and the wall so that she can move around, climb up and down and walk back and forth a little bit. I bring a special bag with books and quiet toys for her to look at and play with, and I make sure she's not allowed to play with them during the week so she'll be interested in them. As long as she's not talking or disturbing others I don't worry about her moving around a little bit and playing quietly. When she does have a bad week where I have to take her out, I make her sit on my lap in the foyer, and she's not allowed to move around or talk to anyone. She has to stay on my lap. That way she realizes that being in sacrament meeting is a privilege and that having to leave is not. We haven't had to leave the meeting for a long time now.
I know how tempting it is just to stay home, but it's really important that you get your son used to going to church now while he's little. He'll have a much harder time feeling comfortable at church later in his life than if he gets in the habit now. And that's the important thing to remember--you're going to church not just for your sakes, but for his as well. I promise that after a few weeks of difficulty, it'll start to get easier, as long as you're consistent.
And don't worry too much about what everyone else in the congregation might be thinking. Most of the people there have been (or will be) parents to a 2 1/2 year old at some time in their lives, and they know what it's like. They're not expecting your little guy to be a perfect angel, and neither should you. If he were, you wouldn't need to bring him to church, right? :)
Good luck!
M.