I think the first thing to realize is that there are many, many ways to homeschool, and that for some families, one way is best, and for other families, another way is best. There's no one right answer, and as your son gets older, your methods may change. There are a few things I'd recommend. First, look up any homeschooling charter schools that may exist in your area. These are actually public schools that will pay for curriculum materials and provide a supervising teacher, and then you will be your child's "learning coach." In other words, you are doing the day-to-day teaching, but there's a master teacher you will report to, to make sure you're staying on track, and the master teacher issues the grades at the end of the semester. One that springs to mind is K12 - in your area, it's probably called Florida Virtual Academy or something similar. We started off using K12, and while the curriculum itself is very solid, it wasn't exactly right for my kids.
I ended up deciding I would rather not report to a public school while homeschooling my children, and that my kids would benefit more from a Waldorf-style education (which is very hands-on and project-based, with an emphasis on the whole child, not just prepping for standardized tests). Therefore, we decided to use Oak Meadow curriculum. I think I paid about $500 each child for an entire year's worth of curriculum/art supplies, and we have been very happy with it. (I'm sure you could find the curriculum used on Amazon or somewhere, too.) I should note that I use Life of Fred math curriculum (not Oak Meadow), and my girls LOVE it.
Like I said, there are many ways to homeschool, and none is any more valid than the next. When you're starting out, I think it's best to keep things simple and don't get too stressed out about it. Learning should be fun, and homeschooling can be a fun experience for both you and your child. I would also recommend looking up your local chapter of the HSLDA (which is a homeschooling organization) - in our area, the local chapter has get-togethers and conferences, which are usually reasonable in price, and informative.
ETA: I love the people who don't homeschool and never have, but feel the need to tell you exactly what it will be like. Umm... no. I co-own a business and I work full-time. However, I work from home, so homeschooling works for our family. I have to structure my day carefully, but it works. What people don't realize is that homeschooling kids are often able to learn all that their public school counterparts do in about half the time. At home, we don't have problems with discipline, or with trying to transition 25 kids to a different activity. We don't have anti-bullying assemblies (well, we do, but it's more like, "Be nice to your sister!"). My kids don't have to wait in a lunch line. My 6th grader usually finishes her assigned school work before lunch, and then has the rest of the day to read for fun, work on art or music, etc. It IS possible to work full-time and homeschool. Just wanted to throw that out there!