Our son has ADHD (inattentive type, which is what I believe ADD is) and Autism and tics. We did try ADHD meds at one point. They did help him, but focusing on behavior modification and sensory issues was more effective in his case. He does now take a med for his tics.
The thing about ADHD is that it really is a medical diagnosis and it really may be a situation where medicine is going to play a huge role. You're not going to know unless you give it a try, and you can always decide to stop using the meds.
Our society has done many kids a disservice by putting such a stigma on ADHD meds. I grew up in the 80's, and I always thought that ADHD meds were really so that parents and teachers could cope with kids who were behavior problems. There were so many adults around me who honestly thought ADHD meds were really just a poor replacement for bad parenting. I am so glad that I had conversations with many parents about this before our son was even diagnosed. So many parents I talked to said that finding the right med wasn't easy, but once they did their child's life changed. They were able to really function for the first time.
I know you are really trying to do what's best for him, and that's probably why you have been hesitant to try the meds. This isn't an easy decision, and it's really ok to ask your doctor more questions. But do keep in mind that giving him medicine just might be what's best for him.