R.R.
I can totally see how you feel he's limiting you, but guy-girl relations are always so tricky, and can lead to so much marital trouble even if you dont' do anything wrong per se. Just the fact that you can create a suspicious atmosphere is unhealthy. I think your marriage and your desire to make your husband happy and trusting is much more important than any friendship - family always comes first.
My husband and I trust each other 100%, b ut my husband always says that it's simply not proper for a married individual to have a close personal friendship (as opposed to the couple both being friends with the single) someone of the opposite sex. And I agree with him.
Also, I don't think there's an issue with your husband not having enough faith in you - it's simply natural for platonic relationships to unintentionally slip into unsafe territory, and I'm sure that's what he's concerned about.
Besides, you should take it as a compliment - your husband thinks you're too attractive for other men to control themselves :)