C.S.
I have been to both as well. I say Santa Fe, because it is everything you are looking for.
I suggest you google the santa fe calendar to see what is going on the weekend you are there. That way you can plan your weekend accordingly.
Santa Fe, has excellent cozy restaurants, art shops, culture, bars, live bands, sometimes street bands, sometimes mariachis, sometimes art exhibits in the street, art galleries, & shopping.
My warning, hotels jump from 2 starts to 4.5 stars quick! I don't know that they have a 3 star hotel and I don't care what the ratings say.
My favorite hotel is La Fonda. Every room is unique and sometimes they pull my name up and tell me the penthouse is empty and they are going to upgrade me...Yay!