Another vote for Aleene's Tacky Glue. If you check the label, you'll see that it will handle fabric, wood, plastics, most anything, yet it is safe to use, nontoxic, dries clear, and sets up faster than basic Elmer's school glue. You can also use a fabric glue but try it yourself first -- some types of fabric glues are runnier than Tacky Glue and your daughter might end up squirting out a ton of it (and it does not come out if it dries on any clothing). Aleene's makes a wide range of glues so check them out -- any craft store chain should sell their glues. I would avoid rubber cement . See this, from the National Institutes of Health, and note the second sentence about young kids:
http://www.nlm.nih.gov/medlineplus/ency/article/002820.htm
Tip: Tacky Glue can be a bit thick so be sure to keep the nozzle at the top clear of dried glue, store it upside down as someone else noted (great idea) and for your daughter, consider squeezing the glue out onto a paper plate and letting her use a cheap, disposable kiddie paintbrush to apply glue instead of having her squeeze the bottle. The Tacky Glue bottle could be a bit frustrating for her to squeeze as it's not really ideal for very little kids' hands, and getting out the thicker-than-Elmer's glue can be tough for a young one. I used the paper-plate-and-paintbrush method a lot when my daughter was little and still use it myself sometimes when crafting!