S.S.
I really am a fan of Creative Memories (CM) scrapbooking. They have easy to use quality materials. On their website they have a starter set. You might be able to find something on Craigslist or eBay.
Even if you decide you don't like that style of scrapbooks, their supplies are great.
As far as paper, it depends on how detailed you get. I find packs of paper useful for providing boarders or framing to pages and pictures. I buy patterned individual and plain colored packs of paper.
You can contact a local CM seller via the internet. www.creativememories.com.
Another helpful store is Archiver's. They can be a little pricy with some things, but they are very knowledgeable and could direct you well. www.archiversonline.com.
Good Luck and Happy Scraping!