Hi B.,
There is website hosting from www.domainnamesanity.com. They have a lot of packages to choose from, and to get started for a three month package plus a domain name will cost you less than $50.00. They have what is called a WYSIWYG editor (what you see is what you get) for building your website and it is SUPER easy. I have built four websites with them and I wouldn't use anybody else. They also have POP3 email accounts for really cheap so that if, for instance, your site is www.brandyt.com, you can have email addresses that say ____@____.com and ____@____.com, etcetera.
I would not suggest using PayPal. I am currently in litigation with them. Don't trust them with your money. They keep it in their own online bank account and they can take it without your knowledge.
The best way to go is Google Checkout. It doesn't cost you a dime to set up an account with them and customers can pay you securely using an echeck or a credit or debit card. When you get paid, the payment goes directly into your checking account, minus a small fee for the use of Google Checkout's services. They are the most reputable and safest way to do business online that you do not have to pay upfront for.
Once you do get your website up and running and making money, I do suggest you add Verisign to your site in order to process credit cards. They do have an upfront fee of about $250.00 to $300.00, but buyers feel very safe when they are purchasing from a website that is Verisign secured. They process credit cards much the same way as Google Checkout; the money goes directly into your checking account.
I've been building websites for years, and I've made a lot of mistakes but I've also made a lot of good decisions. I hope that I have helped you and I wish you the best of luck!
A.