I second meetdilip's suggestion of Godaddy and Hostgator. But if you are a completely new beginner into websites, then I would also advice you to check some cheaper and reliable hosting alternatives like:
Cheap Reseller Hosting, Affordable reseller hosting, Quality reseller hosting, Reseller program, Cpanel reseller hosting, Host reseller http://www.securesignup.net
I have used both the above cheap companies at some point of time and they have been in business for many years. So, you can trust them if you are looking for affordable hosts. HostGator is a recommended host if you are looking for a highly trusted but they are lot more expensive.
For domains you can go with Godaddy but make sure to use a coupon if you are looking for even cheaper prices on domains.
Check this link for a few good domain promo codes and you will save around 3 dollars at least for each domain with these
Domain Promo Codes - Godaddy Promo Codes&Coupon Codes
For scripts I would advise to go for wordpress for a start which is a free script. You can download and find other instructions in the wordpress site at:
WordPress › Blog Tool and Publishing Platform
Plugins are mostly free in the wordpress repository. There are also thousands of free wordpress themes there in the site and all over the net. But if you want more professional themes then you might look for some good paid themes like studiopress, theme-junke.com (cheap themes - try to use coupon THEME50 for 50% discount), elegantthemes.com (cheap yearly premium themes subscription etc.). For a start I would advise to go for a free theme though.
And when choosing a hosting never be fooled up by unlimited bandwidth provided by some hosts. In most probability you would never need it being a newbie but in case you even need it that is a blatant and open lie which everybody knows. No host would ever allow you to consume huge bandwidth and resource consumption in a shared hosting plan and you can trust me on that as I own a few dedicated servers and purchase loads of hosting myself. Go for a limited plan which is affordable at the start. I highly recommend scala and securesignup in their starter shared hosting plans for a newbie as I provided the links above.