As far as your hosting provider, it sounds like you already know what you need. Just start looking for providers (GoDaddy, 1and1, etc) and compare features and prices.
Tried GoDaddy a few years back, but being a total newbie to the whole website thing despite being able to toss out a simple html index page as needed, I did not get a lot of helpful advice from them. Seemed they were more interested in just selling a site-name online for you to be registered owner as than providing support and helping guide development. Think I did insist on an Apache host, but that whole do-everything-by-ftp became really tiresome after a bit and I just allowed the domain to expire.