Absolutely. Most hosting companies (GoDaddy, Bluehost, HostGator, etc) all provide Wordpress hosting. It's a pretty simple process to get up and running.
But can I download Wordpress onto my computer, design the site offline if I want to, then FTP the files to my host?