Once you have your initial WordPress install there are a few modifications you should apply to your site.  Here are some great links on those modifications:

1. 10 Tips After Installing WordPress

2. The Very First Steps After a Fresh WordPress Install