if they have what the site needs availible. for example, i'm not going to choose an html-only host for a php-based site. another thing is the price. luckily, i have my own server, so it's free. :P
my priority is bandwidth and uptime. I like reliable hosting with as less downtime as possible. I always monitor my host with third party monitoring service like http://www.serviceuptime.com