i havn't personally had this problem yet but passwords would be my first pot of call, then i would investigate the hack further and have someone give the site a check over for possible weaknesses or exploitable areas. It depends on how your site was hacked. give some more info.
Do you know how they got in to your site to hack it? Is there any upgrades to any of the software you are using?
And yes... passwords should be changed immediatly.
I don't know how they defaced my skalinks trading links directory. I have replaced all the files and changed the passwords. Seems to be working now. The rest of the site is html and does not apea to have been touched. But all directories were reloaded from my machine after deletion on the sever.