Do you know which bots you want to ban, or just the bad ones? They don't carry badges to identify themselves. Some of them have a user agent string you can identify, while others you'll need to go after the IP address for. Anyway, I would think the first step ( if you haven't done it ) is to find a list of the bots you don't like.
Next step depends on your server. Windows? Linux? Do you have rights to edit the .htaccess file ( assuming you run Apache )? I wrote an article on opting out of imgred that you might be interested in. It uses Apache code to ban a particular bot ( if you can call it that ) by IP and hostname; you can just list all the IPs you want to ban in there. I'm far from an expert on mod_rewrite, mod_security, or anything like that, which is why I'm pointing to pre-written code. If that's the web server you're using, someone else can hopefully explain how to ban according to a user agent string, too. |
