Is there a way to parse webserver log files in order to delete all rows which contain a certain IP address?

We use a link-checking service for our website. Unfortunately, this is increasing our pageviews significantly. If we could delete these from our log files, it would be ideal!

Any ideas? Is there a script or program that can do this automatically, perhaps scheduled once a day?

Thanks,
WebGrrl

I think it would be better to configure your web statistics package (awstats or whatever) to ignore hits from that IP address rather than delete entries from your log files.

Most web statistics packages have the ability to ignore hits from a specific IP address or range.

Our stats software can ignore IP addresses. But this only applies to the *reports* that the software generates. The software's cost is based on how many pageviews there are, so even though it may "ignore" IP addresses for reporting purposes, it still counts them for licensing purposes.

This is why it we would need a script or something to automatically parse the log file (maybe once a day?) and delete rows which contain the IP addresses from these spiders.

Is there anything that will do this automatically? Thanks!

WebGrrl