I seen someone posted about this 4 weeks ago, but looks like a botnet keeps crawling my site for the last few days causing the site to be offline constantly. Is there any way to block these without blocking google? It seems to be pretty smart about crawling with a few different ip's every few minutes to try to avoid being blocked automatically. Thanks.
Browser: Bookmark Buddy
Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)