Immediately block fake Google crawlers: Yes
How should we treat Google’s crawlers: Verified Google crawlers have unlimited access to this site
If anyone’s requests exceed: 30 per minute (1 every 2 seconds) then throttle it.
If a crawler’s page views exceed: 960 per minute (16 per second) then throttle it.
If a crawler’s pages not found (404s) exceed: 960 per minute (16 per second) then throttle it.
If a human’s page views exceed: 240 per minute (4 per second) then throttle it.
If a human’s pages not found (404s) exceed: 120 per minute (2 per second) then throttle it.
If 404's for known vulnerable URL’s exceed: 30 per minute (1 every 2 seconds) then throttle it.
How long is an IP address blocked when it breaks a rule: 12 hours
↧
iskandarX on "[Plugin: Wordfence Security] Recommended settings for Firewall Rules"
↧