Hi, folks
while this may not apply to some of you, in our case today it did.
We were getting major server process over-loads, going from normal .09 to 49, with php going from green to yellow to red all day long. THis started over the weekend.
Turned out to be a semi-annual content scraping to the point of abuse from YANDEX bot.
For example with 5 minutes number of requests hitting *one* website (along with IP)
9981 5.255.204.30
12586 178.154.183.203
12780 5.255.204.29
SO in 5 minutes they were hitting 35,000 pages — and this is just ONE of our websites (!).
Time: Mon Mar 23 19:25:41 2015 -0400
1 Min Load Avg: 34.08
5 Min Load Avg: 12.39
15 Min Load Avg: 6.12
=====================================
NOW coming back to earth ….
Last 1 minute 1.58
Last 5 minutes 2.54
Last 15 minutes 4.76
