mercurial.selenic.com is off the air?

Matt Mackall mpm at selenic.com
Mon Dec 15 21:15:01 UTC 2014


On Mon, 2014-12-15 at 13:21 -0500, Neal Becker wrote:
> I can't seem to get to the web site

Short answer: blame China.

Long answer: I'm regularly playing whack-a-mole with Chinese search
engines that ignore robots.txt and hammer the wiki. I don't what the
deal is with China but it's usually China. Because everything on the
wiki is dynamic and some of it is rather expensive to generate, we can
run out of CPU. When a few decide to index at the same time.. we have
problems.

For some reason "automatically rate limit CPU-abusing spiders" is not a
thing in the Apache module world. Suggestions welcome.

-- 
Mathematics is the supreme nostalgia of our time.





More information about the Mercurial mailing list