alexschreyer.net
Using robots.txt to your advantage to reduce server load • [as]
A little while ago, my hoster (1and1.com) whom I actually like quite a bit, decided that I was using too much of my fair share of the common server and
Alex Schreyer
