Robots Blog

I'm a bit of a fan of the robots.txt file - and I've spent a lot of time messing around with the how's and why's of how it works. I've even put together a robots.txt generator and FAQ.

Brette Tabke (of WebmasterWorld, if you've been sleeping under a rock and didn't know already) has turned his robots.txt file into a blog. Not only is this irreverent, it's damn funny!

Brette has garnered some fame as of late because he's apparently declared war on rogue robots to his site. Where most SEO's and webmasters are desperately trying to get robots to visit, Brette is desparately trying to keep them away, especially the bandwidth sucking parasite ones that spammers create.

Strange how the rules change once you hit a certain level of success...

Ian