robots-dot-txt

A really lightweight and simple robots-txt parser.