Search
robots-txt-parser
A lightweight robots.txt parser for Node.js with support for wildcards, caching and promises.
0.1.2
0.1.3
1.0.0
1.0.1
1.0.2
1.0.3
1.0.4
1.0.5
1.0.6
1.0.7
1.0.8
1.0.9
1.0.10
2.0.0
2.0.1
2.0.2
2.0.3
main:
https:/unpkg.com/robots-txt-parser@2.0.3/src/index.js
Copy URL
Browse on unpkg