robotstxt-util

RFC 9309 spec compliant robots.txt builder and parser. 🦾

v4.1.0 URL: https://unpkg.com/robotstxt-util@4.1.0/dist/index.js

Open Browse Files

robots robotstxt seo search-engine-optimization robotstxt-parser robotstxt-builder rfc5234