robotstxt-util

RFC 9309 spec compliant robots.txt builder and parser. 🦾
v4.1.0 URL: https://unpkg.com/robotstxt-util@4.1.0/dist/index.js
OpenBrowse Files
robotsrobotstxtseosearch-engine-optimizationrobotstxt-parserrobotstxt-builderrfc5234