isbot

🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.

v5.1.17 URL: https://unpkg.com/isbot@5.1.17/index.mjs

Open Browse Files

bot crawlers spiders googlebot useragent user agent parsing 🤖

sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

v3.2.18 URL: https://unpkg.com/sitemapper@3.2.18/lib/assets/sitemapper.js

Open Browse Files

parse sitemap xml robots.txt sitemaps crawlers webcrawler

@qbbsh/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

v3.2.10 URL: https://unpkg.com/@qbbsh/sitemapper@3.2.10/lib/assets/sitemapper.js

Open Browse Files

parse sitemap xml robots.txt sitemaps crawlers webcrawler

@raing3/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

v1.0.1 URL: https://unpkg.com/@raing3/sitemapper@1.0.1/lib/assets/sitemapper.js

Open Browse Files

parse sitemap xml robots.txt sitemaps crawlers webcrawler

@context-labs/sitemapper

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

v3.2.10 URL: https://unpkg.com/@context-labs/sitemapper@3.2.10/lib/assets/sitemapper.js

Open Browse Files

parse sitemap xml robots.txt sitemaps crawlers webcrawler