crawl

Website crawler and differencer
v0.3.1 URL: https://unpkg.com/crawl@0.3.1/index.js
OpenBrowse Files
crawldifferencerdiffwebwebsite

easycrawler

Simple and Easy Crawler library for Node.js
v1.0.1 URL: https://unpkg.com/easycrawler@1.0.1/index.js
OpenBrowse Files
spidercrawlersearchscraperwebsiteweb-crawlernode-crawlerjs-crawlerspiderweb-searchlinksurl

open

Open stuff like URLs, files, executables. Cross-platform.
v10.2.0 URL: https://unpkg.com/open@10.2.0/index.js
OpenBrowse Files
appopenopeneropenslaunchstartxdg-openxdgdefaultcmdbrowsereditorexecutableexeurlurlsargumentsargsspawnexecchildprocesswebsitefile

crawled

Crawled - the smartest crawler ever made.
v2.4.4 URL: https://unpkg.com/crawled@2.4.4/index.js
OpenBrowse Files
crawlcrawlercrawledclicommandlinecmdcommandwebwebpagewebsitewwwinternet

rag-crawler

Crawl a website to generate knowledge file for RAG
v1.6.0 URL: https://unpkg.com/rag-crawler@1.6.0/dist/index.js
OpenBrowse Files
crawlerllmRAGwebsite