crawl

Website crawler and differencer

v0.3.1 URL: https://unpkg.com/crawl@0.3.1/index.js

Open Browse Files

crawl differencer diff web website

easycrawler

Simple and Easy Crawler library for Node.js

v1.0.1 URL: https://unpkg.com/easycrawler@1.0.1/index.js

Open Browse Files

spider crawler search scraper website web-crawler node-crawler js-crawler spider web-search links url

open

Open stuff like URLs, files, executables. Cross-platform.

v10.2.0 URL: https://unpkg.com/open@10.2.0/index.js

Open Browse Files

app open opener opens launch start xdg-open xdg default cmd browser editor executable exe url urls arguments args spawn exec child process website file

sitebot

SiteBot is an event driven website crawler.

v2.2.0 URL: https://unpkg.com/sitebot@2.2.0/index.js

Open Browse Files

website crawler spider site crawler bot site bot website

rag-crawler

Crawl a website to generate knowledge file for RAG

v1.6.0 URL: https://unpkg.com/rag-crawler@1.6.0/dist/index.js

Open Browse Files

crawler llm RAG website