crawler

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

v2.0.2 URL: https://unpkg.com/crawler@2.0.2/index.js

Open Browse Files

javascript crawler spider scraper scraping jquery nodejs http https http2 got request url network gzip

scrape-it

A Node.js scraper for humans.

v6.1.3 URL: https://unpkg.com/scrape-it@6.1.3/lib/index.js

Open Browse Files

scrape it a scraping module for humans

@mintlify/scraping

Scrape documentation frameworks to Mintlify docs

v4.0.26 URL: https://unpkg.com/@mintlify/scraping@4.0.26/bin/index.js

Open Browse Files

mintlify mint scraping

rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

v23.6.101 URL: https://unpkg.com/rebrowser-puppeteer-core@23.6.101/lib/esm/puppeteer/puppeteer-core-browser.js

Open Browse Files

rebrowser rebrowser-patches automation bot bot-detection captcha scraping web-scraping puppeteer chrome headless automation

google-sr

Fast and efficient Package for scraping Google search results without the need for an API key

v4.0.0 URL: https://unpkg.com/google-sr@4.0.0/dist/index.js

Open Browse Files

google-sr gsr google googlesr search google-search googlesearch scraping simple