crawler

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

v2.0.2 URL: https://unpkg.com/crawler@2.0.2/index.js

Open Browse Files

javascript crawler spider scraper scraping jquery nodejs http https http2 got request url network gzip

scrape-it

A Node.js scraper for humans.

v6.1.3 URL: https://unpkg.com/scrape-it@6.1.3/lib/index.js

Open Browse Files

scrape it a scraping module for humans

dom-parser

Fast dom parser based on regexps

v1.1.5 URL: https://unpkg.com/dom-parser@1.1.5/dist/index.js

Open Browse Files

domparser dom parser xml html xmlparser htmlparser scraping

@mintlify/scraping

Scrape documentation frameworks to Mintlify docs

v4.0.18 URL: https://unpkg.com/@mintlify/scraping@4.0.18/bin/index.js

Open Browse Files

mintlify mint scraping

rebrowser-puppeteer-core

A drop-in replacement for puppeteer-core patched with rebrowser-patches. It allows to pass modern automation detection tests.

v23.6.101 URL: https://unpkg.com/rebrowser-puppeteer-core@23.6.101/lib/esm/puppeteer/puppeteer-core-browser.js

Open Browse Files

rebrowser rebrowser-patches automation bot bot-detection captcha scraping web-scraping puppeteer chrome headless automation