x-crawl

x-crawl is a flexible Node.js AI-assisted crawler library.

v10.0.2 URL: https://unpkg.com/x-crawl@10.0.2/index.js

Open Browse Files

x-crawl nodejs typescript ts javascript crawl crawler spider ai ai assisted ai crawl flexible control page rotate agents fingerprint multifunction

@jswork/next-spider-fetch

Fetch special for spider.

v1.0.13 URL: https://unpkg.com/@jswork/next-spider-fetch@1.0.13/dist/index.js

Open Browse Files

next spider crawl fetch

syphonx

SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or size. It combines the power of CSS Selectors and jQuery, Regular Expressions, and Javascript into a declarative template format to elegantly solve the simplest

v1.2.66 URL: https://unpkg.com/syphonx@1.2.66/index.js

Open Browse Files

automation cheerio crawl crawler crawling chrome dom headless html html2json jquery parse parser puppeteer regex scrape scraper scraping spider spidering transform web web crawler web crawling web scraper web scraping

spiderable-middleware

Perfect SEO for JavaScript websites. Pre-rendering — it's just like SSR with simple integration and no coding

v2.0.0 URL: https://unpkg.com/spiderable-middleware@2.0.0/lib/index.js

Open Browse Files

_escaped_fragment_crawl SEO middleware spiderable crawlble prerender prerendering ajax seo angular backbone emberjs meteor meteorjs express connect http https ostr.io

js-spider

JSpider 3 is a Chrome DevTools crawler framework that includes full crawler support. JSpider 3 是在 Chrome Devtools 中进行爬虫的爬虫框架, 这个框架包括了完整的爬虫支持。

v3.2.3 URL: https://unpkg.com/js-spider@3.2.3/dist/JSpider.esm.min.js

Open Browse Files

spider javascript web crawl browser front-end