fdir

The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

v6.4.2 URL: https://unpkg.com/fdir@6.4.2/dist/index.js

Open Browse Files

util os sys fs walk crawler directory files io tiny-glob glob fast-glob speed javascript nodejs

@nodelib/fs.walk

A library for efficiently walking a directory recursively

v2.0.0 URL: https://unpkg.com/@nodelib/fs.walk@2.0.0/out/index.js

Open Browse Files

NodeLib fs FileSystem file system walk scanner crawler

apify-client

Apify API client for JavaScript

v2.10.0 URL: https://unpkg.com/apify-client@2.10.0/dist/bundle.js

Open Browse Files

apify api apifier crawler scraper

crawler

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

v2.0.2 URL: https://unpkg.com/crawler@2.0.2/index.js

Open Browse Files

javascript crawler spider scraper scraping jquery nodejs http https http2 got request url network gzip

notion-md-crawler

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

v1.0.0 URL: https://unpkg.com/notion-md-crawler@1.0.0/dist/index.cjs

Open Browse Files

notion crawler crawling serialization machine-learning ai markdown