fdir

The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s

crawler-user-agents

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

notion-md-crawler

A library to recursively retrieve and serialize Notion pages with customization for machine learning applications.

react-pdf

Display PDFs in your React app as easily as if they were images.