simplecrawler

Very straightforward, event driven web crawler. Features a flexible queue interface and a basic cache mechanism with extensible backend.

lru-cache

A cache object that deletes the least-recently-used items.

axios-cached-dns-resolve

Caches dns resolutions made with async dns.resolve instead of default sync dns.lookup, refreshes in background