shiny-spider

A web scraper designed for the S&P 500 stock index out of the box, to be easy to implement and use directly after install, as well as customize based on specific user needs.

syphonx

SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or size. It combines the power of CSS Selectors and jQuery, Regular Expressions, and Javascript into a declarative template format to elegantly solve the simplest

crawlbug

A NodeJS web crawler that can be deployed to multiple machines and writes page data to a Firebase database.