epic-link-crawler

A simple in depth links crawler. You can easily collect all the links available on a website.