Floodesh is a distributed web spider/crawler written with Nodejs.
node.js web crawler
Generic web crawler powered by Node.js
Minimalistic web crawler for Node.js
Web crawler wrapper around puppeteer module to simply the crawling on ajax/java script enabled pages.
A really small crawler.
Utils for web resources. Get a web page and save to disk (with minimal dependencies)
A web crawler/spider
web crawler, parser and scraper with storage capabilities
A proxy crawler.
Bare tooltip web component.
Page scrapper that retrieves proxy server information from HideMyAss website
A user agent parser that determines whether a request is from a robot, crawler, spider, etc.
Page scrapper that retrieves proxy server information from FreeProxyLists website
"a service for scraping emails from a webpage, given the number of levels to reach
Web Crawler in Node.js to spider dynamically whole websites.
Flowesh is the non-cluster version of floodesh. It's a middleware based web spider which is lightweight and easy to maintain
Scrap the web asynchronously in live, reusing Node.js, all in one file, with a few lines!
A web scraping framework written in coffeescript