Introduction to Node Crawler Series

This is a set of tutorials that will help you with your very first crawler with node.js.

The plan of this tutorial is as follows. First of all, we will write a functional crawler using node.js and dump the data into files or simply print it on screen. In the following article, we will use MongoDB as our data management system and organize our data. Then we will optimize and attack some of the pitfalls.

As mentioned, Node.js and MongoDB are required for the full tutorial. Here we link to the articles that talks about the installation and configuration of them.

• Node.js Download
• Documentation of MongoDB