node-web-crawler

To use the web crawler, you need to have Node.js installed on your machine.

To run the web crawler, you need to run the following command and provide your desired base url:

npm run start BASE_URL

NOTE: The web crawler only crawls links on the same base url.