PROJECT : CRAWLER MODULE 3
DESCRIPTION :
- This project contains the module which is basically used to format the facebook and twitter crawler feeds
- Folder Inputs has the json format which are the outputs of Crawler Module 1 ( to extract feeds) & Crawler Module 2 ( to extract concepts (entity,hastag etc))
- One can handle any new concept type by adding new entry in the JSON under feedConcepts and a additional condition formatStatement module in crawlerModule.js
HOW TO RUN THE PROJECT :
- This Project can be run on node
- Steps to run
- install node
- clone the repo
- run the file node crawlerModule.js