1. Change the default values inside 'settings.py'.
2. Run the crawler using ant of these 2 command line options:
* Scheduled Job:
python crawler_job.py --s #This option will run the crawler as an "scheduled" job. The crawler will wait for the right schedule time set on the 'settings.py' everyday before it begin crawling.
* Unscheduled Job:
python crawler_job.py --u #This option will run the crawler as an "unscheduled" job. The crawler will immediately run after entering the command.
forked from minimaxir/facebook-page-post-scraper
-
Notifications
You must be signed in to change notification settings - Fork 1
popstick/facebook-page-post-scraper
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis. Added MySQL support
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%