Parallel downloading of airbnb profiles.
To run this project you will need to:
- Fill the method
user_ids_to_download
at airbnb_spider.py with the strategy you need to download the data (as a list of ids coming from a CSV file). - Extract an
airbnb_client_id
from a device using the Airbnb unofficial API (as an Android phone with the official app). Create a enviroment variable calledAIRBNB_CLIENT_ID
with the value of such key. - Execute
scrapy crawl airbnb
. Profiles will be saved as JSON files.