Skip to content
This repository has been archived by the owner on Sep 11, 2022. It is now read-only.

webScraper v0.4 - alpha

Latest
Compare
Choose a tag to compare
@danthespal danthespal released this 20 Feb 10:11
· 9 commits to master since this release
  • added requirements.txt file so that installing same libraries will be easier and updated README file
  • corrected pep8 warnings
  • added dynamic user-agents to settings file
  • added additional info about a product
  • added loop until last page to extract all elements
  • addapt css to xpath, see more info in comments
  • store items informations into sqlite database
  • fix some problems in saving items
  • increase column product_name string
  • check for duplicate product_name