Skip to content

(part of) A Python/Flask/SQL application for scraping the internet for news articles relating to all politicians and parties, and saving these to a searchable database

Notifications You must be signed in to change notification settings

jomwells/politicsDB

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

politicsDB - Python news article scraper and database script

(part of) A Python/Flask/SQL application for scraping the internet for news articles mentioning UK politicians and/or political parties, and saving these to a searchable SQL database (for use with a Flask Web Server - not included) along with references to all mentions.

This code relies on the database (JSON file) of politicans names, websites and images provided by the government here

Please note - this file is now outdated (as of the 2017 GE) however the code functions properly

This is only part of the application (which is work in progress), this provides no mechanism for viewing the contents of the generated site.db file, or searching for a particular politicans, this is achieved through a custom Flask web server. However, the methods used in update_database.py could be adapted for any form of web article scraping

About

(part of) A Python/Flask/SQL application for scraping the internet for news articles relating to all politicians and parties, and saving these to a searchable database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages