Title: Exploratory Data Analysis on the World Bank Data
Following steps are performed to achieve the given architecture.
- Load public dataset into big query.
- Understand the schema and choose the indiactors.
- Query the public dataset to get the required data.
- Store the data on GCS creating buckets.
- Clean and process the data.
- Combine the data and batch load the data into bigquery.
- With CI/CD pipeline, run queries.
- Obtain visualisations.