The task is to implement an ETL (Extract, Transform, Load) client in Python3 that will interact with a local API data source.
Preferred Python version >= 3.8 (https://devguide.python.org/versions/)
You may only use appropriately licensed and open source 3rd party libraries when necessary.
Write an ETL client that will:
- Extract data only from latest week from both:
SolarandWindendpoints. - Transform naive timestamps from the data source to a timezone aware
utcformat. - Ensure column naming and column type are adhering proper naming strategy and types.
- Finally load the data to an
/outputdirectory, using a file format of your choosing. Keeping in mind directory and filename structure/convention.
Do not change the /api_data_source
The task will be assessed on design, implementation, functionality, documentation, and testability.
Treat this as a production release.
The code should be pushed to version control repository that can be easily retrieved and ran locally.
After completing the assessment, please submit the repository link to: [email protected].
Any further questions required for clarification, please also reach out to Will.
- Setup a virtual or package manager environment (
pipenv,conda, etc.) - Install requirements into your environment:
pip install -r requirements.txt - Run the API data source:
python -m uvicorn api_data_source.main:app --reload - Open and view the API documentation:
http://127.0.0.1:8000/docsorhttp://localhost:8000/docs
Good luck!