Skip to content
/ ml-ecmwf Public

Download and prepare data from ECMWF for ML/AI processing

License

Notifications You must be signed in to change notification settings

ucyo/ml-ecmwf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

40 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Overview

This is a template for generating a reproducible Python environment for data science within a docker environment. The current base setup is like the following:

Package Usage
docker OS environment
poetry Python package manager
jupyter notebook Development environment

Steps for environment creation

  1. Create environment files (e.g. copy examples)
cp env/.jupyter.env.example env/.jupyter.env
  1. Build docker container
sudo docker-compose build .

2.1 Start python within docker container

sudo docker-compose run code python

2.2 Start jupyter notebook

sudo docker-compose up --build

Add a python package

  1. Use poetry to add package and resolve dependencies
sudo docker-compose run code poetry add <package>
  1. Commit changes to git
git add code/poetry.lock code/pyproject.toml

About

Download and prepare data from ECMWF for ML/AI processing

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published