Skip to content

Execute Experiments without Kubernetes on Galileo

Jonas Umland edited this page Mar 30, 2021 · 1 revision
  • Clone the 2 required repos (mpci-dag, mpci)
  • For each repo create one python virtualenv and install the respective requirements.txt (mpci/services/python-images/requirements.txt and mpci-dag/requirements.txt)
  • build the execution environment locally using docker build . -f r-executor.Dockerfile -t mpci/mpci_execution_r in folder mpci/services/executionenvironments/r/executor
  • spin up a postgres instance e.g using a docker-compose file such as
version: '3'
services:
  postgres-db:
    image: postgres:12
    environment:
      POSTGRES_USER: admin
      POSTGRES_PASSWORD: admin
    ports:
      - "5432:5432"

  • start a screen process, activate the mpci-virtualenv and start the backend using cd mpci/services/python-images/src/ && run_dev_server.sh
  • start another screen process, activate the mpci-dag venv start the experiment with PYTHONPATH=. python experiments/run.py . occasionally it might be helpful to delete the postgres and restart to empty the database.