-
Notifications
You must be signed in to change notification settings - Fork 1
Execute Experiments without Kubernetes on Galileo
Jonas Umland edited this page Mar 30, 2021
·
1 revision
- Clone the 2 required repos (mpci-dag, mpci)
- For each repo create one python virtualenv and install the respective
requirements.txt
(mpci/services/python-images/requirements.txt and mpci-dag/requirements.txt) - build the execution environment locally using
docker build . -f r-executor.Dockerfile -t mpci/mpci_execution_r
in folder mpci/services/executionenvironments/r/executor - spin up a postgres instance e.g using a docker-compose file such as
version: '3'
services:
postgres-db:
image: postgres:12
environment:
POSTGRES_USER: admin
POSTGRES_PASSWORD: admin
ports:
- "5432:5432"
- start a screen process, activate the mpci-virtualenv and start the backend using
cd mpci/services/python-images/src/ && run_dev_server.sh
- start another screen process, activate the mpci-dag venv start the experiment with
PYTHONPATH=. python experiments/run.py
. occasionally it might be helpful to delete the postgres and restart to empty the database.
- Home
- Setup
- API Documentation
- Data model
- How to...
- ...add a new remote database
- ...create migrations
- ...develop locally
- ...simplified dev setup
- ...deploy on kubernetes (internal)
- ...monitor the cluster
- ...fix expired K8s certificates
- ...add new dependencies
- ...rebuild base image
- ...add a new algorithm in R
- ...add support for new language
- ...add a new node to Kubernetes cluster
- Coding Conventions
- Roadmap
- Ownership