Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dash utils and expand prefect utils #1

Open
wants to merge 46 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
a9f7d83
Add dash mantine components for job management
taxe10 Sep 10, 2024
b71b8b0
Add dash bootstrap components for job management
taxe10 Sep 10, 2024
bcd0ddb
Adding job manager component according to UI style
taxe10 Sep 10, 2024
a8950fc
Add example scripts
taxe10 Sep 10, 2024
4bdbe01
Place deployment inside test harness
taxe10 Sep 10, 2024
4271ef9
Add package description
taxe10 Sep 10, 2024
460bb93
Added delete flow_run
taxe10 Sep 10, 2024
281f0b0
Make delete test less restrictive
taxe10 Sep 10, 2024
b6a6064
Add cancel flow_run and update get_flow_run_name with is_complete option
taxe10 Sep 11, 2024
6023a4e
Add staticmethod decorator to callback
taxe10 Sep 11, 2024
de02d53
Add dash testing and pin griffe as newest version is not compatible w…
taxe10 Sep 11, 2024
678ce65
Add dash unit tests
taxe10 Sep 11, 2024
fe7d70b
Add left margin drawer covering the modal
taxe10 Sep 11, 2024
b9ca9fc
Added optional modal props
taxe10 Sep 11, 2024
2d2abf4
Rename get_flow_runs_by_name to query
taxe10 Sep 20, 2024
3fb6757
Add generation of ML parameters
taxe10 Sep 20, 2024
8e8346b
Assign unique naming convention per ui style
taxe10 Sep 20, 2024
a162cfd
Refactor MLEx dash components
taxe10 Sep 20, 2024
13779a1
Update unitest for refactor and add ML parameters generation
taxe10 Sep 20, 2024
3bf74e3
Update examples for refactor and add model.json files with gui parame…
taxe10 Sep 20, 2024
802f403
Parse job_manager to layout
taxe10 Sep 20, 2024
bc2de11
Add callback to retrieve lists of jobs
taxe10 Sep 21, 2024
045ae10
Replace dcc.Dropdown for dbc.Select to allow overflow of text
taxe10 Sep 21, 2024
9ed5318
Rename dash_utils to components_<ui_style>
taxe10 Sep 21, 2024
886028e
Remove Columns
taxe10 Oct 16, 2024
ee64e47
Minor refactor mlex_components and add get params values
taxe10 Oct 16, 2024
fd8c595
Add test to retrieve params values
taxe10 Oct 16, 2024
1e68489
Add get params values to examples
taxe10 Oct 16, 2024
53aa5af
Add get logs, and cancel/delete jobs
taxe10 Oct 17, 2024
1da0aee
Add get logs with flow_run_id
taxe10 Oct 17, 2024
d12aef5
Update component name and add warning modals
taxe10 Oct 17, 2024
7fcc4bd
Add display logs, cancel/delete jobs, and disable advanced options wh…
taxe10 Oct 17, 2024
0d8cfbd
Expand toggle tests
taxe10 Oct 17, 2024
17c23dc
Add get flow run logs test
taxe10 Oct 17, 2024
c325c0d
Update dbc version to clear dbc.Select when value is None
taxe10 Oct 17, 2024
c161280
Add warning modals
taxe10 Oct 17, 2024
7059080
Add get logs, cancel/delete jobs
taxe10 Oct 17, 2024
3013d0f
Adapt warning toggle test for dmc
taxe10 Oct 17, 2024
765d522
Fix bug when canceling a flow_run that has finalized
taxe10 Oct 17, 2024
d31995f
Update test for bug fix
taxe10 Oct 17, 2024
d230bc4
Typo
taxe10 Oct 17, 2024
ea45227
Add dev dependencies
taxe10 Oct 17, 2024
c7ba3a7
Add profile
taxe10 Oct 17, 2024
a27e63c
Undoing previous sortin
taxe10 Oct 17, 2024
2638094
Remove profile
taxe10 Oct 17, 2024
1b5258d
Add isort profile
taxe10 Oct 17, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/test-lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
python-version: '3.11'
- name: Install dependencies
run: |
python -m pip install ".[all]""
python -m pip install ".[all,dev]"
- name: Lint with flake8
run: |
# stop the build if there are Python syntax errors or undefined names
Expand Down
24 changes: 23 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,26 @@
# mlex_utils
# Utils for MLExchange Platform

**mlex_utils** is a utility package designed to support the MLExchange platform by providing convenient tools and extensions for Dash Plotly and Prefect. Currently, this package focuses on facilitating job launches and monitoring workflows with Prefect, making it easier to manage and track your machine learning tasks. As the platform evolves, mlex_utils will continue to expand, incorporating additional utilities to enhance the MLExchange experience and streamline data workflows.

## Features
- Utilities for integrating Dash Plotly components to orchestrate ML jobs using Dash Bootstrap Components and Dash Mantime Components
- Prefect job management tools for launching, scheduling, and monitoring ML jobs.

## Installation

To install `mlex_utils`, you can create a new Python environment and install all the dependencies:

```
conda create -n new_env python==3.11
conda activate new_env
pip install .
```

Alternatively, you can choose to install a set of utils according to your use case. For example, to install the Prefect-related dependencies and utils:

```
pip install ".[prefect]"
```

## Copyright
MLExchange Copyright (c) 2024, The Regents of the University of California,
Expand Down
Binary file added examples/assets/mlex.ico
Binary file not shown.
Binary file added examples/assets/mlex.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading