Releases: zapata-engineering/orquestra-sdk
Releases · zapata-engineering/orquestra-sdk
v0.58.0
What's Changed
- chore: CHANGELOG bump by @jamesclark-Zapata in #323
- chore: fix space around arithmetic operators. by @BenjaminMummery in #325
- docs: reference revised schema for TaskLogMessage. by @BenjaminMummery in #326
- feat!: add orquestra sdk head node current version as a requirement in ray runtime environments by @BenjaminMummery in #324
- feat!: bump Dockerfiles to Python 3.11 by @jamesclark-Zapata in #330
- chore: Bump coverage Python and remove Windows coverage tests by @jamesclark-Zapata in #331
- feat: normalize end time for terminated workflows in SDK by @BenjaminMummery in #329
- chore: remove deprecationwarning for 'None' workspace_ids in secrets. by @BenjaminMummery in #333
Full Changelog: v0.57.0...v0.58.0
v0.57.0
What's Changed
- chore: roll changelog by @alexjuda in #309
- Imp: Proper error when secrets are used as strings by @SebastianMorawiec in #310
- Fix: orq login --list properly handles missing or empty config file by @SebastianMorawiec in #311
- int: Remove WorkflowDB.get_workflow_runs_list by @alexjuda in #312
- refactor!: remove unused
corq
code by @alexjuda in #314 - refactor: separate the list workflows summary and list interactable workflow objects paths by @BenjaminMummery in #313
- Feat: Workflows continue to run after a failed task until all started tasks are complete. by @BenjaminMummery in #317
- Docs: fix pydoclint errors by @BenjaminMummery in #316
- fix: sdk.Secret not pickling by @jamesclark-Zapata in #318
- feat: catch exceptions from environment setup in workflow driver ray by @BenjaminMummery in #301
- feat: CLI display owner when listing CE workflow runs by @BenjaminMummery in #320
- docs: make requirement of matching orquestra-sdk versions explicit. by @BenjaminMummery in #322
- chore: add missing mypy stubs. by @BenjaminMummery in #321
Full Changelog: v0.56.0...v0.57.0
v0.56.0
What's Changed
- chore: Bump CHANGELOG by @jamesclark-Zapata in #297
- int: Fix changelog formatting by @alexjuda in #298
- Feat!: ORQ_CURRENT_CONFIG as default config when using "auto" by @SebastianMorawiec in #299
- docs: simple docs fixes by @BenjaminMummery in #292
- Feat: Dry_run of a workflows by @SebastianMorawiec in #282
- chore: remove UnsavedConfigChangesError by @BenjaminMummery in #300
- feat: add
orq restart
command by @BenjaminMummery in #302 - int!: remove sdk.v2 module by @alexjuda in #305
- int: fix docs warnings by @alexjuda in #304
- Fix: Package-dependent exception thrown from the task no-longer causes the red-herring error by @SebastianMorawiec in #306
- ci: Build isolated docs to validate syntax by @alexjuda in #307
- CI: add docstring checking. by @BenjaminMummery in #308
- Feat: bump ray version by @SebastianMorawiec in #276
- feat: Rich CLI outputs by @jamesclark-Zapata in #303
Full Changelog: v0.55.0...v0.56.0
v0.55.0
What's Changed
- Feat: Remove all instances of project prompts for listing workflows by @SebastianMorawiec in #264
- chore: roll changelog by @alexjuda in #275
- docs: clarify secrets documentation. by @BenjaminMummery in #268
- docs: correct unclear language in quickstart guide. by @BenjaminMummery in #267
- feat!: Remove QE by @jamesclark-Zapata in #280
- feat: remove checks for additional env vars when determining local or remote execution. by @BenjaminMummery in #270
- docs: fix typo in resource management - 10k is not 10^7 by @BenjaminMummery in #281
- int: prototype makefile cleanup by @alexjuda in #283
- int: remove subtree by @alexjuda in #285
- feat!: Split logs into stdout and stderr by @jamesclark-Zapata in #284
- docs: remove references to wf.prepare() by @BenjaminMummery in #287
- internal: Print coverage only on matrix jobs with print_coverage set by @jamesclark-Zapata in #290
- feat: Redirect logs to files by @jamesclark-Zapata in #289
- docs: update Jupyter tutorial by @alexjuda in #286
- docs: Link Windows installation by @alexjuda in #294
- int: Fix CHANGELOG formatting by @alexjuda in #295
- ci: Lint changelog by @alexjuda in #296
- Int: More refactoring of internal code by @SebastianMorawiec in #288
- feat: Task logs from CE by @jamesclark-Zapata in #293
Full Changelog: v0.54.0...v0.55.0
v0.54.0
What's Changed
- Update CHANGELOG.md by @alexjuda in #251
- docs: add clearer config_name description in secrets guide. by @BenjaminMummery in #243
- docs: add a new beginners cli tutorial by @BenjaminMummery in #242
- Feat!: Change behaviour of orq wf list command by @SebastianMorawiec in #250
- docs: Use orquestra-sdk[all] as the update command by @jamesclark-Zapata in #254
- int: Remove outdated release GH workflow file by @alexjuda in #255
- feat: add version command. by @BenjaminMummery in #252
- fix: a tiny typo '_' -> '-' fix in CLI help strings by @zaptim in #248
- Imp: Aggregate all NotATaskWarnings to one warning by @SebastianMorawiec in #258
- docs: ensure that dependency installation issues are resolved. by @BenjaminMummery in #260
- feat: Error message when submitting an unsupported workflow SDK version to CE by @jamesclark-Zapata in #257
- Fix: Fix usage of get_artifacts on failed workflow by @SebastianMorawiec in #261
- docs: add documentation for workspace and project management. by @BenjaminMummery in #256
- fix: Add State.KILLED as a valid 'completed' state by @jamesclark-Zapata in #262
- tests: Reduce performance test timeouts by @jamesclark-Zapata in #263
- chore!: remove deprecated wfprint and workflow_logger by @jamesclark-Zapata in #272
- Int: Flatten our code. Remove
v2
ordorq
as those names are obsolete by @SebastianMorawiec in #265 - docs: rm custom-images guide by @1ethanhansen in #271
- docs: MLflow connection by @alexjuda in #266
New Contributors
Full Changelog: v0.53.0...v0.54.0
v0.53.0
What's Changed
- chore: remove debug print by @jamesclark-Zapata in #228
- Feat!: Remove unsupported local_run() function from WorkflowDef by @SebastianMorawiec in #227
- chore: Use NamedTuple when returning IDs by @jamesclark-Zapata in #225
- fix: Use non-root user to install Python packages and use a venv by @emre-aydin in #231
- Fix: Fix listing workflows on ray runtime when using ORQ_CURRENT_* env variables by @SebastianMorawiec in #234
- Imp: Throw an early error at submittion time when invalid number of resources was requested by @SebastianMorawiec in #230
- Feat:
get_current_user
function to mlflow namespace for powering MLflow UI label by @SebastianMorawiec in #238 - Feat: Bump Ray to 2.5.1 by @SebastianMorawiec in #240
- docs: correct references to 'in-process' that should be 'in_process' by @BenjaminMummery in #239
- fix: Use non-root user to install Python packages and use a venv in CUDA Docker image by @emre-aydin in #235
- Feat: get mlflow tracking uri and token in API by @BenjaminMummery in #232
- docs: rework Dependency Installation guide by @alexjuda in #244
- docs: avoid undefined pronouns. by @BenjaminMummery in #245
- Feat: Verify if workflow resources are sufficient at submission time by @SebastianMorawiec in #246
- docs: QE migration guide by @alexjuda in #241
- fix: move venv for studio by @roryschadler in #233
- docs: CE migration guide, missing bits by @alexjuda in #247
- fix: module not found errors on CE by @alexjuda in #249
Full Changelog: v0.52.0...v0.53.0
v0.52.0
What's Changed
- chore: Roll CHANGELOG.md by @alexjuda in #210
- Feat!: Remove last bits of default config in our code by @SebastianMorawiec in #212
- docs: add how to log in with CE/QE. by @BenjaminMummery in #209
- refactor: single place for handling dates by @alexjuda in #213
- Feat: Default workspace and project can be set locally using env variables by @SebastianMorawiec in #208
- Feat: Add warning when accessing secrets without specifying workspace by @SebastianMorawiec in #215
- feat: list stored logins by @BenjaminMummery in #206
- int: emit task start/end markers by @alexjuda in #217
- feat: access system and env setup logs from the CLI by @BenjaminMummery in #211
- feat: api get system logs from local ray by @BenjaminMummery in #221
- feat: tell the user what runtime is used when reporting successful login by @BenjaminMummery in #216
- feat: capture arbitrary prints inside tasks by @alexjuda in #220
- Int: Prepare CE Runtime to use different client URI's by @SebastianMorawiec in #219
- Feat!: Changed wf_def.get_tasks() return type from set, to topologically sorted list by @SebastianMorawiec in #222
- chore: Fix bad merge of CHANGELOG by @jamesclark-Zapata in #226
- feat: MLFlow temp artifact utility by @BenjaminMummery in #223
Full Changelog: v0.51.0...v0.52.0
v0.51.0
What's Changed
- docs: update changelog for v0.50.0 by @BenjaminMummery in #196
- imp: separate env set up logs from task logs by @alexjuda in #191
- chore: Add quotes by @roryschadler in #201
- docs: Fix code snippets by @jamesclark-Zapata in #200
- chore!: CE default login action by @jamesclark-Zapata in #199
- feat: Force stop workflows runs by @jamesclark-Zapata in #198
- feat: API access CE system logs. by @BenjaminMummery in #195
- chore: Add missing breaking change in changelog for v0.50.0 by @jamesclark-Zapata in #203
- feat: Add Filtering ability for get_tasks function in SDK API by @BenjaminMummery in #188
- imp: env setup logs for local runtime by @alexjuda in #194
- Feat!: Switch default source import from LocalImport to InlineImport by @SebastianMorawiec in #202
- Fix: Fix Ray WFs failing caused by any task returning dict defined in return statement by @SebastianMorawiec in #205
- feat: informative error when passing string as pat by @BenjaminMummery in #204
- Feat: Add new public API for WorkflowRun which returns serialized values and artifacts by @SebastianMorawiec in #207
Full Changelog: v0.50.0...v0.51.0
v0.50.0
🚨 Breaking Changes
WorkflowRun.get_logs()
now returns a data structure with logs split into categories.- Local workflow database has changed format: downgrading from v0.50.0 will require user intervention.
🔥 Features
- Add .project property to WorkflowRun to get the info about workspace and project of running workflow
VersionMismatch
warnings are shown only when interacting with specific workflow runs, not while listing workflows.- Add
--qe
flag toorq login
, this is the default so there is no change in behavior. - Bump Ray version to 2.4.0
- New API method
WorkflowRun.start_from_ir()
that allows to start workflow run having only IR object - The WorkflowLogs object returned from
WorkflowRun.get_logs()
now includes Compute Engine system logs for workflow runs using CE.
🐛 Bug Fixes
- Secrets with workspaces now work inside workflow functions and for personal access tokens in
GithubImport
. list_workspaces
andlist_projects
work inside Studio withauto
config- Listing workflows on QE no longer fails if there was a CE workflow in the DB
💅 Improvements
- Add prompters to
orq wf submit
command for CE runtime if workspace and project weren’t passed explicitly - Auto-select and highlight current workspace and project when using
auto
config in CLI in studio orquestra-sdk-base
CPU container image has a 20% size reduction.- Added
State
enum to the baseorquestra.sdk
package for easier filtering task runs. - Logs fetched from CE are now split into “task” and “env setup” categories.
📃 Docs
- Update resource management guide for Compute Engine
- Add section for using custom images on Compute Engine
What's Changed
- chore: Update Changelog by @jamesclark-Zapata in #179
- Feat: Add project property to workflow run to return workspace and project by @SebastianMorawiec in #173
- Imp: Prompt for workspace and project while submitting a workflow via CLI by @SebastianMorawiec in #181
- chore: Add QE CLI flag by @jamesclark-Zapata in #168
- feat: suppress VersionMismatch warnings when listing wf runs by @BenjaminMummery in #174
- feat: secret with workspaces in IR and GithubImport by @jamesclark-Zapata in #185
- ci: add
imp
/improvement
prefix to the PR template by @alexjuda in #172 - chore: Add ruff to github workflows by @jamesclark-Zapata in #180
- ci: run pyright by @alexjuda in #177
- Internal: Use external URI when using auto config on cluster instead of internal one by @SebastianMorawiec in #190
- docs: some .rst typos and missing link by @1ethanhansen in #184
- refactor!: logs datastructure by @alexjuda in #187
- chore: Bump Ray to 2.4.0 by @jamesclark-Zapata in #137
- fix: Reduce CPU base image size by @jamesclark-Zapata in #160
- Feat: New API to start workflow runs from IR by @SebastianMorawiec in #175
- fix: Skip CE workflows when listing workflows in QE by @jamesclark-Zapata in #192
- imp: re-export State in the base package by @alexjuda in #193
- docs: Update for custom images and Compute Engine by @emre-aydin in #186
- Imp: Improve workspace and project prompters in studio showing and auto-selecting current context by @SebastianMorawiec in #182
- docs: Update documentation as we disable single node runtime by @emre-aydin in #197
New Contributors
- @1ethanhansen made their first contribution in #184
Full Changelog: v0.49.1...v0.50.0
v0.49.1
What's Changed
- chore: Update CHANGELOG.md by @jamesclark-Zapata in #176
- Fix: Fix prompters for workspaces and projects by @SebastianMorawiec in #178
Full Changelog: v0.49.0...v0.49.1