Skip to content

Latest commit

 

History

History
288 lines (195 loc) · 12.8 KB

README.md

File metadata and controls

288 lines (195 loc) · 12.8 KB
Raw

This add-on has been deprecated

Important Note:

The seeq-azureml add-on is meant to be used for proof-of-concept models only. There are four significant caveats that users should be aware of when using this add-on:

  1. A new Azure app registration must be set up to provide the identity to Seeq via OIDC (Open ID Connect).
  2. The Azure app registration needs contributor access to the AzureML Studio workspace.
  3. A secret needs to be generated and configured in an ini file as per the instructions on the Seeq Add-on Installation section of the documentation.
  4. This add-on has very limited capability for scalability to multiple assets.

Unit tests

N|Scheme

N|Scheme

Introduction

seeq-azureml provides an example framework that allows a data scientist working in Azure ML Studio and a plant engineer or subject matter expert (SME) working in Seeq to collaborate and develop an effective, sustainable solution for high value problems in manufacturing.

This python module integrates with Microsoft Azure Machine Learning (AML) models as a web service and can be installed as a Seeq Add-on in Seeq Workbench. The plant engineer and/or SME interacts with the module through an easy to use UI from which they can accomplish critical activities such as ad hoc/historical evaluations, model deployment in real time, scaling to other assets, etc.

The seeq-azureml add-on is distributed as an example of a collaborative workflow between data scientists (model builders) and plant engineers/SMEs (model consumers). Users are encouraged to fork the repo and make the necessary modifications/enhancements that addresses the specific needs/workflows of their organization.

N|Scheme

Documentation

The documentation for seeq-azureml can be found here.

User Guide

seeq-azureml User Guide provides a more in-depth explanation of how this Seeq Add-on enables engineers and SMEs in OT to directly interface with models built by data science teams in Azure ML Studio and that have been registered and deployed in an AML endpoint as a cloud service.

For additional details on the Data Scientist workflow, take a look at following video

Data Scientist Workflow

Seeq_Data_Scientist_Rev_1.mp4

For additional details on the Engineering workflow, take a look at the following video

Engineering Workflow

Seeq_Data_Engineer_Rev_1.mp4

Installation

The backend of seeq-azureml requires Python >3.7 or later.

Dependencies

See requirements.txt file for a list of dependencies and versions. Additionally, you will need to install the seeq module with the appropriate version that matches your Seeq server. For more information on the seeq module see seeq at pypi

User Installation Requirements (Seeq Data Lab)

If you want to install seeq-azureml as a Seeq Add-on Tool, you will need:

  • Seeq Data Lab (> R50.5.0, >R51.1.0, >R52.1.0, or >=R53)
  • seeq module whose version matches the Seeq server version, and the version of SPy >= 182.25
  • Seeq server admin access
  • Enable Add-on Tools in the Seeq server

User Installation (Seeq Data Lab)

The latest build of the project can be found here as a wheel file. The file is published as a courtesy and does not imply any guarantee or obligation for support from the publisher.

Pre-requisites

Before installing the seeq-azureml Seeq Add-on, you will have to create an Azure application and service principal. Follow the steps in here to create your application, and choose Option 2 for the Authentication method.

Seeq Add-on Installation

Once the Azure application and service principal have been created. Follow these steps to install the Seeq Add-on:

  1. Create a new Seeq Data Lab project and open the Terminal window
  2. Run pip install seeq-azureml
  3. Run python -m seeq.addons.azureml [--users <users_list> --groups <groups_list>]
  4. Create an aml_config.ini file in the ~/.seeq folder of the Seeq Data Lab Project with the information required to connect to the Azure ML services. The following steps summarized how to create the aml_config.ini file in the correct Seeq Data Lab location and where to get the values required for the configuration.
    1. Download the aml_config.ini configuration file from here
    2. Upload the file to the Seeq Data Lab project using the Upload button located in the top-right corner of the home page of the project.
    3. From the Seeq Data Lab project home page, open the uploaded file and modify the fields appropriately:
      1. The SUBSCRIPTION_ID, RESOURCE_GROUP, and WORKSPACE_NAME can be obtained by logging into the Azure portal and clicking on the Machine Learning service . Once in the Machine Learning service, click on the desired WORKSPACE_NAME from the list. The Overview tab will show a list of Essentials from which you can take the values for SUBSCRIPTION_ID and RESOURCE_GROUP.
      2. The TENANT_ID, APP_ID, and APP_SECRET are obtained when creating the Azure application in the section Get tenant and app ID values for signing in , Option 2 .
      3. Save the aml_config.ini file.
    4. Back to the Terminal window from Steps 1 and 2, run the command mv aml_config.ini .seeq/ to move the aml_config.ini file to the appropriate folder.

Note: If Step 3 gives an error make sure that the seeq module is >= a.b.c.182.25 where a.b.c are explained here

Development

We welcome new contributors of all experience levels.

Important links

Source code

You can get started by cloning the repository with the command:

git clone [email protected]:seeq12/seeq-azureml.git

Installation from source

For development work, it is highly recommended creating a python virtual environment and install the package in that working environment. If you are not familiar with python virtual environments, you can take a look here

Once your virtual environment is activated, you can install seeq-azureml from source with:

python setup.py install

Testing

There are two main ways to test seeq-azureml: automatic testing mainly for the backend, and user interface testing.

Automatic Testing

After installing from source, you can launch the test suite from the root directory of the project (i.e. seeq-azureml directory). There are two types of automatic tests set up: 1) unit test and system test. The system and unit tests can be run at the same time or independently. Use the pytest markers defined in pytest.ini to run only one set of tests at a time.

For example, to run only the unit tests:

pytest -v -m unit

The system tests require a connection to both a Seeq server and Azure ML Studio. Before running system tests, you will have to provide the required variables in tests/test_config.ini. Please be careful not to commit your credentials in the configuration file back into the repository. To avoid committing changes in the configuration file, run the following command in the root directory of the project before modifying the configuration file.

git update-index --assume-unchanged tests/test_config.ini

Then, you can fill out the configuration file and use it for the tests. Lastly, make sure that the seeq module version in your local environment should match the Seeq server version.

To run only the system tests (after modifying tests/test_config.ini):

pytest -v -m system

To run all tests (both unit and system tests):

pytest -v

User Interface Testing

To test the UI, use the developer_notebook.ipynb in the development folder of the project. This notebook can also be used while debugging from your IDE. You can also create a whl first, install it on your virtual environment, and then run developer_notebook.ipynb notebook there.

Changelog

The changelog can be found here

Support

Code related issues (e.g. bugs, feature requests) can be created in the issue tracker

Maintainer: Seeq

Citation

Please cite this work as:

seeq-azureml
Seeq Corporation, 2021
https://github.com/seeq12/seeq-azureml