Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delivery: Add rereview of models to Delivery section #221

Open
irisoren-sg opened this issue Sep 24, 2024 · 4 comments · May be fixed by #247
Open

Delivery: Add rereview of models to Delivery section #221

irisoren-sg opened this issue Sep 24, 2024 · 4 comments · May be fixed by #247
Assignees

Comments

@irisoren-sg
Copy link
Collaborator

In some cases, models may be held in abeyance with a strong likelihood that they will be reused. In these cases, delivery and communication are not an end point. Regular reviews may be used to ensure they can be brought back into use when required by, for example, ensuring they are compatible with current software and hardware.

@irisoren-sg
Copy link
Collaborator Author

@rebecca-wodcke-gad
I just realised that this issue relates to the changes the continuous review and maintenance edits that you added in #228 .

in #216 @Hurstharrier and I discussed this separately, and thought that rather than in the lifecycle chapter, the text re: review would fit in Delivery chapter, as it discusses details rather than the "high-level" which is what is how the Analytical Lifecycle presents the stages. The text you added is great, but do you think it should stay in Analytical Lifecycle/Move to Delivery, or be included in both in some way?

@irisoren-sg irisoren-sg changed the title Delivery: Add review of models to Delivery section Delivery: Add rereview of models to Delivery section Sep 30, 2024
@Hurstharrier
Copy link
Collaborator

@irisoren-sg @rebecca-wodcke-gad - I think regular review of the model is important for models using AI methods such as neural networks.

@rebecca-wodcke-gad
Copy link
Collaborator

@irisoren-sg the text I added covers the whole cycle rather than just delivery e.g. you may want to reconsider the scope or communication when re using. If you think all of it or some of the detail should move to the delivery section, I don't feel strongly about it

@rebecca-wodcke-gad rebecca-wodcke-gad self-assigned this Oct 10, 2024
@rebecca-wodcke-gad
Copy link
Collaborator

Add to QA culture
does the model continue to be calibrated appropriately, this is particularly important for black box models?
Design
The process for reviewing inputs and calibrations should be planned in the design stage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants