Try the NIMs and KServe guide

[kimwnasptd]

Context

We want to integrate Canonical's NIMs guide with KServe as part of our Charmed Kubeflow documentation.

To do so we'll need to run and verify the steps of the above guide, and document any modifications that we need to make for users to use NIMs with CKF.

With a quick look we might need to reconsider:

1. Downloading the ngc CLI and downloading the model in the PVC (the NIM container should do this on first launch)
2. Manually create a PersistentVolume. A PVC should be enough, which will be used by the ISVCs
3. Instead of defining a custom ClusterServingRuntime and InferenceService we could use the ones from NVIDIA

What needs to get done

1. Run the tutorial
2. Write down deviations we could do

Definition of Done

1. We have run the paper above
2. We have documented if we want some changes to the above paper
3. Are ready to go and handle the docs task

[syncronize-issues-to-jira]

Thank you for reporting us your feedback!

The internal ticket has been created: https://warthogs.atlassian.net/browse/KF-6279.

This message was autogenerated