Skip to content

KServe Multi Model Serving

Jump to bottom
Alon Gubkin edited this page Mar 1, 2022 · 4 revisions

InferenceDB supports KServe's Multi Model Serving using the filter object in InferenceLogger.

Python

KServe

Data Destinations

Extend InferenceDB

Clone this wiki locally