Repositories list

• BentoML

  Public
  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  pythonmachine-learningdeep-learning+ 12model-servingmultimodalmlopsml-engineeringai-inferencellmgenerative-ai+ 5

  Python

  •

  Apache License 2.0

  •791•7.1k•156•12•Updated Nov 9, 2024Nov 9, 2024

• yatai-image-builder

  Public
  🐳 Build OCI images for Bentos in k8s

  dockerdocker-imagecontainer+ 3container-imagekubernetesk8s

  Go

  •9•14•4•11•Updated Nov 9, 2024Nov 9, 2024

• bentoml-comfyui

  Public
  BentoML extension for ComfyUI

  Python

  •

  MIT License

  •0•2•0•0•Updated Nov 9, 2024Nov 9, 2024

• ComfyUI-IDL

  Public
  ComfyUI Interface Definition Language

  Python

  •

  Apache License 2.0

  •0•1•0•0•Updated Nov 8, 2024Nov 8, 2024

• openllm-models

  Public
  Python

  •8•13•1•0•Updated Nov 8, 2024Nov 8, 2024

• yatai-common

  Public
  Go

  •5•1•0•2•Updated Nov 7, 2024Nov 7, 2024

• BentoComfyUI

  Public
  Python

  •0•0•0•0•Updated Nov 6, 2024Nov 6, 2024

• OpenLLM

  Public
  Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.

  llamamistralfine-tuning+ 15mlopsbentomlvicunallmmodel-inferencellmopsllm-serving+ 8

  Python

  •

  Apache License 2.0

  •636•10k•18•0•Updated Nov 5, 2024Nov 5, 2024

• BentoVLLM

  Public
  Self-host LLMs with vLLM and BentoML

  Python

  •12•72•4•2•Updated Nov 5, 2024Nov 5, 2024

• bentocloud-homepage-news

  Public
  1•1•0•0•Updated Nov 1, 2024Nov 1, 2024

• BentoVoiceAgent

  Public
  Build Phone Calling Voice Agent fully powered by open source models.

  voice-agentai-phone-calling-guideai-voice-assistant+ 1ai-phone

  Python

  •1•4•0•0•Updated Nov 1, 2024Nov 1, 2024

• BentoDiffusion

  Public
  BentoDiffusion: A collection of diffusion models served with BentoML

  kubernetesailora+ 4model-servingfine-tuningdiffusion-modelsstable-diffusion

  Python

  •

  Apache License 2.0

  •25•334•9•1•Updated Nov 1, 2024Nov 1, 2024

• BentoMoshi

  Public
  Python

  •

  Apache License 2.0

  •0•1•0•0•Updated Oct 31, 2024Oct 31, 2024

• .github

  Public
  ✨🍱🦄️

  4•1•0•0•Updated Oct 24, 2024Oct 24, 2024

• BentoColPali

  Public
  Python

  •0•0•0•0•Updated Oct 24, 2024Oct 24, 2024

• BentoSpacy

  Public
  Python

  •0•0•0•0•Updated Oct 21, 2024Oct 21, 2024

• byoc

  Public
  Shell

  •1•0•0•1•Updated Oct 18, 2024Oct 18, 2024

• BentoDeepSpeedMII

  Public
  Python

  •0•0•0•1•Updated Oct 17, 2024Oct 17, 2024

• helm-charts

  Public
  0•0•0•0•Updated Oct 17, 2024Oct 17, 2024

• circus

  Public
  A Process & Socket Manager built with zmq

  Python

  •

  Other

  •258•0•0•1•Updated Oct 16, 2024Oct 16, 2024

• BentoCrewAI

  Public
  Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs

  Python

  •1•2•0•1•Updated Oct 15, 2024Oct 15, 2024

• BentoXTTSStreaming

  Public
  xtts with streaming endpoint

  Python

  •0•0•0•0•Updated Oct 15, 2024Oct 15, 2024

• BentoCLIP

  Public
  building a CLIP application using BentoML

  Python

  •2•8•0•3•Updated Oct 11, 2024Oct 11, 2024

• BentoSentenceTransformers

  Public
  how to build a sentence embedding application using BentoML

  Python

  •2•6•0•2•Updated Oct 11, 2024Oct 11, 2024

• BentoXTTS

  Public
  how to build an text-to-speech application using BentoML

  Python

  •2•5•1•3•Updated Oct 11, 2024Oct 11, 2024

• BentoFunctionCalling

  Public
  Python

  •1•3•0•1•Updated Oct 11, 2024Oct 11, 2024

• BentoWhisperX

  Public
  Python

  •5•10•0•8•Updated Oct 11, 2024Oct 11, 2024

• BentoBLIP

  Public
  how to build an image captioning application on top of a BLIP model with BentoML

  Python

  •2•3•0•3•Updated Oct 11, 2024Oct 11, 2024

• BentoShield

  Public
  Python

  •0•1•0•0•Updated Oct 11, 2024Oct 11, 2024

• BentoResnet

  Public
  Python

  •1•2•0•0•Updated Oct 11, 2024Oct 11, 2024