Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
-
Updated
Jun 11, 2024 - Python
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Model Deployment at Scale on Kubernetes 🦄️
Pybind11 bindings for Whisper.cpp
BentoML Example Projects 🎨
A simple web application that lets you replace any part of an image with an image generated based on your description.
This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoML, Streamlit, MLflow and even code on how to deploy your machine learning model as an android app.
Helm Chart for installing Yatai on Kubernetes ⎈
Machine Learning Web Application. Helps to visualize a character-by-character breakdown of how sentiment analysis classifies text
To automatically tag people in various chat groups
DKT Project Served by Airflow / BentoML / Docker Swarm
Deploying machine learning model using 10+ different deployment tools
My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club
API serving for your diffusers models
Generate novel text - novel finetuned from skt KoGPT2 base v2 - 한국어
Python bentoML(API serving for machine learning model) example & tutorial code
Add a description, image, and links to the bentoml topic page so that developers can more easily learn about it.
To associate your repository with the bentoml topic, visit your repo's landing page and select "manage topics."