parano's repos on GitHub
3 人关注
awesome-model-serving
A curated list of awesome projects, papers, resources related to machine learning model serving
Python · 2 人关注
BentoML
Model Serving Made Easy
1 人关注
awesome-datascience
:memo: An awesome Data Science repository to learn and apply for real world problems.
0 人关注
aiohttp
Asynchronous HTTP client/server framework for asyncio and Python
0 人关注
aws-ec2-deploy
Deploy BentoML bundled models to AWS EC2 with autoscaling
0 人关注
benchmark
BentoML Model Server Benchmark
0 人关注
bentobuild
A small utility module to make it simple to build BentoML Services into images inside Kubernetes clusters.
0 人关注
BentoCrewAI
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
0 人关注
bentoctl
CLI tool for deploying ML models in the cloud - built on top of BentoML 🚀
0 人关注
BentoVLLM
how to build a LLM application using BentoML using vLLM
0 人关注
BentoVoiceAgent
Build Phone Calling Voice Agent fully powered by open source models.
0 人关注
circus
A Process & Socket Manager built with zmq
Go · 0 人关注
client-go
Go client for Kubernetes.
0 人关注
CLIP-API-service
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
0 人关注
clipper
A low-latency prediction-serving system
0 人关注
cloudpickle
Extended pickling support for Python objects
0 人关注
comfy-pack
ComfyPack - A comprehensive toolkit for standardizing, packaging and deploying ComfyUI workflows as reproducible environments and production-ready REST services.
Go · 0 人关注
community
Kubernetes community content
0 人关注
containerregistry
A set of Python libraries and tools for interacting with a Docker Registry.