Model Serving made Efficient in the Cloud
conda install conda-forge::mosec
A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine.