Databricks Model ServingCER-0524
Databricks Model Serving Endpoints Running Without Scale to Zero
Custom model serving endpoints in Databricks run on serverless CPU or GPU compute sized by provisioned concurrency. When scale to zero is not enabled, the endpoint never drops below its minimum provisioned concurrency, and Databricks'...