Deployments

deploy_bentoml

bentoml.deployment.clipper.deploy_bentoml(clipper_conn, archive_path, api_name, input_type='strings', model_name=None, labels=['bentoml'])

Deploy bentoml bundle to clipper cluster

Parameters:
  • clipper_conn (clipper_admin.ClipperConnection) – Clipper connection instance
  • archive_path (str) – Path to the bentoml service archive.
  • api_name (str) – name of the api that will be used as prediction function for clipper cluster
  • input_type (str) – Input type that clipper accept. The default input_type for image handler is bytes, for other handlers is strings. Availabel input_type are integers, floats, doubles, bytes, or strings
  • model_name (str) – Model’s name for clipper cluster
  • labels (list(str), optional) – labels for clipper model
Returns:

Model name and model version that deployed to clipper

Return type:

tuple