towhee.serve.triton.bls.mock.mock_pb_util.MockTritonPythonBackendUtils

class towhee.serve.triton.bls.mock.mock_pb_util.MockTritonPythonBackendUtils[source]

Bases: object

mock triton_python_backend_utils, used in UT.

Methods

InferenceRequest

InferenceResponse

Tensor

TritonError

get_input_tensor_by_name

param r:

MockInferenceRequest

Attributes

TRITONSERVER_RESPONSE_COMPLETE_FINAL

static get_input_tensor_by_name(r, input_key)[source]
Parameters:

  • r – MockInferenceRequest

  • input_key – str

Returns:

MockTritonPythonBackendTensor