towhee.serve.triton.triton_config_builder.create_modelconfig¶
- towhee.serve.triton.triton_config_builder.create_modelconfig(model_name, max_batch_size, inputs, outputs, backend, enable_dynamic_batching=False, preferred_batch_size=None, max_queue_delay_microseconds=None, instance_count=1, device_ids=None)[source]¶
- example of input and output:
- {
INPUT0’: (‘TYPE_INT8’, [-1, -1, 3]), INPUT1’: (‘TYPE_FP32’, [-1, -1, 3])
}