Skip to content

Conversation

larmoreg
Copy link

@larmoreg larmoreg commented Oct 4, 2024

Trying to do print(repr(request.inputs()[0].triton_dtype())) throws the following exception:

tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] Failed to process the request(s) for model 'example', message: TypeError: Unable to convert function return value to a Python type! The signature was
	(self: c_python_backend_utils.Tensor) -> TRITONSERVER_datatype_enum

With this change you get something like <TritonDtype.TYPE_FP32: 11>.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant