I'm currently trying use perf_analyzer of Nvidia Triton Inference Server with Deep Learning model which take as input a numpy array (which is an image).*
I followed the steps to use real data from the documentation but my input are rejected by the perf_analyzer : "error: unsupported input data provided perf_analyzer".
This is my input config:
"input": [
{
"name": "input_1:0",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
-1,
-1,
3
],
"is_shape_tensor": false,
"allow_ragged_batch": false
}
],
And an example of JSON which I want to load in my perf_analyzer :
{
"data": [
{
"input_1:0": {
"content": [
[
[
[
1.8207893371582031,
2.0784313678741455,
2.4482789039611816
],...,
[
-2.1179039478302,
-2.0357143878936768,
-1.804444432258606
]
]
]
],
"shape": [
1024,
1024,
3
]
}
}
]
}
Do you have any idea how to pass images in my type_FP32 through JSON?
Thanks