I have a tensorflow model with a string parameter as input. Whats the type to use for strings in the Triton Java api?
Eg. Model definition
{
"name":"test_model", "platform":"tensorflow_savedmodel", "backend":"tensorflow",
"version_policy":{
"latest":{
"num_versions":1
}
},
"max_batch_size":8,
"input":[{
"name":"input_text", "data_type":"TYPE_STRING", "format":"FORMAT_NONE", "dims":[1],"reshape":{
"shape":[]},"is_shape_tensor":false, "allow_ragged_batch":false
}]
Client code
String text = "the text";
InferTensorContents.Builder input0_data = InferTensorContents.newBuilder();
input0_data ... how to set
Triton uses google protobufs, so this is they way by using ByteString