Having problems with implementing triton service into gitlab CI. As I noticed in the triton github https://github.com/triton-inference-server/server, they don't have any exposed port by default in Dockerfile and I'm not really able to access the service in any way? Is there any workaround for accessing the triton service?
Thanks!
.triton_service: &triton_service
name: nvcr.io/nvidia/tritonserver:21.06-py3
command: ['tritonserver', '--model-repository=$(S3_TRITON_BUCKET)', '--model-control-mode=explicit', '--allow-http=true', '--allow-metrics=false', '--allow-gpu-metrics=false', '--log-verbose=true', '--log-info=true', '--log-warning=true', '--log-error=true']
alias: triton
services:
- *triton_service
script:
- curl -v http://triton:8000/v2/health/ready