I'm running a job on AWS Batch, and this job prepares some data and versions it using dvc. Secondly, the job does some transformation generating new data, and it should save this new data using dvc again. Also, in this case, i'm setting a instance-profile role to enable the AWS Batch to persist on my S3 bucket.
The first dvc push works perfectly. But the second one generates the error Unable to locate credentials
I have also changed the script to just touch a file, add to dvc and push, and then repeat the process in with other file, and could replicate the problem.
I have already solved, changing the command dvc push to dvc push especific-file-to-push, but I'm now trying to understand what is the problem with dvc push command without the parameter specifying the file.
Does anybody know?
I'm using dvc dvc==2.9.5 and boto3==1.21.21