How can we use GCSObjectExistenceSensor to sense one or more files with filemask

Question

How can we use GCSObjectExistenceSensor to sense one or more files with filemask which are present in a folder in GCS bucket.

when using "use_glob" getting invalid argument error.

I tried to sense files with first 4 letter of the filename and i am expecting to sense existense of one or more files.

Answer 1

You should use GCSObjectsWithPrefixExistenceSensor

Checks for the existence of GCS objects at a given prefix, passing matches via XCom.

When files matching the given prefix are found, the poke method’s criteria will be fulfilled and the matching objects will be returned from the operator and passed through XCom for downstream tasks.