Error reporting for Dataflow

812 views Asked by At

Is there a way to send notifications when an error happens in Dataflow ?

Is it possible to integrate it with something like Sentry ?

Or maybe with Stackdriver or Google Cloud's error reporting service ?

1

There are 1 answers

1
Evgeny Minkevich On BEST ANSWER

I believe it is possible through the following configuration:

  • Dataflow logs are streamed into Google Cloud Logging.
  • Create a custom log based metric in Google Cloud Logging.
  • Create an alert policy in Google Cloud Monitoring (Stackdriver) based on the custom log based metric.