Service Health
Incident affecting Google Cloud Dataflow
Issue with starting dataflow flex template jobs in asia-northeast1 and asia-east1
Incident began at 2022-08-23 17:57 and ended at 2022-08-23 21:09 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Tokyo (asia-northeast1)
Date | Time | Description | |
---|---|---|---|
| 23 Aug 2022 | 21:09 PDT |
The issue with Google Cloud Dataflow has been resolved for all affected users as of Tuesday, 2022-08-23 20:40 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 23 Aug 2022 | 20:36 PDT | Summary: Issue with starting dataflow flex template jobs in asia-northeast1 and asia-east1 Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Tuesday, 2022-08-23 21:30 US/Pacific. Diagnosis: Dataflow flex template job will fail when at creating a launcher VM with UNAVAILABLE error Error message: Failed to start the VM, launcher-..., used for launching because of status code: UNAVAILABLE, reason: Persistent retriable error, maximum number of retries (10) reached. Workaround: Customers could launch their jobs in different regions. |
| 23 Aug 2022 | 18:47 PDT | Summary: Issue with starting dataflow flex template jobs in asia-northeast1 and asia-east1 Description: We are experiencing an issue with Google Cloud Dataflow. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-08-23 21:05 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Dataflow flex template job will fail when at creating a launcher VM with UNAVAILABLE error Error message: Failed to start the VM, launcher-..., used for launching because of status code: UNAVAILABLE, reason: Persistent retriable error, maximum number of retries (10) reached. Workaround: Customers could launch their jobs in different regions. |
| 23 Aug 2022 | 18:39 PDT | Summary: Issue with starting dataflow flex template jobs in asia-northeast1 and asia-east1 Description: We are experiencing an issue with Google Cloud Dataflow. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-08-23 21:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Dataflow flex template job will fail when at creating a launcher VM with UNAVAILABLE error Error message: Failed to start the VM, launcher-..., used for launching because of status code: UNAVAILABLE, reason: Persistent retriable error, maximum number of retries (10) reached. Workaround: Customers could launch their jobs in different regions. |
| 23 Aug 2022 | 18:38 PDT | Summary: Issue with starting dataflow flex template jobs in asia-northeast1 and asia-east1 Description: We are experiencing an issue with Google Cloud Dataflow. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-08-23 19:15 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Dataflow flex template job will fail when at creating a launcher VM with UNAVAILABLE error Error message: Failed to start the VM, launcher-..., used for launching because of status code: UNAVAILABLE, reason: Persistent retriable error, maximum number of retries (10) reached. Workaround: Customers could launch their jobs in different regions. |
- All times are US/Pacific