Skip to content

[SUPPORT] Apply 'write.ignore.failed' when write data failed #12187

@fhan688

Description

Describe the problem you faced

In Flink engine, if exception occurs when task writing data, it will be ignored and the exception will be reported to StreamWriteCoordinator with write event, StreamWriteCoordinator will decide whether to commit when there is write failure according to 'write.ignore.failed'.

Whether we should apply 'write.ignore.failed' ahead when write failure occurs, thus throw an exception faster.

To Reproduce

Expected behavior

  1. promote 'write.ignore.failed' to hudi-client-common
  2. throw exception in write handles
  3. default value of 'write.ignore.failed' is false

Environment Description

Additional context

related PR:#12150

Stacktrace

Metadata

Assignees

No one assigned

    Labels

    feature-enquiryissue contains feature enquiries/requests or great improvement ideas

    Projects

    • Status

      ⏳ Awaiting Triage

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions