1.18.0 (2023-12-05)

Features

• a table for all drain configuration(jobRunID for now) (#4153) (3d605d3)
• append only tables config for snowflake (#4186) (09a1ab0)
• capture delayed events (#4104) (f9f8782)
• generic consent management (#4056) (0f202e8)
• include error codes in v2 failed-records response payload (#4116) (e803bf9)
• introduce random sleep before clickhouse loads (#4193) (85cfdcf)
• partial failure support for delivery via transformer proxy (#4131) (a7e2e81)

Bug Fixes

• add autovacuum_vacuum_cost_limit to the reports table [PIPE-512] (#4136) (690aeb0)
• align gha pr comment with workflow config (#4194) (1355c96)
• clickhouse zookeeper table metadata (#4121) (41e060a)
• error reporting handling and config changes (#4195) (70af46e)
• gateway responds with http status 500 and body pq: invalid byte sequence for encoding UTF8: 0x00 (#4161) (7b118b9)
• graceful termination for cron tracker (#4128) (cb33412)
• snowflake delete (#4179) (906e5b0)
• source no pending jobs (#4197) (79f8551)
• warehouse archiver integration tests (#4135) (cb33412)
• warehouse: crash recovery without panics (#4182) (a97436e)

Miscellaneous

• add a dial timeout of 10 seconds in etcd client during tests (#4127) (cb33412)
• deps: bump actions/checkout from 3 to 4 (#4151) (1621628)
• deps: bump actions/stale from 5 to 8 (#4149) (0534c38)
• deps: bump amannn/action-semantic-pull-request from 4 to 5 (#4168) (324e9d9)
• deps: bump arduino/setup-protoc from 1 to 2 (#4150) (f97b69c)
• deps: bump beatlabs/delete-old-branches-action from 0.0.9 to 0.0.10 (#4147) (95f5ec2)
• deps: bump docker/build-push-action from 3 to 5 (#4148) (cebce15)
• deps: bump docker/login-action from 2 to 3 (#4155) (38986ed)
• deps: bump docker/metadata-action from 4 to 5 (#4167) (a61ab5f)
• deps: bump github.com/aws/aws-sdk-go from 1.46.4 to 1.47.10 (#4134) (cb33412)
• deps: bump github.com/aws/aws-sdk-go from 1.47.10 to 1.47.11 (#4143) (3e103d3)
• deps: bump github.com/grpc-ecosystem/grpc-gateway/v2 from 2.16.0 to 2.18.1 (#4091) (cb33412)
• deps: bump github.com/hashicorp/go-retryablehttp from 0.7.4 to 0.7.5 (#4107) (2400b7a)
• deps: bump github.com/minio/minio-go/v7 from 7.0.63 to 7.0.64 (#4177) (6da3150)
• deps: bump github.com/onsi/ginkgo/v2 from 2.13.0 to 2.13.2 (#4180) (58d1a97)
• deps: bump github.com/onsi/gomega from 1.29.0 to 1.30.0 (#4114) (cb33412)
• deps: bump golang.org/x/oauth2 from 0.14.0 to 0.15.0 (#4185) (6dbccb3)
• deps: bump google-github-actions/release-please-action from 3 to 4 (#4184) (5845a02)
• deps: revert google-github-actions/release-please-action from 4 to 3 (#4203) (26ef4b1)
• enforce slices instead of exp/slices pkg (#4047) (cb33412)
• error logs for unmarshal error debugging (#4181) (852e1b9)
• filtered and error stats separated in processor (#4137) (22e4944)
• improve fatal log during panic capture (#4189) (7ff4103)
• improve rsources service table setup procedure (#4165) (42d5130)
• include all aborted jobs in failed records (362f65a)
• include all aborted jobs in failed records (#4154) (ba5b80f)
• include github-actions and docker updates (PIPE-539) (#4144) (61f3957)
• increasing health timeout (6c28e25)
• introduce loadfiles GetByID (#4093) (cb33412)
• kafka batch integration test (#4146) (6c28e25)
• linter fixes for enterprise and event-schema in rudder-server (#4021) (cb33412)
• populate total events (#4099) (cb33412)
• processor: include partition tag in stats (#4170) (1eecaa9)
• revert data bricks sql client to 1.4.0 (#4157) (ea455ca)
• router: fine grained job iterator configuration (#4169) (b1bbf7a)
• router: interruption of iterator should cause router to sleep (#4171) (d29f819)
• router: interuption of iterator should cause router to sleep (d29f819)
• split integration tests (#4138) (cb33412)
• trim down error responses stored in job status to a maximum of 10KB (#4166) (44f7456)
• uncomment clickhouse integration test (#4156) (554acfa)