8000 Implement blocking put for back-pressure in DebeziumChangeEvent in sink connector lightweight by captainpro-eng · Pull Request #1108 · Altinity/clickhouse-sink-connector · GitHub
[go: up one dir, main page]

Skip to content

Implement blocking put for back-pressure in DebeziumChangeEvent in sink connector lightweight - #1108

Merged
subkanthi merged 3 commits into
Altinity:2.8.0from
captainpro-eng:develop
Oct 1, 2025
Merged

subkanthi merged 3 commits into
Altinity:2.8.0from
captainpro-eng:develop

Conversation

@captainpro-eng
@captainpro-eng 8000 captainpro-eng commented Jul 11, 2025
Copy link
Copy Markdown

…ngeEventCapture in sink connector lightweight
@captainpro-eng
Copy link
Copy Markdown
Author

@subkanthi please update on this.

@subkanthi
Copy link
Copy Markdown
Collaborator

It will be really useful if we log the size of the messages in the queue when its about to go over the limit.

#512

@subkanthi
subkanthi changed the base branch from develop to 2.8.0 July 29, 2025 21:21
…ngeEventCapture in sink connector lightweight
@captainpro-eng
Copy link
Copy Markdown
Author

Hi @subkanthi Thanks, I have added some logs.

this.records.add(convertedRecords);
try {
int remainingCapacity = this.records.remainingCapacity();
if (remainingCapacity == 0) {
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we maybe also notify when its 90% of the capacity

…ngeEventCapture in sink connector lightweight
@subkanthi
subkanthi merged commit 5a1b646 into Altinity:2.8.0 Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

0