Skip to content

feat(ingest): Enable zstd compression for error ingestion tasks - #127202

Merged
jan-auer merged 1 commit into
masterfrom
junior/zstd-error-ingest-tasks
Oct 13, 2026
Merged

jan-auer merged 1 commit into
masterfrom
junior/zstd-error-ingest-tasks

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

We are going to send event payloads inline in task params, instead of only a cache key. This makes the params of the error pipeline tasks much larger. Today they are only compressed above 3MB. Compression compensates for the added data.

This enables zstd compression for the error pipeline up to and including save_event: symbolicate, process, and save. The reprocessing variants are included because they go through the same code.

Post-processing is left out. It reads the event from nodestore, so it does not receive the payload inline.

Workers already decompress params based on the compression-type: zstd header. Only the producer side changes.

via async jauer.

--

View Junior Session [Sentry]

Opt the symbolication, process_event, save_event, and save_event_attachments
tasks (including reprocessing variants) into zstd parameter compression.
With inline event payloads these tasks can carry the full event in their
params, which previously stayed plaintext unless over the 3MB threshold.

Co-Authored-By: Jan Michael Auer <jan.auer@sentry.io>
@sentry-junior
sentry-junior Bot requested review from a team as code owners October 12, 2026 15:47
@github-actions github-actions Bot added the Scope: Backend Automatically applied to PRs that change backend components label Oct 12, 2026
@jan-auer
jan-auer merged commit 3f7f36a into master Oct 13, 2026
70 of 71 checks passed
@jan-auer
jan-auer deleted the junior/zstd-error-ingest-tasks branch October 13, 2026 10:38

This branch had an error being deployed

1 failed deployment
Preview — 08c44b61 Deployed Oct 12, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Scope: Backend Automatically applied to PRs that change backend components

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants