feat: add new envelope transport #1094

giortzisg · 2025-09-24T11:22:19Z

Description

Create the new transport that accepts envelopes and not events. For now only the implementation for the new transport is added, without deprecating the old one. The PR also includes some misc changes:

creating an envelope convertible interface, to accept a generic type of events/logs/transactions, etc..
moving the dsn internally under the protocol folder and re exporting everything on the top level to avoid cyclic imports when using the new transport.

Issues

resolves: Create new transport that accepts envelopes #1092
resolves: GO-84

Note

Introduce envelope-first Sync/Async HTTP transports, centralize DSN and envelope types under internal/protocol, and adapt SDK to use them with minimal API surface changes.

Transport (new):
- Add internal/http transports: AsyncTransport and SyncTransport that send protocol.Envelopes, with queueing, flush/close, rate limiting, proxy/TLS config, headers, and keep-alive handling.
Protocol (new):
- Add internal/protocol: Dsn, Envelope (+ items, header), SdkInfo, and interfaces (EnvelopeConvertible, TelemetryTransport).
- Provide DSN parsing, request headers, API URL, JSON marshal/unmarshal.
SDK integration/refactor:
- Wrap and re-export Dsn and DsnParseError in top-level sentry; NewDsn delegates to protocol; RequestHeaders() uses SDK version; minor typo fix in comment.
- Add Event.ToEnvelope/ToEnvelopeWithTime; include DSC trace info and attachments; fallback JSON marshal path preserved.
- Update DynamicSamplingContext and transport.go to use DSN getters (GetPublicKey, etc.) and scheme constants from protocol in NewRequest.
Tests:
- Add comprehensive tests for protocol DSN/envelope, new transports (queueing, flush, rate limits, errors, keep-alive, proxies/TLS, concurrency, goroutine leaks), and wrapper behavior; expand request and event tests.

^{Written by Cursor Bugbot for commit 1ed184b. This will update automatically on new commits. Configure here.}

linear · 2025-09-24T11:22:22Z

GO-84 Create new transport that accepts envelopes

codecov · 2025-09-24T11:24:49Z

Codecov Report

❌ Patch coverage is 84.61538% with 104 lines in your changes missing coverage. Please review.
✅ Project coverage is 86.64%. Comparing base (193c8ad) to head (d61df59).

Files with missing lines	Patch %	Lines
internal/http/transport.go	84.22%	40 Missing and 16 partials ⚠️
internal/protocol/envelope.go	63.73%	22 Missing and 11 partials ⚠️
interfaces.go	87.93%	5 Missing and 2 partials ⚠️
transport.go	86.11%	2 Missing and 3 partials ⚠️
internal/protocol/dsn.go	97.69%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@                    Coverage Diff                     @@
##           feat/transport-buffers    #1094      +/-   ##
==========================================================
- Coverage                   86.98%   86.64%   -0.35%     
==========================================================
  Files                          57       60       +3     
  Lines                        6356     6894     +538     
==========================================================
+ Hits                         5529     5973     +444     
- Misses                        675      739      +64     
- Partials                      152      182      +30

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

semgrep-code-getsentry · 2025-09-26T08:31:06Z

internal/http/transport.go

+		return &tls.Config{
+			RootCAs: options.CaCerts,
+		}


MinVersion is missing from this TLS configuration. By default, as of Go 1.22, TLS 1.2 is currently used as the minimum. General purpose web applications should default to TLS 1.3 with all other protocols disabled. Only where it is known that a web server must support legacy clients with unsupported an insecure browsers (such as Internet Explorer 10), it may be necessary to enable TLS 1.0 to provide support. Add `MinVersion: tls.VersionTLS13' to the TLS configuration to bump the minimum version to TLS 1.3.

🧼 Fixed in commit 871ade0 🧼

can we address this?

Since go uses tls1.2 we should be good to this as the min version. We already inherit the min version of the runtime anyways.

sl0thentr0py

ideally we'd also abstract the older event types as envelope items, but I'll leave it upto you if you want to do that now or separately later

dsn.go

interfaces.go

lcian

Left some mostly minor comments, looks good overall. Haven't looked at the tests yet.

internal/http/transport.go

internal/protocol/interfaces.go

internal/protocol/envelope.go

transport.go

internal/http/transport_test.go

aldy505 · 2025-10-09T13:34:27Z

internal/http/transport.go

+func (t *AsyncTransport) SendEvent(event protocol.EnvelopeConvertible) {
+	envelope, err := event.ToEnvelope(t.dsn)
+	if err != nil {
+		debuglog.Printf("Failed to convert to envelope: %v", err)


Suggested change

debuglog.Printf("Failed to convert to envelope: %v", err)

debuglog.Printf("Failed to convert to envelope: %s", err.Error())

using %v is heavier performance-wise than %s

for errors I think this doesn't really apply, both just call err.Error() IIRC.

aldy505 · 2025-10-09T13:35:37Z

internal/http/transport.go

+	}
+
+	if err := t.SendEnvelope(envelope); err != nil {
+		debuglog.Printf("Error sending the envelope: %v", err)


Suggested change

debuglog.Printf("Error sending the envelope: %v", err)

debuglog.Printf("Error sending the envelope: %s", err.Error())

same goes with this

aldy505 · 2025-10-09T13:39:31Z

internal/protocol/dsn.go

+	// Parse
+	parsedURL, err := url.Parse(rawURL)
+	if err != nil {
+		return nil, &DsnParseError{fmt.Sprintf("invalid url: %v", err)}


Why don't we do something like this?

Suggested change

return nil, &DsnParseError{fmt.Sprintf("invalid url: %v", err)}

return nil, &DsnParseError{fmt.Errorf("invalid url: %w", err)}

That way, we can trace what the actual inner error is.

This would modify DsnParseError to:

type DsnParseError struct { Message error }

I don't really want to break the signature for message, since it doesn't really give that much value.

aldy505 · 2025-10-09T13:40:32Z

internal/protocol/dsn.go

+	// PublicKey
+	publicKey := parsedURL.User.Username()
+	if publicKey == "" {
+		return nil, &DsnParseError{"empty username"}


username is confusing, users only understand "public key" and "project id"

Suggested change

return nil, &DsnParseError{"empty username"}

return nil, &DsnParseError{"empty public key"}

aldy505 · 2025-10-09T13:42:09Z

internal/protocol/dsn.go

+	if dsn.secretKey != "" {
+		url += fmt.Sprintf(":%s", dsn.secretKey)
+	}
+	url += fmt.Sprintf("@%s", dsn.host)


Annoying request, but: What about self-hosted users that uses private IPv6 address on their DSN? 😀

Why is this problematic for IPv6?

For IPv6, you would need to enclose it within [] brackets. Or maybe just create a test case for this one.

add new transport

0c154b8

giortzisg added 5 commits September 25, 2025 09:26

fix lint

fc93d2c

fix tests

3c7498e

modify envelope serialization and tests

0a406ba

change transport opts

6f9c638

remove transport.Configure

bf26d59

semgrep-code-getsentry bot reviewed Sep 26, 2025

View reviewed changes

giortzisg added 3 commits September 26, 2025 11:16

add proper await on queue flush

c7205ca

add test for marshall fallback

8c8a4bd

fix tests

4228142

giortzisg force-pushed the feat/transport-envelope branch from 3ce9dee to 4228142 Compare September 29, 2025 14:02

add sendEvent

803349d

giortzisg marked this pull request as ready for review September 29, 2025 14:27

giortzisg requested review from cleptric and sl0thentr0py September 29, 2025 14:28

This comment was marked as outdated.

Sign in to view

giortzisg added 3 commits September 30, 2025 11:23

fix dsn exporting

51f0373

enhance transport test suite

58a7b02

change backpressure test

1ed184b

sl0thentr0py approved these changes Sep 30, 2025

View reviewed changes

dsn.go Show resolved Hide resolved

interfaces.go Show resolved Hide resolved

giortzisg added 3 commits October 6, 2025 16:54

Merge branch 'master' into feat/transport-envelope

7a2f452

specify min tls version

a146a1e

use global debuglog

871ade0

lcian reviewed Oct 7, 2025

View reviewed changes

giortzisg added 2 commits October 8, 2025 16:05

chore: amend debug output and func comments

4c15f3a

chore: refactor tests

b2c7dc4

This comment was marked as outdated.

Sign in to view

chore: fix overflow test

9d368d4

This comment was marked as outdated.

Sign in to view

giortzisg added 2 commits October 9, 2025 11:36

add noopTransport

a357417

add internalTransport wrapper

992feaf

This comment was marked as outdated.

Sign in to view

giortzisg added 2 commits October 9, 2025 11:39

chore: make internalTransportAdapter private

bc5d4b8

chore: fix race

f89d05d

This comment was marked as outdated.

Sign in to view

lcian reviewed Oct 9, 2025

View reviewed changes

transport.go Outdated Show resolved Hide resolved

lcian reviewed Oct 9, 2025

View reviewed changes

internal/http/transport_test.go Show resolved Hide resolved

lcian reviewed Oct 9, 2025

View reviewed changes

internal/http/transport_test.go Show resolved Hide resolved

lcian approved these changes Oct 9, 2025

View reviewed changes

chore: reexport internal wrapper

ec10979

This comment was marked as outdated.

Sign in to view

lcian mentioned this pull request Oct 9, 2025

feat(go): Use new async transport getsentry/gib-potato#351

Merged

change RequestHeaders receiver

17d1a15

This comment was marked as outdated.

Sign in to view

modify internal transport adapters

d206afe

This comment was marked as outdated.

Sign in to view

aldy505 reviewed Oct 9, 2025

View reviewed changes

giortzisg changed the base branch from master to feat/transport-buffers October 9, 2025 15:04

giortzisg changed the base branch from feat/transport-buffers to master October 10, 2025 08:22

giortzisg changed the base branch from master to feat/transport-buffers October 10, 2025 09:07

Merge branch 'feat/transport-buffers' into feat/transport-envelope

d61df59

giortzisg mentioned this pull request Oct 10, 2025

feat: add telemetry scheduler #1107

Open

	debuglog.Printf("Failed to convert to envelope: %v", err)
	debuglog.Printf("Failed to convert to envelope: %s", err.Error())

	debuglog.Printf("Error sending the envelope: %v", err)
	debuglog.Printf("Error sending the envelope: %s", err.Error())

	return nil, &DsnParseError{fmt.Sprintf("invalid url: %v", err)}
	return nil, &DsnParseError{fmt.Errorf("invalid url: %w", err)}

	return nil, &DsnParseError{"empty username"}
	return nil, &DsnParseError{"empty public key"}

feat: add new envelope transport #1094

Are you sure you want to change the base?

feat: add new envelope transport #1094

Uh oh!

Conversation

giortzisg commented Sep 24, 2025 • edited by cursor bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Issues

Uh oh!

linear bot commented Sep 24, 2025

Uh oh!

codecov bot commented Sep 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

semgrep-code-getsentry bot Sep 26, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

This comment was marked as outdated.

Uh oh!

sl0thentr0py left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

lcian left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

This comment was marked as outdated.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

giortzisg Oct 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

lcian Oct 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

giortzisg commented Sep 24, 2025 •

edited by cursor bot

Loading

codecov bot commented Sep 24, 2025 •

edited

Loading

semgrep-code-getsentry bot Sep 26, 2025 •

edited

Loading

giortzisg Oct 10, 2025 •

edited

Loading

lcian Oct 9, 2025 •

edited

Loading