Skip to content

chore(llmobs): dataframe and csv support #14041

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 23 commits into from
Jul 23, 2025
Merged

chore(llmobs): dataframe and csv support #14041

merged 23 commits into from
Jul 23, 2025

Conversation

gary-huang
Copy link
Contributor

@gary-huang gary-huang commented Jul 17, 2025 •
edited by Yun-Kim
Loading

adds support to create dataset from csv files and pandas dataframe support for datasets
image

Also reverts a change from #14110 where config was removed as a task function arg. We are going back to previous behavior where users can configure their task function execution

Checklist

  • PR author has checked that all the criteria below are met
  • The PR description includes an overview of the change
  • The PR description articulates the motivation for the change
  • The change includes tests OR the PR description describes a testing strategy
  • The PR description notes risks associated with the change, if any
  • Newly-added code is easy to change
  • The change follows the library release note guidelines
  • The change includes or references documentation updates if necessary
  • Backport labels are set (if applicable)

Reviewer Checklist

  • Reviewer has checked that all the criteria below are met
  • Title is accurate
  • All changes are related to the pull request's stated goal
  • Avoids breaking API changes
  • Testing strategy adequately addresses listed risks
  • Newly-added code is easy to change
  • Release note makes sense to a user of the library
  • If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
  • Backport labels are set in a manner that is consistent with the release branch maintenance policy

@gary-huang
dataframe and csv support
9e3ae0d 
also create_dataset does not push immediately, it is more natural to push manually
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 17, 2025 •
edited
Loading

CODEOWNERS have been resolved as:

tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_8dbba503-cf48-4e82-805e-1d9cb46e5ed3_batch_update_post_34c161e3.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_8dbba503-cf48-4e82-805e-1d9cb46e5ed3_batch_update_post_466da69c.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_8dbba503-cf48-4e82-805e-1d9cb46e5ed3_records_get_46238641.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_acf19ca4-8062-4548-abbf-95b33f55d51d_batch_update_post_b8c84073.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_acf19ca4-8062-4548-abbf-95b33f55d51d_records_get_d7e731ad.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_delete_post_d7976483.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_delete_post_f8dc510e.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_filter_name__test-dataset-good-csv-pipe_get_bcb704ce.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_filter_name__test-dataset-good-csv_get_989b2028.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_post_027be704.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_post_c1d4ae31.yaml  @DataDog/ml-observability
tests/llmobs/llmobs_cassettes/datadog/datadog_api_unstable_llm-obs_v1_datasets_post_d59b5313.yaml  @DataDog/ml-observability
tests/llmobs/static_files/empty.csv                                     @DataDog/ml-observability
tests/llmobs/static_files/good_dataset.csv                              @DataDog/ml-observability
tests/llmobs/static_files/good_dataset_pipe_separated.csv               @DataDog/ml-observability
ddtrace/llmobs/_constants.py                                            @DataDog/ml-observability
ddtrace/llmobs/_experiment.py                                           @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability
riotfile.py                                                             @DataDog/apm-python
tests/llmobs/test_experiments.py                                        @DataDog/ml-observability
.riot/requirements/1900591.txt                                          @DataDog/apm-python
.riot/requirements/46e9996.txt                                          @DataDog/apm-python
.riot/requirements/5908834.txt                                          @DataDog/apm-python
.riot/requirements/97f1328.txt                                          @DataDog/apm-python
.riot/requirements/f37741b.txt                                          @DataDog/apm-python
.riot/requirements/ffd66c1.txt                                          @DataDog/apm-python

@gary-huang gary-huang changed the title [MLOB-3266 | MLOB-3258] dataframe and csv support (chore)dataframe and csv support Jul 17, 2025
@gary-huang gary-huang added the changelog/no-changelog A changelog entry is not required for this PR. label Jul 17, 2025
@gary-huang gary-huang changed the title (chore)dataframe and csv support chore(llmobs): dataframe and csv support Jul 17, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 17, 2025 •
edited
Loading

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 283 ± 5 ms.

The average import time from base is: 288 ± 5 ms.

The import time difference between this PR and base is: -4.6 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.236 ms (0.79%)
ddtrace.bootstrap.sitecustomize 1.546 ms (0.55%)
ddtrace.bootstrap.preload 1.546 ms (0.55%)
ddtrace.internal.remoteconfig.client 0.721 ms (0.25%)
ddtrace 0.690 ms (0.24%)
ddtrace.internal._unpatched 0.035 ms (0.01%)
json 0.035 ms (0.01%)
json.decoder 0.035 ms (0.01%)
re 0.035 ms (0.01%)
enum 0.035 ms (0.01%)
types 0.035 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Jul 17, 2025

Benchmarks

Benchmark execution time: 2025-07-17 08:48:45

Comparing candidate commit e9da8e2 in PR branch gary/mlob-3266 with baseline commit 46de703 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 547 metrics, 2 unstable metrics.

scenario:telemetryaddmetric-1-distribution-metric-1-times

  • 🟥 execution_time [+349.561ns; +379.876ns] or [+11.792%; +12.815%]

Yun-Kim
Yun-Kim reviewed Jul 17, 2025
View reviewed changes
@pr-commenter
Copy link

pr-commenter bot commented Jul 22, 2025 •
edited
Loading

Performance SLOs

Benchmark execution time: 2025-07-23 19:35:23

Comparing candidate commit 10fea87 in branch gary/mlob-3266 with performance thresholds.

Performance Test Results

Legend: ✅ Pass | ⚠️ Unstable | ❌ Fail

⚠️ coreapiscenario - 12/12 (2 unstable)

⚠️ context_with_data_listeners

Metric Status Value SLO % Under SLO
execution_time ⚠️ 13.878µs < 20.000µs +30.6%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ context_with_data_no_listeners

Metric Status Value SLO % Under SLO
execution_time ✅ 3.811µs < 10.000µs +61.9%
max_rss_usage ✅ 29.137MB < 31.000MB +6.0%

⚠️ context_with_data_only_all_listeners

Metric Status Value SLO % Under SLO
execution_time ⚠️ 13.840µs < 20.000µs +30.8%
max_rss_usage ✅ 29.138MB < 31.000MB +6.0%

✅ get_item_exists

Metric Status Value SLO % Under SLO
execution_time ✅ 631.575ns < 10.000µs +93.7%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ get_item_missing

Metric Status Value SLO % Under SLO
execution_time ✅ 688.382ns < 10.000µs +93.1%
max_rss_usage ✅ 29.138MB < 31.000MB +6.0%

✅ set_item

Metric Status Value SLO % Under SLO
execution_time ✅ 24.630µs < 30.000µs +17.9%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%
✅ djangosimple - 22/22

✅ appsec

Metric Status Value SLO % Under SLO
execution_time ✅ 21.357ms < 22.300ms +4.2%
max_rss_usage ✅ 63.721MB < 65.500MB +2.7%

✅ exception-replay-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 1.355ms < 1.450ms +6.6%
max_rss_usage ✅ 63.524MB < 65.500MB +3.0%

✅ iast

Metric Status Value SLO % Under SLO
execution_time ✅ 21.413ms < 22.250ms +3.8%
max_rss_usage ✅ 63.721MB < 65.500MB +2.7%

✅ profiler

Metric Status Value SLO % Under SLO
execution_time ✅ 15.909ms < 16.550ms +3.9%
max_rss_usage ✅ 50.764MB < 53.000MB +4.2%

✅ span-code-origin

Metric Status Value SLO % Under SLO
execution_time ✅ 26.997ms < 28.200ms +4.3%
max_rss_usage ✅ 66.131MB < 68.000MB +2.7%

✅ tracer

Metric Status Value SLO % Under SLO
execution_time ✅ 21.428ms < 22.700ms +5.6%
max_rss_usage ✅ 63.701MB < 65.500MB +2.7%

✅ tracer-and-profiler

Metric Status Value SLO % Under SLO
execution_time ✅ 23.800ms < 24.900ms +4.4%
max_rss_usage ✅ 65.136MB < 67.000MB +2.8%

✅ tracer-no-caches

Metric Status Value SLO % Under SLO
execution_time ✅ 18.924ms < 19.650ms +3.7%
max_rss_usage ✅ 63.721MB < 65.500MB +2.7%

✅ tracer-no-databases

Metric Status Value SLO % Under SLO
execution_time ✅ 19.206ms < 20.100ms +4.5%
max_rss_usage ✅ 63.721MB < 65.500MB +2.7%

✅ tracer-no-middleware

Metric Status Value SLO % Under SLO
execution_time ✅ 21.132ms < 22.500ms +6.1%
max_rss_usage ✅ 63.701MB < 65.500MB +2.7%

✅ tracer-no-templates

Metric Status Value SLO % Under SLO
execution_time ✅ 21.139ms < 22.250ms +5.0%
max_rss_usage ✅ 63.721MB < 65.500MB +2.7%
✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Metric Status Value SLO % Under SLO
execution_time ✅ 18.559ms < 19.850ms +6.5%
max_rss_usage ✅ 63.701MB < 65.500MB +2.7%

✅ errortracking-enabled-user

Metric Status Value SLO % Under SLO
execution_time ✅ 18.572ms < 19.400ms +4.3%
max_rss_usage ✅ 63.701MB < 65.500MB +2.7%

✅ tracer-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 18.613ms < 19.450ms +4.3%
max_rss_usage ✅ 63.653MB < 65.500MB +2.8%
✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Metric Status Value SLO % Under SLO
execution_time ✅ 2.119ms < 2.300ms +7.9%
max_rss_usage ✅ 51.630MB < 53.000MB +2.6%

✅ errortracking-enabled-user

Metric Status Value SLO % Under SLO
execution_time ✅ 2.114ms < 2.250ms +6.0%
max_rss_usage ✅ 51.590MB < 53.000MB +2.7%

✅ tracer-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 2.111ms < 2.300ms +8.2%
max_rss_usage ✅ 51.177MB < 53.000MB +3.4%
✅ flasksimple - 14/14

✅ appsec-get

Metric Status Value SLO % Under SLO
execution_time ✅ 4.616ms < 4.750ms +2.8%
max_rss_usage ✅ 63.074MB < 64.000MB +1.4%

✅ appsec-post

Metric Status Value SLO % Under SLO
execution_time ✅ 6.632ms < 6.750ms +1.7%
max_rss_usage ✅ 63.467MB < 64.000MB +0.8%

✅ appsec-telemetry

Metric Status Value SLO % Under SLO
execution_time ✅ 4.605ms < 4.750ms +3.1%
max_rss_usage ✅ 63.099MB < 64.000MB +1.4%

✅ debugger

Metric Status Value SLO % Under SLO
execution_time ✅ 1.886ms < 2.000ms +5.7%
max_rss_usage ✅ 42.074MB < 44.000MB +4.4%

✅ iast-get

Metric Status Value SLO % Under SLO
execution_time ✅ 1.881ms < 2.000ms +5.9%
max_rss_usage ✅ 44.441MB < 45.000MB +1.2%

✅ profiler

Metric Status Value SLO % Under SLO
execution_time ✅ 1.982ms < 2.100ms +5.6%
max_rss_usage ✅ 43.431MB < 44.000MB +1.3%

✅ tracer

Metric Status Value SLO % Under SLO
execution_time ✅ 3.385ms < 3.650ms +7.3%
max_rss_usage ✅ 51.354MB < 53.000MB +3.1%
✅ flasksqli - 6/6

✅ appsec-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 3.974ms < 4.200ms +5.4%
max_rss_usage ✅ 63.386MB < 66.000MB +4.0%

✅ iast-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 2.574ms < 2.800ms +8.1%
max_rss_usage ✅ 56.505MB < 58.000MB +2.6%

✅ tracer-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 2.101ms < 2.250ms +6.6%
max_rss_usage ✅ 51.236MB < 53.000MB +3.3%
✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 82.769µs < 100.000µs +17.2%
max_rss_usage ✅ 29.137MB < 31.000MB +6.0%

✅ b3_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 14.133µs < 20.000µs +29.3%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ b3_single_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 13.438µs < 20.000µs +32.8%
max_rss_usage ✅ 29.117MB < 31.000MB +6.1%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Metric Status Value SLO % Under SLO
execution_time ✅ 64.978µs < 80.000µs +18.8%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Metric Status Value SLO % Under SLO
execution_time ✅ 68.030µs < 80.000µs +15.0%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ empty_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 1.604µs < 10.000µs +84.0%
max_rss_usage ✅ 29.157MB < 31.000MB +5.9%

✅ full_t_id_datadog_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 23.734µs < 30.000µs +20.9%
max_rss_usage ✅ 29.078MB < 31.000MB +6.2%

✅ invalid_priority_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.593µs < 10.000µs +34.1%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ invalid_span_id_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.516µs < 10.000µs +34.8%
max_rss_usage ✅ 29.138MB < 31.000MB +6.0%

✅ invalid_tags_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.522µs < 10.000µs +34.8%
max_rss_usage ✅ 29.137MB < 31.000MB +6.0%

✅ invalid_trace_id_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.521µs < 10.000µs +34.8%
max_rss_usage ✅ 29.039MB < 31.000MB +6.3%

✅ large_header_no_matches

Metric Status Value SLO % Under SLO
execution_time ✅ 27.486µs < 30.000µs +8.4%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ large_valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 28.696µs < 40.000µs +28.3%
max_rss_usage ✅ 29.157MB < 31.000MB +5.9%

✅ medium_header_no_matches

Metric Status Value SLO % Under SLO
execution_time ✅ 9.854µs < 20.000µs +50.7%
max_rss_usage ✅ 29.137MB < 31.000MB +6.0%

✅ medium_valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 11.309µs < 20.000µs +43.5%
max_rss_usage ✅ 29.078MB < 31.000MB +6.2%

✅ none_propagation_style

Metric Status Value SLO % Under SLO
execution_time ✅ 1.690µs < 10.000µs +83.1%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ tracecontext_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 34.716µs < 40.000µs +13.2%
max_rss_usage ✅ 29.078MB < 31.000MB +6.2%

✅ valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 6.613µs < 10.000µs +33.9%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ valid_headers_basic

Metric Status Value SLO % Under SLO
execution_time ✅ 6.085µs < 10.000µs +39.2%
max_rss_usage ✅ 29.216MB < 31.000MB +5.8%

✅ wsgi_empty_headers

Metric Status Value SLO % Under SLO
execution_time ✅ 1.591µs < 10.000µs +84.1%
max_rss_usage ✅ 29.138MB < 31.000MB +6.0%

✅ wsgi_invalid_priority_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.565µs < 10.000µs +34.3%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ wsgi_invalid_span_id_header

Metric Status Value SLO % Under SLO
execution_time ✅ 1.583µs < 10.000µs +84.2%
max_rss_usage ✅ 29.197MB < 31.000MB +5.8%

✅ wsgi_invalid_tags_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.573µs < 10.000µs +34.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ wsgi_invalid_trace_id_header

Metric Status Value SLO % Under SLO
execution_time ✅ 6.547µs < 10.000µs +34.5%
max_rss_usage ✅ 29.117MB < 31.000MB +6.1%

✅ wsgi_large_header_no_matches

Metric Status Value SLO % Under SLO
execution_time ✅ 28.639µs < 40.000µs +28.4%
max_rss_usage ✅ 29.157MB < 31.000MB +5.9%

✅ wsgi_large_valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 29.691µs < 40.000µs +25.8%
max_rss_usage ✅ 29.177MB < 31.000MB +5.9%

✅ wsgi_medium_header_no_matches

Metric Status Value SLO % Under SLO
execution_time ✅ 10.179µs < 20.000µs +49.1%
max_rss_usage ✅ 29.117MB < 31.000MB +6.1%

✅ wsgi_medium_valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 11.537µs < 20.000µs +42.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ wsgi_valid_headers_all

Metric Status Value SLO % Under SLO
execution_time ✅ 6.558µs < 10.000µs +34.4%
max_rss_usage ✅ 29.138MB < 31.000MB +6.0%

✅ wsgi_valid_headers_basic

Metric Status Value SLO % Under SLO
execution_time ✅ 6.084µs < 10.000µs +39.2%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%
✅ httppropagationinject - 16/16

✅ ids_only

Metric Status Value SLO % Under SLO
execution_time ✅ 20.032µs < 30.000µs +33.2%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ with_all

Metric Status Value SLO % Under SLO
execution_time ✅ 35.325µs < 40.000µs +11.7%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ with_dd_origin

Metric Status Value SLO % Under SLO
execution_time ✅ 26.539µs < 30.000µs +11.5%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ with_priority_and_origin

Metric Status Value SLO % Under SLO
execution_time ✅ 28.843µs < 40.000µs +27.9%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ with_sampling_priority

Metric Status Value SLO % Under SLO
execution_time ✅ 22.458µs < 30.000µs +25.1%
max_rss_usage ✅ 29.059MB < 31.000MB +6.3%

✅ with_tags

Metric Status Value SLO % Under SLO
execution_time ✅ 28.841µs < 40.000µs +27.9%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ with_tags_invalid

Metric Status Value SLO % Under SLO
execution_time ✅ 32.017µs < 40.000µs +20.0%
max_rss_usage ✅ 29.157MB < 31.000MB +5.9%

✅ with_tags_max_size

Metric Status Value SLO % Under SLO
execution_time ✅ 28.581µs < 40.000µs +28.5%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%
✅ iast_aspects - 40/40

✅ re_expand_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 33.292µs < 40.000µs +16.8%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ re_expand_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 28.662µs < 40.000µs +28.3%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_findall_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.679µs < 10.000µs +63.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_findall_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.403µs < 10.000µs +86.0%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ re_finditer_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 5.120µs < 10.000µs +48.8%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_finditer_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.424µs < 10.000µs +85.8%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_fullmatch_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.389µs < 10.000µs +66.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_fullmatch_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.288µs < 10.000µs +87.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_group_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.462µs < 10.000µs +65.4%
max_rss_usage ✅ 34.662MB < 35.000MB +1.0%

✅ re_group_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.605µs < 10.000µs +84.0%
max_rss_usage ✅ 34.662MB < 35.000MB +1.0%

✅ re_groups_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.623µs < 10.000µs +63.8%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_groups_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.672µs < 10.000µs +83.3%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_match_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.443µs < 10.000µs +65.6%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_match_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.289µs < 10.000µs +87.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_search_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.284µs < 10.000µs +67.2%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ re_search_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.198µs < 10.000µs +88.0%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ re_sub_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.752µs < 10.000µs +52.5%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ re_sub_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.526µs < 10.000µs +84.7%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ re_subn_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.922µs < 10.000µs +50.8%
max_rss_usage ✅ 34.623MB < 35.500MB +2.5%

✅ re_subn_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.606µs < 10.000µs +83.9%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%
✅ iastaspects - 118/118

✅ add_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 329.069ns < 10.000µs +96.7%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ add_inplace_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 328.996ns < 10.000µs +96.7%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ add_inplace_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 321.549ns < 10.000µs +96.8%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ add_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 275.959ns < 10.000µs +97.2%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ bytearray_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.865µs < 10.000µs +81.3%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ bytearray_extend_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.372µs < 10.000µs +86.3%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ bytearray_extend_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 614.745ns < 10.000µs +93.9%
max_rss_usage ✅ 34.681MB < 35.000MB +0.9%

✅ bytearray_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 482.611ns < 10.000µs +95.2%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ bytes_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.883µs < 10.000µs +81.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ bytes_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 492.490ns < 10.000µs +95.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ bytesio_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.907µs < 10.000µs +80.9%
max_rss_usage ✅ 34.662MB < 35.000MB +1.0%

✅ bytesio_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 493.326ns < 10.000µs +95.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ capitalize_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 742.535ns < 10.000µs +92.6%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ capitalize_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 439.789ns < 10.000µs +95.6%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ casefold_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 733.667ns < 10.000µs +92.7%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ casefold_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 370.880ns < 10.000µs +96.3%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ decode_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 719.095ns < 10.000µs +92.8%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ decode_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 417.024ns < 10.000µs +95.8%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ encode_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 713.824ns < 10.000µs +92.9%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ encode_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 413.385ns < 10.000µs +95.9%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ format_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.349µs < 10.000µs +66.5%
max_rss_usage ✅ 34.662MB < 35.000MB +1.0%

✅ format_map_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.219µs < 10.000µs +67.8%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ format_map_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 775.691ns < 10.000µs +92.2%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ format_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 593.340ns < 10.000µs +94.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ index_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 340.509ns < 10.000µs +96.6%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ index_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 276.712ns < 10.000µs +97.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ join_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.225µs < 10.000µs +87.8%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ join_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 487.610ns < 10.000µs +95.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ ljust_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 10.245µs < 20.000µs +48.8%
max_rss_usage ✅ 34.800MB < 35.500MB +2.0%

✅ ljust_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 402.248ns < 10.000µs +96.0%
max_rss_usage ✅ 34.603MB < 35.500MB +2.5%

✅ lower_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.385µs < 10.000µs +76.2%
max_rss_usage ✅ 34.603MB < 35.500MB +2.5%

✅ lower_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 364.245ns < 10.000µs +96.4%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ lstrip_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 10.306µs < 20.000µs +48.5%
max_rss_usage ✅ 34.780MB < 35.500MB +2.0%

✅ lstrip_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 385.596ns < 10.000µs +96.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ modulo_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 592.399ns < 10.000µs +94.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ modulo_aspect_for_bytearray_bytearray

Metric Status Value SLO % Under SLO
execution_time ✅ 1.277µs < 10.000µs +87.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ modulo_aspect_for_bytes

Metric Status Value SLO % Under SLO
execution_time ✅ 752.163ns < 10.000µs +92.5%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ modulo_aspect_for_bytes_bytearray

Metric Status Value SLO % Under SLO
execution_time ✅ 982.207ns < 10.000µs +90.2%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ modulo_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 627.812ns < 10.000µs +93.7%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ replace_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.681µs < 10.000µs +53.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ replace_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 460.774ns < 10.000µs +95.4%
max_rss_usage ✅ 34.603MB < 35.500MB +2.5%

✅ repr_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 914.639ns < 10.000µs +90.9%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ repr_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 413.179ns < 10.000µs +95.9%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ rstrip_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 10.229µs < 20.000µs +48.9%
max_rss_usage ✅ 34.819MB < 35.500MB +1.9%

✅ rstrip_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 380.919ns < 10.000µs +96.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ slice_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 485.582ns < 10.000µs +95.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ slice_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 446.112ns < 10.000µs +95.5%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ stringio_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.202µs < 10.000µs +78.0%
max_rss_usage ✅ 34.681MB < 35.000MB +0.9%

✅ stringio_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 712.276ns < 10.000µs +92.9%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ strip_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 10.261µs < 20.000µs +48.7%
max_rss_usage ✅ 34.800MB < 35.500MB +2.0%

✅ strip_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 389.856ns < 10.000µs +96.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ swapcase_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.480µs < 10.000µs +75.2%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ swapcase_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 536.303ns < 10.000µs +94.6%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ title_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.415µs < 10.000µs +75.9%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ title_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 499.428ns < 10.000µs +95.0%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ translate_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 3.290µs < 10.000µs +67.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ translate_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.046µs < 10.000µs +89.5%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ upper_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.336µs < 10.000µs +76.6%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ upper_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 368.842ns < 10.000µs +96.3%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%
✅ iastaspectsospath - 24/24

✅ ospathbasename_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 5.063µs < 10.000µs +49.4%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ ospathbasename_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.086µs < 10.000µs +89.1%
max_rss_usage ✅ 34.662MB < 35.000MB +1.0%

✅ ospathjoin_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 6.013µs < 10.000µs +39.9%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ ospathjoin_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 2.292µs < 10.000µs +77.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ ospathnormcase_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.000µs < 10.000µs +60.0%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ ospathnormcase_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 569.221ns < 10.000µs +94.3%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ ospathsplit_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 5.901µs < 10.000µs +41.0%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ ospathsplit_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.589µs < 10.000µs +84.1%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ ospathsplitdrive_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.255µs < 10.000µs +57.4%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ ospathsplitdrive_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 691.755ns < 10.000µs +93.1%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ ospathsplitext_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 4.571µs < 10.000µs +54.3%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ ospathsplitext_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.373µs < 10.000µs +86.3%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%
✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.518µs < 10.000µs +84.8%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%

✅ rsplit_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 577.745ns < 10.000µs +94.2%
max_rss_usage ✅ 34.623MB < 35.000MB +1.1%

✅ split_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.473µs < 10.000µs +85.3%
max_rss_usage ✅ 34.681MB < 35.000MB +0.9%

✅ split_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 569.138ns < 10.000µs +94.3%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ splitlines_aspect

Metric Status Value SLO % Under SLO
execution_time ✅ 1.414µs < 10.000µs +85.9%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ splitlines_noaspect

Metric Status Value SLO % Under SLO
execution_time ✅ 585.303ns < 10.000µs +94.1%
max_rss_usage ✅ 34.603MB < 35.000MB +1.1%
✅ iastpropagation - 8/8

✅ no-propagation

Metric Status Value SLO % Under SLO
execution_time ✅ 48.828µs < 60.000µs +18.6%
max_rss_usage ✅ 34.603MB < 35.500MB +2.5%

✅ propagation_enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 145.096µs < 160.000µs +9.3%
max_rss_usage ✅ 34.662MB < 35.500MB +2.4%

✅ propagation_enabled_100

Metric Status Value SLO % Under SLO
execution_time ✅ 1.567ms < 1.800ms +13.0%
max_rss_usage ✅ 34.642MB < 35.000MB +1.0%

✅ propagation_enabled_1000

Metric Status Value SLO % Under SLO
execution_time ✅ 28.939ms < 30.550ms +5.3%
max_rss_usage ✅ 34.662MB < 35.500MB +2.4%
✅ otelsdkspan - 24/24

✅ add-event

Metric Status Value SLO % Under SLO
execution_time ✅ 40.603ms < 42.000ms +3.3%
max_rss_usage ✅ 31.870MB < 35.000MB +8.9%

✅ add-link

Metric Status Value SLO % Under SLO
execution_time ✅ 36.342ms < 38.550ms +5.7%
max_rss_usage ✅ 31.910MB < 35.000MB +8.8%

✅ add-metrics

Metric Status Value SLO % Under SLO
execution_time ✅ 219.745ms < 232.000ms +5.3%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%

✅ add-tags

Metric Status Value SLO % Under SLO
execution_time ✅ 212.959ms < 221.600ms +3.9%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%

✅ get-context

Metric Status Value SLO % Under SLO
execution_time ✅ 29.229ms < 31.300ms +6.6%
max_rss_usage ✅ 31.890MB < 35.000MB +8.9%

✅ is-recording

Metric Status Value SLO % Under SLO
execution_time ✅ 29.486ms < 31.000ms +4.9%
max_rss_usage ✅ 31.870MB < 35.000MB +8.9%

✅ record-exception

Metric Status Value SLO % Under SLO
execution_time ✅ 63.340ms < 65.850ms +3.8%
max_rss_usage ✅ 31.910MB < 35.000MB +8.8%

✅ set-status

Metric Status Value SLO % Under SLO
execution_time ✅ 31.960ms < 34.150ms +6.4%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%

✅ start

Metric Status Value SLO % Under SLO
execution_time ✅ 29.011ms < 30.150ms +3.8%
max_rss_usage ✅ 31.870MB < 35.000MB +8.9%

✅ start-finish

Metric Status Value SLO % Under SLO
execution_time ✅ 34.181ms < 35.350ms +3.3%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%

✅ start-finish-telemetry

Metric Status Value SLO % Under SLO
execution_time ✅ 34.088ms < 35.450ms +3.8%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%

✅ update-name

Metric Status Value SLO % Under SLO
execution_time ✅ 31.249ms < 33.400ms +6.4%
max_rss_usage ✅ 31.850MB < 35.000MB +9.0%
✅ otelspan - 22/22

✅ add-event

Metric Status Value SLO % Under SLO
execution_time ✅ 43.865ms < 47.150ms +7.0%
max_rss_usage ✅ 42.095MB < 42.500MB +1.0%

✅ add-metrics

Metric Status Value SLO % Under SLO
execution_time ✅ 319.885ms < 344.800ms +7.2%
max_rss_usage ✅ 559.796MB < 562.000MB +0.4%

✅ add-tags

Metric Status Value SLO % Under SLO
execution_time ✅ 289.292ms < 314.000ms +7.9%
max_rss_usage ✅ 560.017MB < 563.500MB +0.6%

✅ get-context

Metric Status Value SLO % Under SLO
execution_time ✅ 84.689ms < 92.350ms +8.3%
max_rss_usage ✅ 37.230MB < 38.000MB +2.0%

✅ is-recording

Metric Status Value SLO % Under SLO
execution_time ✅ 42.367ms < 44.500ms +4.8%
max_rss_usage ✅ 41.532MB < 42.000MB +1.1%

✅ record-exception

Metric Status Value SLO % Under SLO
execution_time ✅ 61.448ms < 67.650ms +9.2%
max_rss_usage ✅ 37.679MB < 38.000MB +0.8%

✅ set-status

Metric Status Value SLO % Under SLO
execution_time ✅ 47.385ms < 50.400ms +6.0%
max_rss_usage ✅ 41.420MB < 42.000MB +1.4%

✅ start

Metric Status Value SLO % Under SLO
execution_time ✅ 40.840ms < 43.450ms +6.0%
max_rss_usage ✅ 41.520MB < 42.000MB +1.1%

✅ start-finish

Metric Status Value SLO % Under SLO
execution_time ✅ 80.814ms < 86.000ms +6.0%
max_rss_usage ✅ 31.575MB < 32.000MB +1.3%

✅ start-finish-telemetry

Metric Status Value SLO % Under SLO
execution_time ✅ 82.626ms < 86.000ms +3.9%
max_rss_usage ✅ 31.654MB < 32.000MB +1.1%

✅ update-name

Metric Status Value SLO % Under SLO
execution_time ✅ 42.778ms < 45.150ms +5.3%
max_rss_usage ✅ 41.911MB < 42.500MB +1.4%
✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Metric Status Value SLO % Under SLO
execution_time ✅ 343.101ms < 354.300ms +3.2%
max_rss_usage ✅ 35.008MB < 38.000MB +7.9%

✅ cache_on

Metric Status Value SLO % Under SLO
execution_time ✅ 384.860ns < 10.000µs +96.2%
max_rss_usage ✅ 33.767MB < 38.000MB +11.1%
✅ packagesupdateimporteddependencies - 24/24

✅ import_many

Metric Status Value SLO % Under SLO
execution_time ✅ 155.175µs < 170.000µs +8.7%
max_rss_usage ✅ 34.215MB < 35.500MB +3.6%

✅ import_many_cached

Metric Status Value SLO % Under SLO
execution_time ✅ 120.787µs < 130.000µs +7.1%
max_rss_usage ✅ 34.066MB < 35.500MB +4.0%

✅ import_many_stdlib

Metric Status Value SLO % Under SLO
execution_time ✅ 1.611ms < 1.750ms +7.9%
max_rss_usage ✅ 34.316MB < 35.500MB +3.3%

✅ import_many_stdlib_cached

Metric Status Value SLO % Under SLO
execution_time ✅ 972.148µs < 1.100ms +11.6%
max_rss_usage ✅ 34.463MB < 35.500MB +2.9%

✅ import_many_unknown

Metric Status Value SLO % Under SLO
execution_time ✅ 834.997µs < 890.000µs +6.2%
max_rss_usage ✅ 34.347MB < 35.500MB +3.2%

✅ import_many_unknown_cached

Metric Status Value SLO % Under SLO
execution_time ✅ 803.375µs < 870.000µs +7.7%
max_rss_usage ✅ 34.248MB < 35.500MB +3.5%

✅ import_one

Metric Status Value SLO % Under SLO
execution_time ✅ 19.771µs < 30.000µs +34.1%
max_rss_usage ✅ 34.252MB < 35.500MB +3.5%

✅ import_one_cache

Metric Status Value SLO % Under SLO
execution_time ✅ 6.299µs < 10.000µs +37.0%
max_rss_usage ✅ 33.959MB < 35.500MB +4.3%

✅ import_one_stdlib

Metric Status Value SLO % Under SLO
execution_time ✅ 18.647µs < 20.000µs +6.8%
max_rss_usage ✅ 34.013MB < 35.500MB +4.2%

✅ import_one_stdlib_cache

Metric Status Value SLO % Under SLO
execution_time ✅ 6.290µs < 10.000µs +37.1%
max_rss_usage ✅ 34.240MB < 35.500MB +3.5%

✅ import_one_unknown

Metric Status Value SLO % Under SLO
execution_time ✅ 45.527µs < 50.000µs +8.9%
max_rss_usage ✅ 34.052MB < 35.500MB +4.1%

✅ import_one_unknown_cache

Metric Status Value SLO % Under SLO
execution_time ✅ 6.269µs < 10.000µs +37.3%
max_rss_usage ✅ 34.254MB < 35.500MB +3.5%
✅ ratelimiter - 12/12

✅ defaults

Metric Status Value SLO % Under SLO
execution_time ✅ 2.327µs < 10.000µs +76.7%
max_rss_usage ✅ 28.705MB < 31.000MB +7.4%

✅ high_rate_limit

Metric Status Value SLO % Under SLO
execution_time ✅ 2.401µs < 10.000µs +76.0%
max_rss_usage ✅ 28.666MB < 31.000MB +7.5%

✅ long_window

Metric Status Value SLO % Under SLO
execution_time ✅ 2.353µs < 10.000µs +76.5%
max_rss_usage ✅ 28.705MB < 31.000MB +7.4%

✅ low_rate_limit

Metric Status Value SLO % Under SLO
execution_time ✅ 2.359µs < 10.000µs +76.4%
max_rss_usage ✅ 28.685MB < 31.000MB +7.5%

✅ no_rate_limit

Metric Status Value SLO % Under SLO
execution_time ✅ 824.882ns < 10.000µs +91.8%
max_rss_usage ✅ 28.705MB < 31.000MB +7.4%

✅ short_window

Metric Status Value SLO % Under SLO
execution_time ✅ 2.481µs < 10.000µs +75.2%
max_rss_usage ✅ 28.724MB < 31.000MB +7.3%
✅ recursivecomputation - 8/8

✅ deep

Metric Status Value SLO % Under SLO
execution_time ✅ 308.750ms < 320.950ms +3.8%
max_rss_usage ✅ 29.904MB < 31.000MB +3.5%

✅ deep-profiled

Metric Status Value SLO % Under SLO
execution_time ✅ 345.117ms < 359.150ms +3.9%
max_rss_usage ✅ 34.603MB < 35.500MB +2.5%

✅ medium

Metric Status Value SLO % Under SLO
execution_time ✅ 7.005ms < 7.400ms +5.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ shallow

Metric Status Value SLO % Under SLO
execution_time ✅ 939.189µs < 1.050ms +10.6%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%
✅ samplingrules - 8/8

✅ average_match

Metric Status Value SLO % Under SLO
execution_time ✅ 331.367µs < 350.000µs +5.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ high_match

Metric Status Value SLO % Under SLO
execution_time ✅ 502.184µs < 550.000µs +8.7%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ low_match

Metric Status Value SLO % Under SLO
execution_time ✅ 170.008µs < 190.000µs +10.5%
max_rss_usage ✅ 431.436MB < 432.500MB +0.2%

✅ very_low_match

Metric Status Value SLO % Under SLO
execution_time ✅ 8.668ms < 9.150ms +5.3%
max_rss_usage ✅ 54.909MB < 55.000MB +0.2%
✅ sethttpmeta - 32/32

✅ all-disabled

Metric Status Value SLO % Under SLO
execution_time ✅ 12.237µs < 20.000µs +38.8%
max_rss_usage ✅ 29.590MB < 31.000MB +4.5%

✅ all-enabled

Metric Status Value SLO % Under SLO
execution_time ✅ 42.103µs < 50.000µs +15.8%
max_rss_usage ✅ 29.550MB < 31.000MB +4.7%

✅ collectipvariant_exists

Metric Status Value SLO % Under SLO
execution_time ✅ 42.689µs < 50.000µs +14.6%
max_rss_usage ✅ 29.531MB < 31.000MB +4.7%

✅ no-collectipvariant

Metric Status Value SLO % Under SLO
execution_time ✅ 42.117µs < 50.000µs +15.8%
max_rss_usage ✅ 29.610MB < 31.000MB +4.5%

✅ no-useragentvariant

Metric Status Value SLO % Under SLO
execution_time ✅ 41.285µs < 50.000µs +17.4%
max_rss_usage ✅ 29.550MB < 31.000MB +4.7%

✅ obfuscation-no-query

Metric Status Value SLO % Under SLO
execution_time ✅ 42.647µs < 50.000µs +14.7%
max_rss_usage ✅ 29.511MB < 31.000MB +4.8%

✅ obfuscation-regular-case-explicit-query

Metric Status Value SLO % Under SLO
execution_time ✅ 78.706µs < 90.000µs +12.5%
max_rss_usage ✅ 29.944MB < 31.000MB +3.4%

✅ obfuscation-regular-case-implicit-query

Metric Status Value SLO % Under SLO
execution_time ✅ 79.337µs < 90.000µs +11.8%
max_rss_usage ✅ 29.924MB < 31.000MB +3.5%

✅ obfuscation-send-querystring-disabled

Metric Status Value SLO % Under SLO
execution_time ✅ 158.206µs < 170.000µs +6.9%
max_rss_usage ✅ 29.924MB < 31.000MB +3.5%

✅ obfuscation-worst-case-explicit-query

Metric Status Value SLO % Under SLO
execution_time ✅ 152.180µs < 160.000µs +4.9%
max_rss_usage ✅ 29.904MB < 31.000MB +3.5%

✅ obfuscation-worst-case-implicit-query

Metric Status Value SLO % Under SLO
execution_time ✅ 157.695µs < 170.000µs +7.2%
max_rss_usage ✅ 29.944MB < 31.000MB +3.4%

✅ useragentvariant_exists_1

Metric Status Value SLO % Under SLO
execution_time ✅ 41.502µs < 50.000µs +17.0%
max_rss_usage ✅ 29.511MB < 31.000MB +4.8%

✅ useragentvariant_exists_2

Metric Status Value SLO % Under SLO
execution_time ✅ 42.484µs < 50.000µs +15.0%
max_rss_usage ✅ 29.531MB < 31.000MB +4.7%

✅ useragentvariant_exists_3

Metric Status Value SLO % Under SLO
execution_time ✅ 41.910µs < 50.000µs +16.2%
max_rss_usage ✅ 29.570MB < 31.000MB +4.6%

✅ useragentvariant_not_exists_1

Metric Status Value SLO % Under SLO
execution_time ✅ 41.520µs < 50.000µs +17.0%
max_rss_usage ✅ 29.570MB < 31.000MB +4.6%

✅ useragentvariant_not_exists_2

Metric Status Value SLO % Under SLO
execution_time ✅ 41.353µs < 50.000µs +17.3%
max_rss_usage ✅ 29.491MB < 31.000MB +4.9%
✅ span - 26/26

✅ add-event

Metric Status Value SLO % Under SLO
execution_time ✅ 22.832ms < 26.200ms +12.9%
max_rss_usage ✅ 48.447MB < 49.000MB +1.1%

✅ add-metrics

Metric Status Value SLO % Under SLO
execution_time ✅ 90.266ms < 98.350ms +8.2%
max_rss_usage ✅ 614.375MB < 961.000MB +36.1%

✅ add-tags

Metric Status Value SLO % Under SLO
execution_time ✅ 148.946ms < 168.550ms +11.6%
max_rss_usage ✅ 615.008MB < 962.500MB +36.1%

✅ get-context

Metric Status Value SLO % Under SLO
execution_time ✅ 21.373ms < 23.700ms +9.8%
max_rss_usage ✅ 47.301MB < 47.500MB +0.4%

✅ is-recording

Metric Status Value SLO % Under SLO
execution_time ✅ 21.494ms < 23.900ms +10.1%
max_rss_usage ✅ 47.292MB < 47.500MB +0.4%

✅ record-exception

Metric Status Value SLO % Under SLO
execution_time ✅ 40.871ms < 44.500ms +8.2%
max_rss_usage ✅ 40.328MB < 40.500MB +0.4%

✅ set-status

Metric Status Value SLO % Under SLO
execution_time ✅ 23.057ms < 26.000ms +11.3%
max_rss_usage ✅ 47.278MB < 47.500MB +0.5%

✅ start

Metric Status Value SLO % Under SLO
execution_time ✅ 21.151ms < 23.500ms +10.0%
max_rss_usage ✅ 47.291MB < 47.500MB +0.4%

✅ start-finish

Metric Status Value SLO % Under SLO
execution_time ✅ 49.672ms < 52.500ms +5.4%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ start-finish-telemetry

Metric Status Value SLO % Under SLO
execution_time ✅ 51.367ms < 55.300ms +7.1%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ start-finish-traceid128

Metric Status Value SLO % Under SLO
execution_time ✅ 53.019ms < 56.050ms +5.4%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ start-traceid128

Metric Status Value SLO % Under SLO
execution_time ✅ 21.398ms < 24.600ms +13.0%
max_rss_usage ✅ 47.312MB < 47.500MB +0.4%

✅ update-name

Metric Status Value SLO % Under SLO
execution_time ✅ 21.932ms < 24.100ms +9.0%
max_rss_usage ✅ 47.843MB < 48.000MB +0.3%
✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Metric Status Value SLO % Under SLO
execution_time ✅ 3.189µs < 10.000µs +68.1%
max_rss_usage ✅ 29.078MB < 31.000MB +6.2%

✅ 1-count-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 212.411µs < 240.000µs +11.5%
max_rss_usage ✅ 29.117MB < 31.000MB +6.1%

✅ 1-distribution-metric-1-times

Metric Status Value SLO % Under SLO
execution_time ✅ 3.357µs < 10.000µs +66.4%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ 1-distribution-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 191.447µs < 210.000µs +8.8%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ 1-gauge-metric-1-times

Metric Status Value SLO % Under SLO
execution_time ✅ 2.082µs < 10.000µs +79.2%
max_rss_usage ✅ 29.078MB < 31.000MB +6.2%

✅ 1-gauge-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 124.404µs < 140.000µs +11.1%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ 1-rate-metric-1-times

Metric Status Value SLO % Under SLO
execution_time ✅ 3.227µs < 10.000µs +67.7%
max_rss_usage ✅ 29.039MB < 31.000MB +6.3%

✅ 1-rate-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 212.850µs < 230.000µs +7.5%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ 100-count-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 21.334ms < 22.500ms +5.2%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ 100-distribution-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 1.984ms < 2.100ms +5.5%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ 100-gauge-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 1.289ms < 1.400ms +7.9%
max_rss_usage ✅ 29.118MB < 31.000MB +6.1%

✅ 100-rate-metrics-100-times

Metric Status Value SLO % Under SLO
execution_time ✅ 2.176ms < 2.400ms +9.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ flush-1-metric

Metric Status Value SLO % Under SLO
execution_time ✅ 4.181µs < 10.000µs +58.2%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ flush-100-metrics

Metric Status Value SLO % Under SLO
execution_time ✅ 182.242µs < 200.000µs +8.9%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ flush-1000-metrics

Metric Status Value SLO % Under SLO
execution_time ✅ 2.196ms < 2.350ms +6.6%
max_rss_usage ✅ 30.297MB < 31.000MB +2.3%
✅ tracer - 6/6

✅ large

Metric Status Value SLO % Under SLO
execution_time ✅ 29.928ms < 32.950ms +9.2%
max_rss_usage ✅ 30.278MB < 31.000MB +2.3%

✅ medium

Metric Status Value SLO % Under SLO
execution_time ✅ 2.897ms < 3.200ms +9.5%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

✅ small

Metric Status Value SLO % Under SLO
execution_time ✅ 331.736µs < 370.000µs +10.3%
max_rss_usage ✅ 29.098MB < 31.000MB +6.1%

@gary-huang gary-huang marked this pull request as ready for review July 23, 2025 02:55
@gary-huang gary-huang requested review from a team as code owners July 23, 2025 02:55
Kyle-Verhoog
Kyle-Verhoog reviewed Jul 23, 2025
View reviewed changes
@gary-huang gary-huang enabled auto-merge (squash) July 23, 2025 16:04
@gary-huang gary-huang disabled auto-merge July 23, 2025 18:51
@Yun-Kim Yun-Kim enabled auto-merge (squash) July 23, 2025 18:59
@Yun-Kim Yun-Kim disabled auto-merge July 23, 2025 20:06
@Yun-Kim Yun-Kim merged commit f4a14fd into main Jul 23, 2025
887 checks passed
@Yun-Kim Yun-Kim deleted the gary/mlob-3266 branch July 23, 2025 20:14
alyshawang pushed a commit that referenced this pull request Jul 25, 2025
@gary-huang @Kyle-Verhoog
@Yun-Kim @alyshawang
chore(llmobs): dataframe and csv support (#14041)
747e8c4 
adds support to create dataset from csv files and pandas dataframe
support for datasets
<img width="1084" height="406" alt="image"
src="https://github.com/user-attachments/assets/9d0509e7-ee11-4245-8b23-d5c2f9a021b9"
/>


Also reverts a change from #14110 where config was removed as a task
function arg. We are going back to previous behavior where users can
configure their task function execution


## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Kyle Verhoog <[email protected]>
Co-authored-by: Yun Kim <[email protected]>
Co-authored-by: Yun Kim <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Kyle-Verhoog Kyle-Verhoog Kyle-Verhoog approved these changes

@Yun-Kim Yun-Kim Yun-Kim left review comments

@emmettbutler emmettbutler emmettbutler approved these changes

@gnufede gnufede Awaiting requested review from gnufede gnufede is a code owner automatically assigned from DataDog/apm-python

Assignees
No one assigned
Labels
changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@gary-huang @emmettbutler @Kyle-Verhoog @Yun-Kim