Skip to content

chore(deps): upgrade aws-lc-rs to 1.16.1#1772

Closed
gyuheon0h wants to merge 1 commit intomainfrom
gyuheon0h/upgrade-aws-lc-sys
Closed

chore(deps): upgrade aws-lc-rs to 1.16.1#1772
gyuheon0h wants to merge 1 commit intomainfrom
gyuheon0h/upgrade-aws-lc-sys

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Mar 20, 2026 •
edited
Loading

What does this PR do?

aws-lc-rs v1.13 has a few CVEs

Bumping to latest, which is 1.16.1

cargo update -p aws-lc-rs --precise 1.16.1

Motivation

Saw this notification on one of my PRs

Also, https://dd.slack.com/archives/C6YASP83Z/p1773932459149399

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Mar 20, 2026

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title upgrade aws-lc-rs to 1.16.1 chore(crashtracking): upgrade aws-lc-rs to 1.16.1 Mar 20, 2026
@gyuheon0h gyuheon0h changed the title chore(crashtracking): upgrade aws-lc-rs to 1.16.1 chore(deps): upgrade aws-lc-rs to 1.16.1 Mar 20, 2026
@gyuheon0h gyuheon0h marked this pull request as ready for review March 20, 2026 17:36
@gyuheon0h gyuheon0h requested a review from a team as a code owner March 20, 2026 17:36
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/upgrade-aws-lc-sys branch from fa385a7 to 127714a Compare March 20, 2026 17:39
@gyuheon0h gyuheon0h force-pushed the gyuheon0h/upgrade-aws-lc-sys branch from 127714a to a3a9fa1 Compare March 20, 2026 17:40
@gyuheon0h gyuheon0h closed this Mar 20, 2026
@codecov-commenter
Copy link

codecov-commenter commented Mar 20, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.31%. Comparing base (26caae8) to head (a3a9fa1).
⚠️ Report is 6 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1772      +/-   ##
==========================================
- Coverage   71.32%   71.31%   -0.02%     
==========================================
  Files         431      432       +1     
  Lines       64709    64882     +173     
==========================================
+ Hits        46155    46268     +113     
- Misses      18554    18614      +60
Components Coverage Δ
libdd-crashtracker 64.97% <ø> (+0.04%) ⬆️
libdd-crashtracker-ffi 35.24% <ø> (+0.38%) ⬆️
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 88.32% <ø> (+0.33%) ⬆️
libdd-data-pipeline-ffi 76.01% <ø> (+0.81%) ⬆️
libdd-common 79.87% <ø> (ø)
libdd-common-ffi 73.87% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.29% <ø> (ø)
libdd-profiling 81.60% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 64.94% <ø> (ø)
datadog-sidecar 31.76% <ø> (+0.15%) ⬆️
datdog-sidecar-ffi 9.61% <ø> (+0.89%) ⬆️
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 92.26% <ø> (+0.04%) ⬆️
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.95% <ø> (-0.11%) ⬇️
datadog-tracer-flare 86.88% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@pr-commenter
Copy link

pr-commenter bot commented Mar 20, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-20 17:58:26

Comparing candidate commit a3a9fa1 in PR branch gyuheon0h/upgrade-aws-lc-sys with baseline commit 0c25580 in branch main.

Found 12 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

scenario:credit_card/is_card_number/ 378282246310005

  • 🟩 execution_time [-5.751µs; -5.668µs] or [-7.807%; -7.694%]
  • 🟩 throughput [+1132591.367op/s; +1148029.258op/s] or [+8.343%; +8.457%]

scenario:credit_card/is_card_number/378282246310005

  • 🟩 execution_time [-5.607µs; -5.515µs] or [-7.979%; -7.848%]
  • 🟩 throughput [+1213240.932op/s; +1231912.531op/s] or [+8.526%; +8.657%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟩 execution_time [-7.393µs; -7.369µs] or [-13.916%; -13.870%]
  • 🟩 throughput [+3031321.188op/s; +3042730.419op/s] or [+16.105%; +16.165%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟩 execution_time [-5.750µs; -5.681µs] or [-9.722%; -9.605%]
  • 🟩 throughput [+1798380.517op/s; +1818140.780op/s] or [+10.637%; +10.754%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟩 execution_time [-5.449µs; -5.400µs] or [-9.792%; -9.705%]
  • 🟩 throughput [+1933235.289op/s; +1948975.642op/s] or [+10.757%; +10.845%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟩 execution_time [-7.417µs; -7.392µs] or [-13.957%; -13.910%]
  • 🟩 throughput [+3040773.949op/s; +3052292.306op/s] or [+16.159%; +16.220%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.801ms 49.125ms ± 1.005ms 48.969ms ± 0.050ms 49.026ms 49.198ms 56.469ms 57.980ms 18.40% 7.710 59.394 2.04% 0.071ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.986ms; 49.265ms] or [-0.284%; +0.284%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.326µs 3.188µs ± 1.428µs 3.014µs ± 0.024µs 3.034µs 3.381µs 13.828µs 15.195µs 404.20% 7.552 57.455 44.68% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.990µs; 3.386µs] or [-6.207%; +6.207%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 185.221µs 185.771µs ± 0.255µs 185.770µs ± 0.204µs 185.973µs 186.203µs 186.304µs 186.354µs 0.31% 0.117 -0.727 0.14% 0.018µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5366122.488op/s 5382972.307op/s ± 7376.882op/s 5383004.832op/s ± 5924.873op/s 5388926.217op/s 5394100.428op/s 5397209.444op/s 5398941.996op/s 0.30% -0.112 -0.728 0.14% 521.624op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.892µs 17.976µs ± 0.045µs 17.968µs ± 0.022µs 17.993µs 18.059µs 18.100µs 18.277µs 1.72% 2.048 9.635 0.25% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54714203.347op/s 55628676.704op/s ± 137915.386op/s 55655811.385op/s ± 68653.380op/s 55711532.311op/s 55786671.767op/s 55870301.518op/s 55891005.963op/s 0.42% -1.993 9.201 0.25% 9752.090op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.154µs 10.252µs ± 0.034µs 10.250µs ± 0.020µs 10.269µs 10.302µs 10.352µs 10.387µs 1.34% 0.555 1.429 0.33% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 96277910.565op/s 97545933.445op/s ± 321579.283op/s 97564509.027op/s ± 191370.732op/s 97764597.848op/s 97981430.367op/s 98266923.172op/s 98480858.156op/s 0.94% -0.524 1.370 0.33% 22739.089op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [185.736µs; 185.807µs] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5381949.942op/s; 5383994.672op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.970µs; 17.983µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55609562.958op/s; 55647790.450op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.247µs; 10.256µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good throughput [97501365.649op/s; 97590501.241op/s] or [-0.046%; +0.046%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.272ms 4.277ms ± 0.003ms 4.277ms ± 0.001ms 4.278ms 4.280ms 4.282ms 4.305ms 0.65% 4.699 44.274 0.07% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.276ms; 4.277ms] or [-0.009%; +0.009%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.638µs 146.660µs ± 1.667µs 146.408µs ± 0.506µs 146.934µs 148.263µs 152.809µs 162.470µs 10.97% 5.882 46.538 1.13% 0.118µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.429µs; 146.891µs] or [-0.158%; +0.158%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.898µs 3.915µs ± 0.002µs 3.915µs ± 0.001µs 3.916µs 3.918µs 3.919µs 3.920µs 0.13% -1.723 11.474 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255117177.097op/s 255454223.004op/s ± 153676.383op/s 255447487.688op/s ± 84681.279op/s 255531049.107op/s 255692710.648op/s 255754614.277op/s 256548181.386op/s 0.43% 1.742 11.629 0.06% 10866.561op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.150µs 80.124µs ± 0.262µs 80.168µs ± 0.044µs 80.211µs 80.287µs 80.350µs 80.553µs 0.48% -7.809 81.984 0.33% 0.019µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12414248.578op/s 12480770.177op/s ± 41908.669op/s 12473779.492op/s ± 6911.631op/s 12480806.083op/s 12542296.888op/s 12572594.097op/s 12961824.627op/s 3.91% 8.038 85.780 0.33% 2963.390op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 67.818µs 67.956µs ± 0.079µs 67.942µs ± 0.040µs 67.983µs 68.089µs 68.144µs 68.529µs 0.86% 2.335 12.619 0.12% 0.006µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 14592382.500op/s 14715470.505op/s ± 17150.954op/s 14718372.641op/s ± 8602.273op/s 14726844.034op/s 14735030.232op/s 14743882.925op/s 14745381.632op/s 0.18% -2.303 12.328 0.12% 1212.756op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.918µs 3.920µs 3.925µs 0.26% -0.743 7.013 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254784031.393op/s 255434421.874op/s ± 165033.486op/s 255443687.439op/s ± 93969.163op/s 255529162.266op/s 255674588.672op/s 255705421.988op/s 256459182.990op/s 0.40% 0.759 7.097 0.06% 11669.630op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 64.601µs 64.713µs ± 0.068µs 64.700µs ± 0.041µs 64.745µs 64.844µs 64.951µs 64.970µs 0.42% 1.219 1.859 0.11% 0.005µs 1 200
credit_card/is_card_number/378282246310005 throughput 15391658.119op/s 15452949.576op/s ± 16314.633op/s 15456061.509op/s ± 9721.220op/s 15463953.524op/s 15472067.583op/s 15477789.372op/s 15479597.890op/s 0.15% -1.212 1.833 0.11% 1153.619op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.505µs 45.746µs ± 0.083µs 45.752µs ± 0.061µs 45.811µs 45.871µs 45.909µs 45.933µs 0.39% -0.308 -0.285 0.18% 0.006µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21771034.920op/s 21859776.894op/s ± 39596.771op/s 21856998.567op/s ± 29097.217op/s 21887393.958op/s 21929613.316op/s 21953704.667op/s 21975399.794op/s 0.54% 0.317 -0.276 0.18% 2799.915op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.584µs 6.632µs ± 0.013µs 6.635µs ± 0.006µs 6.641µs 6.646µs 6.649µs 6.652µs 0.24% -1.499 2.471 0.19% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150339558.320op/s 150784278.469op/s ± 287861.139op/s 150705882.408op/s ± 137093.425op/s 150889484.802op/s 151345876.831op/s 151768761.389op/s 151881856.435op/s 0.78% 1.512 2.521 0.19% 20354.856op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.900µs 3.916µs ± 0.003µs 3.916µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.924µs 0.23% -0.511 4.389 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254811296.029op/s 255385591.450op/s ± 185489.015op/s 255393181.803op/s ± 105573.332op/s 255494692.099op/s 255663702.761op/s 255750278.266op/s 256432259.479op/s 0.41% 0.524 4.452 0.07% 13116.054op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.250µs 65.705µs ± 0.082µs 65.718µs ± 0.040µs 65.753µs 65.810µs 65.852µs 65.878µs 0.24% -1.626 5.463 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15179505.089op/s 15219677.112op/s ± 19136.170op/s 15216522.160op/s ± 9235.868op/s 15226889.991op/s 15250910.381op/s 15284223.849op/s 15325715.017op/s 0.72% 1.644 5.562 0.13% 1353.132op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.356µs 53.431µs ± 0.036µs 53.425µs ± 0.020µs 53.451µs 53.501µs 53.526µs 53.573µs 0.28% 0.739 0.870 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18666139.514op/s 18715569.143op/s ± 12608.963op/s 18717832.460op/s ± 7113.277op/s 18723610.478op/s 18732948.688op/s 18740029.882op/s 18742006.609op/s 0.13% -0.735 0.860 0.07% 891.588op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.914µs ± 0.002µs 3.915µs ± 0.001µs 3.915µs 3.918µs 3.920µs 3.923µs 0.22% -2.096 18.435 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254890467.486op/s 255463836.920op/s ± 162674.793op/s 255455214.590op/s ± 77473.476op/s 255541851.197op/s 255688082.205op/s 255746695.618op/s 256747878.310op/s 0.51% 2.127 18.696 0.06% 11502.845op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.149µs 50.219µs ± 0.032µs 50.215µs ± 0.018µs 50.234µs 50.274µs 50.336µs 50.400µs 0.37% 1.445 5.211 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19841232.442op/s 19912764.028op/s ± 12807.040op/s 19914544.697op/s ± 7197.718op/s 19921120.828op/s 19929120.290op/s 19937251.826op/s 19940714.262op/s 0.13% -1.435 5.155 0.06% 905.594op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.479µs 45.737µs ± 0.082µs 45.737µs ± 0.054µs 45.789µs 45.872µs 45.905µs 45.916µs 0.39% -0.021 -0.230 0.18% 0.006µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21779054.377op/s 21864387.166op/s ± 39399.232op/s 21864055.526op/s ± 25681.472op/s 21889658.779op/s 21927317.381op/s 21947889.849op/s 21988302.825op/s 0.57% 0.031 -0.222 0.18% 2785.946op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.563µs 6.623µs ± 0.016µs 6.627µs ± 0.010µs 6.636µs 6.641µs 6.643µs 6.647µs 0.31% -1.143 1.157 0.25% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150443629.845op/s 150991200.558op/s ± 372856.126op/s 150903226.580op/s ± 227562.151op/s 151210068.814op/s 151722119.055op/s 152100662.348op/s 152374204.476op/s 0.97% 1.156 1.204 0.25% 26364.909op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.915µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255432924.936op/s; 255475521.073op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.088µs; 80.160µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12474962.039op/s; 12486578.316op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [67.945µs; 67.967µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14713093.547op/s; 14717847.462op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255411549.820op/s; 255457293.928op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [64.703µs; 64.722µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/378282246310005 throughput [15450688.524op/s; 15455210.627op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.735µs; 45.758µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21854289.162op/s; 21865264.626op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.630µs; 6.634µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/x371413321323331 throughput [150744383.684op/s; 150824173.254op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255359884.456op/s; 255411298.443op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.693µs; 65.716µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15217025.023op/s; 15222329.201op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.426µs; 53.436µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18713821.662op/s; 18717316.624op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255441291.758op/s; 255486382.082op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.215µs; 50.224µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19910989.096op/s; 19914538.961op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.725µs; 45.748µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21858926.812op/s; 21869847.521op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.621µs; 6.625µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [150939526.285op/s; 151042874.831op/s] or [-0.034%; +0.034%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.009µs 34.521µs ± 0.805µs 34.165µs ± 0.049µs 34.247µs 36.192µs 36.317µs 38.219µs 11.86% 1.875 2.324 2.33% 0.057µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.410µs; 34.633µs] or [-0.323%; +0.323%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.329µs 25.973µs ± 9.389µs 18.647µs ± 0.236µs 33.343µs 42.077µs 43.126µs 70.978µs 280.63% 1.219 2.274 36.06% 0.664µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.672µs; 27.275µs] or [-5.010%; +5.010%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.386ns 192.695ns ± 2.313ns 192.366ns ± 1.478ns 193.607ns 197.425ns 200.279ns 204.283ns 6.20% 1.792 4.416 1.20% 0.164ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.375ns; 193.016ns] or [-0.166%; +0.166%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.012µs 160.428µs ± 0.315µs 160.381µs ± 0.129µs 160.511µs 160.904µs 161.368µs 162.895µs 1.57% 3.703 22.488 0.20% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.384µs; 160.472µs] or [-0.027%; +0.027%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.066µs 88.391µs ± 0.169µs 88.371µs ± 0.081µs 88.463µs 88.567µs 88.661µs 90.181µs 2.05% 5.989 61.341 0.19% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [88.368µs; 88.414µs] or [-0.026%; +0.026%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.284µs 2.356µs ± 0.017µs 2.357µs ± 0.006µs 2.366µs 2.374µs 2.380µs 2.388µs 1.33% -2.082 5.475 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.354µs; 2.358µs] or [-0.098%; +0.098%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.977µs 5.048µs ± 0.045µs 5.029µs ± 0.028µs 5.082µs 5.136µs 5.139µs 5.140µs 2.22% 0.621 -0.720 0.89% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.042µs; 5.054µs] or [-0.124%; +0.124%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.319ms 14.372ms ± 0.030ms 14.368ms ± 0.014ms 14.381ms 14.411ms 14.501ms 14.546ms 1.24% 2.349 9.233 0.21% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.368ms; 14.376ms] or [-0.029%; +0.029%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 13.080ms 13.112ms ± 0.016ms 13.109ms ± 0.009ms 13.120ms 13.136ms 13.158ms 13.206ms 0.74% 1.630 6.458 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [13.110ms; 13.114ms] or [-0.016%; +0.016%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.206ms 4.212ms ± 0.008ms 4.211ms ± 0.001ms 4.212ms 4.215ms 4.219ms 4.314ms 2.45% 11.893 154.809 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.211ms; 4.213ms] or [-0.025%; +0.025%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.385ms 3.422ms ± 0.035ms 3.409ms ± 0.011ms 3.427ms 3.506ms 3.528ms 3.542ms 3.89% 1.770 2.234 1.02% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.417ms; 3.427ms] or [-0.142%; +0.142%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 238.296ns 249.962ns ± 13.925ns 243.623ns ± 3.404ns 253.116ns 282.342ns 290.553ns 290.813ns 19.37% 1.681 1.632 5.56% 0.985ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [248.032ns; 251.892ns] or [-0.772%; +0.772%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.305µs 496.203µs ± 0.450µs 496.156µs ± 0.326µs 496.492µs 497.042µs 497.361µs 497.405µs 0.25% 0.449 -0.209 0.09% 0.032µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2010432.357op/s 2015305.296op/s ± 1826.407op/s 2015494.901op/s ± 1325.752op/s 2016768.647op/s 2017953.667op/s 2018577.195op/s 2018959.148op/s 0.17% -0.444 -0.215 0.09% 129.146op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 370.577µs 371.282µs ± 0.300µs 371.270µs ± 0.194µs 371.479µs 371.732µs 372.045µs 372.259µs 0.27% 0.052 0.282 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2686302.369op/s 2693372.403op/s ± 2179.757op/s 2693454.280op/s ± 1410.253op/s 2694675.041op/s 2697270.697op/s 2698470.911op/s 2698494.510op/s 0.19% -0.047 0.278 0.08% 154.132op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 167.792µs 168.221µs ± 0.167µs 168.213µs ± 0.101µs 168.318µs 168.492µs 168.620µs 168.814µs 0.36% 0.136 0.472 0.10% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5923681.764op/s 5944570.728op/s ± 5909.479op/s 5944835.522op/s ± 3583.848op/s 5948154.502op/s 5954780.505op/s 5958656.340op/s 5959769.615op/s 0.25% -0.129 0.465 0.10% 417.863op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 38.266µs 38.381µs ± 0.048µs 38.375µs ± 0.030µs 38.408µs 38.464µs 38.521µs 38.568µs 0.50% 0.693 1.011 0.13% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 25928234.707op/s 26054702.294op/s ± 32880.702op/s 26058519.429op/s ± 20208.446op/s 26075969.511op/s 26097308.706op/s 26120860.401op/s 26132789.519op/s 0.29% -0.684 0.989 0.13% 2325.017op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.191µs 46.286µs ± 0.063µs 46.274µs ± 0.039µs 46.316µs 46.402µs 46.460µs 46.588µs 0.68% 1.209 2.310 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21464780.469op/s 21604876.684op/s ± 29297.388op/s 21610262.281op/s ± 18345.446op/s 21627459.088op/s 21640259.021op/s 21645824.696op/s 21649088.008op/s 0.18% -1.197 2.255 0.14% 2071.638op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.141µs; 496.265µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015052.173op/s; 2015558.418op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [371.240µs; 371.324µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2693070.310op/s; 2693674.497op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [168.198µs; 168.244µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5943751.731op/s; 5945389.725op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [38.374µs; 38.388µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26050145.345op/s; 26059259.243op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.277µs; 46.295µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21600816.348op/s; 21608937.020op/s] or [-0.019%; +0.019%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a3a9fa1 1774028427 gyuheon0h/upgrade-aws-lc-sys
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 748.802µs 749.884µs ± 0.477µs 749.832µs ± 0.276µs 750.115µs 750.782µs 751.290µs 751.987µs 0.29% 0.947 1.988 0.06% 0.034µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [749.818µs; 749.950µs] or [-0.009%; +0.009%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@gyuheon0h @codecov-commenter