Test sarahchen6/add-sca-benchmarks branch of apm-sdks-benchmarks

[sarahchen6]

What Does This Do

Test changes made in https://github.com/DataDog/apm-sdks-benchmarks/pull/161

Motivation

Additional Notes

Contributor Checklist

• Format the title according to the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any other useful labels
• Avoid using close, fix, or any linking keywords when referencing an issue
  Use solves instead, and assign the PR milestone to the issue
• Update the CODEOWNERS file on source file addition, migration, or deletion
• Update public documentation with any new configuration flags or behaviors
• Add your completed PR to the merge queue by commenting /merge. You can also:
  • Customize the commit message associated with the merge with /merge --commit-message "..."
  • Remove your PR from the merge queue with /merge -c
  • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level
  • Get more information in this doc

Jira ticket: [PROJ-IDENT]

[dd-octo-sts]

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass
Load	🟢 pass
DaCapo	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Variant	Metric	Candidate	master	Δ (95% CI of mean)
dacapo:biojava:tracing	datadog	execution_time	14.43 s	14.52 s	[-1.9%; +0.7%] (no difference)
dacapo:tomcat:tracing	datadog	execution_time	1.66 ms	1.66 ms	[-1.4%; +1.3%] (no difference)
startup:insecure-bank:iast:Agent	datadog	execution_time	14.93 s	14.63 s	[+0.6%; +3.5%] (maybe worse)
startup:insecure-bank:tracing:Agent	datadog	execution_time	13.71 s	13.72 s	[-1.1%; +0.9%] (no difference)
webserver--insecure-bank--tracing--high_load	load	agg_http_req_duration_p50	824.46 µs	802.90 µs	[-0.8%; +6.1%] (no difference)
startup:petclinic:appsec:Agent	datadog	execution_time	16.90 s	16.92 s	[-1.5%; +1.2%] (no difference)
startup:petclinic:iast:Agent	datadog	execution_time	16.97 s	16.86 s	[-0.4%; +1.6%] (no difference)
startup:petclinic:profiling:Agent	datadog	execution_time	16.69 s	17.04 s	[-3.5%; -0.5%] (maybe better)
startup:petclinic:sca:Agent	datadog	execution_time	16.91 s	16.64 s	[+0.2%; +3.0%] (maybe worse)
startup:petclinic:tracing:Agent	datadog	execution_time	16.11 s	16.12 s	[-1.5%; +1.4%] (no difference)
webserver--spring-petclinic--tracing--high_load	load	agg_http_req_duration_p50	25.72 ms	25.70 ms	[-5.2%; +5.4%] (unstable)

Commit: ae260994 · CI Pipeline · Benchmarking Platform UI