Skip to content

Remove local dd-trace-java benchmarks#11502

Open
sarahchen6 wants to merge 1 commit into
masterfrom
sarahchen6/remove-local-benchmarks
Open

Remove local dd-trace-java benchmarks#11502
sarahchen6 wants to merge 1 commit into
masterfrom
sarahchen6/remove-local-benchmarks

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

What Does This Do

Remove local dd-trace-java dacapo, load, startup benchmark definitions in favor of updated apm-sdks-benchmarks ones located in https://github.com/DataDog/apm-sdks-benchmarks/tree/main/.gitlab

Motivation

Clean up repo

Additional Notes

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level
    • Get more information in this doc

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 29, 2026
@datadog-datadog-prod-us1-2
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1-2 Bot commented May 29, 2026

Pipelines

Fix all issues with BitsAI

⚠️ Warnings

🚦 1 Pipeline job failed

DataDog/apm-reliability/dd-trace-java | check_smoke 1/4   View in Datadog   GitLab

🔄 Retry job. This looks flaky and may succeed on retry. Unable to read workspace metadata due to corrupted metadata.bin file.

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 49b8e0b | Docs | Datadog PR Page | Give us feedback!

@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented May 29, 2026

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 14.00 s 13.90 s [-0.3%; +1.7%] (no difference)
startup:insecure-bank:tracing:Agent 12.92 s 12.92 s [-1.3%; +1.2%] (no difference)
startup:petclinic:appsec:Agent 16.55 s 16.53 s [-1.4%; +1.6%] (no difference)
startup:petclinic:iast:Agent 16.60 s 16.67 s [-1.6%; +0.7%] (no difference)
startup:petclinic:profiling:Agent 16.50 s 16.49 s [-1.2%; +1.4%] (no difference)
startup:petclinic:tracing:Agent 15.77 s 16.07 s [-3.0%; -0.8%] (maybe better)

Commit: 49b8e0b4 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6 sarahchen6 marked this pull request as ready for review June 1, 2026 13:22
@sarahchen6 sarahchen6 requested a review from a team as a code owner June 1, 2026 13:22
@sarahchen6 sarahchen6 requested review from AlexeyKuznetsov-DD and PerfectSlayer and removed request for a team June 1, 2026 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants