Skip to content

[FLINK-39107][tests] Run otel container from a prebuilt image#27637

Draft
Efrat19 wants to merge 1 commit intoapache:masterfrom
Efrat19:FLINK-39107
Draft

[FLINK-39107][tests] Run otel container from a prebuilt image#27637
Efrat19 wants to merge 1 commit intoapache:masterfrom
Efrat19:FLINK-39107

Conversation

@Efrat19
Copy link
Contributor

@Efrat19 Efrat19 commented Feb 19, 2026

What is the purpose of the change

We are hitting docker build issues when multiple tests are building otel from a dockerfile in parallel. While it could be addressed by a resource lock, we realized we could actually use the prebuilt image with a mounted output directory instead of building from dockerfile. It is also the recommended approach by docker to use volumes for writable locations, to avoid copy-on-write bottlenecks

Brief change log

  • Use a prebuilt otel image with a mounted output directory instead of building from dockerfile.

Verifying this change

This change is already covered by existing tests, such as:

  • org.apache.flink.metrics.otel.OpenTelemetryMetricReporterITCase
  • org.apache.flink.traces.otel.OpenTelemetryTraceReporterITCase

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not applicable

@Efrat19
Copy link
Contributor Author

Efrat19 commented Feb 19, 2026

@flinkbot run azure

@Efrat19 Efrat19 changed the title [FLINK-39107][metrics] Run otel container from a prebuilt image [FLINK-39107][tests] Run otel container from a prebuilt image Feb 19, 2026
@flinkbot
Copy link
Collaborator

flinkbot commented Feb 19, 2026

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

Copy link
Contributor

@MartijnVisser MartijnVisser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, given that CI passes of course. Thanks for addressing it!

@Efrat19 Efrat19 marked this pull request as draft February 19, 2026 12:24
@Efrat19 Efrat19 force-pushed the FLINK-39107 branch 3 times, most recently from f071695 to b2bca70 Compare February 19, 2026 16:07
@Efrat19
Copy link
Contributor Author

Efrat19 commented Feb 19, 2026

@flinkbot run azure

We are hitting docker build issues when multiple tests are building otel from a dockerfile in parallel. While it could be addressed by a resource lock, we realized we could actually use the prebuilt image with a mounted output directory instead of building from dockerfile. It is also the recommended approach by docker to use volumes for writable locations, to avoid copy-on-write bottlenecks https://docs.docker.com/engine/storage/drivers/\#copying-makes-containers-efficient
@Efrat19
Copy link
Contributor Author

Efrat19 commented Feb 20, 2026

@flinkbot run azure

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

Comments