Skip to content

[CIEXE-2681] Use published Docker CI images with internal Buildx - #882

Open
ericdog wants to merge 7 commits into
DataDog:mainfrom
ericdog:ericlim/internal-buildx-modern-docker-20261103
Open

ericdog wants to merge 7 commits into
DataDog:mainfrom
ericdog:ericlim/internal-buildx-modern-docker-20261103

Conversation

@ericdog

@ericdog ericdog commented Nov 3, 2026 •

Copy link
Copy Markdown

Use maintained docker:27.3.1 and docker:29.4.0-noble-py3 tags in CI instead of pipeline-specific candidates or fixed digests. Keep Python virtual environments, the SKIP_PIP_INSTALL guard and existing deployment/E2E controls. The tools check logs the inherited Buildx version without rejecting later releases.

Earlier candidate runs passed layer builds, size checks and unit tests. Those results validate earlier artifacts; current CI will validate the maintained-tag configuration.

Publication prerequisite: images#12612 is still unmerged. Its newer Buildx client reaches these maintained tags only after source merge and normal default-branch image publication. Docker 27.3.1 is already published from master.

Mutable tags are intentional. New job image resolution follows the runner pull policy; existing running jobs and already-built derived images keep their current contents. Validation: diff checks and applicable YAML parsing pass; CI remains enabled on signed commits. No image promotion or deployment was performed.

@ericdog
ericdog force-pushed the ericlim/internal-buildx-modern-docker-20261103 branch from edda1eb to 0970e69 Compare November 3, 2026 15:42
@ericdog
ericdog marked this pull request as ready for review November 4, 2026 16:26
@ericdog
ericdog requested review from a team as code owners November 4, 2026 16:26
@ericdog
ericdog requested a review from lym953 November 4, 2026 16:26
@ericdog

ericdog commented Nov 4, 2026

Copy link
Copy Markdown
Author

/ddci trigger

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Nov 4, 2026 •

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-11-04 16:27:34 UTC ℹ️ Start processing command /ddci trigger


2026-11-04 16:27:37 UTC

Tasks sourcing running asynchronously in workflow devflow:4924896d-a00c-476c-a539-b3c721df0f9f_47:01a1a763-25c5-7b53-9ea7-7b5e2b14c881 under run id 01a1a763-2e2d-7a17-b0cb-f742a5242fe9

@datadog-datadog-prod-us1-2 datadog-datadog-prod-us1-2 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: FAIL

With SKIP_PIP_INSTALL unset, the Noble-based layer-publishing jobs still invoke system pip and abort under PEP 668 before publishing any layers.

Open Bits AI session

🤖 Bits Code Review · Commit 0970e69

Comment thread ci/input_files/build.yaml.tpl Resolved
@ericdog
ericdog force-pushed the ericlim/internal-buildx-modern-docker-20261103 branch from 1ff3e17 to 628602f Compare November 5, 2026 11:36
@datadog-datadog-prod-us1-2

datadog-datadog-prod-us1-2 Bot commented Nov 5, 2026 •

Copy link
Copy Markdown

Pipelines

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 61558e2 | Docs | Give us feedback!

@datadog-datadog-prod-us1-2 datadog-datadog-prod-us1-2 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: PASS

More details

CI jobs now use digest-pinned Docker images with internal Buildx, apt-installed AWS tools, and Python virtual environments. Publishing exports SKIP_PIP_INSTALL=true, resolving the earlier Noble system-pip failure. No findings remain open. Full container and CI integration validation remains outstanding.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Bits Code Review · Commit 97c3648

@ericdog ericdog added the buildx-internal-rollout Internal Buildx CI adoption label Nov 12, 2026
rules:
# Image-maintenance validation has no authorization to deploy Lambda services.
- if: '$CI_COMMIT_BRANCH == "ericlim/internal-buildx-modern-docker-20261103" || $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME == "ericlim/internal-buildx-modern-docker-20261103"'
when: never

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to commit these?

@ericdog

ericdog commented Nov 12, 2026

Copy link
Copy Markdown
Author

/gitlab resync-job-status

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Nov 12, 2026 •

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-11-12 23:54:56 UTC ℹ️ Start processing command /gitlab resync-job-status


2026-11-12 23:55:44 UTC

47 jobs status updated and 0 skipped for a total of 47 jobs

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

buildx-internal-rollout Internal Buildx CI adoption

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants