Skip to content

build: Add CI remote cache #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
janickm wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

build: Add CI remote cache #52

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 29 additions & 4 deletions .github/actions/setup-bazel/action.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,22 @@ inputs:
github-token:
description: 'GitHub token for package authentication'
required: true
bazel-remote-cache:
description: 'Remote cache gRPC/HTTP endpoint'
required: true
bazel-remote-cache-header:
description: 'Authentication header for remote cache (format: header-name=value)'
required: true
bazel-remote-cache-upload:
description: 'Whether to upload results to the remote cache (disable for PRs to prevent cache pollution)'
required: false
default: 'true'
bazel-bes-backend:
description: 'Build Event Service backend endpoint'
required: true
bazel-bes-results-url:
description: 'Build Event Service results URL'
required: true

runs:
using: 'composite'
Expand Down Expand Up @@ -62,8 +78,9 @@ runs:
with:
# Avoid downloading Bazel every time
bazelisk-cache: true
# Store build cache per workflow
disk-cache: ${{ github.workflow }}
# Disk cache is not needed in CI, using remote cache.
# Local developer builds still use --disk_cache from .bazelrc.
disk-cache: false
# Share repository cache between workflows.
# The repo contents cache (--repo_contents_cache, enabled by default since Bazel 8.3.0)
# lives under the repository cache directory, so caching it here also persists
Expand All @@ -75,10 +92,18 @@ runs:
# Only save caches on push (not on PRs) to avoid cache pollution
cache-save: ${{ github.event_name != 'pull_request' }}
# Bump to force-invalidate all CI caches (e.g. after changing cache structure)
cache-version: 2
# Add custom bazelrc options: color / timestamps / no GPU for CI builds
cache-version: 3
# Add custom bazelrc options
bazelrc: |
build --color=yes
build --show_timestamps
build --build_metadata=REPO_URL=https://github.com/NVIDIA/ncore.git
test --config=no-gpu
common --repo_contents_cache=~/.cache/bazel-repo/contents
common --remote_cache=${{ inputs.bazel-remote-cache }}
common --remote_cache_compression
common --remote_timeout=10m
common --remote_header=${{ inputs.bazel-remote-cache-header }}
build --remote_upload_local_results=${{ inputs.bazel-remote-cache-upload }}
build --bes_backend=${{ inputs.bazel-bes-backend }}
build --bes_results_url=${{ inputs.bazel-bes-results-url }}
13 changes: 13 additions & 0 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,11 @@ jobs:
install-pandoc: true
free-disk-space: true
github-token: ${{ secrets.NVIDIA_PACKAGES_TOKEN || secrets.GITHUB_TOKEN }}
bazel-remote-cache: ${{ secrets.BAZEL_REMOTE_CACHE }}
bazel-remote-cache-header: ${{ secrets.BAZEL_REMOTE_CACHE_HEADER }}
bazel-remote-cache-upload: ${{ github.event_name != 'pull_request' && 'true' || 'false' }}
bazel-bes-backend: ${{ secrets.BAZEL_BES_BACKEND }}
bazel-bes-results-url: ${{ secrets.BAZEL_BES_RESULTS_URL }}

- name: Check code format
run: bazelisk run format.check
Expand Down Expand Up @@ -88,6 +93,10 @@ jobs:
install-pandoc: true
free-disk-space: true
github-token: ${{ secrets.NVIDIA_PACKAGES_TOKEN || secrets.GITHUB_TOKEN }}
bazel-remote-cache: ${{ secrets.BAZEL_REMOTE_CACHE }}
bazel-remote-cache-header: ${{ secrets.BAZEL_REMOTE_CACHE_HEADER }}
bazel-bes-backend: ${{ secrets.BAZEL_BES_BACKEND }}
bazel-bes-results-url: ${{ secrets.BAZEL_BES_RESULTS_URL }}

- name: Build documentation
run: bazelisk build //docs:ncore
Expand Down Expand Up @@ -131,6 +140,10 @@ jobs:
install-pandoc: false
free-disk-space: true
github-token: ${{ secrets.NVIDIA_PACKAGES_TOKEN || secrets.GITHUB_TOKEN }}
bazel-remote-cache: ${{ secrets.BAZEL_REMOTE_CACHE }}
bazel-remote-cache-header: ${{ secrets.BAZEL_REMOTE_CACHE_HEADER }}
bazel-bes-backend: ${{ secrets.BAZEL_BES_BACKEND }}
bazel-bes-results-url: ${{ secrets.BAZEL_BES_RESULTS_URL }}

- name: Publish to PyPI
env:
Expand Down
Loading