Skip to content

[skmo] restart Skupper controller for SKMO Listener workaround - #4139

Closed
srac0 wants to merge 1 commit into
openstack-k8s-operators:mainfrom
srac0:fix/skmo-skupper-race-condition
Closed

srac0 wants to merge 1 commit into
openstack-k8s-operators:mainfrom
srac0:fix/skmo-skupper-race-condition

Conversation

@srac0

@srac0 srac0 commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The Skupper Listener playbook creates a cert-manager Certificate and immediately attempts to create a Listener referencing the TLS secret. In practice, cert-manager can take 5-10 minutes to issue certificates, causing the Listener to enter an Error state when the secret doesn't exist yet. The Skupper controller does not re-reconcile automatically, leaving the Listener permanently broken.

@openshift-ci

openshift-ci Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci

openshift-ci Bot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign dasm for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@srac0
srac0 force-pushed the fix/skmo-skupper-race-condition branch 3 times, most recently from b01ee71 to 8ca54aa Compare August 31, 2026 19:43
@centosinfra-prod-github-app

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/7934b24859a2450ca78c0b4f780bcc7c

❌ openstack-k8s-operators-content-provider FAILURE in 7m 30s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal-minor-update SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ cifmw-pod-zuul-files SUCCESS in 5m 06s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 2h 16m 49s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 38m 05s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 10m 01s
✔️ cifmw-pod-pre-commit SUCCESS in 9m 46s
✔️ cifmw-architecture-validate-hci SUCCESS in 5m 46s
✔️ cifmw-molecule-kustomize_deploy SUCCESS in 6m 01s

@srac0
srac0 force-pushed the fix/skmo-skupper-race-condition branch from 8ca54aa to d167503 Compare September 1, 2026 07:37
The Skupper Keystone Listener is created before OSCP deployment (services
need immediate authentication), but its TLS certificate only becomes
available after OSCP creates the cert-manager Issuer. The Listener does
not auto-reconcile when the certificate appears later, leaving it
unconfigured and blocking OSCP readiness.

Add a scenario-gated task between apply and wait_conditions that waits
for the certificate and restarts the Skupper controller deployment. On
restart, the controller re-reads all Listeners and configures
successfully. Gated on cifmw_skupper_keystone_enabled and the
control-plane2 stage, so it only runs for SKMO deployments.

Signed-off-by: Samuel Rac <srac@redhat.com>
@srac0
srac0 force-pushed the fix/skmo-skupper-race-condition branch from d167503 to 8d4e82d Compare September 1, 2026 13:30
@srac0 srac0 changed the title [skmo] Resolve Skupper Listener race condition with Certificate creation [skmo] restart Skupper controller for SKMO Listener workaround Sep 1, 2026
@github-actions

Copy link
Copy Markdown

This PR is stale because it has been for over 15 days with no activity.
Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions Bot added the Stale label Sep 17, 2026
@github-actions github-actions Bot closed this Sep 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant