[Server] Resolving Image Pull Errors During CircleCI Upgrade On Event Log

Overview

Encountering image pull errors during a CircleCI upgrade can disrupt production workflows. This issue often arises due to misconfigured image pull secrets in the Helm values file, leading to errors such as ErrImagePull ImagePullBackOff FailedToRetrieveImagePullSecret when running kubectl get pod -n circleci-server.

Prerequisites

  • Access to your Helm values file (values.yaml).
  • Administrative access to your CircleCI environment.

Solution

Run kubectl describe pod <pod_name_of_err_image_pull> -n circleci-server command and look at the event logs and if you are seeing Unable to retrieve some image pull secrets (map[name:regcred]) please proceed to the following steps:

To resolve the image pull errors, follow these steps:

  1. Remove Incorrect regcred Reference:

    • Open your values.yaml file.
    • Locate and remove any lines referencing the - name: regcred secret. This misconfiguration is causing the image pull failures.
    • Example lines to remove: 
      imagePullSecrets:
      - name: regcred
  2. Simplify Your Helm Values Configuration:

    • Ensure your Helm values are clear and concise to prevent future misconfigurations.
    • Below is a suggested structure for your values.yaml
    • global:
      domainName: "<full-domain-name-of-your-install>"
      license: '<license>'
      container:
      registry: cciserver.azurecr.io
      org:
    • Replace <full-domain-name-of-your-install>, <license>, and <your-organization> with your actual deployment details.

By removing the incorrect regcred reference and simplifying your Helm values configuration, you can prevent similar issues in future upgrades.

Additional Resources

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Article is closed for comments.