Hi,
I am installing the portworx in a air-gapped kubernetes cluster. It is failing to bring up the protworx pod and running on the kubernetes cluster. The cluster is a k3s.
[ec2-user@piab ~]$ kubectl get pods -n kube-system -l name=portworx -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
portworx-vxptx 1/2 CrashLoopBackOff 47 13h XX.XX.XX.XX XXXX
portworx-mnpv2 1/2 CrashLoopBackOff 47 13h XX.XX.XX.XX XXXX
portworx-txj4t 1/2 Error 47 13h XX.XX.XX.XX XXXX
Error message:
kubectl logs portworx-mnpv2 -n kube-system -c portworx
time=“2021-06-17T14:01:49Z” level=info msg=“Input arguments: /px-oci-mon -c px-cluster-d5721abb-e1c4-4319-b2e9-a8cf933594b3 -s /dev/nvme1n1 -secret_type k8s -b --oem esse -x kubernetes”
time=“2021-06-17T14:01:49Z” level=info msg=“Updated arguments: /px-oci-mon -c px-cluster-d5721abb-e1c4-4319-b2e9-a8cf933594b3 -s /dev/nvme1n1 -secret_type k8s -b -x kubernetes”
time=“2021-06-17T14:01:49Z” level=info msg=“OCI-Monitor computed version v2.6.0.2-ge9755295-dirty”
time=“2021-06-17T14:01:49Z” level=info msg=“Detected PX_HTTP_PROXY=http://proxy.ext.ray.com:80, setting as HTTP/HTTPS proxy”
time=“2021-06-17T14:01:49Z” level=info msg=“Service handler initialized via as DBus{type:dbus,svc:portworx.service,id:0xc00000a8e0}”
time=“2021-06-17T14:01:49Z” level=info msg=“Activating REST server”
time=“2021-06-17T14:01:49Z” level=info msg=“> run-host: /bin/sh -c cat /etc/crictl.yaml || cat /var/vcap/store/crictl.yaml”
time=“2021-06-17T14:01:49Z” level=info msg=“Locating my container handler”
time=“2021-06-17T14:01:49Z” level=info msg=“Negotiated Docker API version: 1.32”
time=“2021-06-17T14:01:49Z” level=info msg=“> Attempt to use Docker as container handler failed” error=“Error inspecting container ‘9bd61a21dacb3d8737453b18017a1dba8d9f379528613adc08c4843d96438dc6’: Error: No such container: 9bd61a21dacb3d8737453b18017a1dba8d9f379528613adc08c4843d96438dc6”
time=“2021-06-17T14:01:49Z” level=info msg=“> Using ContainerD as container handler”
time=“2021-06-17T14:01:49Z” level=info msg=“Detected HostNetwork setting - will track portworx status via REST”
time=“2021-06-17T14:01:49Z” level=info msg=“Parsed Registry/Repo demo-artifactory.demo.local:8081/docker-local/px-images from own image URN demo-artifactory.demo.local:8081/docker-local/px-images/oci-monitor:2.6.0.2”
time=“2021-06-17T14:01:49Z” level=info msg=“Detected custom registry server/repo – installing PX-OCI from demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2”
time=“2021-06-17T14:01:49Z” level=info msg=“Removed env variables: [AUTOPILOT_PORT AUTOPILOT_PORT_9628_TCP AUTOPILOT_PORT_9628_TCP_ADDR AUTOPILOT_PORT_9628_TCP_PORT AUTOPILOT_PORT_9628_TCP_PROTO AUTOPILOT_SERVICE_HOST AUTOPILOT_SERVICE_PORT AUTOPILOT_SERVICE_PORT_AUTOPILOT METRICS_SERVER_PORT METRICS_SERVER_PORT_443_TCP METRICS_SERVER_PORT_443_TCP_ADDR METRICS_SERVER_PORT_443_TCP_PORT METRICS_SERVER_PORT_443_TCP_PROTO METRICS_SERVER_SERVICE_HOST METRICS_SERVER_SERVICE_PORT PATH PORTWORX_API_PORT PORTWORX_API_PORT_9001_TCP PORTWORX_API_PORT_9001_TCP_ADDR PORTWORX_API_PORT_9001_TCP_PORT PORTWORX_API_PORT_9001_TCP_PROTO PORTWORX_API_PORT_9020_TCP PORTWORX_API_PORT_9020_TCP_ADDR PORTWORX_API_PORT_9020_TCP_PORT PORTWORX_API_PORT_9020_TCP_PROTO PORTWORX_API_PORT_9021_TCP PORTWORX_API_PORT_9021_TCP_ADDR PORTWORX_API_PORT_9021_TCP_PORT PORTWORX_API_PORT_9021_TCP_PROTO PORTWORX_API_SERVICE_HOST PORTWORX_API_SERVICE_PORT PORTWORX_API_SERVICE_PORT_PX_API PORTWORX_API_SERVICE_PORT_PX_REST_GATEWAY PORTWORX_API_SERVICE_PORT_PX_SDK PORTWORX_SERVICE_PORT PORTWORX_SERVICE_PORT_9001_TCP PORTWORX_SERVICE_PORT_9001_TCP_ADDR PORTWORX_SERVICE_PORT_9001_TCP_PORT PORTWORX_SERVICE_PORT_9001_TCP_PROTO PORTWORX_SERVICE_PORT_9019_TCP PORTWORX_SERVICE_PORT_9019_TCP_ADDR PORTWORX_SERVICE_PORT_9019_TCP_PORT PORTWORX_SERVICE_PORT_9019_TCP_PROTO PORTWORX_SERVICE_PORT_9020_TCP PORTWORX_SERVICE_PORT_9020_TCP_ADDR PORTWORX_SERVICE_PORT_9020_TCP_PORT PORTWORX_SERVICE_PORT_9020_TCP_PROTO PORTWORX_SERVICE_PORT_9021_TCP PORTWORX_SERVICE_PORT_9021_TCP_ADDR PORTWORX_SERVICE_PORT_9021_TCP_PORT PORTWORX_SERVICE_PORT_9021_TCP_PROTO PORTWORX_SERVICE_SERVICE_HOST PORTWORX_SERVICE_SERVICE_PORT PORTWORX_SERVICE_SERVICE_PORT_PX_API PORTWORX_SERVICE_SERVICE_PORT_PX_KVDB PORTWORX_SERVICE_SERVICE_PORT_PX_REST_GATEWAY PORTWORX_SERVICE_SERVICE_PORT_PX_SDK STORK_SERVICE_PORT STORK_SERVICE_PORT_443_TCP STORK_SERVICE_PORT_443_TCP_ADDR STORK_SERVICE_PORT_443_TCP_PORT STORK_SERVICE_PORT_443_TCP_PROTO STORK_SERVICE_PORT_8099_TCP STORK_SERVICE_PORT_8099_TCP_ADDR STORK_SERVICE_PORT_8099_TCP_PORT STORK_SERVICE_PORT_8099_TCP_PROTO STORK_SERVICE_SERVICE_HOST STORK_SERVICE_SERVICE_PORT STORK_SERVICE_SERVICE_PORT_EXTENDER STORK_SERVICE_SERVICE_PORT_WEBHOOK TRAEFIK_PORT TRAEFIK_PORT_443_TCP TRAEFIK_PORT_443_TCP_ADDR TRAEFIK_PORT_443_TCP_PORT TRAEFIK_PORT_443_TCP_PROTO TRAEFIK_PORT_80_TCP TRAEFIK_PORT_80_TCP_ADDR TRAEFIK_PORT_80_TCP_PORT TRAEFIK_PORT_80_TCP_PROTO TRAEFIK_PROMETHEUS_PORT TRAEFIK_PROMETHEUS_PORT_9100_TCP TRAEFIK_PROMETHEUS_PORT_9100_TCP_ADDR TRAEFIK_PROMETHEUS_PORT_9100_TCP_PORT TRAEFIK_PROMETHEUS_PORT_9100_TCP_PROTO TRAEFIK_PROMETHEUS_SERVICE_HOST TRAEFIK_PROMETHEUS_SERVICE_PORT TRAEFIK_PROMETHEUS_SERVICE_PORT_METRICS TRAEFIK_SERVICE_HOST TRAEFIK_SERVICE_PORT TRAEFIK_SERVICE_PORT_HTTP TRAEFIK_SERVICE_PORT_HTTPS]”
time=“2021-06-17T14:01:49Z” level=info msg=“Preparing to download Portworx image…”
time=“2021-06-17T14:01:49Z” level=info msg=“REST: Changing install-state: ST_UNKNOWN → ST_INSTALL”
time=“2021-06-17T14:01:49Z” level=info msg=“Detected imagePullPolicy IfNotPresent”
time=“2021-06-17T14:01:49Z” level=warning msg=“Got error or empty digest while checking image demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2” digest= error=“”
time=“2021-06-17T14:01:49Z” level=info msg=“Using anonymous Docker credentials”
time=“2021-06-17T14:01:49Z” level=info msg=“Got error while checking remote image digest for demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2 (will pull)” error=“failed to do request: Head https://demo-artifactory.demo.local:8081/v2/docker-local/px-images/px-essentials/manifests/2.6.0.2: http: server gave HTTP response to HTTPS client”
time=“2021-06-17T14:01:49Z” level=info msg=“Pulling image demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2 …”
time=“2021-06-17T14:01:49Z” level=error msg=“Could not pull demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2: Could not pull demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2: Could not pull demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2: Error fetching image: failed to resolve reference "demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2": failed to do request: Head https://demo-artifactory.demo.local:8081/v2/docker-local/px-images/px-essentials/manifests/2.6.0.2: http: server gave HTTP response to HTTPS client”
It is failing to pull the docker image from the private registry “demo-artifactory.demo.local:8081/docker-local/px-images/px-essentials:2.6.0.2”. Please advice.