Portworx `2.9.1.4` Installation Failed on Azure RedHat Openshift (ARO) `4.10.40`

Followed this documentation:

Error Details:
px-cluster Pod details:

@ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7 portworx[40285]: time="2023-04-04T19:48:02Z" level=warning msg="azure.Describe got AuthN error -- fetching secrets and retrying" file="azure_storage.go:79" component=porx/storage/hal/provider/azure error="azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178XXXX/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2019-12-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {\"error\":\"invalid_request\",\"error_description\":\"Identity not found\"} Endpoint http://169.254.169.254/metadata/identity/oauth2/token?api-version=2018-02-01&resource=https%3A%2F%2Fmanagement.azure.com%2F

Pod Status:

[kubeadmin@bastionNode ~]$ oc get po
NAME                                                     READY   STATUS    RESTARTS         AGE
apiserver-watcher-ms-aro463-px-cluster4-pt7sj-master-0   1/1     Running   1                16h
apiserver-watcher-ms-aro463-px-cluster4-pt7sj-master-1   1/1     Running   1                16h
apiserver-watcher-ms-aro463-px-cluster4-pt7sj-master-2   1/1     Running   1                16h
autopilot-865c94dccd-w9zpg                               1/1     Running   0                70m
portworx-api-4bl9z                                       0/1     Running   0                176m
portworx-api-5d7sw                                       0/1     Running   0                176m
portworx-api-cbgtr                                       0/1     Running   0                176m
portworx-operator-7785d48ddf-f7jrm                       1/1     Running   0                179m
prometheus-px-prometheus-0                               2/2     Running   0                71m
px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a-czqgp    1/2     Running   11 (6m13s ago)   176m
px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a-q7wtt    1/2     Running   11 (6m13s ago)   176m
px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a-qzj65    1/2     Running   11 (6m13s ago)   176m
px-csi-ext-8f4d8f64c-2jlhr                               4/4     Running   0                70m
px-csi-ext-8f4d8f64c-bwrcc                               4/4     Running   0                176m
px-csi-ext-8f4d8f64c-jns92                               4/4     Running   0                71m
px-prometheus-operator-788d4fd9f9-9t6c6                  1/1     Running   0                71m
stork-5556c6fbbd-6ggzn                                   1/1     Running   0                70m
stork-5556c6fbbd-fb26h                                   1/1     Running   0                71m
stork-5556c6fbbd-sptth                                   1/1     Running   0                71m
stork-scheduler-54c884c5cd-578gh                         1/1     Running   0                71m
stork-scheduler-54c884c5cd-jcqgv                         1/1     Running   0                70m
stork-scheduler-54c884c5cd-sl6k2                         1/1     Running   0                71m

Secret Detail:

[kubeadmin@bastionNode ~]$ oc get secret | grep px-azure
px-azure                                             Opaque                                3      3h32m

Pxctl Status:

sh-4.4# pxctl status
PX stopped working 27.4s ago.  Last status: Could not init boot manager  (error="Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178XXXX/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}")

List of last known failures:

Type	ID			Resource						Severity	Count	LastSeen		FirstSeen		Description					
NODE	NodeStartFailure	ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7	ALARM		1	Apr 4 23:59:57 UTC 2023	Apr 4 23:59:57 UTC 2023	Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178XXXX/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}

Can you please help me with this? Thanks.

Can you check any one of this pod log and also post the StorageCLuster spec details here?

Pod Details:

Name:         px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a-czqgp
Namespace:    kube-system
Priority:     0
Node:         ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7/10.56.0.73
Start Time:   Tue, 04 Apr 2023 20:44:32 +0000
Labels:       controller-revision-hash=5776c765b7
              name=portworx
              operator.libopenstorage.org/driver=portworx
              operator.libopenstorage.org/name=px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a
Annotations:  cluster-autoscaler.kubernetes.io/safe-to-evict: true
              operator.libopenstorage.org/node-labels:
                {"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"Standard_D16s_v3","beta.kubernetes.io/os":"linux","failure-domain.b...
Status:       Running
IP:           10.56.0.73
IPs:
  IP:           10.56.0.73
Controlled By:  StorageCluster/px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a
Containers:
  portworx:
    Container ID:  cri-o://9a7c8b03ffdf205f011e4600b2c56a65176feb13241f44a2850b4e030ad89ff1
    Image:         docker.io/portworx/oci-monitor:2.9.1.4
    Image ID:      docker.io/portworx/oci-monitor@sha256:5fe00fc3e50b9c44fdde21c0a876959ca2962610dc4e8360afa163fc12892199
    Port:          <none>
    Host Port:     <none>
    Args:
      -c
      px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a
      -x
      kubernetes
      -b
      -s
      type=Premium_LRS,size=500
      -kvdb_dev
      type=Premium_LRS,size=150
      -max_storage_nodes_per_zone
      2
      -secret_type
      k8s
      -r
      17001
    State:       Running
      Started:   Wed, 05 Apr 2023 20:30:34 +0000
    Last State:  Terminated
      Reason:    Error
      Message:   PX stopped working 1.8s ago.  Last status: Could not init boot manager  (error="Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178e4fc/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}")

      Exit Code:    2
      Started:      Wed, 05 Apr 2023 20:15:04 +0000
      Finished:     Wed, 05 Apr 2023 20:30:32 +0000
    Ready:          False
    Restart Count:  92
    Liveness:       http-get http://127.0.0.1:17001/status delay=840s timeout=1s period=30s #success=1 #failure=3
    Readiness:      http-get http://127.0.0.1:17015/health delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment:
      PX_TEMPLATE_VERSION:   v4
      PRE-EXEC:              if [ -f /etc/pwx/.private.json ] && [ -d /ostree/deploy/rhcos/deploy ]; then chattr -i /etc/pwx/.private.json /ostree/deploy/rhcos/deploy/*/etc/pwx/.private.json || /bin/true; fi
      CSI_ENDPOINT:          unix:///var/lib/kubelet/plugins/pxd.portworx.com/csi.sock
      PX_NAMESPACE:          kube-system
      PX_SECRETS_NAMESPACE:  kube-system
      NODE_NAME:              (v1:spec.nodeName)
    Mounts:
      /etc/crictl.yaml from crioconf (rw)
      /etc/pwx from etcpwx (rw)
      /etc/systemd/system from sysdmount (rw)
      /host_proc from procmount (rw)
      /opt/pwx from optpwx (rw)
      /run/containerd from containerddir (rw)
      /var/cores from diagsdump (rw)
      /var/lib/osd from varlibosd (rw)
      /var/log from journalmount2 (ro)
      /var/run/crio from criosock (rw)
      /var/run/dbus from dbusmount (rw)
      /var/run/docker.sock from dockersock (rw)
      /var/run/log from journalmount1 (ro)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s9tw7 (ro)
  csi-node-driver-registrar:
    Container ID:  cri-o://058cf1ef8ab9ba175949acfa95e490d1c572832591e2d13831c584cd18640869
    Image:         k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0
    Image ID:      k8s.gcr.io/sig-storage/csi-node-driver-registrar@sha256:a61d309da54641db41fb8f35718f744e9f730d4d0384f8c4b186ddc9f06cbd5f
    Port:          <none>
    Host Port:     <none>
    Args:
      --v=5
      --csi-address=$(ADDRESS)
      --kubelet-registration-path=/var/lib/kubelet/plugins/pxd.portworx.com/csi.sock
    State:          Running
      Started:      Tue, 04 Apr 2023 20:44:34 +0000
    Ready:          True
    Restart Count:  0
    Environment:
      ADDRESS:         /csi/csi.sock
      KUBE_NODE_NAME:   (v1:spec.nodeName)
    Mounts:
      /csi from csi-driver-path (rw)
      /registration from registration-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s9tw7 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  dockersock:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/docker.sock
    HostPathType:  
  containerddir:
    Type:          HostPath (bare host directory volume)
    Path:          /run/containerd
    HostPathType:  
  criosock:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/crio
    HostPathType:  
  crioconf:
    Type:          HostPath (bare host directory volume)
    Path:          /etc/crictl.yaml
    HostPathType:  FileOrCreate
  optpwx:
    Type:          HostPath (bare host directory volume)
    Path:          /opt/pwx
    HostPathType:  
  procmount:
    Type:          HostPath (bare host directory volume)
    Path:          /proc
    HostPathType:  
  sysdmount:
    Type:          HostPath (bare host directory volume)
    Path:          /etc/systemd/system
    HostPathType:  
  dbusmount:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/dbus
    HostPathType:  
  varlibosd:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/osd
    HostPathType:  
  diagsdump:
    Type:          HostPath (bare host directory volume)
    Path:          /var/cores
    HostPathType:  
  etcpwx:
    Type:          HostPath (bare host directory volume)
    Path:          /etc/pwx
    HostPathType:  
  journalmount1:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/log
    HostPathType:  
  journalmount2:
    Type:          HostPath (bare host directory volume)
    Path:          /var/log
    HostPathType:  
  registration-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/kubelet/plugins_registry
    HostPathType:  DirectoryOrCreate
  csi-driver-path:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/kubelet/plugins/pxd.portworx.com
    HostPathType:  DirectoryOrCreate
  kube-api-access-s9tw7:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
    ConfigMapName:           openshift-service-ca.crt
    ConfigMapOptional:       <nil>
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/disk-pressure:NoSchedule op=Exists
                             node.kubernetes.io/memory-pressure:NoSchedule op=Exists
                             node.kubernetes.io/network-unavailable:NoSchedule op=Exists
                             node.kubernetes.io/not-ready:NoExecute op=Exists
                             node.kubernetes.io/pid-pressure:NoSchedule op=Exists
                             node.kubernetes.io/unreachable:NoExecute op=Exists
                             node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
  Type     Reason                             Age                    From      Message
  ----     ------                             ----                   ----      -------
  Normal   PortworxMonitorImagePullInPrgress  169m                   portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   169m (x27 over 3h4m)   portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  154m                   portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   153m (x27 over 168m)   portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  138m                   portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   138m (x27 over 153m)   portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  123m                   portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   122m (x27 over 137m)   portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  107m                   portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   107m (x27 over 122m)   portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  92m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   91m (x27 over 106m)    portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  76m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   76m (x27 over 91m)     portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  61m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   60m (x27 over 75m)     portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   Pulling                            45m (x91 over 24h)     kubelet   Pulling image "docker.io/portworx/oci-monitor:2.9.1.4"
  Normal   PortworxMonitorImagePullInPrgress  45m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   45m (x27 over 60m)     portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  30m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   29m (x27 over 44m)     portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Normal   PortworxMonitorImagePullInPrgress  14m                    portworx  Portworx image docker.io/portworx/px-enterprise:2.9.1.4 pull and extraction in progress
  Warning  NodeStartFailure                   14m (x27 over 29m)     portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}
  Warning  Unhealthy                          26s (x10027 over 24h)  kubelet   Readiness probe failed: HTTP probe failed with statuscode: 503
  Warning  NodeStartFailure                   3s (x25 over 13m)      portworx  Failed to start Portworx: Authentication error: Authentication error: azure.BearerAuthorizer#WithAuthorization: Failed to refresh the Token for request to https://management.azure.com/subscriptions/6f046466-4b41-405b-b34c-c8992178xxxx/resourceGroups/aro-ms-aro463-px-cluster4/providers/Microsoft.Compute/virtualMachines/ms-aro463-px-cluster4-pt7sj-worker-westus22-lwtz7?%24expand=instanceView&api-version=2018-06-01: StatusCode=400 -- Original Error: adal: Refresh request failed. Status Code = '400'. Response body: {"error":"invalid_request","error_description":"Identity not found"}

StorageCluster details:

apiVersion: core.libopenstorage.org/v1
kind: StorageCluster
metadata:
  annotations:
    portworx.io/install-source: https://install.portworx.com/?operator=true&mc=false&kbver=1.25.0&b=true&kd=type%3DPremium_LRS%2Csize%3D150&s=%22type%3DPremium_LRS%2Csize%3D500%22&c=px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a&osft=true&stork=true&csi=true&mon=true&st=k8s&promop=true
    portworx.io/is-openshift: "true"
  creationTimestamp: "2023-04-04T20:44:26Z"
  finalizers:
  - operator.libopenstorage.org/delete
  generation: 2
  name: px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a
  namespace: kube-system
  resourceVersion: "680313"
  uid: 43b95a62-7981-41e1-979b-bfb791636e77
spec:
  autopilot:
    enabled: true
    providers:
    - name: default
      params:
        url: http://px-prometheus:9090
      type: prometheus
  cloudStorage:
    deviceSpecs:
    - type=Premium_LRS,size=500
    kvdbDeviceSpec: type=Premium_LRS,size=150
    maxStorageNodesPerZone: 2
  csi:
    enabled: true
    installSnapshotController: true
  image: portworx/oci-monitor:2.9.1.4
  imagePullPolicy: Always
  kvdb:
    internal: true
  monitoring:
    prometheus:
      enabled: true
      exportMetrics: true
      resources: {}
  placement:
    nodeAffinity:
      requiredDuringSchedulingIgnoredDuringExecution:
        nodeSelectorTerms:
        - matchExpressions:
          - key: px/enabled
            operator: NotIn
            values:
            - "false"
          - key: node-role.kubernetes.io/infra
            operator: DoesNotExist
          - key: node-role.kubernetes.io/master
            operator: DoesNotExist
        - matchExpressions:
          - key: px/enabled
            operator: NotIn
            values:
            - "false"
          - key: node-role.kubernetes.io/infra
            operator: DoesNotExist
          - key: node-role.kubernetes.io/master
            operator: Exists
          - key: node-role.kubernetes.io/worker
            operator: Exists
  revisionHistoryLimit: 10
  secretsProvider: k8s
  startPort: 17001
  stork:
    args:
      webhook-controller: "false"
    enabled: true
  updateStrategy:
    rollingUpdate:
      maxUnavailable: 1
    type: RollingUpdate
  version: 2.9.1.4
status:
  clusterName: px-cluster-9626af2f-3f1e-4770-8c67-2edfe8c9822a
  desiredImages:
    autopilot: portworx/autopilot:1.3.1
    csiAttacher: docker.io/openstorage/csi-attacher:v1.2.1-1
    csiNodeDriverRegistrar: k8s.gcr.io/sig-storage/csi-node-driver-registrar:v2.1.0
    csiProvisioner: docker.io/openstorage/csi-provisioner:v1.6.1-1
    csiResizer: k8s.gcr.io/sig-storage/csi-resizer:v1.1.0
    csiSnapshotController: k8s.gcr.io/sig-storage/snapshot-controller:v4.0.0
    csiSnapshotter: k8s.gcr.io/sig-storage/csi-snapshotter:v4.0.0
    prometheus: quay.io/prometheus/prometheus:v2.29.1
    prometheusConfigReloader: quay.io/prometheus-operator/prometheus-config-reloader:v0.50.0
    prometheusOperator: quay.io/prometheus-operator/prometheus-operator:v0.50.0
    stork: openstorage/stork:2.11.0
  phase: Initializing
  storage: {}
  version: 2.9.1.4

@sensre I have just edited the pod details. Please check again.

Another thing to note, AZURE_* environment variables are not added automatically to the storage cluster after adding a secret and creating a storage cluster. I have seen AZURE_* environment variables added in another ARO cluster storage cluster in which Portworx 2.12 is installed successfully.