PVC stuck in pending because of i/o timeout during PVC provisioning

Hi,

we are currently trying to get Portworx Essentials running on a managed Kubernetes cluster from DataLine. The PX cluster status is operational, showing 4 nodes with storage. However, when we try to create a PVC, it stays in “Pending” state with the following error message:

Failed to provision volume with StorageClass “px-secure-sc”: Get http://10.96.43.173:9001/v1/osd-volumes/versions: dial tcp 10.96.43.173:9001: i/o timeout

If I understand the architecture correctly, this means that kube-controller-manager cannot reach the Portworx service, and therefore cannot trigger the volume creation.

Can you suggest any further steps do debug and hopefully resolve this? We do not have access to the controlplane as this is a managed Kubernetes setup.

Best
Dominik

Can you share the output of kubectl get pods -n kube-system and share the spec file which was used for installation.

I’m working together with Dominik on this.

Output of kubectl get pods -n kube-system:

portworx-7c8mv                                            1/1     Running   0          27h
portworx-7qwl5                                            1/1     Running   0          27h
portworx-api-65xs6                                        1/1     Running   0          27h
portworx-api-7mvw7                                        1/1     Running   0          27h
portworx-api-hjtpb                                        1/1     Running   0          27h
portworx-api-v4z5s                                        1/1     Running   0          27h
portworx-k6lx6                                            1/1     Running   0          27h
portworx-msgqn                                            1/1     Running   0          27h

spec:
https://install.portworx.com/2.5?mc=false&kbver=1.17.8&oem=esse&user=5dad7baa-935f-11ea-97e6-f6e09c7a4e5e&b=true&f=true&j=auto&c=px-cluster-a224c99b-86b5-4bc0-9d59-3624abe8a213&stork=false&st=k8s

Can you apply this yaml and check:

After applying this were you able to provision the PVC ?

Hi,

yes that helped bringing up the the pvc.

Thank you!