Failed to load PX filesystem dependencies for kernel 4.18.0-259.el8.x86_64

dgrekov · January 19, 2021, 6:33pm

Trying to do a new Operator based deployment on SentOS 8 and Portworx is not coming up. getting an error “Failed to load PX filesystem dependencies for kernel 4.18.0-259.el8.x86_64” What can I do to fix this? Can I manually download the dependencies from somewhere?

Jan 19 13:20:22 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:22.743688597-05:00" level=info msg="PullImage \" **portworx** /oci-monitor:2.6.2.1\""
Jan 19 13:20:23 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:23.296296476-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/ **portworx** /oci-monitor:2.6.2.1,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 13:20:23 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:23.478378431-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/ **portworx** /oci-monitor:2.6.2.1,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 13:20:23 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:23.536607886-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/ **portworx** /oci-monitor@sha256:c13e05ef45167ef820cbf19468323bf8323704d703928e477cacf13f96900d60,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 13:20:23 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:23.537775294-05:00" level=info msg="PullImage \" **portworx** /oci-monitor:2.6.2.1\" returns image reference \"sha256:6904b142f4081c123f1a316da3d1ac1d7832932004a33c49f028419140fc3d31\""
Jan 19 13:20:23 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:23.539914536-05:00" level=info msg="CreateContainer within sandbox \"76df5a6b04354bdaf24f437746af45c9beefc41b6eb7461ae88983e36be157a5\" for container &ContainerMetadata{Name: **portworx** ,Attempt:49,}"
Jan 19 13:20:24 node0.dimagre.com containerd[16593]: time="2021-01-19T13:20:24.054013528-05:00" level=info msg="CreateContainer within sandbox \"76df5a6b04354bdaf24f437746af45c9beefc41b6eb7461ae88983e36be157a5\" for &ContainerMetadata{Name: **portworx** ,Attempt:49,} returns container id \"38110183cf28b11647e4a5cea24325e6cdda99a3c7921841c21e0d1f77532b2e\""
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Rootfs found at /opt/pwx/oci/rootfs"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="PX binaries found at /opt/pwx/bin/px-runc"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=error msg="Cannot listen on UNIX socket: listen unix /run/docker/plugins/pxd.sock: bind: no such file or directory"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=warning msg="Failed to start pxd-dummy: failed to listen on pxd.sock, ingnoring and continuing..."
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Multipath conf update disabled. PX devices will not be blacklisted."
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Initializing as version 2.6.2.1-4c79af9 (OCI)"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="SPEC READ [a33159b58c7741051755439f039c47ab /opt/pwx/oci/config.json]"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Enabling Sharedv4 NFS support ..."
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Setting up NFS service"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="> Initialized service controls via DBus{type:dbus,svc:nfs-server.service,id:0xc42021c860}"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Checking mountpoints for following shared directories: [/var/lib/kubelet /var/lib/osd]"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Found following mountpoints for shared dirs: map[/var/lib/kubelet:{isMP=f,Opts=shared:1,Parent=/} /:{isMP=T,Opts=shared:1} /var/lib/osd:{isMP=f,Opts=shared:1,Parent=/}]"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="PX-RunC arguments: -a -b -c px-cluster-7ca5106f-4d1e-4b33-a584-561431e687af -j auto -secret_type k8s -x kubernetes"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="PX-RunC mounts: /dev:/dev /etc/exports:/etc/exports /opt/pwx/oci/mounts/etc/hostname:/etc/hostname /opt/pwx/oci/mounts/etc/hosts:/etc/hosts /etc/iscsi:/etc/iscsi /etc/mdadm:/etc/mdadm /etc/nvme:/etc/nvme /etc/nvmet:/etc/nvmet /etc/pwx:/etc/pwx /opt/pwx/oci/mounts/etc/resolv.conf:/etc/resolv.conf /etc/target:/etc/target /opt/pwx/bin:/export_bin /proc:/hostproc /lib/modules:/lib/modules proc:/proc:nosuid,noexec,nodev /run/docker:/run/docker /run/lock/iscsi:/run/lock/iscsi /run/log/journal:/run/log/journal:ro /run/lvm:/run/lvm /run/mdadm:/run/mdadm /run/udev:/run/udev sysfs:/sys:nosuid,noexec,nodev cgroup:/sys/fs/cgroup:nosuid,noexec,nodev /opt/pwx/oci/mounts/tmp/px-termination-log:/tmp/px-termination-log /usr/src:/usr/src /var/cores:/var/cores /run:/var/host_run:bind /var/lib/iscsi:/var/lib/iscsi /var/lib/kubelet:/var/lib/kubelet:shared /var/lib/nfs:/var/lib/nfs /var/lib/osd:/var/lib/osd:shared /var/lock/iscsi:/var/lock/iscsi /var/run/dbus:/var/run/dbus /opt/pwx/oci/mounts/var/run/secrets/kubernetes.io/serviceaccount:/var/run/secrets/kubernetes.io/serviceaccount"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="PX-RunC env: CONTAINER_RUNTIME=containerd CSI_ENDPOINT=unix:///var/lib/kubelet/plugins/pxd. **portworx** .com/csi.sock DBUS_SESSION_BUS_ADDRESS=unix:path=/var/run/dbus/system_bus_socket GOMAXPROCS=64 GOTRACEBACK=crash HOSTNAME=node0.dimagre.com KUBELET_DIR=/var/lib/kubelet KUBERNETES_PORT=tcp://10.1.0.1:443 KUBERNETES_PORT_443_TCP=tcp://10.1.0.1:443 KUBERNETES_PORT_443_TCP_ADDR=10.1.0.1 KUBERNETES_PORT_443_TCP_PORT=443 KUBERNETES_PORT_443_TCP_PROTO=tcp KUBERNETES_SERVICE_HOST=10.1.0.1 KUBERNETES_SERVICE_PORT=443 KUBERNETES_SERVICE_PORT_HTTPS=443 KUBE_DNS_PORT=udp://10.1.0.10:53 KUBE_DNS_PORT_53_TCP=tcp://10.1.0.10:53 KUBE_DNS_PORT_53_TCP_ADDR=10.1.0.10 KUBE_DNS_PORT_53_TCP_PORT=53 KUBE_DNS_PORT_53_TCP_PROTO=tcp KUBE_DNS_PORT_53_UDP=udp://10.1.0.10:53 KUBE_DNS_PORT_53_UDP_ADDR=10.1.0.10 KUBE_DNS_PORT_53_UDP_PORT=53 KUBE_DNS_PORT_53_UDP_PROTO=udp KUBE_DNS_PORT_9153_TCP=tcp://10.1.0.10:9153 KUBE_DNS_PORT_9153_TCP_ADDR=10.1.0.10 KUBE_DNS_PORT_9153_TCP_PORT=9153 KUBE_DNS_PORT_9153_TCP_PROTO=tcp KUBE_DNS_SERVICE_HOST=10.1.0.10 KUBE_DNS_SERVICE_PORT=53 KUBE_DNS_SERVICE_PORT_DNS=53 KUBE_DNS_SERVICE_PORT_DNS_TCP=53 KUBE_DNS_SERVICE_PORT_METRICS=9153 LVM_USE_HOST=1 NFS_SERVICE=nfs-server.service PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin PORTWORX_API_PORT=tcp://10.1.112.134:9001 PORTWORX_API_PORT_9001_TCP=tcp://10.1.112.134:9001 PORTWORX_API_PORT_9001_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9001_TCP_PORT=9001 PORTWORX_API_PORT_9001_TCP_PROTO=tcp PORTWORX_API_PORT_9020_TCP=tcp://10.1.112.134:9020 PORTWORX_API_PORT_9020_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9020_TCP_PORT=9020 PORTWORX_API_PORT_9020_TCP_PROTO=tcp PORTWORX_API_PORT_9021_TCP=tcp://10.1.112.134:9021 PORTWORX_API_PORT_9021_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9021_TCP_PORT=9021 PORTWORX_API_PORT_9021_TCP_PROTO=tcp PORTWORX_API_SERVICE_HOST=10.1.112.134 PORTWORX_API_SERVICE_PORT=9001 PORTWORX_API_SERVICE_PORT_PX_API=9001 PORTWORX_API_SERVICE_PORT_PX_REST_GATEWAY=9021 PORTWORX_API_SERVICE_PORT_PX_SDK=9020 PORTWORX_OPERATOR_METRICS_PORT=tcp://10.1.17.118:8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP=tcp://10.1.17.118:8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_ADDR=10.1.17.118 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_PORT=8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_PROTO=tcp PORTWORX_OPERATOR_METRICS_SERVICE_HOST=10.1.17.118 PORTWORX_OPERATOR_METRICS_SERVICE_PORT=8999 PORTWORX_OPERATOR_METRICS_SERVICE_PORT_METRICS=8999 PORTWORX_SERVICE_PORT=tcp://10.1.86.157:9001 PORTWORX_SERVICE_PORT_9001_TCP=tcp://10.1.86.157:9001 PORTWORX_SERVICE_PORT_9001_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9001_TCP_PORT=9001 PORTWORX_SERVICE_PORT_9001_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9019_TCP=tcp://10.1.86.157:9019 PORTWORX_SERVICE_PORT_9019_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9019_TCP_PORT=9019 PORTWORX_SERVICE_PORT_9019_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9020_TCP=tcp://10.1.86.157:9020 PORTWORX_SERVICE_PORT_9020_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9020_TCP_PORT=9020 PORTWORX_SERVICE_PORT_9020_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9021_TCP=tcp://10.1.86.157:9021 PORTWORX_SERVICE_PORT_9021_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9021_TCP_PORT=9021 PORTWORX_SERVICE_PORT_9021_TCP_PROTO=tcp PORTWORX_SERVICE_SERVICE_HOST=10.1.86.157 PORTWORX_SERVICE_SERVICE_PORT=9001 PORTWORX_SERVICE_SERVICE_PORT_PX_API=9001 PORTWORX_SERVICE_SERVICE_PORT_PX_KVDB=9019 PORTWORX_SERVICE_SERVICE_PORT_PX_REST_GATEWAY=9021 PORTWORX_SERVICE_SERVICE_PORT_PX_SDK=9020 PX_IMAGE=docker.io/ **portworx** /px-essentials:2.6.2.1 PX_IMAGE_DIGEST=sha256:e9a94c004f5fa58a828b7702d1e8c34f903e49098734271cdfdcdbedb33ace8d PX_LIGHTHOUSE_PORT=tcp://10.1.154.213:80 PX_LIGHTHOUSE_PORT_443_TCP=tcp://10.1.154.213:443 PX_LIGHTHOUSE_PORT_443_TCP_ADDR=10.1.154.213 PX_LIGHTHOUSE_PORT_443_TCP_PORT=443 PX_LIGHTHOUSE_PORT_443_TCP_PROTO=tcp PX_LIGHTHOUSE_PORT_80_TCP=tcp://10.1.154.213:80 PX_LIGHTHOUSE_PORT_80_TCP_ADDR=10.1.154.213 PX_LIGHTHOUSE_PORT_80_TCP_PORT=80 PX_LIGHTHOUSE_PORT_80_TCP_PROTO=tcp PX_LIGHTHOUSE_SERVICE_HOST=10.1.154.213 PX_LIGHTHOUSE_SERVICE_PORT=80 PX_LIGHTHOUSE_SERVICE_PORT_HTTP=80 PX_LIGHTHOUSE_SERVICE_PORT_HTTPS=443 PX_LOGLEVEL=info PX_NAMESPACE=kube-system PX_RUNC=true PX_SECRETS_NAMESPACE=kube-system PX_SHARED=/var/lib/kubelet:shared:1;/var/lib/osd:shared:1 PX_TEMPLATE_VERSION=v4 PX_VERSION=2.6.2.1-4c79af9 SEALED_SECRETS_CONTROLLER_PORT=tcp://10.1.255.254:8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP=tcp://10.1.255.254:8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_ADDR=10.1.255.254 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_PORT=8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_PROTO=tcp SEALED_SECRETS_CONTROLLER_SERVICE_HOST=10.1.255.254 SEALED_SECRETS_CONTROLLER_SERVICE_PORT=8080 STORK_SERVICE_PORT=tcp://10.1.9.213:8099 STORK_SERVICE_PORT_443_TCP=tcp://10.1.9.213:443 STORK_SERVICE_PORT_443_TCP_ADDR=10.1.9.213 STORK_SERVICE_PORT_443_TCP_PORT=443 STORK_SERVICE_PORT_443_TCP_PROTO=tcp STORK_SERVICE_PORT_8099_TCP=tcp://10.1.9.213:8099 STORK_SERVICE_PORT_8099_TCP_ADDR=10.1.9.213 STORK_SERVICE_PORT_8099_TCP_PORT=8099 STORK_SERVICE_PORT_8099_TCP_PROTO=tcp STORK_SERVICE_SERVICE_HOST=10.1.9.213 STORK_SERVICE_SERVICE_PORT=8099 STORK_SERVICE_SERVICE_PORT_EXTENDER=8099 STORK_SERVICE_SERVICE_PORT_WEBHOOK=443 TERM=xterm container=oci"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Parent OCI mount '/opt/pwx/oci' already on PRIVATE propagation (private)"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Found 2 usable runc binaries: /opt/pwx/bin/runc and /opt/pwx/bin/runc-fb"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Detected kernel release 4.18.0-259"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T13:20:25-05:00" level=info msg="Exec: [\"/opt/pwx/bin/runc\" \"run\" \"-b\" \"/opt/pwx/oci\" \"--no-new-keyring\" \" **portworx** \"]"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Executing with arguments: -a -b -c px-cluster-7ca5106f-4d1e-4b33-a584-561431e687af -j auto -secret_type k8s -x kubernetes
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Installed pxctl...
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Tue Jan 19 18:20:25 UTC 2021 : Running version 2.6.2.1-4c79af9 on Linux node0.dimagre.com 4.18.0-259.el8.x86_64 #1 SMP Mon Dec 21 21:05:36 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Version: Linux version 4.18.0-259.el8.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 8.4.1 20200928 (Red Hat 8.4.1-1) (GCC)) #1 SMP Mon Dec 21 21:05:36 UTC 2020
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: mapping:
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Setting portmap: 9001
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: time="2021-01-19T18:20:25Z" level=error msg="Cannot listen on UNIX socket: listen unix /run/docker/plugins/pxd.sock: bind: no such file or directory"
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Error: failed to listen on pxd.sock
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Tue Jan 19 18:20:25 UTC 2021 partprobe begin
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: Tue Jan 19 18:20:25 UTC 2021 partprobe end
Jan 19 13:20:25 node0.dimagre.com **portworx** [537960]: sed: can't read /etc/mdadm/mdadm.conf: No such file or directory
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking local archive, please wait...
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: Checking short path for KVERSION 4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el7.x86_64/build
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: Checking local host dependencies...
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: nsenter: failed to execute python: No such file or directory
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: cp: cannot stat '/tmp/localyum/yum/vars/releasever': No such file or directory
Jan 19 13:20:26 node0.dimagre.com **portworx** [537960]: Updating dependencies, please wait...
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: http://debuginfo.centos.org/%24stream/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/x86_64/nightly/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/debug-x86_64/nightly/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/x86_64/stable/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/debug-x86_64/stable/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/x86_64/test/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:30 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:31 node0.dimagre.com **portworx** [537960]: https://download.docker.com/linux/centos/%24releasever/debug-x86_64/test/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
Jan 19 13:20:31 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:31 node0.dimagre.com **portworx** [537960]: http://yum. **portworx** .com/repo/CentOS/%24releasever/kernel-devel/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
Jan 19 13:20:31 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/CentOS/AppStream/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/CentOS/AppStream/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/cdrecorder/AppStream/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/cdrecorder/AppStream/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/cdrom/AppStream/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/cdrom/AppStream/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/cdrom/BaseOS/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/cdrom/BaseOS/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/CentOS/BaseOS/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/CentOS/BaseOS/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: file:///media/cdrecorder/BaseOS/repodata/repomd.xml: [Errno 14] curl#37 - "Couldn't open file /media/cdrecorder/BaseOS/repodata/repomd.xml"
Jan 19 13:20:32 node0.dimagre.com **portworx** [537960]: Trying other mirror.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/appstream/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/baseos/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/extras/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/ha/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/powertools/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Eg. Invalid release/repo/arch combination/
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: removing mirrorlist with no valid mirrors: /tmp/localyum/installedRPM/var/cache/yum/rt/mirrorlist.txt
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Setting up Install Process
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: Error: Nothing to do
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:33 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: Reading package lists...
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: Building dependency tree...
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: Reading state information...
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: E: Unable to locate package linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: E: Couldn't find any package by glob 'linux-headers-4.18.0-259.el8.x86_64'
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: E: Couldn't find any package by regex 'linux-headers-4.18.0-259.el8.x86_64'
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: Checking short path for KVERSION 4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el7.x86_64/build
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:37 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: Reading package lists...
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: Building dependency tree...
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: Reading state information...
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: E: Unable to locate package linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: E: Couldn't find any package by glob 'linux-headers-4.18.0-259.el7.x86_64'
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: E: Couldn't find any package by regex 'linux-headers-4.18.0-259.el7.x86_64'
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64

dgrekov · January 19, 2021, 6:34pm

Logs Continued:

Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el7.x86_64/build
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el7.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:41 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /hostusr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /lib/modules/4.18.0-259.el8.x86_64/build
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /usr/src/linux
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking /var/lib/osd/pxfs/kernel_headers/usr/src/linux-4.18.0-259-obj/x86_64/el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Downloading from: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/packages ...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Download kernel failed, trying again...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Download kernel failed...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Failed to install/locate kernel headers for 4.18.0-259.el8.x86_64
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Downloading from: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Trying from: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Unavailable: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Downloading from: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Trying from: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: Unavailable: https://mirrors. **portworx** .com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10
Jan 19 13:20:42 node0.dimagre.com **portworx** [537960]: checking local archive, please wait...
Jan 19 13:20:43 node0.dimagre.com **portworx** [537960]: Failed to load PX filesystem dependencies for kernel 4.18.0-259.el8.x86_64
Jan 19 13:20:43 node0.dimagre.com systemd[1]: **portworx** .service: Main process exited, code=exited, status=10/n/a
Jan 19 13:20:43 node0.dimagre.com systemd[1]: **portworx** .service: Failed with result 'exit-code'.
Jan 19 13:20:43 node0.dimagre.com systemd[1]: **portworx** -output.service: Succeeded.
Jan 19 13:20:43 node0.dimagre.com systemd[1]: **portworx** .socket: Succeeded.

aleks · January 19, 2021, 7:13pm

As you’re using a CentOS 8 - if you install the kernel-devel RPM via dnf on the host(s), Portworx should attempt to recover from the issue - can you give that a try and let us know if it helps?

dgrekov · January 19, 2021, 7:29pm

trying that now, waiting for it to try again in the next 15 min

dgrekov · January 19, 2021, 7:40pm

Better but still not 100%, something is still missing.

Jan 19 14:37:52 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:52.749132633-05:00" level=info msg="PullImage \"portworx/oci-monitor:2.6.2.1\""
Jan 19 14:37:53 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:53.609059772-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/portworx/oci-monitor:2.6.2.1,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 14:37:53 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:53.841257574-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/portworx/oci-monitor:2.6.2.1,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 14:37:53 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:53.891569743-05:00" level=info msg="ImageUpdate event &ImageUpdate{Name:docker.io/portworx/oci-monitor@sha256:c13e05ef45167ef820cbf19468323bf8323704d703928e477cacf13f96900d60,Labels:map[string]string{io.cri-containerd.image: managed,},XXX_unrecognized:[],}"
Jan 19 14:37:53 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:53.892736599-05:00" level=info msg="PullImage \"portworx/oci-monitor:2.6.2.1\" returns image reference \"sha256:6904b142f4081c123f1a316da3d1ac1d7832932004a33c49f028419140fc3d31\""
Jan 19 14:37:53 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:53.894890447-05:00" level=info msg="CreateContainer within sandbox \"76df5a6b04354bdaf24f437746af45c9beefc41b6eb7461ae88983e36be157a5\" for container &ContainerMetadata{Name:portworx,Attempt:54,}"
Jan 19 14:37:54 node0.dimagre.com containerd[16593]: time="2021-01-19T14:37:54.324725324-05:00" level=info msg="CreateContainer within sandbox \"76df5a6b04354bdaf24f437746af45c9beefc41b6eb7461ae88983e36be157a5\" for &ContainerMetadata{Name:portworx,Attempt:54,} returns container id \"246bfbaad3345bc5d79d04d1932f22561f5f1e885e074f60b2628c49dc9234a5\""
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=error msg="Cannot listen on UNIX socket: listen unix /run/docker/plugins/pxd.sock: bind: no such file or directory"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=warning msg="Failed to start pxd-dummy: failed to listen on pxd.sock, ingnoring and continuing..."
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Rootfs found at /opt/pwx/oci/rootfs"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="PX binaries found at /opt/pwx/bin/px-runc"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Multipath conf update disabled. PX devices will not be blacklisted."
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Initializing as version 2.6.2.1-4c79af9 (OCI)"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="SPEC READ [a33159b58c7741051755439f039c47ab  /opt/pwx/oci/config.json]"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Enabling Sharedv4 NFS support ..."
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Setting up NFS service"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="> Initialized service controls via DBus{type:dbus,svc:nfs-server.service,id:0xc4204d0940}"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Checking mountpoints for following shared directories: [/var/lib/kubelet /var/lib/osd]"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Found following mountpoints for shared dirs: map[/:{isMP=T,Opts=shared:1} /var/lib/osd:{isMP=f,Opts=shared:1,Parent=/} /var/lib/kubelet:{isMP=f,Opts=shared:1,Parent=/}]"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="PX-RunC arguments: -a -b -c px-cluster-7ca5106f-4d1e-4b33-a584-561431e687af -j auto -secret_type k8s -x kubernetes"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="PX-RunC mounts: /dev:/dev /etc/exports:/etc/exports /opt/pwx/oci/mounts/etc/hostname:/etc/hostname /opt/pwx/oci/mounts/etc/hosts:/etc/hosts /etc/iscsi:/etc/iscsi /etc/mdadm:/etc/mdadm /etc/nvme:/etc/nvme /etc/nvmet:/etc/nvmet /etc/pwx:/etc/pwx /opt/pwx/oci/mounts/etc/resolv.conf:/etc/resolv.conf /etc/target:/etc/target /opt/pwx/bin:/export_bin /proc:/hostproc /lib/modules:/lib/modules proc:/proc:nosuid,noexec,nodev /run/docker:/run/docker /run/lock/iscsi:/run/lock/iscsi /run/log/journal:/run/log/journal:ro /run/lvm:/run/lvm /run/mdadm:/run/mdadm /run/udev:/run/udev sysfs:/sys:nosuid,noexec,nodev cgroup:/sys/fs/cgroup:nosuid,noexec,nodev /opt/pwx/oci/mounts/tmp/px-termination-log:/tmp/px-termination-log /usr/src:/usr/src /var/cores:/var/cores /run:/var/host_run:bind /var/lib/iscsi:/var/lib/iscsi /var/lib/kubelet:/var/lib/kubelet:shared /var/lib/nfs:/var/lib/nfs /var/lib/osd:/var/lib/osd:shared /var/lock/iscsi:/var/lock/iscsi /var/run/dbus:/var/run/dbus /opt/pwx/oci/mounts/var/run/secrets/kubernetes.io/serviceaccount:/var/run/secrets/kubernetes.io/serviceaccount"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="PX-RunC env: CONTAINER_RUNTIME=containerd CSI_ENDPOINT=unix:///var/lib/kubelet/plugins/pxd.portworx.com/csi.sock DBUS_SESSION_BUS_ADDRESS=unix:path=/var/run/dbus/system_bus_socket GOMAXPROCS=64 GOTRACEBACK=crash HOSTNAME=node0.dimagre.com KUBELET_DIR=/var/lib/kubelet KUBERNETES_PORT=tcp://10.1.0.1:443 KUBERNETES_PORT_443_TCP=tcp://10.1.0.1:443 KUBERNETES_PORT_443_TCP_ADDR=10.1.0.1 KUBERNETES_PORT_443_TCP_PORT=443 KUBERNETES_PORT_443_TCP_PROTO=tcp KUBERNETES_SERVICE_HOST=10.1.0.1 KUBERNETES_SERVICE_PORT=443 KUBERNETES_SERVICE_PORT_HTTPS=443 KUBE_DNS_PORT=udp://10.1.0.10:53 KUBE_DNS_PORT_53_TCP=tcp://10.1.0.10:53 KUBE_DNS_PORT_53_TCP_ADDR=10.1.0.10 KUBE_DNS_PORT_53_TCP_PORT=53 KUBE_DNS_PORT_53_TCP_PROTO=tcp KUBE_DNS_PORT_53_UDP=udp://10.1.0.10:53 KUBE_DNS_PORT_53_UDP_ADDR=10.1.0.10 KUBE_DNS_PORT_53_UDP_PORT=53 KUBE_DNS_PORT_53_UDP_PROTO=udp KUBE_DNS_PORT_9153_TCP=tcp://10.1.0.10:9153 KUBE_DNS_PORT_9153_TCP_ADDR=10.1.0.10 KUBE_DNS_PORT_9153_TCP_PORT=9153 KUBE_DNS_PORT_9153_TCP_PROTO=tcp KUBE_DNS_SERVICE_HOST=10.1.0.10 KUBE_DNS_SERVICE_PORT=53 KUBE_DNS_SERVICE_PORT_DNS=53 KUBE_DNS_SERVICE_PORT_DNS_TCP=53 KUBE_DNS_SERVICE_PORT_METRICS=9153 LVM_USE_HOST=1 NFS_SERVICE=nfs-server.service PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin PORTWORX_API_PORT=tcp://10.1.112.134:9001 PORTWORX_API_PORT_9001_TCP=tcp://10.1.112.134:9001 PORTWORX_API_PORT_9001_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9001_TCP_PORT=9001 PORTWORX_API_PORT_9001_TCP_PROTO=tcp PORTWORX_API_PORT_9020_TCP=tcp://10.1.112.134:9020 PORTWORX_API_PORT_9020_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9020_TCP_PORT=9020 PORTWORX_API_PORT_9020_TCP_PROTO=tcp PORTWORX_API_PORT_9021_TCP=tcp://10.1.112.134:9021 PORTWORX_API_PORT_9021_TCP_ADDR=10.1.112.134 PORTWORX_API_PORT_9021_TCP_PORT=9021 PORTWORX_API_PORT_9021_TCP_PROTO=tcp PORTWORX_API_SERVICE_HOST=10.1.112.134 PORTWORX_API_SERVICE_PORT=9001 PORTWORX_API_SERVICE_PORT_PX_API=9001 PORTWORX_API_SERVICE_PORT_PX_REST_GATEWAY=9021 PORTWORX_API_SERVICE_PORT_PX_SDK=9020 PORTWORX_OPERATOR_METRICS_PORT=tcp://10.1.17.118:8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP=tcp://10.1.17.118:8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_ADDR=10.1.17.118 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_PORT=8999 PORTWORX_OPERATOR_METRICS_PORT_8999_TCP_PROTO=tcp PORTWORX_OPERATOR_METRICS_SERVICE_HOST=10.1.17.118 PORTWORX_OPERATOR_METRICS_SERVICE_PORT=8999 PORTWORX_OPERATOR_METRICS_SERVICE_PORT_METRICS=8999 PORTWORX_SERVICE_PORT=tcp://10.1.86.157:9001 PORTWORX_SERVICE_PORT_9001_TCP=tcp://10.1.86.157:9001 PORTWORX_SERVICE_PORT_9001_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9001_TCP_PORT=9001 PORTWORX_SERVICE_PORT_9001_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9019_TCP=tcp://10.1.86.157:9019 PORTWORX_SERVICE_PORT_9019_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9019_TCP_PORT=9019 PORTWORX_SERVICE_PORT_9019_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9020_TCP=tcp://10.1.86.157:9020 PORTWORX_SERVICE_PORT_9020_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9020_TCP_PORT=9020 PORTWORX_SERVICE_PORT_9020_TCP_PROTO=tcp PORTWORX_SERVICE_PORT_9021_TCP=tcp://10.1.86.157:9021 PORTWORX_SERVICE_PORT_9021_TCP_ADDR=10.1.86.157 PORTWORX_SERVICE_PORT_9021_TCP_PORT=9021 PORTWORX_SERVICE_PORT_9021_TCP_PROTO=tcp PORTWORX_SERVICE_SERVICE_HOST=10.1.86.157 PORTWORX_SERVICE_SERVICE_PORT=9001 PORTWORX_SERVICE_SERVICE_PORT_PX_API=9001 PORTWORX_SERVICE_SERVICE_PORT_PX_KVDB=9019 PORTWORX_SERVICE_SERVICE_PORT_PX_REST_GATEWAY=9021 PORTWORX_SERVICE_SERVICE_PORT_PX_SDK=9020 PX_IMAGE=docker.io/portworx/px-essentials:2.6.2.1 PX_IMAGE_DIGEST=sha256:e9a94c004f5fa58a828b7702d1e8c34f903e49098734271cdfdcdbedb33ace8d PX_LIGHTHOUSE_PORT=tcp://10.1.154.213:80 PX_LIGHTHOUSE_PORT_443_TCP=tcp://10.1.154.213:443 PX_LIGHTHOUSE_PORT_443_TCP_ADDR=10.1.154.213 PX_LIGHTHOUSE_PORT_443_TCP_PORT=443 PX_LIGHTHOUSE_PORT_443_TCP_PROTO=tcp PX_LIGHTHOUSE_PORT_80_TCP=tcp://10.1.154.213:80 PX_LIGHTHOUSE_PORT_80_TCP_ADDR=10.1.154.213 PX_LIGHTHOUSE_PORT_80_TCP_PORT=80 PX_LIGHTHOUSE_PORT_80_TCP_PROTO=tcp PX_LIGHTHOUSE_SERVICE_HOST=10.1.154.213 PX_LIGHTHOUSE_SERVICE_PORT=80 PX_LIGHTHOUSE_SERVICE_PORT_HTTP=80 PX_LIGHTHOUSE_SERVICE_PORT_HTTPS=443 PX_LOGLEVEL=info PX_NAMESPACE=kube-system PX_RUNC=true PX_SECRETS_NAMESPACE=kube-system PX_SHARED=/var/lib/kubelet:shared:1;/var/lib/osd:shared:1 PX_TEMPLATE_VERSION=v4 PX_VERSION=2.6.2.1-4c79af9 SEALED_SECRETS_CONTROLLER_PORT=tcp://10.1.255.254:8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP=tcp://10.1.255.254:8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_ADDR=10.1.255.254 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_PORT=8080 SEALED_SECRETS_CONTROLLER_PORT_8080_TCP_PROTO=tcp SEALED_SECRETS_CONTROLLER_SERVICE_HOST=10.1.255.254 SEALED_SECRETS_CONTROLLER_SERVICE_PORT=8080 STORK_SERVICE_PORT=tcp://10.1.9.213:8099 STORK_SERVICE_PORT_443_TCP=tcp://10.1.9.213:443 STORK_SERVICE_PORT_443_TCP_ADDR=10.1.9.213 STORK_SERVICE_PORT_443_TCP_PORT=443 STORK_SERVICE_PORT_443_TCP_PROTO=tcp STORK_SERVICE_PORT_8099_TCP=tcp://10.1.9.213:8099 STORK_SERVICE_PORT_8099_TCP_ADDR=10.1.9.213 STORK_SERVICE_PORT_8099_TCP_PORT=8099 STORK_SERVICE_PORT_8099_TCP_PROTO=tcp STORK_SERVICE_SERVICE_HOST=10.1.9.213 STORK_SERVICE_SERVICE_PORT=8099 STORK_SERVICE_SERVICE_PORT_EXTENDER=8099 STORK_SERVICE_SERVICE_PORT_WEBHOOK=443 TERM=xterm container=oci"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Parent OCI mount '/opt/pwx/oci' already on PRIVATE propagation (private)"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Found 2 usable runc binaries: /opt/pwx/bin/runc and /opt/pwx/bin/runc-fb"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Detected kernel release 4.18.0-259"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T14:37:56-05:00" level=info msg="Exec: [\"/opt/pwx/bin/runc\" \"run\" \"-b\" \"/opt/pwx/oci\" \"--no-new-keyring\" \"portworx\"]"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Executing with arguments: -a -b -c px-cluster-7ca5106f-4d1e-4b33-a584-561431e687af -j auto -secret_type k8s -x kubernetes
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Installed pxctl...
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Tue Jan 19 19:37:56 UTC 2021 : Running version 2.6.2.1-4c79af9 on Linux node0.dimagre.com 4.18.0-259.el8.x86_64 #1 SMP Mon Dec 21 21:05:36 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Version: Linux version 4.18.0-259.el8.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 8.4.1 20200928 (Red Hat 8.4.1-1) (GCC)) #1 SMP Mon Dec 21 21:05:36 UTC 2020
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: mapping:
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Setting portmap: 9001
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: time="2021-01-19T19:37:56Z" level=error msg="Cannot listen on UNIX socket: listen unix /run/docker/plugins/pxd.sock: bind: no such file or directory"
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Error: failed to listen on pxd.sock
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Tue Jan 19 19:37:56 UTC 2021 partprobe begin
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: Tue Jan 19 19:37:56 UTC 2021 partprobe end
Jan 19 14:37:56 node0.dimagre.com portworx[604071]: sed: can't read /etc/mdadm/mdadm.conf: No such file or directory
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: checking /hostusr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: checking /hostusr/src/linux-headers-4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: found /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: found /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: checking /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:37:57 node0.dimagre.com portworx[604071]: found /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:38:00 node0.dimagre.com portworx[604071]: Using /usr/src/kernels/4.18.0-259.el8.x86_64 with defines  CC=gcc-8
Jan 19 14:38:00 node0.dimagre.com portworx[604071]: Creating px fs...
Jan 19 14:38:04 node0.dimagre.com portworx[604071]: Checking alternate paths, please wait...
Jan 19 14:38:04 node0.dimagre.com portworx[604071]: Checking kernel dir: /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:38:04 node0.dimagre.com portworx[604071]: Found kernel dir: /usr/src/kernels/4.18.0-259.el8.x86_64
Jan 19 14:38:04 node0.dimagre.com portworx[604071]: Failed to build PX filesystem dependency...
Jan 19 14:38:04 node0.dimagre.com portworx[604071]: Downloading from: https://mirrors.portworx.com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Trying from: https://mirrors.portworx.com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Unavailable: https://mirrors.portworx.com/build-results/pxfuse/for-installer/x86_64/4.18.0-259.el8.x86_64/version/10
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Downloading from: https://mirrors.portworx.com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Trying from: https://mirrors.portworx.com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10...
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Unavailable: https://mirrors.portworx.com/build-results/pxfuse/for-installer/108f0df/x86_64/4.18.0-259.el8.x86_64/version/10
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: checking local archive, please wait...
Jan 19 14:38:05 node0.dimagre.com portworx[604071]: Failed to load PX filesystem dependencies for kernel 4.18.0-259.el8.x86_64
Jan 19 14:38:05 node0.dimagre.com systemd[1]: portworx.service: Main process exited, code=exited, status=10/n/a
Jan 19 14:38:05 node0.dimagre.com systemd[1]: portworx.service: Failed with result 'exit-code'.
Jan 19 14:38:05 node0.dimagre.com systemd[1]: portworx-output.service: Succeeded.
Jan 19 14:38:05 node0.dimagre.com systemd[1]: portworx.socket: Succeeded.

dgrekov · January 19, 2021, 10:39pm

Looks like it’s having trouble building it still, what other dependencies could I have missed?

dgrekov · January 20, 2021, 5:32pm

@aleks, what do you think?

aleks · January 21, 2021, 1:12pm

Hi there, sorry I meant to reply and was caught up on trying to make that work. At the moment we only support kernels 4.18.0-240.xxx Centos 8 Stream releases. We are in the process of making it work for 4.18.0-257, 4.18.0-259 and 4.18.0-269.

The kernel code has changes some and the btrfs code needs to be rebuild for those kernels.

Let me get back to you with a potential eta or fix shortly…

dgrekov · January 22, 2021, 1:28am

Can I somehow roll back my kernel version? Would that help? Also, would this be better submitted over the support channel or is the forum the best place to continue this?

dgrekov · January 22, 2021, 11:14pm

I have resolved the issue by rolling back the kernel version to an earlier version. All works now! Thank you for your support.

Topic		Replies	Views
Failed to load PX filesystem dependencies Portworx on Kubernetes	17	3174	July 1, 2020
Failed to load PX filesystem dependencies for kernel 5.19.0-kaisen1-amd64 Portworx Essentials	1	423	November 27, 2022
Error during deployment of Portworx essential Portworx Essentials	4	698	January 28, 2021
Not able to pull the image px-essentials:2.6.0.2 Portworx on Kubernetes install	2	876	October 28, 2022
Could not talk to Docker/Containerd/CRI: Could not initialize container handler Portworx Install	1	1295	November 17, 2020

Failed to load PX filesystem dependencies for kernel 4.18.0-259.el8.x86_64

Related Topics