K8S Create POD using PowerStore Lun, Failed with mount

Dear Support:

      We create PVC/PV in customer's PowerStore(ISCSI)+K8S environment, but fail with mount volume.

Need your kindly help to give suggestion . Thx!

[root@ran-test-hw12-1 iscsi]# kubectl -n csi-powerstore get pvc

NAME               STATUS   VOLUME                  CAPACITY   ACCESS MODES   STORAGECLASS     AGE

ps-block-vol       Bound    csi-pstore-bba0825c14   8Gi        RWO            powerstore-raw   24h

ps-block-vol-32g   Bound    csi-pstore-5286e2fcd2   32Gi       RWO            powerstore-raw   20h

ps-xfs-vol         Bound    csi-pstore-ce9c065534   16Gi       RWO            powerstore-xfs   24h

 

[root@ran-test-hw12-1 iscsi]# kubectl -n csi-powerstore get pv

NAME                    CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS   CLAIM                             STORAGECLASS     REASON   AGE

csi-pstore-5286e2fcd2   32Gi       RWO            Delete           Bound    csi-powerstore/ps-block-vol-32g   powerstore-raw            20h

csi-pstore-bba0825c14   8Gi        RWO            Delete           Bound    csi-powerstore/ps-block-vol       powerstore-raw            24h

csi-pstore-ce9c065534   16Gi       RWO            Delete           Bound    csi-powerstore/ps-xfs-vol         powerstore-xfs            24h

 

[root@ran-test-hw12-1 iscsi]# cat create_pod.yaml

apiVersion: v1

kind: Pod

metadata:

    name: ps-pod

    namespace: csi-powerstore

spec:

    containers:

      - name: ps-pod

        image: centos:latest

        command: [ "/bin/sleep", "3600" ]

        volumeDevices:

          - devicePath: "/dev/ps-raw"

            name: ps-raw-vol-1

        volumeMounts:

          - mountPath: "/ps-xfs"

            name: ps-xfs-vol-1

    nodeName: rancher-dg-tn8

    volumes:

      - name: ps-raw-vol-1

        persistentVolumeClaim:

          claimName: ps-block-vol

      - name: ps-xfs-vol-1

        persistentVolumeClaim:

          claimName: ps-xfs-vol

 

 

[root@ran-test-hw12-1 powerstore_csi_install]# kubectl -n csi-powerstore describe pods ps-pod

Name:         ps-pod

Namespace:    csi-powerstore

Priority:     0

Node:         ran-test-hw12-1/10.2.56.231

Start Time:   Tue, 28 Sep 2021 12:13:12 +0800

Labels:      

Annotations:  kubectl.kubernetes.io/last-applied-configuration:

                {"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{},"name":"ps-pod","namespace":"csi-powerstore"},"spec":{"containers":[{"command...

              kubernetes.io/psp: default-psp

Status:       Pending

IP:          

IPs:         

Containers:

  ps-pod:

    Container ID: 

    Image:         centos:latest

    Image ID:     

    Port:         

    Host Port:    

    Command:

      /bin/bash

    State:          Waiting

      Reason:       ContainerCreating

    Ready:          False

    Restart Count:  0

    Environment:   

    Mounts:

      /ps-xfs from ps-xfs-vol-1 (rw)

      /var/run/secrets/kubernetes.io/serviceaccount from default-token-ls6cc (ro)

    Devices:

      /dev/ps-raw from ps-raw-vol-1

Conditions:

  Type              Status

  Initialized       True

  Ready             False

  ContainersReady   False

  PodScheduled      True

Volumes:

  ps-raw-vol-1:

    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

    ClaimName:  ps-block-vol

    ReadOnly:   false

  ps-xfs-vol-1:

    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

    ClaimName:  ps-xfs-vol

    ReadOnly:   false

  default-token-ls6cc:

    Type:        Secret (a volume populated by a Secret)

    SecretName:  default-token-ls6cc

    Optional:    false

QoS Class:       BestEffort

Node-Selectors: 

Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s

                 node.kubernetes.io/unreachable:NoExecute for 300s

Events:

  Type     Reason                  Age    From                      Message

  ----     ------                  ----   ----                      -------

  Normal   SuccessfulAttachVolume  3m53s  attachdetach-controller   AttachVolume.Attach succeeded for volume "csi-pstore-ce9c065534"

  Normal   SuccessfulAttachVolume  3m53s  attachdetach-controller   AttachVolume.Attach succeeded for volume "csi-pstore-bba0825c14"

  Warning  FailedMount             112s   kubelet, ran-test-hw12-1  MountVolume.MountDevice failed for volume "csi-pstore-ce9c065534" : rpc error: code = DeadlineExceeded desc = context deadline exceeded

  Warning  FailedMapVolume         112s   kubelet, ran-test-hw12-1  MapVolume.SetUpDevice failed for volume "csi-pstore-bba0825c14" : rpc error: code = DeadlineExceeded desc = context deadline exceeded

  Warning  FailedMount             111s   kubelet, ran-test-hw12-1  Unable to attach or mount volumes: unmounted volumes=[ps-xfs-vol-1 ps-raw-vol-1], unattached volumes=[ps-xfs-vol-1 default-token-ls6cc ps-raw-vol-1]: timed out waiting for the condition