CrashLoopBackOff - CSI driver for Isilon installation failed

Hi, there

 

After installation of csi driver for Isilon on a 3-nodes k8s cluster, pods failed starting up.  

Below is the logs and environment includes k8s version etc.

 any help to find it out why?

 

root@njppl1567:/Isilon/csi-isilon/helm# kubectl get pod -n isilon

NAME                  READY   STATUS             RESTARTS   AGE

isilon-controller-0   3/4     CrashLoopBackOff   2          28s

isilon-node-4zzb4     1/2     CrashLoopBackOff   1          28s

isilon-node-mld52     1/2     CrashLoopBackOff   1          28s

isilon-node-z242w     1/2     CrashLoopBackOff   1          28s

root@njppl1567:/Isilon/csi-isilon/helm# kubectl get pod -n isilon

NAME                  READY   STATUS             RESTARTS   AGE

isilon-controller-0   3/4     CrashLoopBackOff   2          30s

isilon-node-4zzb4     1/2     Error              2          30s

isilon-node-mld52     1/2     Error              2          30s

isilon-node-z242w     1/2     Error              2          30s

root@njppl1567:/Isilon/csi-isilon/helm# kubectl logs isilon-controller-0 driver -n isilon

time="2020-04-16T04:16:48Z" level=info msg="log level for logrus and gournal configured to INFO"

time="2020-04-16T04:16:48Z" level=error msg="init client failed : 'Authorization required'"

time="2020-04-16T04:16:48Z" level=info msg="Configured 'csi-isilon.dellemc.com'" accesspoint=System autoprobe=true endpoint=172.22.15.50 insecure=true mode=controller password="******" path=/ifs/data/csi quotaenabled=false user="root\n"

time="2020-04-16T04:16:48Z" level=info msg="removed sock file" path=/var/run/csi/csi.sock

time="2020-04-16T04:16:48Z" level=fatal msg="grpc failed" error="s.isiSvc (type isiService) is nil, probe failed"

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm# kubectl get pod -n isilon

NAME                  READY   STATUS             RESTARTS   AGE

isilon-controller-0   3/4     CrashLoopBackOff   6          5m16s

isilon-node-4zzb4     1/2     CrashLoopBackOff   5          5m16s

isilon-node-mld52     1/2     CrashLoopBackOff   5          5m16s

isilon-node-z242w     1/2     CrashLoopBackOff   5          5m16s

root@njppl1567:/Isilon/csi-isilon/helm# kubectl logs isilon-node-mld52  driver -n isilon

time="2020-04-16T04:19:34Z" level=info msg="log level for logrus and gournal configured to INFO"

time="2020-04-16T04:19:34Z" level=error msg="init client failed : 'Authorization required'"

time="2020-04-16T04:19:34Z" level=info msg="Configured 'csi-isilon.dellemc.com'" accesspoint=System autoprobe=true endpoint=172.22.15.50 insecure=true mode=node password="******" path=/ifs/data/csi quotaenabled=false user="root\n"

time="2020-04-16T04:19:34Z" level=info msg="removed sock file" path=/var/lib/kubelet/plugins/csi-isilon/csi_sock

time="2020-04-16T04:19:34Z" level=fatal msg="grpc failed" error="s.isiSvc (type isiService) is nil, probe failed"

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm# kubectl version

Client Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.3", GitCommit:"5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0", GitTreeState:"clean", BuildDate:"2019-06-06T01:44:30Z", GoVersion:"go1.12.5", Compiler:"gc", Platform:"linux/amd64"}

Server Version: version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.10", GitCommit:"575467a0eaf3ca1f20eb86215b3bde40a5ae617a", GitTreeState:"clean", BuildDate:"2019-12-11T12:32:32Z", GoVersion:"go1.12.12", Compiler:"gc", Platform:"linux/amd64"}

root@njppl1567:/Isilon/csi-isilon/helm# helm version

Client: &version.Version{SemVer:"v2.14.3", GitCommit:"0e7f3b6637f7af8fcfddb3d2941fcc7cbebb0085", GitTreeState:"clean"}

Server: &version.Version{SemVer:"v2.14.3", GitCommit:"0e7f3b6637f7af8fcfddb3d2941fcc7cbebb0085", GitTreeState:"clean"}

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm# cat /etc/issue

Ubuntu 16.04.6 LTS \n \l

 

root@njppl1567:/Isilon/csi-isilon/helm#

root@njppl1567:/Isilon/csi-isilon/helm#