ScaleIO 2.0 with LVM

Hello there,

I've installed ScaleIO 2.0 on my 3-nodes Ubuntu 14.04. So far, so good, i created volumes and mapped them.

With LVM, when i create a logicial volume, scini crashs. Without LVM, i can mkfs and everything works as expected.

Anyone had this kind of problems? By the way, i'm using openvswitch 2.4 for the whole network (lacp+vlan+jumbo frame)

Here is the log:

[   22.235512] ScaleIO R2_0 drvMain_Init:61 :Driver starting load process. HZ 250...

[   22.235512]

[   22.276110] ScaleIO R2_0 mosCpu_Init:69 :eax=0000000d, ebx=756e6547, ecx=6c65746e, edx=49656e69

[   22.315985] ScaleIO R2_0 mosT10Dif_Init:705 :(T10DIF) T10DIF layer using CPU (PCLMUL) acceleration !!!

[   22.358031] ScaleIO R2_0 drvMain_Init:63 :Load process done. Status SUCCESS

[   22.358031]

[   22.400750] ScaleIO R2_0 ioctl_HandleSetIniGuid:552 :Set GUID (35FED5B4-090C-45D6-9EB7-AF50FDC78D7B) finished . status 65 (SUCCESS)

[   22.462358] ScaleIO R2_0 ioctl_HandleAddMdm:377 :Create finish for MDM. First IP x.x.x.x.Number of IP addresses 2. Status 65 (SUCCESS)

[   22.526655] ScaleIO R2_0 ioctl_HandleBootWait:314 :Doing boot wait for 12000 milliseconds

[   34.567564] ScaleIO R2_0 ioctl_HandleBootWait:316 :Boot wait finished

[   43.827744] init: plymouth-upstart-bridge main process ended, respawning

[   50.781956] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294904989] Connected to MDM with ID 282685a22494ef7c

[   50.828837] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294905001] Connected to SDS with ID 437952e500000000

[   50.829223] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294905001] Connected to SDS with ID 437952e700000002

[   50.829224] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294905001] Connected to SDS with ID 437952e600000001

[   52.968187] ScaleIO R2_0 blkDev_Create:1059 :Created device scinia (251,0). Capacity 117440512 LB

[   53.020603] ScaleIO R2_0 blkDev_Create:1059 :Created device scinib (251,16). Capacity 117440512 LB

[   53.069910] ScaleIO R2_0 blkDev_Create:1059 :Created device scinic (251,32). Capacity 419430400 LB

[   53.118516] ScaleIO R2_0 blkDev_Create:1059 :Created device scinid (251,48). Capacity 1056964608 LB

[  207.274339] ScaleIO R2_0 netIOV_GetVec:248 :Error: assert(elemOffset < elemSize)

[  207.309447] CPU: 1 PID: 2031 Comm: net_sched Tainted: P           OE   4.2.0-30-generic #36~14.04.1-Ubuntu

[  207.309449] Hardware name: HP ProLiant MicroServer Gen8, BIOS J06 06/06/2014

[  207.309450]  000000000000ffff ffff8803f50c7988 ffffffff817b4f61 0000000000000001

[  207.309452]  0000000000000000 ffff8803f50c79d8 ffffffffc02f8dde ffff8803f50c7a50

[  207.309453]  0000010000000000 ffff8803f50c79c8 ffff8803f58ff0d8 0000000000000041

[  207.309455] Call Trace:

[  207.309460]  [ ] dump_stack+0x45/0x57

[  207.309471]  [ ] netIOV_GetVec+0x32e/0x3c0 [scini]

[  207.309479]  [ ] netSock_DoIO+0x15c/0x610 [scini]

[  207.309482]  [ ] ? tcp_write_xmit+0x296/0xec0

[  207.309484]  [ ] ? _raw_spin_unlock_bh+0x1e/0x20

[  207.309486]  [ ] ? release_sock+0x111/0x160

[  207.309503]  [ ] ? mosHash_GetRecordFromBucket+0x41/0xf0 [scini]

[  207.309513]  [ ] ? netCon_RcvLoop_CK+0x2d0/0x880 [scini]

[  207.309519]  [ ] netSock_Recv_CK+0xb9/0x140 [scini]

[  207.309526]  [ ] netSock_Recv+0x121/0x1c0 [scini]

[  207.309530]  [ ] ? netCon_RcvLoop_CK+0x329/0x880 [scini]

[  207.309535]  [ ] netCon_RcvLoop_CK+0x282/0x880 [scini]

[  207.309536]  [ ] ? sock_recvmsg+0x3b/0x50

[  207.309542]  [ ] ? netSock_Recv_CK+0x33/0x140 [scini]

[  207.309548]  [ ] netSock_Recv_CK+0x64/0x140 [scini]

[  207.309553]  [ ] netSock_DoIO+0xdb/0x610 [scini]

[  207.309556]  [ ] ? internal_add_timer+0x7e/0x90

[  207.309561]  [ ] ? netSock_DoIO+0x93/0x610 [scini]

[  207.309564]  [ ] ? __schedule+0x358/0x8f0

[  207.309566]  [ ] ? remove_wait_queue+0x4d/0x60

[  207.309572]  [ ] mosMitCond_Wait+0x5f/0x1b0 [scini]

[  207.309579]  [ ] mosMit_RunWithTLS+0x4f/0x60 [scini]

[  207.309586]  [ ] mosMitSchedThrd_ThrdEntry+0xe5/0x4f0 [scini]

[  207.309593]  [ ] ? mosTicks_GetCurrentTick+0x20/0x20 [scini]

[  207.309599]  [ ] mosOsThrd_Entry+0x1a/0x40 [scini]

[  207.309601]  [ ] kthread+0xc9/0xe0

[  207.309603]  [ ] ? kthread_create_on_node+0x1c0/0x1c0

[  207.309604]  [ ] ret_from_fork+0x3f/0x70

[  207.309606]  [ ] ? kthread_create_on_node+0x1c0/0x1c0

[  207.309617] ------------[ cut here ]------------

[  207.332075] kernel BUG at /emc/svc_flashbld/workspace/ScaleIO-UBUNTU-14.04/src/ini/linux/net/net_iov.c:248!

[  207.378126] invalid opcode: 0000 [#1] SMP

[  207.397560] Modules linked in: scini(POE) openvswitch libcrc32c ipmi_ssif gpio_ich intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul crc32_pclmul aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd hpilo lp parport lpc_ich ipmi_si 8250_fintek ipmi_msghandler serio_raw shpchp acpi_power_meter mac_hid ie31200_edac edac_core uas usb_storage ahci tg3 ptp psmouse libahci pps_core hpsa

[  207.577640] CPU: 1 PID: 2031 Comm: net_sched Tainted: P           OE   4.2.0-30-generic #36~14.04.1-Ubuntu

[  207.623220] Hardware name: HP ProLiant MicroServer Gen8, BIOS J06 06/06/2014

[  207.656444] task: ffff8803f4319b80 ti: ffff8803f50c4000 task.ti: ffff8803f50c4000

[  207.691590] RIP: 0010:[ ]  [ ] netIOV_GetVec+0x32e/0x3c0 [scini]

[  207.733850] RSP: 0018:ffff8803f50c7998  EFLAGS: 00010246

[  207.758749] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000006

[  207.792789] RDX: 0000000000000000 RSI: 0000000000000246 RDI: ffff8803f50c7f58

[  207.826729] RBP: ffff8803f50c79d8 R08: 000000000000000a R09: 0000000000000000

[  207.860225] R10: 0000000000000000 R11: 000000000000037e R12: 000000000000ffff

[  207.893927] R13: 0000000000000000 R14: 0000000000000000 R15: 000000000000ffff

[  207.927844] FS:  0000000000000000(0000) GS:ffff8803fa240000(0000) knlGS:0000000000000000

[  207.966193] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033

[  207.992679] CR2: 00007ff08425b000 CR3: 0000000001c0e000 CR4: 00000000001406e0

[  208.026665] Stack:

[  208.036127]  ffff8803f50c7a50 0000010000000000 ffff8803f50c79c8 ffff8803f58ff0d8

[  208.070726]  0000000000000041 ffff8803f58ff758 ffff8800ecfbf090 ffff8803f58ff220

[  208.105315]  ffff8803f50c7b68 ffffffffc030faac ffff8803f50c7a68 ffffffff81708266

[  208.139753] Call Trace:

[  208.151709]  [ ] netSock_DoIO+0x15c/0x610 [scini]

[  208.180887]  [ ] ? tcp_write_xmit+0x296/0xec0

[  208.208625]  [ ] ? _raw_spin_unlock_bh+0x1e/0x20

[  208.237939]  [ ] ? release_sock+0x111/0x160

[  208.264553]  [ ] ? mosHash_GetRecordFromBucket+0x41/0xf0 [scini]

[  208.299719]  [ ] ? netCon_RcvLoop_CK+0x2d0/0x880 [scini]

[  208.331454]  [ ] netSock_Recv_CK+0xb9/0x140 [scini]

[  208.361598]  [ ] netSock_Recv+0x121/0x1c0 [scini]

[  208.391036]  [ ] ? netCon_RcvLoop_CK+0x329/0x880 [scini]

[  208.422840]  [ ] netCon_RcvLoop_CK+0x282/0x880 [scini]

[  208.453902]  [ ] ? sock_recvmsg+0x3b/0x50

[  208.479696]  [ ] ? netSock_Recv_CK+0x33/0x140 [scini]

[  208.510549]  [ ] netSock_Recv_CK+0x64/0x140 [scini]

[  208.540717]  [ ] netSock_DoIO+0xdb/0x610 [scini]

[  208.569358]  [ ] ? internal_add_timer+0x7e/0x90

[  208.597066]  [ ] ? netSock_DoIO+0x93/0x610 [scini]

[  208.627040]  [ ] ? __schedule+0x358/0x8f0

[  208.653092]  [ ] ? remove_wait_queue+0x4d/0x60

[  208.680960]  [ ] mosMitCond_Wait+0x5f/0x1b0 [scini]

[  208.710540]  [ ] mosMit_RunWithTLS+0x4f/0x60 [scini]

[  208.740674]  [ ] mosMitSchedThrd_ThrdEntry+0xe5/0x4f0 [scini]

[  208.774822]  [ ] ? mosTicks_GetCurrentTick+0x20/0x20 [scini]

[  208.808195]  [ ] mosOsThrd_Entry+0x1a/0x40 [scini]

[  208.837661]  [ ] kthread+0xc9/0xe0

[  208.860422]  [ ] ? kthread_create_on_node+0x1c0/0x1c0

[  208.890810]  [ ] ret_from_fork+0x3f/0x70

[  208.916144]  [ ] ? kthread_create_on_node+0x1c0/0x1c0

[  208.946736] Code: c9 45 31 c0 e9 75 ff ff ff 31 c0 31 c9 e9 dc fe ff ff 31 c0 31 c9 e9 dc fe ff ff 31 ff e8 1b 97 02 00 85 c0 75 6d e8 3e c1 4b c1 <0f> 0b 31 ff e8 09 97 02 00 85 c0 74 21 48 8b 35 06 51 03 00 b9

[  209.036434] RIP  [ ] netIOV_GetVec+0x32e/0x3c0 [scini]

[  209.067307]  RSP

[  209.083539] ---[ end trace 9def4736d75615bd ]---

[  209.210621] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294944597] Disconnected from SDS with ID 437952e600000001

[  209.305048] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294944621] Disconnected from SDS with ID 437952e500000000

[  209.365454] ScaleIO R2_0 netChan_PrintConnectNotice:5148 :[4294944636] Disconnected from SDS with ID 437952e700000002

Thanks a lot!