I just started setting up our 4 hosts for iscsi multipathing a couple of days ago. We have 3 nics on each host for iscsi. First 2 hosts did great. Today I was working on the 3rd host and did the hba rescan, and I started to get "Out of resource" messages from the EQ because I was going over the connection limit of 1024. I've never seen the EQ gui lock up before, so that was pretty exciting.
So I removed 2 of the nics from the iscsi binding and rescanned, and the EQ is resting comfortably at 923 connections.
Why do we have so many connections, you might ask? Well, we got some advice a long time ago to create a new LUN for each VM. We have 75 VMs, so I'm rethinking that approach. Here are my questions:
Any advice on LUNS for multiple VMs and iscsi volumes (Windows drives)? We have Windows terminal servers and utility servers, some Linux web servers, and some templates, etc. I'm thinking of creating a lun for each category of VM. I realize that we need to have about 20% free space for each lun after the VMs are in.
I'd prefer to keep the Windows volume LUNs separate. I don't think I have to worry about the iscsi connection limit for those once I take care of the VM luns, but I was wondering how other people are handling theirs.
Thanks for any advice.