| Both sides previous revision
Previous revision
Next revision
|
Previous revision
Last revision
Both sides next revision
|
en:jobs:iser_vsphere6 [2016/07/30 10:32]
admin [Links] |
en:jobs:iser_vsphere6 [2016/08/29 12:28]
admin [Configuring iSER server on Centos 6] |
| ======= Configuring of server iSER - iSCSI Extensions for RDMA on linux Centos 6 and vSphere 6 as iSER client======= | ======= Configuring of server iSER - iSCSI Extensions for RDMA on linux Centos 6 and vSphere 6 as iSER client======= |
| |
| ==== Preface ==== | ==== Hardware ==== |
| Most of you have been faced with iSCSI performance limitation in ~380 MB/s. This limitation doesn't depends on Ethernet port speed.\\ | |
| Below is example how to overcame this limitation with Infiniband (%%IPoIB%%) and iSER protocol.\\ | |
| Hardware Centos 6 linux server: 1xXeon 5504, 12GB MEM, RAID6 ADAPTEC 14 HDD + HOT SPARE 1TB SAS DISKS, Infiniband Mallanox %%ConnectX®-2%% MHQH29C-XTR QR.\\ | Hardware Centos 6 linux server: 1xXeon 5504, 12GB MEM, RAID6 ADAPTEC 14 HDD + HOT SPARE 1TB SAS DISKS, Infiniband Mallanox %%ConnectX®-2%% MHQH29C-XTR QR.\\ |
| Hardware vSphere6 host: 2xXeon x5690, 96 GB MEM, Infiniband Mallanox %%ConnectX®-2%% MHQH29C-XTR QR.\\ | Hardware vSphere6 host: 2xXeon x5690, 96 GB MEM, Infiniband Mallanox %%ConnectX®-2%% MHQH29C-XTR QR.\\ |
| yum install -y opensm | yum install -y opensm |
| |
| Enable %%IPoIB%% and switch infiniband to connected mode. Enable iSER support. This [[https://www.kernel.org/doc/Documentation/infiniband/ipoib.txt|Link]] about differences between connected and datagram modes. | Enabling %%IPoIB%% and switch infiniband to connected mode. Enabling iSER support. This [[https://www.kernel.org/doc/Documentation/infiniband/ipoib.txt|Link]] about differences between connected and datagram modes. |
| |
| cat /etc/rdma/rdma.conf | cat /etc/rdma/rdma.conf |
| BOOTPROTO=none | BOOTPROTO=none |
| CONNECTED_MODE=yes | CONNECTED_MODE=yes |
| MTU=9000 | MTU=1500 |
| IPADDR=172.19.254.10 | IPADDR=172.19.254.10 |
| NETMASK=255.255.255.0 | NETMASK=255.255.255.0 |
| BOOTPROTO=none | BOOTPROTO=none |
| CONNECTED_MODE=yes | CONNECTED_MODE=yes |
| MTU=9000 | MTU=1500 |
| IPADDR=172.19.254.11 | IPADDR=172.19.254.11 |
| NETMASK=255.255.255.0 | NETMASK=255.255.255.0 |
| {{:ru:jobs:vsphere_net.jpg?800|600}}.\\ | {{:ru:jobs:vsphere_net.jpg?800|600}}.\\ |
| |
| Now you can Add Send Target Server (Centos 6 server) for each IB port. Rescan adapters and format Datastore. | Now you can Add Send Target Server (Centos 6 server) for each IB port. Rescan adapters and format Datastore. |
| |
| ==== Performance ==== | ==== Performance ==== |
| |
| ==== Links ==== | ==== Links ==== |
| [[https://forums.servethehome.com/index.php?threads/connectx-2-and-esxi-6-0.5382/|Forum Link]] | [[https://forums.servethehome.com/index.php?threads/connectx-2-and-esxi-6-0.5382/|Forum Link]]\\ |
| [[https://www.mellanox.com/related-docs/case_studies/CS_StarWind2.pdf| Accelerating iSCSI SAN Storage with Mellanox]] | [[https://www.mellanox.com/related-docs/case_studies/CS_StarWind2.pdf| Accelerating iSCSI SAN Storage with Mellanox]] |
| |
Main page
