When we have more than one physical connection from a server to a storage for access a same LUN. We should define a MPxIO for the SAN connection. With this refference, we would like to introduce a simply way on how to configure MPxIO for SAN in Solaris 11. If you not configure MPxIO, the LUN will appears duplicated in format output. So, configure MPxIO is must for multipath connection.
I will begin with check current disk status bellow :
Then check port connection status :root@fidtest:~# echo | format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c2t0d0 /pci@400/pci@0/pci@8/scsi@0/sd@0,0 1. c2t2d0 /pci@400/pci@0/pci@8/scsi@0/sd@2,0 2. c2t3d0 LDOM02 /pci@400/pci@0/pci@8/scsi@0/sd@3,0 3. c2t4d0 /pci@400/pci@0/pci@8/scsi@0/sd@4,0 4. c2t5d0 /pci@400/pci@0/pci@8/scsi@0/sd@5,0 5. c2t6d0 /pci@400/pci@0/pci@8/scsi@0/sd@6,0 6. c2t7d0 /pci@400/pci@0/pci@8/scsi@0/sd@7,0
Then, detects all LUN connected after physically connected from server to storage :root@fidtest:~# luxadm -e port /devices/pci@500/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl NOT CONNECTED /devices/pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0:devctl CONNECTED /devices/pci@400/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl NOT CONNECTED /devices/pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0:devctl CONNECTED
Actually, only 2 LUN assigned to this server. But it's detected as 4 LUNs. It's occured due to MPxIO is not configured. So, each physical connection has own LUN detected. 4 LUN that I mentions as bellow : c4t0d0: configured with capacity of 9.98GB c4t0d1: configured with capacity of 4.98GB c6t0d0: configured with capacity of 9.98GB c6t0d1: configured with capacity of 4.98GB Then, we should enable MPxIO using the command bellow :root@fidtest:~# devfsadm -Cv root@fidtest:~# echo | format Searching for disks... Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,0 (ssd0): Jun 28 09:01:08 fidtest Corrupt label; wrong magic number Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,1 (ssd2): Jun 28 09:01:08 fidtest Corrupt label; wrong magic number Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,0 (ssd1): Jun 28 09:01:08 fidtest Corrupt label; wrong magic number ... c4t0d0: configured with capacity of 9.98GB c4t0d1: configured with capacity of 4.98GB c6t0d0: configured with capacity of 9.98GB c6t0d1: configured with capacity of 4.98GB AVAILABLE DISK SELECTIONS: 0. c2t0d0 /pci@400/pci@0/pci@8/scsi@0/sd@0,0 1. c2t2d0 /pci@400/pci@0/pci@8/scsi@0/sd@2,0 2. c2t3d0 LDOM02 /pci@400/pci@0/pci@8/scsi@0/sd@3,0 3. c2t4d0 /pci@400/pci@0/pci@8/scsi@0/sd@4,0 4. c2t5d0 /pci@400/pci@0/pci@8/scsi@0/sd@5,0 5. c2t6d0 /pci@400/pci@0/pci@8/scsi@0/sd@6,0 6. c2t7d0 /pci@400/pci@0/pci@8/scsi@0/sd@7,0 7. c4t0d0 /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,0 8. c4t0d1 /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,1 9. c6t0d0 /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,0 10. c6t0d1 /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,1 Specify disk (enter its number): Specify disk (enter its number):
It's normal that enabling MPxIO is requres reboot. After reboot, system will initiated root filesystem using stmsboot automatically. Bellow the capture after reboot :root@fidtest:~# stmsboot -e WARNING: stmsboot operates on each supported multipath-capable controller detected in a host. In your system, these controllers are /pci@500/pci@0/pci@c/SUNW,qlc@0/fp@0,0 /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 /pci@400/pci@0/pci@c/SUNW,qlc@0/fp@0,0 /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0 /pci@400/pci@0/pci@8/scsi@0 ... WARNING: This operation will require a reboot. Do you want to continue ? [y/n] (default: y) y The changes will come into effect after rebooting the system. Reboot the system now ? [y/n] (default: y) y Jun 28 09:02:21 fidtest reboot: initiated by wardi on /dev/console Jun 28 09:02:30 fidtest syslogd: going down on signal 15 Terminated root@fidtest:~# root@fidtest:~# Terminated wardi@fidtest:~$ syncing file systems... done rebooting... Resetting...
After multipath enable, the LUN detected are 2 LUN not 4 LUN anymore. So, the step to enable MPxIO is done without editing any file configuration because it's a simple way hehehehe. /* EOF */Boot device: /pci@400/pci@0/pci@8/scsi@0/disk@0,0:a File and args: SunOS Release 5.11 Version 11.2 64-bit Copyright (c) 1983, 2015, Oracle and/or its affiliates. All rights reserved. stmsboot: Root is on ZFS stmsboot: configuring devices stmsboot: vfstab has been updated stmsboot: now regenerating boot archive Hostname: fidtest fidtest console login: wardi fPassword: Last login: Tue Jun 28 08:53:26 on console wardi@fidtest:~$ su - Password: Jun 28 09:11:52 fidtest su: 'su root' succeeded for wardi on /dev/console Oracle Corporation SunOS 5.11 11.2 August 2015 You have new mail. root@fidtest:~# echo | format Searching for disks... done c0t600000E00D1100000011046100010000d0: configured with capacity of 4.98GB c0t600000E00D1100000011046100000000d0: configured with capacity of 9.98GB AVAILABLE DISK SELECTIONS: 0. c0t5000C50005BB5AC3d0 /scsi_vhci/disk@g5000c50005bb5ac3 1. c0t5000C50005BCC443d0 /scsi_vhci/disk@g5000c50005bcc443 2. c0t5000C50005BCC463d0 /scsi_vhci/disk@g5000c50005bcc463 3. c0t5000C50005BCDE43d0 /scsi_vhci/disk@g5000c50005bcde43 4. c0t5000C50005BCE90Bd0 LDOM02 /scsi_vhci/disk@g5000c50005bce90b 5. c0t5000C50005BD772Bd0 /scsi_vhci/disk@g5000c50005bd772b 6. c0t600000E00D1100000011046100010000d0 /scsi_vhci/ssd@g600000e00d1100000011046100010000 7. c0t600000E00D1100000011046100000000d0 /scsi_vhci/ssd@g600000e00d1100000011046100000000 8. c2t0d0 /pci@400/pci@0/pci@8/scsi@0/sd@0,0
Simply way to create Multipath MPxIO/STMS for SAN connection on Solaris 11
Aug 2, 2016 11:24 AM
Filed Under: confbuild, oracle, shell, solaris, storage |0 comments
Subscribe to:
Post Comments (Atom)
0 comments:
Post a Comment