Simply way to create Multipath MPxIO/STMS for SAN connection on Solaris 11

Aug 2, 2016 11:24 AM

When we have more than one physical connection from a server to a storage for access a same LUN. We should define a MPxIO for the SAN connection. With this refference, we would like to introduce a simply way on how to configure MPxIO for SAN in Solaris 11. If you not configure MPxIO, the LUN will appears duplicated in format output. So, configure MPxIO is must for multipath connection.
I will begin with check current disk status bellow :
root@fidtest:~# echo | format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
       0. c2t0d0
          /pci@400/pci@0/pci@8/scsi@0/sd@0,0
       1. c2t2d0
          /pci@400/pci@0/pci@8/scsi@0/sd@2,0
       2. c2t3d0   LDOM02
          /pci@400/pci@0/pci@8/scsi@0/sd@3,0
       3. c2t4d0
          /pci@400/pci@0/pci@8/scsi@0/sd@4,0
       4. c2t5d0
          /pci@400/pci@0/pci@8/scsi@0/sd@5,0
       5. c2t6d0
          /pci@400/pci@0/pci@8/scsi@0/sd@6,0
       6. c2t7d0
          /pci@400/pci@0/pci@8/scsi@0/sd@7,0
Then check port connection status :
root@fidtest:~# luxadm -e port
/devices/pci@500/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl              NOT CONNECTED
/devices/pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0:devctl            CONNECTED
/devices/pci@400/pci@0/pci@c/SUNW,qlc@0/fp@0,0:devctl              NOT CONNECTED
/devices/pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0:devctl            CONNECTED
Then, detects all LUN connected after physically connected from server to storage :
root@fidtest:~# devfsadm -Cv
root@fidtest:~# echo | format
Searching for disks...
Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,0 (ssd0):
Jun 28 09:01:08 fidtest         Corrupt label; wrong magic number
Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,1 (ssd2):
Jun 28 09:01:08 fidtest         Corrupt label; wrong magic number
Jun 28 09:01:08 fidtest cmlb: WARNING: /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,0 (ssd1):
Jun 28 09:01:08 fidtest         Corrupt label; wrong magic number
...
c4t0d0: configured with capacity of 9.98GB
c4t0d1: configured with capacity of 4.98GB
c6t0d0: configured with capacity of 9.98GB
c6t0d1: configured with capacity of 4.98GB

AVAILABLE DISK SELECTIONS:
       0. c2t0d0
          /pci@400/pci@0/pci@8/scsi@0/sd@0,0
       1. c2t2d0
          /pci@400/pci@0/pci@8/scsi@0/sd@2,0
       2. c2t3d0   LDOM02
          /pci@400/pci@0/pci@8/scsi@0/sd@3,0
       3. c2t4d0
          /pci@400/pci@0/pci@8/scsi@0/sd@4,0
       4. c2t5d0
          /pci@400/pci@0/pci@8/scsi@0/sd@5,0
       5. c2t6d0
          /pci@400/pci@0/pci@8/scsi@0/sd@6,0
       6. c2t7d0
          /pci@400/pci@0/pci@8/scsi@0/sd@7,0
       7. c4t0d0
          /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,0
       8. c4t0d1
          /pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446184,1
       9. c6t0d0
          /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,0
      10. c6t0d1
          /pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0/ssd@w500000e0d4446194,1
Specify disk (enter its number): Specify disk (enter its number):
Actually, only 2 LUN assigned to this server. But it's detected as 4 LUNs. It's occured due to MPxIO is not configured. So, each physical connection has own LUN detected. 4 LUN that I mentions as bellow : c4t0d0: configured with capacity of 9.98GB c4t0d1: configured with capacity of 4.98GB c6t0d0: configured with capacity of 9.98GB c6t0d1: configured with capacity of 4.98GB Then, we should enable MPxIO using the command bellow :
root@fidtest:~# stmsboot -e
WARNING: stmsboot operates on each supported multipath-capable controller detected in a host. In your system, these controllers are

/pci@500/pci@0/pci@c/SUNW,qlc@0/fp@0,0
/pci@500/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0
/pci@400/pci@0/pci@c/SUNW,qlc@0/fp@0,0
/pci@400/pci@0/pci@c/SUNW,qlc@0,1/fp@0,0
/pci@400/pci@0/pci@8/scsi@0
...

WARNING: This operation will require a reboot.
Do you want to continue ? [y/n] (default: y) y
The changes will come into effect after rebooting the system.
Reboot the system now ? [y/n] (default: y) y
Jun 28 09:02:21 fidtest reboot: initiated by wardi on /dev/console
Jun 28 09:02:30 fidtest syslogd: going down on signal 15

Terminated
root@fidtest:~#
root@fidtest:~# Terminated
wardi@fidtest:~$ syncing file systems... done

rebooting...

Resetting...
It's normal that enabling MPxIO is requres reboot. After reboot, system will initiated root filesystem using stmsboot automatically. Bellow the capture after reboot :
Boot device: /pci@400/pci@0/pci@8/scsi@0/disk@0,0:a  File and args: 

SunOS Release 5.11 Version 11.2 64-bit
Copyright (c) 1983, 2015, Oracle and/or its affiliates. All rights reserved.

stmsboot: Root is on ZFS
stmsboot: configuring devices

stmsboot: vfstab has been updated
stmsboot: now regenerating boot archive
Hostname: fidtest

fidtest console login: wardi
fPassword:
Last login: Tue Jun 28 08:53:26 on console
wardi@fidtest:~$ su -
Password:
Jun 28 09:11:52 fidtest su: 'su root' succeeded for wardi on /dev/console

Oracle Corporation      SunOS 5.11      11.2    August 2015
You have new mail.

root@fidtest:~# echo | format
Searching for disks...

done
c0t600000E00D1100000011046100010000d0: configured with capacity of 4.98GB
c0t600000E00D1100000011046100000000d0: configured with capacity of 9.98GB

AVAILABLE DISK SELECTIONS:
       0. c0t5000C50005BB5AC3d0
          /scsi_vhci/disk@g5000c50005bb5ac3
       1. c0t5000C50005BCC443d0
          /scsi_vhci/disk@g5000c50005bcc443
       2. c0t5000C50005BCC463d0
          /scsi_vhci/disk@g5000c50005bcc463
       3. c0t5000C50005BCDE43d0
          /scsi_vhci/disk@g5000c50005bcde43
       4. c0t5000C50005BCE90Bd0   LDOM02
          /scsi_vhci/disk@g5000c50005bce90b
       5. c0t5000C50005BD772Bd0
          /scsi_vhci/disk@g5000c50005bd772b
       6. c0t600000E00D1100000011046100010000d0
          /scsi_vhci/ssd@g600000e00d1100000011046100010000
       7. c0t600000E00D1100000011046100000000d0
          /scsi_vhci/ssd@g600000e00d1100000011046100000000
       8. c2t0d0
          /pci@400/pci@0/pci@8/scsi@0/sd@0,0
After multipath enable, the LUN detected are 2 LUN not 4 LUN anymore. So, the step to enable MPxIO is done without editing any file configuration because it's a simple way hehehehe. /* EOF */

0 comments:

Article list :