How to add SAN Disk on AIX

1. Install the HBA drivers. These are: (may be already installed)
a) devices.pci.df1000f7 for the FC6227 or
b) devices.pci.df1000f9 for the FC6228
c) devices.pci.common.IBM.fc
d) devices.fcp.disk

Run 'cfgmgr -v' to configure the FC adapter.

2. Ensure the HBA is available by running 'lsdev -C | grep fcs'.

# lsdev -C | grep fcs (Note: It should be in "Available" State NOT in "Defined" State.
fcs0 Available 0L-08 FC Adapter
fcs1 Available 0R-08 FC Adapter

3. How to find the WWN of the HBA with 'lscfg -vl fcs0'.

# lscfg -vl fcs0 (or 1,2,3....)
fcs0 U7879.001.DQDZNMG-P1-C1-T1 FC Adapter

Part Number.....................03N5014
EC Level..............................A
Serial Number..................1B74504EDB
Manufacturer...................001B
Customer Card ID Number.....280D
FRU Number..................... 03N5014
Device Specific.(ZM).......3
Network Address.............10000000C96E827E
ROS Level and ID.............02C82138
Device Specific.(Z0)........1036406D
Device Specific.(Z1)........00000000
Device Specific.(Z2)........00000000
Device Specific.(Z3)........03000909
Device Specific.(Z4)........FFC01159
Device Specific.(Z5)........02C82138
Device Specific.(Z6)........06C32138
Device Specific.(Z7)........07C32138
Device Specific.(Z8)........20000000C96E827E
Device Specific.(Z9)........BS2.10X8
Device Specific.(ZA)........B1D2.10X8
Device Specific.(ZB)........B2D2.10X8
Device Specific.(ZC)........00000000
Hardware Location Code......U7879.001.DQDZNMG-P1-C1-T1
Ensure the child fscsi devices have been created with 'lscfg | grep fscsi'
# lscfg | grep fscsi
* fscsi1 U7879.001.DQD450R-P1-C4-T1 FC SCSI I/O Controller Protocol Device
* fscsi0 U7879.001.DQDZNMG-P1-C1-T1 FC SCSI I/O Controller Protocol Device

4. Install the FC SCSI array drivers:
a) devices.fcp.disk.array.rte
b) devices.fcp.disk.array.diag
c) devices.fcp.disk.rte
d) devices.scsi.scarray.rte
The RDAC patch is also required. This is comprised of the following PTFs: U477090, U477166, U479510, U479487.

Check the AIX systems driver support and state by running the following command:
# manage_disk_drivers
1: DS4100: currently RDAC; supported: RDAC/fcparray, MPIO
2: DS4300: currently RDAC; supported: RDAC/fcparray, MPIO
3: DS4500: currently RDAC; supported: RDAC/fcparray, MPIO
4: DS4700/DS4200: currently RDAC; supported: RDAC/fcparray, MPIO
5: DS4800: currently RDAC; supported: RDAC/fcparray, MPIO
#

5. Reboot (or possibly run 'cfgmgr -v') to detect the disk arrays. If everything works, 'lsdev -Ccdisk' should show the SAN disks such as:
#lsdev -Ccdisk

hdisk0 Available 0J-08-00-5,0 16 Bit LVD SCSI Disk Drive
hdisk1 Available 0U-08-00-5,0 16 Bit LVD SCSI Disk Drive
hdisk4 Available 0L-08-02 1815 DS4800 Disk Array Device (Note: This is a SAN disk)
hdisk5 Available 0L-08-02 1815 DS4800 Disk Array Device (Note: This is a SAN disk)
If several "other FC SCSI Disk Drive" lines are seen the, array drivers are not correctly installed. Remove each FC SCSI device (with rmdev -d -l ) and check the driver installation.
# rmdev -dl fcs0 -R
Then Run "cfgmgr" and

6. How to verify DAR information:
# fget_config -Av

---dar0---

User array name = 'MEEZAN_DS4800_DR'
dac2 ACTIVE dac3 ACTIVE

Disk DAC LUN Logical Drive
utm 31
hdisk4 dac2 9 T24_HA
hdisk5 dac2 10 HA_HB

7. How to check FC connectivity stats
# fcstat fcs0 (or 1,2,3.....)

FIBRE CHANNEL STATISTICS REPORT: fcs0

Device Type: FC Adapter (df1000fd)
Serial Number: 1B74504EDB
Option ROM Version: 02C82138
Firmware Version: B1D2.10X8
World Wide Node Name: 0x20000000C96E827E
World Wide Port Name: 0x10000000C96E827E

FC-4 TYPES:
Supported: 0x0000012000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): 4 GBIT
Port Speed (running): 4 GBIT
Port FC ID: 0x010200
Port Type: Fabric

Seconds Since Last Reset: 3983

Transmit Statistics Receive Statistics
------------------- ------------------
Frames: 272968 19860
Words: 139650816 6934784

LIP Count: 0
NOS Count: 0
Error Frames: 0
Dumped Frames: 0
Link Failure Count: 2
Loss of Sync Count: 8
Loss of Signal: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 4
Invalid CRC Count: 0

IP over FC Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0

FC SCSI Adapter Driver Information
No DMA Resource Count: 0
No Adapter Elements Count: 0
No Command Resource Count: 0

IP over FC Traffic Statistics
Input Requests: 0
Output Requests: 0
Control Requests: 0
Input Bytes: 0
Output Bytes: 0

FC SCSI Traffic Statistics
Input Requests: 511
Output Requests: 2629
Control Requests: 42
Input Bytes: 27115897
Output Bytes: 551900700
#

8. Also check the following for better understand

# lsdev -C |grep dar
dar0 Available 1815 DS4800 Disk Array Router
en0 Defined 0E-08 Standard Ethernet Network Interface
en1 Defined 0E-09 Standard Ethernet Network Interface
en2 Defined 0G-08 Standard Ethernet Network Interface
en3 Defined 0P-08 Standard Ethernet Network Interface
en4 Defined 0P-09 Standard Ethernet Network Interface
en5 Defined 0Q-08 Standard Ethernet Network Interface
en6 Defined 0a-08 Standard Ethernet Network Interface
en7 Defined 0a-09 Standard Ethernet Network Interface
en8 Defined 0b-08 Standard Ethernet Network Interface
en9 Defined 0l-08 Standard Ethernet Network Interface
en10 Defined 0l-09 Standard Ethernet Network Interface
en11 Defined 0o-08 Standard Ethernet Network Interface
en12 Available Standard Ethernet Network Interface

# lsdev -C |grep dac
dac0 Available 0L-08-02 DS3/4K PCM User Interface
dac1 Available 0R-08-02 DS3/4K PCM User Interface
dac2 Available 0L-08-02 1815 DS4800 Disk Array Controller
dac3 Available 0R-08-02 1815 DS4800 Disk Array Controller

#lspath -H -l hdisk

# lspath -l hdisk4
fcs0 path Enable
fcs1 path Enable

9. Type the following command to list the attributes of each dar found on the system:

# lsattr -El darX where X is the number of the dar (e.g: dar 0)

# lsattr -El dar0
act_controller dac2,dac3 Active Controllers False
aen_freq 600 Polled AEN frequency in seconds True
all_controller dac2,dac3 Available Controllers False
autorecovery no Autorecover after failure is corrected True
balance_freq 600 Dynamic Load Balancing frequency in seconds True
cache_size 2048 Cache size for both controllers False
fast_write_ok yes Fast Write available False
held_in_reset none Held-in-reset controller True
hlthchk_freq 600 Health check frequency in seconds True
load_balancing no Dynamic Load Balancing True
switch_retries 5 Number of times to retry failed switches True

The output looks similar to the following example:
# lsattr -El dar0 |grep autorecovery
autorecovery no Autorecover after failure is corrected True