Home

User's Guide and Maintenance Information

1. Adapter Adapter Adapter Adapter E Using System A Using System B j SSA Disk Drives Using SystemC Using System D Adapter Adapter Adapter Adapter C Figure 11 A Large Configuration of Thirty Two Disk Drives Connected to Eight SSA Adapters in Four Using Systems 16 Advanced SerialRAID Adapters User and Maintenance Information Switching Off Using Systems Be careful if you want to switch off one or more using systems in a large configuration If any disk subsystem in the configuration does not use bypass cards some using systems might lose access to disk drives if you e Switch off more than one using system at a time e Switch off a using system when a disk drive has failed Note For more information about bypass cards see the publications for your disk subsystems or enclosures Switching On Using Systems When you switch on using systems of a large configuration ensure that each using system configures all the disk drives in the SSA loop You can switch on each using system and give the cfgmgr command to ensure that all the disk drives are configured If however you need your pdisk assignments to be constant between using systems follow the procedures given in Chapter 2 Introducing SSA Loops 17 Configuring Devices on an SSA Loop If a
2. RAID 10 2 Advanced SerialRAID Adapter at microcode level above 50 Fast Write 1 Advanced SerialRAID Adapter at microcode level below 50 2 Advanced SerialRAID Adapter at microcode level above 50 See the SSA Adapters User s Guide and Maintenance Information manual SA33 3272 Version 01 or above for more information about the level of code that is required in the Micro Channel SSA Multi Initiator RAID EL Adapter type 4 M or the PCI SSA Multi Initiator RAID EL Adapter type 4 N 22 Advanced SerialRAID Adapters User and Maintenance Information Checking the Level of the Adapter Microcode If you need to check the level of the adapter microcode 1 Type on the command line Iscfg vl ssan where ssan is the name of the adapter whose microcode you are checking for example ssa0 A list of vital product data VPD is displayed Find ROS Level and ID The first two characters of this field show the level of the adapter microcode For example 50nn where n is a digit O through 9 shows a microcode level of 50 Chapter 2 Introducing SSA Loops 23 Rules for the Physical Relationship between Disk Drives and Adapters The physical relationship between the disk drives and the adapters in an SSA loop can affect the performance of the subsystem The following rules help you to get best performance from your subsystem One Pair of Adapter Connectors in the Loop The following sequence enables you to det
3. Select the hot spare pool that you want to list 78 Advanced SerialRAID Adapters User and Maintenance Information A list of hot spare pools whose disk drives you want to list is displayed a SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager SSA Hot Spare Pools Move cursor to desired item and press F7 ONE OR MORE items can be selected Press Enter AFTER making all selections EEE EEE EE HEE EEE EE EE EE EEEE Hot Spare Pools in Loop A are pool_Al HEE EH EE THEE EEE EE EE EE A AE Hot Spare Pools in Loop B are pool Bl F1 Help F2 Refresh F3 Cancel F7 Select F8 Image F10 Exit F Enter Do Find n Find Next Select the hot spare pool whose disk drives you want to list The pool status is displayed Pa COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below ssal pool_B2 Component Location Size Status hdisk4 raid_10 pdisk13 04 02 REGY 0 18 2GB good 6 P pdisk3 04 02 REGY 05 P 9 2GB good pdisk7 04 02 REGY 01 P 9 2GB good Hot Spare Disks pdisk9 04 02 REGY 02 P 9 2GB Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel1 F1O Exit Find n Find Next S The columns of information displayed on the screen have the following meanings Chapter 6 Using the RAID Array Conf
4. SRN Problem Possible Causes SSA03 Description The service aid was unable to open an hdisk This problem might have occurred because a disk drive has failed or has been removed from the system Action Take the actions described here 1 Use the Configuration Verification service aid see Configuration erification Service to determine the location code of the SSA adapter to which the hdisk is attached For example if the location code of the hdisk is 00 03 L the location code of the SSA adapter is 00 03 2 Run the Link Verification service aid see to the SSA adapter 3 If a link failure is indicated by the service aid go to FMAP 2320 SSA 4 If no link failures are indicated run diagnostics in System Verification mode to each pdisk that is attached to the SSA adapter None Chapter 17 SSA Problem Determination Procedures 387 Software and Microcode Errors Some SRNs indicate that a problem might have been caused by a software error or by a microcode error If you have one of these SRNs do the following actions 1 Make a note of the contents of the error log for the device that has the problem 2 For AIX Versions 4 2 and above run the snap b command to collect system configuration data and to dump data For AIX versions below 4 2 go to the using system service aids and select Display Vital Product Data to display the VPD of the failing system Make a note of the VPD for all
5. Each half of the array contains different data but no indication is given to which data is valid Under these conditions the array is in the Offline state and both systems generate SRN 48760 Chapter 7 Split Site Management 161 162 Advanced SerialRAID Adapters User and Maintenance Information Chapter 8 Using the SSA Spare Tool The SSA Spare Tool helps you to manage your SSA networks when Logical Volume Manager LVM mirrored volume groups are used It works with the LVM to identify stale partitions or missing physical volumes in LVM mirrored volume groups If the SSA Spare Tool finds any stale partitions or missing physical volumes e lt automatically resynchronizes the stale partition if no replacement hardware is needed e It sends an email message that describes the actions taken and indicates whether a disk drive must be exchanged for a new one e It logically exchanges the failed disk drive in the volume group with a preassigned spare disk drive This process is called hot sparing e It synchronizes the new disk drive with the remaining disk drives in the volume group e It notifies you when it has logically exchanged a failed disk drive and has synchronized the replacement disk drive with the other disk drives in the volume group When a failed disk drive has been physically exchanged and the data has been resynchronized the SSA Spare tool can use various scripts to e Move the data from the temporary spare
6. hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09253173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the array whose disk drives you want to identify Note The menu shown here is displayed when you select a RAID 5 array If you select a RAID 1 or a RAID 10 array two lists of disk drives are available One list is for primary disk drives the other is for secondary disk drives Chapter 6 Using the RAID Array Configurator 117 3 The following information is displayed Identify Disks in an SSA RAID Array Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa0 SSA RAID Array hdisk2 Member Disks Flash Disk Identification Lights yes F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1O Exit Enter Do 4 Select yes in the Flash Disk Identification Lights field 5 Press the List key to list the disk drives 6 From the displayed list select the disk drives that you want to identify The Check light flashes on each disk drive that you have selected 118 Advanced SerialRAID Adapters User and Maintenance Information Identifying Hot Spare Disk Drives This option allows you to identify the hot spare disk drives that are available to a particular SSA RAID manager 1 For fast path type smitty ihssaraid and press Enter Otherwi
7. A Type or select values in entry fields SSA RAID Manager SSA RAID Array Connection Address Array Name RAID Array Type State Member Disks Size of Array Percentage Rebuilt Press Enter AFTER making all desired changes Change Show Attributes of an SSA RAID Array Entry Fields ssa hdisk3 00243199986267K raid_5 good pdiskl pdisk3 pdisk4 p gt 3 4G Not Rebuilding Enable Use of Hot Spares yes Allow Page Splits yes ste Current Use AIX System Disk Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do Move the cursor to the attribute that you want to change and press the List key A list of options for that attribute is displayed Select the option that you want 5 If you want to change another attribute move the cursor to that attribute and press the List key 6 Again choose from the list of displayed options Repeat steps H and H for each attribute that you want to change 134 Advanced SerialRAID Adapters User and Maintenance Information Changing Member Disks in an SSA RAID Array This option allows you to remove a disk drive from an array and install a replacement disk drive All the data that is on the original disk drive is automatically written to the replacement disk drive i For fast path type smitty swpssaraid and press Enter Otherwise select Change Member Disks in an SSA RAID Array from the SSA RAID Array menu The fol
8. Action Install an SDRAM module of the correct size or exchange the existing SDRAM module for a new one of the correct size Possible FRUs SDRAM module 99 SSA adapter card 1 using system nstallation and Service Guide 42200 Description Other adapters on the SSA loop are using levels of microcode that are not compatible Action Install the latest level of adapter microcode onto all the other adapters on this SSA loop Chapter 17 SSA Problem Determination Procedures User or service action 363 operation Action 1 Start the using system service aids 2 Select Display or Change Configuration or Vital Product Data VPD Select Display Vital Product Data Find the VPD for the SSA adapter that is logging the error Note the SDRAM and cache sizes Device Specifics ZO and Z1 For fast write operations the size of the available SDRAM must be greater than the size of the fast write cache If you cannot determine the correct size of SDRAM to use contact your support center oar ow SRN Problem Possible Causes 42500 Description The Fast Write Cache Option Card has failed Possible FRUs Fast Write Cache Option Action 1 Exchange the cache card for a new one 2 Switch on power to the using system 3 If the original cache card contained data that was not moved to a disk drive new error codes are produced Run diagnostics in System Verification mode to
9. Before starting this MAP ensure that all the disk drives are working correctly 1 Run diagnostics in Problem Determination mode to identify any disk drive problems that have occurred 2 Run the Link Verification service aid see to find all power problems SSA link problems and i SSA disk drives that have a Failed status 3 Correct all those problems before you start this procedure Attention Some of the steps in this MAP need you to change the configuration of the array or to change the use of an SSA disk drive Do not do those steps unless you have the user s permission 1 from steps B bal and ba You have been sent to this step either from another step in this MAP or because you have one of the following Service Request Numbers SRNs 46000 47000 47500 49000 49100 49500 Do you have SRN 49500 NO a Run diagnostics in System Verification mode to the SSA adapters b Go to step B YES No hot spare disk drives are available Go to step Pian page 414 2 from step il Did the diagnostics produce SRN 46000 47000 47500 49000 or 49100 NO Go to step Ban page 403 YES Go to step 4 on page 403 402 Advanced SerialRAID Adapters User and Maintenance Information SRN 3 Cause from step bh Do you have any other SRN NO Go to step P2 on page 415 YES a Solve the problems that caused the SRN b Return to step Lon page 4021 from step B Find your SRN in the following table th
10. In Figure 50 on page 353 disk drives 1 through 8 should be connected to connectors A1 and A2 of the SSA adapter F but the loop is broken because the SSA cable has been disconnected from connector A2 Disk drives 9 through 12 are connected to connectors B1 and B2 of the same SSA adapter Disk drives 13 through 16 are connected to connectors A1 and A2 of a different SSA adapter H Although the broken loop is reported as an error all the disk drives can still communicate with the using system Disk drives 1 through 8 can communicate through connector A1 of the SSA adapter J Disk drives 9 through 12 can communicate through connectors B1 and B2 of the same SSA adapter normal loop disk drives 13 through 16 can communicate through connectors A1 and A2 of the SSA adapter H 352 Advanced SerialRAID Adapters User and Maintenance Information Using system A1 A2 Bi B2 Using system a1 A2 HA B1 B2 Figure 50 Broken Loop Cable Removed For this example the Link Verification service aid displays the following information Disk Disk Disk Disk Disk Disk Disk Disk 16 15 14 13 12 11 10 9 Disk Disk Disk Disk Disk Disk Disk Disk 1 2 3 4 5 6 7 8 Chapter 16 SSA Service Aids 353 Pe LINK VERIFICATION 802386 SSA Link Verification for systemname ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Ph
11. Select Swap Member Disks in an SSA RAID Arrey see EChangingl 6 Select the hdisk that you noted in step mi The Disk to Remove is the pdisk that you noted in step H The Disk to Add is the replacement disk drive that was installed in exchange for the failed disk drive Hot spare disk drives exist in a pool but they are not protecting any member disk drive This condition does not cause an error to be logged If required you can move hot spare disk drives from this pool to a pool that contains RAID arrays Alternatively you can change the use of hot spare disk drives that are in this pool Chapter 5 Hot Spare Management 53 54 Advanced SerialRAID Adapters User and Maintenance Information Chapter 6 Using the RAID Array Configurator This chapter describes how to use the system management interface tool SMIT to manage your SSA RAID arrays The SMIT provides a set of menus from which you can select the various functions of the ssaraid command The ssaraid command allows you to create delete and manage your RAID arrays If you prefer to use the ssaraid command through the command line interface instead Note If you select a List function from a SMIT menu and no resource of the required type exists the following error popup window might be displayed a N Change Member Disks in an SSA RAID Array Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Arr
12. a LINK VERIFICATION 802386 SSA Link Verification for nunu ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdisk11 AC7AAO9A 0 5 Good nunu pdisk amp AC7AA2D6 1 4 Good nunu pdisk2 AC7AAOBD 23 Good nunu pdisk3 AC7AA0B1 3 2 Good nunu pdisk7 AC7AAOB5 AS oD Good nunu pdisk12 AC7AA052 58 Good nunu pdiskO AC7AAOB9 0 5 Good nunu pdiskl AC7AA0B3 Bi TA Good nunu pdisk10 AC7AA0B4 2 33 Good MORE 4 F3 Cancel F1O Exit Ne If the service aid cannot detect any pdisks a message is displayed Link VERIFICATION 802385 Move cursor onto selection then press lt Enter gt nunu ssal 00 04 IBM SSA 160 SerialRAID Adapter nunu ssal 00 05 IBM SSA 160 SerialRAID Adapter nunu ssal 00 07 IBM SSA 160 SerialRAID Adapter No pdisks are in the Available state If you are running the diagnostics in Concurrent Mode run cfgmgr to ensure that all pdisks are configured before selecting this option If pdisks cannot be configured then go to the START page in the SSA Subsystem Service Guide F3 Cancel F1Q Exit Enter F3 Cancel XN Are any pdisks listed for the selected SSA adapter NO One of the following conditions exists Take the action described e No physical disks are connected to this SSA adapter 394 A
13. b If necessary select Components to Add or Components to Remove to modify the hot spare disk drives that are in the pool c Set Hot Spares Minimum to the alarm value that the user has specified This number is normally one less than the number of hot spare disk drives that are configured It can however but be a lower number d Press Enter Reselect Change Show Delete a Hot Spare Pool This action refreshes the display If the Status of the hot spare pool has changed to Full the repair is complete If any other status value is displayed run diagnostics in System Verification mode to all SSA Adapters to determine the new SRN SSA loop configuration problem Chapter 17 SSA Problem Determination Procedures 379 SRN Problem Possible Causes 49520 Description Hot spare tuning has been lost Action 1 2 3 10 11 12 13 14 15 16 17 18 19 20 2i Type smitty ssaraid and press Enter Select List Status of Hot Spare Pools Select the adapter that logged the error If the adapter is not known select all adapters Note the RAID Manager adapter and pool number of spare pools that have a status of mixed Select List Components in a Hot Spare Pool Select the RAID Manager and pool that you noted earlier Note the array name hdisk and member disk drive pdisk that have a status of wrong_pool This array member disk drive pdisk is exchanged la
14. 42528 Description A fast write disk drive has been detected that was previously unsynchronized but has since been configured on a different adapter Action If this disk drive contains data that should be kept return the disk drive to the adapter to which it was previously connected If the disk drive does not contain data that should be kept 1 Physically remove the disk drive from the system configuration 3 When the items have been deleted reinstall the disk drive that you have just removed User or service action 42529 Description The fast write cache is inactive The battery is charging The using system has recently been switched on The battery Action The battery is in a fast charge operation It remains in the is still charging fast charge operation for up to one hour after the adapter has been connected to the power During this time the fast write function remains Possible FRUs inactive Inactive means that although fast write disk drives can be Fast Write Cache Option enabled and accessed they are not using the fast write function Card battery 100 If the using system has been switched on for less than one hour wait for the battery to complete charging If the using system has been switched on for more than one hour run diagnostics to the adapter in System Verification mode If the same SRN is generated exchange the FRU for a new FRU 4252A Description The supply voltage to th
15. F1l Help F2 Refresh F3 Cancel F7 Select F8 Image F1O Exit F Enter Do Find n Find Next Select the adapter whose protected member disk drives you want to list Chapter 6 Using the RAID Array Configurator 75 3 A list of protected member disk drives is displayed A COMMAND STATUS D Command OK stdout yes stderr no Before command completion additional instructions may appear below ssal Component Location Size Pool Protected Status hdisk4 raid_10 pdisk13 04 02 REGY 06 P 18 2GB pool_B2 yes good pdisk11 04 02 REGY 08 P 9 2GB pool_B1 yes good pdisk3 04 02 REGY 05 P 9 2GB pool_B2 yes good pdisk6 04 02 REGY 03 P 9 2GB pool_B1 yes good pdisk7 04 02 REGY 01 P 9 2GB pool_B2 yes good pdisk15 04 02 REGY 07 P 18 2GB pool_B1 yes good Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next yf The columns of information displayed on the screen have the following meanings Component The array member disk drive of the hdisk that is listed on the screen Location The physical location code of the array member disk drive Size The size of the array member disk drive This value is useful to know if you have assigned a hot spare disk drive to a pool but the array member disk drive is too large to be protected by the hot spare disk drive Pool The pool to which the array member disk drive is assigned Protected If set to yes this field indicates that if the array member disk driv
16. SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 0 array hdisk4 09523173A02137K good 3 4G RAID 0 array Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next 3 Select the array that you want to delete 272 Advanced SerialRAID Adapters User and Maintenance Information 4 A prompt is displayed in a window a SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool ARE YOU SURE Continuing may delete information you may want to keep This is your last chance to stop before continuing Press Enter to continue Press Cancel to return to the application F1l Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next 5 5 Attention When an array is deleted all the data that is contained in that array is lost At the prompt press Enter if you want to delete the array Press Cancel if you do not want to delete the array 6 When you have deleted the array go to step 13 on page 274 Chapter 14 Removal a
17. SSA links can run at 20 MB per second or at 40 MB per second Normally two SSA nodes that can communicate at 40 MB per second operate the link between them at 40 MB per second Some faults however can cause a 40 MB per second link to run at only 20 MB per second The run_ssa_link_speed program detects when a pair of high speed nodes are running at low speed The following entry is added to the cron table to invoke this program at 04 30 each day 182 Advanced SerialRAID Adapters User and Maintenance Information 30 4 x usr Ipp diagnostics bin run_ssa_link_speed 1 gt dev null 2 gt dev null If the program detects a problem it sends an error code to the system error log You can also use the ssa_speed x command to check whether any high speed nodes are running at low speed see Duplicate Node Test The node_number attribute of the ssar can be set to enable SSA disk fencing or SSA target mode operations It is important however that duplicate node numbers do not exist on the subsystem Each hour therefore the device driver performs a duplicate node number test If this test finds a duplicate node number it logs an error code under the SSA_SETUP_ERROR label The device driver continues to log this error each hour until the problem is solved This test runs separately from the run_ssa_healthcheck The test is run hourly but not at any specific time in the hour Error Logging Management Summary If an error is permanent it is
18. buffer A routine or storage that is used to compensate for a difference in rate of flow of data or time of occurrence of events when transferring data from one device to the other C candidate disk Disk drives that are available for use in an array component The components of a RAID array are the member disk drives that are configured for that array The component of a fast write hdisk is the array or disk drive that is configured for fast write operations contiguous Touching or joining at a common edge or boundary for example an unbroken consecutive series of storage locations D daemon In the AIX operating system a program that runs unattended to perform a standard service Some daemons are triggered automatically to perform their task others operate periodically Synonymous with demon deconfigure To remove a disk drive from being a member of an array Degraded state The state that a RAID array enters if while in the Exposed state it receives a write command See also Exposed state descriptor In the AIX object data manager ODM a named and typed variable that defines one characteristic of an object device driver 1 A file that contains the code needed to use an attached device 2 A program that enables a computer to communicate with a specific peripheral device 3 A collection of subroutines that control the interface between I O device adapters and the processor domain That part
19. smitty lsdssaraid A list is displayed of all hdisks that are configured as RAID arrays If an hdisk that is a RAID 1 RAID 5 or RAID 10 array is using the pdisk you can remove the disk drive from the array Go to step Pon page oval If an hdisk that is a RAID O array is using the pdisk a Ask the customer to make a backup of the data if possible from the array and to make the disk free b Ensure that you delete the array before you exchange the pdisk c Note the hdisk number d Go to step 2i e If the hdisk is not a RAID pdisk a Ask the customer to make a backup of the data if possible from the array and to make the disk free b Ensure that the fast wie function is disabled see c Go to step forage ord Attention You should be here only if you are working with a RAID O array For fast path type smitty rmssaraid and press Enter Otherwise select Delete an SSA RAID Array from the SSA RAID Array menu A list of arrays is displayed in a window 271 SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool
20. 218 222 224 226 228 229 229 229 229 230 230 230 231 232 233 233 233 234 234 235 235 235 236 236 237 237 237 238 238 239 239 240 242 243 244 245 245 246 vii Execution of Target Mode Requests 246 SSA tmssa Device Driver 2 a eee ee 247 PUrDOSE qi Ye Sk ad one Cas Be rk ape oP ak Gd Mee A a ca oe ee Mt 24S Synta Ae he ee Se A ce ei ow eee ek A ere 24 Description noa eh EM na ed a ee Seay eee e Ua 8 eae Configuration Information bh Oye he a oh ge da OR 2 GE 8 oe oe 24S Device Dependent Subroutines 248 Errors 2505 Sep ue ee Boo of He es ay eS ga ee a ee 20D tmssa Special File 2 2 Ms 4 oe eed eee be a we ee a 256 PUFDOSE os E ena Sp Onn Ces Me Ss te te ok eh Ame A og ad eal wa Ge Mr e256 Description be GBB a ee ot eee ad A 256 Implementation Specifics zo ty Sywidl BA ete oe ted eer Boe 2 2256 Related Information yas ed 225 IOCINFO Device Information tmssa Device Driver ioctl Operation sO ee 257 PUFDOSG z tee Ba ee oe ae ee ae oe ee Description bes Be Soap eb Ee ade ee S257 TMIOSTAT Status tmssa Device Driver ioctl Operation eh ie ae ig He e g Purposes 3 Ge ae oR eo ans AS ee do phar le eee Ae Fo 259 Description 5 amp e259 TMCHGIMPARM Change Parameters tmssa Device Driver ioctl Operation 260
21. Run the Certify service aid see the pdisks that you noted previously Did the Certify service aid fail when it was run to a particular disk drive NO to each of a Ask the user to recreate the array b Go to step P2 on page 419 YES a Run the Format service aid see to the disk drive b Run the Certify service aid again to the disk drive Go to step E2 on page 408 Chapter 17 SSA Problem Determination Procedures 407 12 from step ft Did the Certify service aid fail again NO a b YES a b Ask the user to recreate the array Go to step P2 on page 415 Excl hanging Disk Exchange the failing disk drive for a new one see Go to step B2 on page 418 to add the disk drive to the group of disk drives that are available for use by the RAID manager 13 from step n An array is in the Degraded state if one member disk drive of the array is missing or has failed and a write command has been sent to that array When an array is in the Degraded state its data is not protected a Type smitty ssaraid and press Enter b Select Change Show Use of an SSA Physical Disk c Go to step f4 on page 40d 408 Advanced SerialRAID Adapters User and Maintenance Information 14 from step E3 Are any disk drives listed as SSA physical disks that are rejected NO YES A disk drive has not been detected by the adapter Go to step 115 onl Run diagnostics in System Verification mode
22. where systemname is the name of the using system that contains the SSA adapter adaptername is the adapter resource identifier The second column shows the adapter location code for example 04 02 e The third column shows the description of the adapter for example IBM SSA 160 SerialRAID Adapter Chapter 16 SSA Service Aids 331 Note If the adapter name is longer than the description field the name is shortened as shown in the screen above 3 When you have selected an adapter a list is displayed that shows all the devices that are connected to the adapter NK VERIFICATION 802386 D SSA Link Verification for nunu ssa0 04 02 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdisk2 AC7AAO9A 0 12 Good nunu pdisk9 AC7AA2D6 Td Good nunu pdisk8 AC7AAOBD 26 10 Good nunu pdisk3 AC7AAOB1 3 9 Good ssd32 ssa0 A 4 8 nunu pdisk6 AC7AA0B5 5 7 Good nunu pdisk1 AC7AA052 6 6 Good nunu pdisk7 AC7AA0B9 7 5 Good nunu pdisk5 AC7AAOQB3 8 4 Good MORE 3 F3 Cancel F1O Exit 7 The columns of information displayed on the screen have the following meanings e The Physical column lists the devices as they appear on the SSA loop A device can be either a pdisk or an adapter If the device is a pdisk it is listed as systemname pdiskname for example nunu pdisk3 where systemname is the name of
23. AY Sh owe ang A202 Physical Disk Drive Change Attributes bo ee e a a a 203 Action Attributes RAID 1 RAID 5 and RAID 10 Only na ee oe OR Se Gy elg Return Godes lt xoz s 2 8 6 boe ee goe ion m e ew w 205 Chapter 12 Using the Programming Interface 207 SSA Subsystem Overview 2 2 ee eee ee 207 Device Drivers 207 Interface between the SSA Adapter Device Driver and Head Device Driver 208 Trace Formatting 2 ee ee ee eee ee 208 SSA Adapter Device Driver 1 ee ee ee 209 PUMDOSE 22 eee a ee eB oe Oa es ee eae oe 209 SYNAX soe ck HY OP a ae Ee ao Se Ae BE a SO ce Sow 2209 Description D A Bede de Sa a a ae Bey A ae 209 PCI SSA Adapter ODM Attributes win Beta wy aoe Ae TA ad nok ne re fe 4209 Device Dependent Subroutines 210 Summary of SSA Error Conditions 2 211 Managing Dumps ee ee 21 Files 212 IOCINFO Device Information SSA Adapter Device Driver ioctl Operation 2 a 2 218 PUFDOSEY 5 D ie wn te Sn RA Ae da GRD a a a a a aa Go Ba a 213 Description moo ep ye Pe ee Be we ce ee TS Files Pur BV Bel SSA_ TRANSACTION SSA Adapter Device Driver ioctl t Operation A T Purpose woe w 2 amp 214 De ScriptiOn oS 4 eae ee TR a ee we ee aoe oe TY Return Values s er a ee a me ae ee we ee a ATS Files D the Gite Sebo SSA_GET ENTRY_ POINT SSA Adapter Device Dr
24. COMMAND STATUS stdout yes 0004AC5119E000D member 08005AEA030D00D member 08005AEA087A00D member 08005AEA098100D member F2 Refresh F9 Shel stderr no present 1 16 present 2 3G present 4 5G not_present n a F3 Cancel F1O Exit Before command completion additional instructions may appear below Physical disk Physical disk Physical disk Physical disk F6 Command Find 108 Advanced SerialRAID Adapters User and Maintenance Information Listing Hot Spare Disk Drives This option allows you to list the hot spare disk drives that are available to a particular array 1 For fast path type smitty lhssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List Hot Spares 2 A list of adapters is displayed in a window 7 Select the adapter whose hot spare disk drives you want to list List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssaQ Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 F1 Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Fin
25. Fl Help F2 Refresh F3 Cancel F9 Shel F10 Exit Enter Do F8 Image Sooo If you want to enable or disable a fast write attribute for one logical disk drive see If you use the two way fast write function and you want to disable the fast write attribute for a disk drive if the partner adapter becomes not accessible see Chapter 9 Using the Fast Write Cache Feature 167 Enabling or Disabling Fast Write for One Disk Drive This option lets you enable or disable the fast write function for one disk drive 1 For fast path access to the Change Show Characteristics of an SSA Logical Disk menu a Type smitty chgssardsk and press Enter b From the menu displayed select the logical disk that you want to change Otherwise a Select Change Show Characteristics of an SSA Logical Disk from the SSA Logical Disks menu b From the menu displayed select the logical disk that you want to change A list of options for the logical disk drives is displayed ip gt Change Show Characteristics of an SSA Logical Disk Type or select values in entry fields Press Enter AFTER making all desired changes MORE 6 Entry Fields Location Label Parent ssar Size in Megabytes 4512 adapter_a ssa adapter_b ssal primary_adapter adapter_a Connection address 0004AC506C3600E Physical volume IDENTIFIER 00406fdac2fb8203000000 gt ASSIGN physical volume identifier no RESERVE disk on open yes Queue depth 5 Maximum
26. For each pair of connectors identify the data that the loop is to access most frequently 3 Assign the data for each pair of adapter connectors to the disk drives that are connected immediately next to the pair of connectors in the loop Assign the most frequently accessed data to those disk drives that are farthest from the adapter connectors By doing this you prevent the activity of the busiest disk drive from obstructing the data path to the other disk drives For example the loop that is shown in Figure 14 contains 16 disk drives The connectors of adapter A are between disk drives 1 and 16 and the connectors of adapter B are between disks 8 and 9 Therefore e Adapter A should access disk drives 1 through 4 and disk drives 13 through 16 The most frequently accessed data should be on disk drives 4 and 13 Adapter B should access disk drives 5 through 8 and disk drives 9 through 12 The most frequently accessed data should be on disk drives 5 and 12 Disk _ Disk _ Disk _ Disk Disk _ Disk _ Disk _ Disk 1 2 3 4 5 6 7 8 lt x m i g L Q Q yj xe xe lt lt x Disk _ Disk _ Disk _ Disk Disk _ Disk _ Disk _ Disk 16 15 14 13 12 11 10 9 Figure 13 Pairs of Connectors in the Loop Some Shared Data Chapter 2 Introducing SSA Loops 25 Pair
27. OOD e Run the ssacand command and specify the adapter to which the logical disk is connected For example ssacand a ssaQ L If the logical disk is an array you can determine the unique identifier in two ways e lf the logical disk is already defined you can use the Isdev command to determine the unique identity as follows 1 Type Isdev Ccdisk r connwhere and press Enter 2 Select the 15 character unique identifier UID that was given by the RAID configuration program when the array was created e Run the ssacand command and specify the adapter to which the logical disk is connected For example ssacand a ssaQ L Device Attributes SSA logical disks and SSA physical disks and the ssar router have several attributes You can use the Isattr command to display these attributes Aitributes of the SSA Router ssar node_number This attribute must be set on systems that are using the SSA Fencing facility or the SSA Disk Concurrent Mode of Operation Interface facility These facilities of the SSA disk device driver are used only in configurations where the SSA disk drives are connected to more than one using system Therefore in configurations where the SSA disk drives are connected to only one using system the node_number attribute has no effect For configurations that use SSA Fencing or the SSA Disk Concurrent Mode of Operation Interface set the node_number to a different value on each using system that is in th
28. Option Card Install the SDRAM module and if present the Fast Write Cache Option Card onto the a adapter card Install the adapter into the using system see the Installation and Service Guide for the using system Chapter 14 Removal and Replacement Procedures 279 Removing an SDRAM Module of an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts 1 Remove the adapter from the using system see the nstallation and Service Guide for the using system 2 Refer to Figure 36 3 Holding your thumbs against the connector J open the clips by pressing them in the directions shown by the arrows in the diagram This action pulls the SDRAM module H out of the connector 4 Remove the SDRAM module 10 mo Figure 36 Removing the SDRAM Module 280 Advanced SerialRAID Adapters User and Maintenance Information Installing an SDRAM Module of an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization
29. Purpose as e a Ah hen Gs Je ap oe a a Se ab de ar he a oe 260 Description e 2 e Re OR ee ea ee eG 260 Part 2 Maintenance Information 2 268 Chapter 13 SSA Adapter Information 265 Installing the SSA Adapter 2 ee ee ee ee 265 Cron Table Entries 2 2 2 ee ee 265 Microcode Maintenance tiaren OS ty we AWS ot 266 Checking the ID and Level of the Microcode Package Rahi eG a in 8 e266 Maintaining the Adapter Microcode 267 Maintaining the Disk Drive Microcode 267 Vital Product Data VPD forthe SSAAdapter 268 Adapter Power On Self Tests POSTs 268 Chapter 14 Removal and Replacement Procedures 271 Exchanging Disk Drives ee A Ut ph ae Ga ah Br ak Gee Se me aT Changing Pdisk and Hdisk Numbers nook 4 foi Ra oe roy ae oe 278 Removing and Replacing an Advanced SerialRAID Adapter DPS ap te kU er EO Removing an SDRAM Module of an Advanced SerialRAID Adapter 280 Installing an SDRAM Module of an Advanced SerialRAID Adapter 281 Removing the Fast Write Cache Option Card of an Advanced SerialRAID Adapter 283 Installing the Fast Write Cache Option Card of an Advanced SerialRAID Adapter 285 Removing the Battery Assembly from the Fast Write Cache Option Card of an Advanced SerialRAID Adapter 287 Installing a Battery Assembly into the F
30. RAID arrays change attributes 201 RAID arrays creation and change attributes 198 return codes 205 SSARAID command attributes 198 ssa_diag command 298 SSA disk concurrent mode of operation interface 239 device driver entry point 239 top kernel extension entry point 240 SSA disk fencing 242 SSA Disks SMIT menu 40 SSA Disks SMIT menu getting access 40 ssa_elacommand 302 SSA error conditions summary 211 SSA error logs 177 error log analysis detailed description 185 summary 184 error logging detailed description 178 summary 177 error logging management detailed description 183 summary 183 ssa_format command 306 SSA_GET_ENTRY_POINT ioctl operation 216 description 216 files 216 purpose 216 return values 216 ssa_getdump command 308 ssa_identify_cancel command 127 SSA link error problem determination 423 link status ready lights 425 service aid 426 ssa link errors 423 SSA link speed 18 SSA loops configuring devices 18 device unique IDs UIDs 21 disk drive identification 19 finding the physical location of a device 358 large configurations 16 links and data paths 7 loops and data paths examples broken loop cable removed 352 broken loop disk drive removed 355 450 Advanced SerialRAID Adapters User and Maintenance Information SSA loops continued normal loops 350 one loop with two adapters in each of two using systems 12 one loop with two adapters in one using system 11 problem determination 349 rules 22 simple 8 simp
31. The link between pdisk1 and pdisk2 is working at 20 MB per second Each row in the list represents one SSA link 346 Advanced SerialRAID Adapters User and Maintenance Information The Source field represents the link end that is closest to the A1 or B1 port The Destination field represents the link end that is closest to the A2 or B2 port Note The Source and Destination fields have no other meaning They do not indicate data flow The Speed field indicates the operating speed of the link as follows 00 The link is not operational 20 20 MB per second 40 40 MB per second Eigure 47 gives a physical representation of the configuration that is shown on the screen Disk Disk B2 40 MB s 40 MB s 40 MB s 4 5 B1 i Disk Disk Disk ao 40 MBs P _4omp s_ 20 mess P5 _40 mess _ _40 mess 0 1 2 3 A1 Figure 47 Configuration Shown by the Service Aid Chapter 16 SSA Service Aids 347 This screen shows the same configuration but here the link is broken between pdisk1 and pdisk2 NK SPEED 802438 gt SSA Link Speed for systemname ssaQ 00 03 IBM SSA 160 SerialRAID Adapter To set or reset Identify move cursor onto selection then press lt Enter gt Source Speed Destination systemname ssaQ Al 40 systemname pdisk3 systemname pdisk3 40 systemname pdisk2 systemname pdisk2 00 2222 2222 00 systemname pdisk1 systemname pdisk1l 40 systemname pdisk0 systemname pdisk0 40
32. To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 B1 B2 Status TOP nunu pdisk1 AC515E90 0 Good nunu pdisk2 AC515EAB 1 Good 2222 nunu pdisk3 AC515EB1 1 Good nunu pdisk4 AC515EB9 0 Good ganges ssa0 A ON 7 nunu pdisk6 AC51606E 1 6 Good KRKKK 205 Good nunu pdiskO AC506D6E 3 4 Good MORE 4 F3 Cancel F10 Exit Ne BY This example shows that the SSA loop is broken between pdisk2 and pdisk3 and that an unconfigured device is present between pdisk6 and pdiskO b If you have just made changes to or have just switched on the unit in which the disk drive is installed you might need to wait for up to 30 seconds before detailed information about the SSA network becomes available to the service aids 4 When you have solved a problem press the Cancel key to leave the display then press Enter to reselect it The display now shows the new status of the SSA links 334 Advanced SerialRAID Adapters User and Maintenance Information g g j provides more examples of link problems and how to use this service aid to solve them Chapter 16 SSA Service Aids 335 Configuration Verification Service Aid The Configuration Verification service aid enables you to determine the relationship between SSA logical units hdisks and SSA physical disk drives pdisks It also displays the connection information and operational status of the disk drive Notes 1 User applicati
33. a RAID array List the parent object of a member object List all candidate objects that can be used to exchange an existing member of a RAID array object List all candidate objects that can be used to create new RAID array objects Give information about an object such as size and current usage Give information in colon separated format Give information in a summary format Give information for a specified device its members its parents its exchange candidates or its object candidates Give information for all objects of a particular type Limit the list to objects that have particular attribute values Create an object Create a particular type of object that is built from the specified members Assign values for attributes of the created object Create AIX customized device objects for the new object and if required use the option that allows you to specify the AIX device name Delete an object Delete the named RAID object Use the option that allows you to delete the AIX device that is associated with the deleted RAID object Change an object by specifying new values for attributes of that object Perform an action on an object for example swap remove or add disk drives in a RAID array 189 e List the objects that have support from a particular RAID manager List all the types of array objects List all the types of objects that can be create
34. a disk drive or an adapter O object data manager ODM In the AIX operating system a data manager intended for the storage of system data ODM Object data manager ODM Offline state The state that a RAID array enters when two or more member disk drives become missing P page split The separation of amounts of data in preparation for data transfer AIX splits data on page boundaries where a page is 4 KB parameter A variable that is given a constant value for a specified application PCI Peripheral Component Interconnect pdisk Physical disk physical disk The actual hardware disk drive POST Power on self test power on self test POST A series of diagnostic tests that are run automatically by a device when the power is switched on primary half The term that distinguishes one half of a split array The term secondary half distinguishes the other half of the split array R RAID Redundant array of independent disks RAID array In RAID systems a group of disks that is handled as one large disk by the operating system RAID manager The software that manages the logical units of an array system Rebuilding state The state that a RAID array enters after a missing member disk drive has been returned to the array or exchanged for a replacement disk drive While the array is in this state the data and parity are rebuilt on the returned or replacement disk drive Rejected disk A fail
35. array if The Enable Use of Hot Spares attribute is set to yes A hot spare disk drive is available When a hot spare disk drive starts operating its Current Use attribute is changed from Hot Spare Disk to Member of an SSA RAID Array If a member disk drive of an array fails but access to that disk drive is still possible its Current Use attribute is changed from Member of an SSA RAID Array to Rejected For all other changes to the use of a disk drive you must use either the ssaraid commands or the SMIT menus Notes 1 Although this book always refers to the smitty commands you can use either the smitty command or the smit command The procedures that you follow remain the same whichever of the two commands you use If you send the smit command from a graphics terminal however the menus are displayed slightly differently from those shown in this book If you are not familiar with the selection of items from the graphics versions of the menus use the smitty command The menus will then appear as shown in this book 2 If you use fast path commands you might need to go through intermediate steps that are not shown in this book Also some menus might be displayed slightly differently from those shown in this book Chapter 6 Using the RAID Array Configurator 87 Getting Access to the SSA RAID Array SMIT Menu 1 For fast path access to the SSA RAID Array SMIT menus type smitty ssaraid and press Enter Otherwise
36. otherwise an error occurs SSA devices can be maintained concurrently that is they can be removed installed and tested on an SSA loop while the other devices on the loop continue to work normally If a disk drive has its Check light on the pdisk might not be configured If the pdisk is not configured you cannot select Service Mode Under these conditions you can remove the disk drive from the SSA loop without taking any special actions If a disk drive does not have its Check light on the SSA loop that passes through it might still be active although the disk drive itself might not be working You must put that disk drive into Service Mode before you remove it from the SSA loop If you leave the Set Service Mode service aid Service Mode is reset 326 Advanced SerialRAID Adapters User and Maintenance Information To use the Set Service Mode service aid 1 Select Set Service Mode from the SSA Service Aids menu see FStarting the SSA Bervice Aids on page 324 A list of physical disk drives pdisks is displayed a y SET SERVICE MODE 802381 D Move cursor onto selection then press lt Enter gt systemname pdisk0 AC50AE43 2GB SSA C Physical Disk Drive systemname pdisk1l AC706EA3 2GB SSA C Physical Disk Drive systemname pdisk2 AC1DBE11 2GB SSA C Physical Disk Drive systemname pdisk3 AC1DBEF4 2GB SSA C Physical Disk Drive systemname pdisk4 AC5OAE58 2GB SSA C Physical Disk Drive systemname pdisk5 AC7C6E51 2GB
37. reconfigured Run the cfgmgr command before you verify that the new level of microcode is correctly installed 342 Advanced SerialRAID Adapters User and Maintenance Information To use the Display Download Disk Drive Microcode service aid 1 wrcrocove DOWNLOAD 802420 Move cursor onto selection then press Enter Display the Microcode levels of all SSA Physical Disk Drives Select this option to display the microcode levels installed on all Available SSA disk drives Download Microcode to selected SSA Physical Disk Drives Select this option to change the level of microcode that is installed on selected Available SSA disk drives Download Microcode to all SSA Physical Disk Drives Select this option to load the latest level of microcode on all Available SSA disk drives F3 Cancel F1O Exit N m y 2 To display the levels of microcode that are installed on the SSA disk drives select Display the Microcode levels of all SSA Physical Disk Drives A list of pdisks is displayed mrcrocone DOWNLOAD 802421 D To set or reset Identify move cursor onto selection then press lt Enter gt Physical Serial ROSid systemname pdiskO AC51DB47 8877 systemname pdisk1l ACQEDE7F 9292 F3 Cancel F1O Exit Ne D Chapter 16 SSA Service Aids 343 3 Attention For several seconds during microcode download new data is written to the disk drive EEPROM If the power fails while that data is being written the
38. select Service Mode If the Check light of the disk drive that you have put into Service Mode does not come on and you are not sure of the oe of that disk drive use ethe Identify function to help you find it see Chapter 16 SSA Service Aids 329 4 Select a second disk drive if required for example pdisk5 The following display appears again S ser SERVICE MODE 802382 systemname pdisk5 AC7C6E51 4GB SSA C Physical Disk Drive Move cursor onto selection then press lt Enter gt Set or Reset Identify Select this option to set or reset the Identify indicator on the disk drive gt Set or Reset Service Mode Select this option to set or reset Service Mode on the disk drive ENSURE THAT NO OTHER HOST SYSTEM IS USING THIS DISK DRIVE BEFORE SELECTING THIS OPTION F3 Cancel F1O Exit Ne D4 5 Select Service Mode or the Identify function If the original disk drive is to remain in Service Mode you can select only the Identify function now Only one disk drive at a time can be in Service Mode The list of pdisks appears again The pdisk that is in Identify Mode is identified by a ser SERVICE MODE 802381 Move cursor onto selection then press lt Enter gt systemname pdisk0 AC50AE43 2GB SSA C Physical Disk Drive systemname pdisk1 AC706EA3 2GB SSA C Physical Disk Drive systemname pdisk2 AC1DBE11 2GB SSA C Physical Disk Drive gt systemname pdisk3 ACIDBEF4 2GB SSA C Physical Disk Drive
39. systemname pdisk4 AC5QAE58 2GB SSA C Physical Disk Drive systemname pdisk5 AC7C6E51 2GB SSA C Physical Disk Drive systemname pdisk6 AC706E9A 2GB SSA C Physical Disk Drive systemname pdisk7 ACIDEEE2 2GB SSA C Physical Disk Drive systemname pdisk8 amp AC1DBE32 2GB SSA C Physical Disk Drive F3 Cancel F1O Exit Ne A 6 Identify other disk drives in the same way if required 330 Advanced SerialRAID Adapters User and Maintenance Information Link Verification Service Aid The Link Verification service aid helps you determine Which devices are connected to the SSA loop Where an SSA loop has been broken The status of the disk drives on that SSA loop The location of enclosure faults that have been detected by the disk drives on that SSA loop To use the Link Verification service aid 1 2 Select Link Verification from the SSA Service Aids menu see Starting the SSA I The Link Verification adapter menu is displayed Ge VERIFICATION 802385 N Move cursor onto selection then press lt Enter gt nunu ssa 04 02 IBM SSA 160 SerialRAID Adapter nunu ssal 04 04 IBM SSA 160 SerialRAID Adapter nunu ssa2 04 07 IBM SSA 160 SerialRAID Adapter F3 Cancel F1O Exit Select the adapter that you want to test The columns of information displayed on the screen have the following meanings The first column shows the adapter name The format of the adapter name is systemname adaptername for example nunu ssa0
40. systemname pdisk0 AC706E9A 0 Good 2222 Good systemname pdisk10 AC1DBE32 3 Good MORE 4 F3 Cancel F1O Exit X J This example screen shows a break in the SSA loop between the pdiskO and pdisk10 In the condition shown by the display the Ready lights on the pdiskO and pdisk10 are both flashing To help locate these disk drives select the pdisk and press Enter The Check light on the selected disk drive flashes This action does not affect the customer s operations For more information about the service aids see Repair Actions When you have determined the parts of the failing link check whether the cause of the problem is obvious for example a loose cable connection or a disk drive with its 426 Advanced SerialRAID Adapters User and Maintenance Information Check light on If the cause is obvious correct it If the cause is not obvious exchange the parts of the link one at a time until the problem is solved Chapter 17 SSA Problem Determination Procedures 427 428 Advanced SerialRAID Adapters User and Maintenance Information Part 3 Appendixes 429 430 Advanced SerialRAID Adapters User and Maintenance Information Appendix Communications Statements The following statements apply to this product The statements for other products intended for use with this product appear in their accompanying manuals Federal Communications Commission FCC Statement This equipment has been tested and found to comp
41. the loop back into its original working configuration Note t is important that you do these actions because they enable the configuration code to reset itself from the effects of the error 388 Advanced SerialRAID Adapters User and Maintenance Information Review the configuration that you are trying to make and determine why that configuration is not valid Correct your configuration by reconfiguring the SSA cables or by removing the excess devices or adapters from the loop Chapter 17 SSA Problem Determination Procedures 389 SSA Maintenance Analysis Procedures MAPs The maintenance analysis procedures MAPs describe how to analyze a failure that has occurred in an SSA loop How to Use the MAPs Attention Unless the using system needs to be switched off for some other reason do not switch off the using system when servicing an SSA loop Enclosure power cables and external SSA cables that connect the devices to the using system can be disconnected while that system is running e To isolate the FRUs do the actions and answer the questions given in the MAPs e When instructed to exchange two or more FRUs in sequence 1 2 5 Exchange the first FRU in the list for a new one Verify that the problem is solved For some problems verification means running the diagnostic programs see the using system service procedures If the problem remains a Reinstall the original FRU b Exchange the next FRU in the list fo
42. the ssa_ela command sends an error message to stdout such as ssaQ SRN 42500 If no error occurs the command sends no message to stdout A non zero return code indicates an error The command sends an error message to stderr 302 Advanced SerialRAID Adapters User and Maintenance Information ssaencl Command Purpose Syntax Description Flags To allow the monitoring and changing of the status for SSA SES disk enclosures subsystems To display enclosure component settings ssaencl 1 name s v i b card t threshold a f fan d drive bay p PSU o c To modify enclosure component settings ssaencl 1 name I ID U B mode card mode S d drive_bay b card p PSU r c o T threshold value To display a usage message ssaencl h ssaencl The ssaencl command can be used to observe the existing settings of an SSA SES disk enclosure subsystem or to modify the settings of that enclosure The command can be used only to observe or modify settings it cannot be used to observe and modify settings at the same time When the command displays enclosure settings it displays them in tables that the user can read easily If the s flag is specified however the command displays the settings in colon separated format as used by commands such as the SMIT commands name Specifies the name of an SSA SES enclosure or pdisk
43. to determine the best aigan Then go to step lal 9 Select Change Show Delete a Hot Spare Pool 10 Add to the correct hot spare pool the hot spare disk drives that you created in step The number of hot spare disk drives that are now in the assigned pool is less than the specified minimum number Possible FRUs Device 100 49540 Description Adapters that do not provide support for hot spare pools have been detected Action This problem has occurred because the cabling has changed or because an SSA adapter that does not provide support for hot spare pools has been added to the SSA loop 1 If the changes were not planned restore the system to its original configuration If the changes were planned do either of the following actions e Update the microcode to the latest level if the SSA adapter is an Advanced SerialRAID Adapter e For all hot spare pools that are connected to this RAID Manger a Type smitty ssaraid and press Enter b Select Change Show Delete a Hot Spare Pool c Remove all member disk drives from the pool Hot spare disk drives have been assigned to pools other than pool zero but other SSA adapters on the SSA loop are using versions of microcode that do not provide support for spare pools 49800 Description A different adapter has been detected on each loop Action Go to and observe the configuration rules for this adapter Correct the configuration SSA l
44. ucode Holds the file name of the microcode package file that supplies the adapter microcode that is present in an SSA adapter bus _io_ addr Holds the value of the bus I O base address of the adapter registers that the SSA adapter device driver for this adapter will use bus_mem_start Holds the value of the bus memory start address that the SSA adapter device driver for this adapter will use bus_mem_start2 Holds the value of the bus memory start address that the SSA adapter device driver for this adapter will use bus_mem_start3 Holds the value of the bus memory start address that the SSA adapter device driver for this adapter will use bus_mem_start4 Holds the value of the bus memory start address that the SSA adapter device driver for this adapter will use Chapter 12 Using the Programming Interface 209 bus_intr_level Holds the value of the bus interrupt level that the SSA adapter device driver for this adapter will use intr_priority Holds the value of the interrupt priority that the SSA adapter device driver for this adapter will use daemon Specifies whether to start the SSA adapter daemon If the attribute is set to TRUE the daemon is started when the adapter is configured The daemon holds the adapter device driver open although the operating system might not be using that adapter device driver at the time This action allows the adapter device driver to reset the adapter card if the software that is running on it
45. variable is set to EFAULT if an error occurs while the caller data is being copied to the device buffers If the write operation is unsuccessful the return value is set to 1 and the errno global variable is set to the value of the return value from the device driver If the return value is other than 1 the write operation was successful and the return value indicates the number of bytes that were written The caller should validate the number of bytes that are sent to check for any errors Because the whole data transfer length is sent in a single write operation you should suspect that a return code that is not equal to the expected total length is an error File offsets are not applicable and are ignored for target mode write operations If the calling program needs to break a blocked write operation a signal is generated The target mode device driver receives that signal and ends the current write operation The write operation that is in progress fails and the errno global variable is set to EINTR The write operation returns the number of bytes that were already sent before the signal was generated The calling program can then continue by issuing another write operation or an ioctl operation or it can close the device If the write operation that the caller attempts to break completes before the signal is generated the write operation ends normally and the signal is ignored If the buffers of remote using systems are full or no d
46. 1 Type Isdev Ccpdisk r connwhere and press Enter 2 Select the 15 character unique identifier UID for which characters 5 through 12 match the serial number that is on the front of the disk drive e Construct the 15 character unique identifier from the 12 character SSA UID that is shown on the label that is on the side of the disk drive You can recognize the UID by its three character suffix 00D e Run the ssacand command and specify the adapter to which the physical disk is connected For example ssacand a ssaQ P Using mkdev to Configure a Logical Disk To use mkdev to configure an SSA logical disk specify the following information Parent ssar Class disk Subclass ssar Type hdisk ConnectionLocation 15 character unique identifier of the logical disk If the logical disk is a system AIX disk you can determine the unique identifier in three ways e If the logical disk is already defined you can use the Isdev command to determine the unique identity as follows 1 Type Isdev Ccdisk r connwhere and press Enter 2 Select the 15 character unique identifier UID for which characters 5 through 12 match the serial number that is on the front of the disk drive Chapter 12 Using the Programming Interface 221 e Construct the 15 character unique identifier from the 12 character SSA UID that is shown on the label that is on the side of the disk drive You can recognize the UID by its three character suffix
47. 43 Degraded state RAID 10 37 Degraded state RAID 5 33 Delete an SSA RAID Array option 68 detail data formats error logging 181 device attributes 222 device dependent routines tmssa device driver 248 close subroutine 249 ioctl subroutine 253 open subroutine 248 read subroutine 249 select entry point 253 write subroutine 251 device dependent subroutines adapter device driver 210 disk device driver open read write and close subroutines 224 readx and writex subroutines 226 device driver entry point 239 device drivers 207 adapter configuring devices 209 description 209 device dependent subroutines 210 direct call entry point 217 IOCINFO ioctl operation 213 managing dumps 211 open and close subroutines 210 purpose 209 SSA_GET_ENTRY_POINT ioctl operation 216 device drivers 207 continued adapter continued SSA_TRANSACTION ioctl operation 214 summary of SSA error conditions 211 syntax 209 disk configuration issues 218 description 218 device attributes 222 device dependent subroutines 224 error conditions 226 IOCINFO ioctl operation 229 open read write and close subroutines 224 purpose 218 readx and writex subroutines 226 special files 228 SSA disk concurrent mode of operation interface 239 SSADISK_ISAL_CMD ioctl operation 230 SSADISK_ISALMgr_CMD ioctl operation 233 SSADISK_LIST_PDISKS ioctl operation 237 SSADISK_SCSI_CMD ioctl operation 235 syntax 218 interface 208 PCI adapter ODM attributes 209 responsibilities
48. 81 adding disks to a hot spare pool 84 adding to the configuration 58 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RAID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 439 arrays continued deleting an old RAID array recorded in an SSA RAID manager 131 deleting from the configuration 68 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 installing and configuring 56 listing AIX system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 listing all supported SSA RAID arrays 99 listing hot spare disk drives 109 listing old RAID arrays recorded in an SSA RAID manager 129 listing rejected array disk drives 111 113 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks fro
49. Coalesce 0x20000 Enable Fast Write yes Bypass Cache In 1 Way Fast Write Network no BOTTOM F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1Q Exit Enter Do 2 If you want to enable the fast write function for a particular disk drive set the Enable Fast Write option to yes for that disk drive If you want to disable the fast write function for a particular disk drive set the Enable Fast Write option to no for that disk drive Notes a If you are using two way fast write and you enable or disable the fast write function the hdisk on the other using system becomes unavailable Delete the hdisk 1 Type rmdev 1 hdiskname d 2 Run cfgmgr to reconfigure the new hdisk b You can disable the fast write function from this menu only if no data for your selected device is present in the fast write cache If data for your selected 168 Advanced SerialRAID Adapters User and Maintenance Information device is present in the fast write cache and you want to disable the fast write function d to on Chapter 9 Using the Fast Write Cache Feature 169 Enabling or Disabling Fast Write for Multiple Devices This option allows you to enable or disable the fast write function on multiple devices You can select multiple devices from the list that this option displays The displayed list contains also offline and broken cache items so that you can delete them 1 For fast path access
50. Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F10 Exit Enter Do 4 Select yes in the Flash Disk Identification Lights field 5 Press the List key to list the disk drives 6 From the displayed list select the disk drives that you want to identify The Check light flashes on each disk drive that you have selected 122 Advanced SerialRAID Adapters User and Maintenance Information Identifying Array Candidate Disk Drives This option allows you to identify disk drives that are available for adding to an array 1 For fast path type smitty icssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select Identify Array Candidate Disks A list of adapters is displayed in a window a List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the adapter whose candidate disk drives you want to identify Chapter 6
51. Problem Determination Procedures 383 SRN Problem Possible Causes 50422 Description The SSA adapter has detected an SS_TIMEOUT error A Possible FRUs transaction has exceeded its time out SSA adapter card 70 i using system Installation Action This problem can be caused by disk drive errors Run diagnostics 3 e Guide in Problem Determination mode to all the disk drives that are attached to the adapter Device age 7 fEichangind Disk Drives on page 271 If you find any problems solve those problems If you do not find any problems run diagnostics in System Verification mode to the adapter If the diagnostics run successfully go to 88 before you exchange the adapter 50425 Description The SSA aiaiai has detected an Possible FRUs SS_LINK_CONFIG_FAILED error SSA devices cannot be configured zeus 90 fExchangind because one device in the SSA loop is causing link responses that are not valid SSA Sagas card 1 Action Isolate the failing device using system Installation and Service Guide 1 If only one SSA loop is connected to the adapter go to step A If two SSA loops are connected to the adapter disconnect one loop and run diagnostics in System Verification mode to the adapter to determine which loop contains the failing device Then go to step 2 Disconnect the first device on the SSA loop that contains the failing device and run the diagnostics in System Verification mode
52. RAID Array menu A list of arrays is displayed in a window fa a SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09523173A02137K good 3 4G RAID 5 array F1l Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Ne A 2 Select the array that you want to delete 68 Advanced SerialRAID Adapters User and Maintenance Information 3 A prompt is displayed in a window i SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool ARE YOU SURE Continuing may delete information you may want
53. SMIT menus as a rejected disk drive If the disk drive cannot be accessed however it cannot be listed as a rejected disk A disk drive cannot be accessed if its Check light is on or its Power light is off To find rejected disk drives that cannot be accessed go to to determine the cause of the failure To find rejected disk drives that can be accessed do the following procedure 1 For fast path type smitty 1fssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List Rejected Array Disks 2 A list of adapters is displayed in a window A List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks dentify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssaQ Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the adapter whose rejected disk drives you want to list Chapter 6 Using the RAID Array Configurator 89 3 A list of rejected disk drives is displayed A COMMAND STATUS D Command OK stdout yes stderr no Before command completion additional instructio
54. SSA RAID array 68 getting access to the SMIT menu 57 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 configuring and installing SSA RAID arrays 56 continued identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 listing AIX system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 listing all supported SSA RAID arrays 99 listing array candidate disk drives 113 listing hot spare disk drives 109 listing old RAID arrays recorded in an SSA RAID manager 129 listing rejected array disk drives 111 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks from a hot spare pool 84 showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 configuring devices adapter device driver 209 configuring devices on an SSA loop 18 configuring SSA disk drive devices 220 221 using mkdev to configure a logical disk 221 using mkdev to configure a physical disk 221 configuring the Fast Write Cache feature 165 configuring the SSA Target mode 244 correcting or removing failed disk dr
55. Select Service Mode or the Identify function For this example assume that you have selected Service Mode The list of pdisks is displayed again and the disk drive that you selected is marked by a gt which shows that the disk drive is in Service Mode set SERVICE MODE 802381 N Move cursor onto selection then press lt Enter gt systemname pdisk0 AC50AE43 2GB SSA C Physical Disk Drive systemname pdisk1 AC706EA3 2GB SSA C Physical Disk Drive systemname pdisk2 ACIDBE11 2GB SSA C Physical Disk Drive gt systemname pdisk3 ACIDBEF4 2GB SSA C Physical Disk Drive systemname pdisk4 AC50AE58 2GB SSA C Physical Disk Drive systemname pdisk5 AC7C6E51 2GB SSA C Physical Disk Drive systemname pdisk6 AC706E9A 2GB SSA C Physical Disk Drive systemname pdisk7 ACIDEEE2 2GB SSA C Physical Disk Drive systemname pdisk8 ACIDBE32 2GB SSA C Physical Disk Drive F3 Cancel F1O Exit lt Y Notes a You can select only one disk drive at time b If you select Service Mode and the selected disk drive is_not in a closed loop or at the end of a string see selection fails and an error message is displayed Use the Link Verification service aid to identify any open link problems before trying to reselect Service Mode c If you select Service Mode and a file system is mounted on the selected disk drive your selection fails Use the Configuration Verification service aid to determine which hdisk must be have its file system unmounted before you can
56. The possible values are defined in the usr include sys errno h file The conc_cmd pointer argument to the special interrupt handler entry point of the top kernel extension is non null The cmd_op message_code and devno fields are zero DD_CONC_UNLOCK The DD_CONC_UNLOCK device driver entry point has completed The error field in the conc_cmd structure contains the return code that is necessary for the completion of this command The possible values are defined in the usr include sys errno h file The conc_cmd pointer argument to the special interrupt handler entry point of the top kernel extension is non null The cmd_op message_code and devno fields are zero DD_CONC_TEST The DD_CONC_TEST device driver entry point has completed The error field in the conc_cmd structure contains the return code that is necessary for the completion of this command The possible values are defined in the usr include sys errno h file The conc_cmd pointer argument to the special interrupt handler entry point of the top kernel extension is non null The cmd_op message_code and devno fields are zero DD_CONC_RECV_REFRESH A message with message_code was received for the SSA disk drive that is specified by the devno argument The conc_cmd argument is null for this operation DD_CONC_RESET The SSA disk drive that is specified by the devno argument was reset and all pending messages or commands have been flushed The argument conc_cmd is null for this operat
57. a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displayed c Select SSA RAID Arrays The SSA RAID Arrays menu is displayed 4 gt SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool Add an SSA RAID Array Delete an SSA RAID Array Change Show Attributes of an SSA RAID Array Change Member Disks in an SSA RAID Array Change Show Use of an SSA Physical Disk Change Use of Multiple SSA Physical Disks Change Show Delete a Hot Spare Pool F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do X J From the following list find the option that you want and go to the place that is indicated 88 Advanced SerialRAID Adapters User and Maintenance Information Identifying and Correcting or Removing Failed Disk Drives When a disk drive fails the array rejects it If access to the array is still possible the Current Use attribute of the disk drive is changed from Member of an SSA RAID Array to Rejected The disk drive is listed in the
58. a member of the failed array Diagnostics in System Verification mode e Certify service aid 6 If in the previous step you found any disk drive failures correct those failures 7 Tell the customer that the array can now be recreated Possible FRUs Device 100 48900 Description An array is not available multiple devices have failed Action Run diagnostics and the Certify service aid to all the disk drives that were used to create the array If problems occur correct those problems before you attempt to recreate the array None Chapter 17 SSA Problem Determination Procedures 375 SRN Problem Possible Causes 48950 Description A disk drive has caused an array building operation to fail Action 1 2 oong 10 11 12 13 14 15 Type smitty ssaraid and press Enter Select List all Defined SSA RAID Arrays The hdisk that is causing this problem is listed as exposed or degraded Ask the user to make a backup of the data that is on this array Some data might not be accessible Return to the SSA RAID Arrays menu and select List Identify SSA Physical Disks Select List Disks in an SSA RAID Array Select the failing hdisk Note the pdisk numbers of the member disk drives of the failed array Ask the user to delete the array Return to the SSA RAID Arrays menu and select Change Show Use of an SSA Physical Disk Run diagnostics in Syste
59. address can therefore change if the configuration is changed Finding the Device When Service Aids Are Available To help you to find the correct physical disk drive the SSA service aids include an Identify function This function when selected causes the Check light of the selected disk drive to flash It also causes the Subsystem Check light if present of the unit containing the selected disk drive to flash Some devices for example adapters do not have Check lights To find such a device you can either use the Identify function to identify devices that are next to the SSA adapter on the SSA link or use the procedure described in Einding the Device When Finding the Device When No Service Aids Are Available When no service aids are available you must find the device by using the port P and SSA address AA values that are provided by some service request numbers SRNs Examples of these SRNs are 43PAA 44PAA and 45PAA The port P values are related to the port connectors of the adapter Connector A1 Connector A2 Connector B1 Connector B2 on o nou ou The AA value is the decimal SSA address value It indicates the position of the device that you are trying to find counted along the SSA loop Use the port value to locate the relevant connector on the SSA adapter then follow the SSA cable to the first rea device Include other adapters as real devices if they are in the same SSA link Do not include dummy devic
60. any other hot spare pool Allow Hot Spare Splits If you select no for this option the RAID manager does not attempt to use hot spare disk drives to replace missing members when a RAID 1 or RAID 10 array is split exactly in half and all the primary or secondary member disk drives of that array are present It is recommended that this option be set to no if the RAID 1 or RAID 10 array is configured to protect against the loss of a physical domain Allow Page Splits If you enable page splits data that is being written to the array is split into 4096 byte pages The pages are then written in parallel to the member disk drives of the array These actions increase the general speed of write operations to the array although the pages are written in a random sequence If you disable this option the data is written sequentially but the general speed of write operations is decreased The sequence in which data is written to the array might be critical to the program that is using the data if an error occurs during the write operation Initial Rebuild When a RAID 1 or a RAID 10 array is first created the data that is contained in the primary member disk drive of the array is different from the data that is contained in the secondary disk drive of the array When data is written to the array it is written both to the primary disk drive and to the secondary disk drive The data that is on the secondary disk drive is therefore a mirrored cop
61. are system disks Select the pdisk from the list Change the Current Use parameter to Hot Spare Disk or to Array Candidate Disk Note It is the user who should make the choice of Current Use parameter That choice should be Hot Spare Disk if the use of hot spares is enabled for the RAID arrays on the subsystem Array Candidate Disk if the use of hot spares is disabled for the RAID arrays on the subsystem 276 Advanced SerialRAID Adapters User and Maintenance Information 28 You have now finished installing the disk drive Go no further with these instructions Chapter 14 Removal and Replacement Procedures 277 Changing Pdisk and Hdisk Numbers Pdisk and hdisk numbers are assigned automatically when the using system is configured To help in system administration it is sometimes useful to change these numbers If you want to change the numbers use the following procedure 1 Find the pdisk or hdisk number that you want to change and select a new unused name Give the command lsdev C1 disknumber Fconnwhere where disknumber is the pdisk or hdisk number for example pdiskO that you want to change The command returns a ConnectionLocation number for example 004AC5119E000D Make a note of this number you will need it later in this procedure Give the command lsdev C1 disknumber Ftype where disknumber is the pdisk or hdisk number for example pdiskO that you want to change The c
62. are configured Flags a AdapterName Specifies the adapter whose connection locations are to be listed P Produce a list of possible connection locations for physical disks L Produce a list of possible connection locations for logical disks 294 Advanced SerialRAID Adapters User and Maintenance Information ssa_certify Command Purpose Syntax Description Flags e To certify the physical disk drive so that data can be read from or written to the disk drive without problems e To certify a RAID 5 array to determine whether any array logical block addresses LBAs have been as unreadable ssa_certify 1 pdisk n MaxReadSize a ssa_certify 1 hdisk b StartLBA c If the ssa_certify command is issued to a pdisk it uses the ISAL_Read ISAL_Write or ISAL_Characteristics command to certify the disk drive It returns 0 unless a nonmedia related problem occurs If such a problem occurs the ssa_certify command prints a message to stderr If a media related problem occurs and the disk drive can perform automatic reassign operations the command attempts to reassign soft error blocks If the attempt to reassign the soft error blocks fails if the block has a hard media error or if the disk drive cannot perform automatic reassign operations the ssa_certify command returns 0 but prints to stdout the LBA of the failing block in decimal followed by the word Failed For example gt ssa_certify 1 pdisk4 4
63. be detected can now be detected 3 The half of the array that could originally be detected can no longer be detected and data is written to it 4 The half of the array that could originally be detected can now be detected again Chapter 7 Split Site Management 159 RAID 10 Array Split shows a RAID 10 array that has been split into halves Split Array Resolution Split Array Resolution Primary System 1 SSA Adapter Primary 1 Primary 2 Figure 32 Forcing Access on a RAID 10 Array Primary Secondary 1 System 2 SSA Adapter Secondary 2 160 Advanced SerialRAID Adapters User and Maintenance Information The Split Array Resolution flag has been set to Secondary to permit I O operations to be performed on the secondary half of the array Only user actions can set this condition Separate write operations can be performed to each half of the array If these write operations are performed however the two halves of the array must not be reconnected RAID 10 Array with Unsynchronized Data System 1 SSA Adapter Figure 33 Reconnecting an Unsynchronized Array shows a RAID 10 array whose halves have been reconnected Split Array Resolution Split Array Resolution Primary 0011 1110 1010 0000 1110 0001 1111 0100 Primary System 2 1111 0000 0000 0001 SSA Adapter Secondary 1 0001 0101 0101 1110 Secondary 2
64. be equal to or greater than the size of the initiator mode device buffer size The SSA interface for target mode transfers has been tuned for 512 byte transfers Each write operation can send as much data as is required unless that write operation is nonblocking In a nonblocking write operation the data that is being written must be completely transferred to the device buffers Therefore the maximum amount of data that can be written during a nonblocking write operation is determined by the size of the device buffers Understanding Target Mode Data Pacing An initiator mode device can send data faster than the associated target mode device application can read it This condition occurs when The previous write operation is complete but all the device buffers are in use and no space is available for the next write operation e The write operation is not yet completed and the device has no available buffers In both these instances the target mode device driver stops the write operation temporarily and uses the retry mechanism to try again later These actions can cause Chapter 12 Using the Programming Interface 245 the write operation to fail As a result the initiator mode device is unable to send any data to the target mode device for the whole of the retry period Alternatively the write operation might time out Think about these possibilities when you set the buffer sizes and the number of buffers for the devices Det
65. cables Action Exchange the FRUs for new FRUs Internal SSA connections 5 enclosure service information 40000 Description The SSA adapter card has failed Possible FRUs o SSA adapter card 100 Action Exchange the FRU for a new FRU using system Installation and Service Guide 362 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 40016 Description A 16 MB SDRAM in the adapter card module has failed Action Exchange the FRUs for new FRUs Possible FRUs 16 MB SDRAM module SDRAM Mod Advanced SerialRAID Adapter on page 280 SSA adapter card 1 using system nstallation and Service Guide 40064 Description A 64 MB SDRAM in the adapter card module has failed Action Exchange the FRUs for new FRUs Possible FRUs 64 MB SDRAM module 99 Bemoving an SDRAM Module of ar Advanced SerialRAID Adapter on page 280 SSA adapter card 1 using system nstallation and Service Guide 40128 Description A 128 MB SDRAM in the adapter card module has failed Action Exchange the FRUs for new FRUs Possible FRUs 128 MB SDRAM module 99 Removing an Advanced SerialRAIO Adapter on page 280 SSA adapter card 1 using system nstallation and Service Guide 42000 Description Either no SDRAM module is present on the adapter card or the POST cannot determine the size of the existing SDRAM module
66. contains values from the usr include ipn ipntra h file A non zero value indicates an error u scsi data_descriptor Set by the caller to describe the buffer for any data that is transferred by the SCSI command If no data is transferred the length of the buffer should be set to 0 u0 scsi direction Set by the caller to indicate the direction of the transfer Valid values are SSADISK_SCSIDIRECTION_NONE No data transfer is involved for the command SSADISK_SCSI_DIRECTION_READ Data is transferred from the subsystem into the using system memory SSADISK_SCSI_DIRECTION_WRITE Data is transferred from the using system memory into the subsystem u0 scsi identifier Identifies the SSA SCSI logical unit number to which the command should be sent The format of this field is as defined for SSA_SCSI bit 7 1 identifies the Target routine bits 6 0 identify the Logical Unit routine Chapter 12 Using the Programming Interface 235 u0 scsi cdb Set by the caller to define the SCSI Command Descriptor Block CDB for the command u scsi cdb_length Set by the caller to indicate the length of the CDB u scsi scsi_status Contains the SCSI status that is returned for the command The device driver does not know the contents of the CDB The driver only passes on the CDB to the hardware See the relevant hardware documentation to determine what CDBs are valid for a particular SSA physical disk Return Values Files If the command was
67. deciding how to configure hot spare disk drive pools 43 rules for hot spare disk drive pools 50 solving hot spare pool problems 51 hot spare pool adding anew one 81 hot spare pool adding disk to or removing disks from 84 hot spare pool changing or showing the status 72 hot spare pool listing the disks 78 hot spare pool showing the disks 75 hot spare pool creation and change attributes 202 housekeeping 188 iassaraid command 125 icssaraid command 123 identification of disk drives 19 Identify AIX System Disks option 125 Identify Array Candidate Disks option 123 Identify Disks in an SSA RAID Array option 117 Identify function 323 Identify Hot Spares option 119 Identify Rejected Array Disks option 121 identifying and correcting or removing failed disk drives 89 identifying SSA Devices location code format 19 identifying SSA Devices continued pdisks and hdisks 19 unique IDs UIDs 21 IEEE SSA unique ID UID 21 ifssaraid command 90 121 inssaraid command 119 indicators Advanced SerialRAID Adapter type 4 P 6 installing a battery assembly into the fast write cache card 289 installing an SDRAM module 281 installing and configuring SSA RAID arrays 56 adding a disk drive to an SSA RAID array 138 adding a new hot spare pool 81 adding an SSA RAID array 58 adding disks to a hot spare pool 84 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RA
68. device driver 218 continued configuring SSA disk drive devices 220 logical and physical disks and RAID arrays 218 multiple adapters 219 device attributes 222 attributes common to logical and physical disks 223 attributes for logical disks only 223 attributes of the SSA router ssar 222 error conditions 226 special files 228 ssadload command 300 ssadlog command 167 ssaencl command 303 ssafastw command 170 ssaidentify command 311 ssaraid command 57 88 96 SSARAID command attributes 198 action attributes 204 hot spare pool creation and change attributes 202 physical disk change attributes 203 RAID arrays change attributes 201 RAID arrays creation and change attributes 198 ssavfynn command 318 ssaxlate command 319 starting the service aids 324 states of arrays RAID O 31 Good 31 Offline 31 states of arrays RAID 1 32 states of arrays RAID 10 36 Degraded 37 Exposed 37 Good 36 multiple 38 Offline 37 Rebuilding 37 Unknown 38 states of arrays RAID 5 33 Degraded 33 Exposed 33 read operations while in 33 write operations while in 33 flowchart 35 Good 33 initial rebuilding operation 34 Offline 34 Rebuilding 34 adapter replacement 34 disk drive replacement 34 summary of SSA error conditions 211 Swap Members in an SSA RAID Array option 140 switching off using systems in a large configuration 17 switching on using systems in a large configuration 17 swpssaraid command 135 T takeover adapter 219 Target Mode 243 targ
69. disk device driver is an example The SSA adapter device driver sends commands for SSA devices to the adapter that is related to those devices When the SSA adapter device driver detects that the commands have completed it informs the originator of the command Responsibilities of the SSA Disk Device Driver The SSA disk device driver provides support for the SSA disk drives that are connected to an SSA adapter That support consists of Standard block I O to SSA logical disks which are represented as hdisks Character mode I O to SSA logical disks which are represented as rhdisks e Error reporting from SSA physical disks which are represented as pdisks e Diagnostics and service interface to SSA physical disks that are represented as pdisks e Re issue of commands in the event of an adapter reset 207 Interface between the SSA Adapter Device Driver and Head Device Driver To communicate with the SSA adapter device driver the SSA head device driver 1 Uses the fp_open kernel service to open the required instance of the SSA adapter device driver 2 Calls the fp_ioctl kernel service to issue the SSA_GET_ENTRY_POINT operation to the opened adapter 3 Calls the function SSA_Ipn_Directive whose address was returned by the ioctl operation These calls to SSA_Ipn_Directive are used for all communication with the SSA device 4 Uses the fp_close kernel service to close the adapter Note When fp_close is called SSA_Ipn_Directive c
70. does not have root privilege ENOMEM Indicates not enough memory ENOSPC Indicates not enough file blocks EFAULT Indicates bad user address dev ssa0 dev ssa1 dev ssan Chapter 12 Using the Programming Interface 215 SSA_GET_ENTRY_POINT SSA Adapter Device Driver ioctl Operation Purpose To allow another kernel extension typically a SSA head device driver to determine the direct call entry point for the SSA adapter device driver This operation is the entry point through which the head device driver communicates with the adapter device driver The address that is supplied is valid only while the calling kernel extension holds an open file descriptor for the SSA adapter device driver This operation is not valid for a user process Description The arg parameter specifies the address of a SSA_GetEntryPointParms_t structure in kernel address space The SSA_GetEntryPointParms_t structure is defined in the usr include sys ssa h file On completion of the operation the fields in the SSA_GetEntryPointParms_t structure are modified as follows EntryPoint Address of the direct call entry point for the SSA adapter device driver which is used to submit operations from a head device driver InterruptPriority The off level interrupt priority at which the calling kernel extension is called back for completion of commands that are started by calling the direct call entry point Return Values When completed successful
71. drive becomes available e The Split Array Resolution flag is set to Secondary Split Array Resolution Primary System 2 SSA Adapter Secondary 1 Figure 24 Dual Host System with Only One System Switched On 152 Advanced SerialRAID Adapters User and Maintenance Information Split Systems The system can become split because communications have failed between the two systems System 1 Split from System 2 igure 25 shows system 1 split from system 2 Split Array Resolution Split Array Resolution Primary Primary System 1 System 2 SSA Adapter SSA Adapter Primary 1 Secondary 1 Primary2 Secondary 2 Figure 25 System 1 Split from System 2 On system 1 the array is in the Exposed or the Degraded state On system 2 the array is in the Offline state and SRN 48750 is generated The array remains in the Offline state on system 2 until The two systems are reconnected e The Split Array Resolution flag is set to Secondary Attention You must set the Split Array Resolution flag to Secondary on both halves of the array if you need access from system 2 This action ensures that write operations can be performed only on the secondary half of the array If data had been allowed to be written to both halves of the array the data would become unsynchronized If the two halves are later reconnected and the Split Array Resolution flag is set differently on the primary and sec
72. drives for the named object Information is presented in summary format You can find the object types argument for the t option if you type the following command gt ssaraid Yc 1 ssaQ where ssa0 is the name of the RAID manager Instruct Types You can give the following instruct type as an argument to the i option when that option is used with the A option exchange 192 Advanced SerialRAID Adapters User and Maintenance Information Examples For the examples given here assume that the following items of hardware are available in the system A RAID Manager named ssa0 e Four SSA physical disks named pdiskO pdisk1 pdisk2 and pdisk3 Example 1 To Create a RAID 0 Array This example shows how to use three SSA physical disks to create a RAID 0 array The attributes of the disks are all set to their default values Type the command gt ssaraid C 1 ssa0 t raid_ s pdisk pdiskl pdisk2 d where C specifies that this is a create operation 1 ssa0 specifies that RAID Manager ssa0 is to be used t raid_ specifies that a RAID 0O array object is to be created s pdisk specifies the free pdisk that is to become the member disk of the new array d specifies that an AIX system disk is to be attached to the new array Example 2 To Create a RAID 1 Array This example shows how to use two SSA physical disks to create a RAID 1 array The attributes of the disks are all set to their default values Type the
73. following a b c d Type smitty ssaraid and press Enter Select Delete an SSA RAID Array Select the array that is in the Offline state and delete it All data that is on that RAID array is now lost You must now locate and repair any failed disk drives and make those disk drives available for the creation of a new array Go to ee e If no disk drives have been added to this system go to step Z on page 405 404 Advanced SerialRAID Adapters User and Maintenance Information 7 from step B The array data cannot be recovered The following steps clear the error condition and change the disk drives to a usable state a Type smitty ssaraid and press Enter b Select Change Show Use of an SSA Physical Disk Are any disk drives listed as SSA physical disks that are rejected NO YES e Go to MAP Ask the user to delete and recreate the array that is in the Offline state Run diagnostics in System Verification mode to all the disk drives that are listed as rejected Run the Certify service aid see to all the disk drives that are listed as rejected If any problems occur exchange the failed disk drives for new disk drives see Go to step ern add the disk drive to the group of disk drives that are available for use by the RAID manager Note A disk drive that is listed as rejected is not necessarily failing For example the array might have rejected the disk drive because a power problem or an S
74. h file A non zero value indicates an error TransactionResult Contains the IPN result word that is returned by IPN for the transaction This contains values that are defined in the usr include ipn ipntra h file A non zero value indicates an error ParameterDDR Set by the caller to indicate the buffer for parameter data TransmitDDR Set by the caller to indicate the buffer for transmit data ReceiveDDR Set by the caller to indicate the buffer for received data 214 Advanced SerialRAID Adapters User and Maintenance Information StatusDDR Set by the caller to indicate the buffer for status data TimeOutPeriod Number of seconds after which the transaction is considered to have failed A value of 0 indicates no time limit Note If an operation takes longer to complete than the specified time out the adapter is reset to purge the command Attention This is a very low level interface It is for use only by configuration methods and diagnostics software Use of this interface might result in system hangs system crashes system corruption or undetected data loss Return Values Files When completed successfully this operation returns a value of 0 Otherwise a value of 1 is returned and the errno global variable is set to one of the following values EIO Indicates an unrecoverable I O error ENXIO_ Indicates an unknown device EINVAL Indicates an unknown command Indicates a bad buffer type EACCESS Indicates user
75. half of the array to remain available This action prevents two using systems writing different data to the separate halves of the array The Split Array Resolution flag determines whether the primary or secondary side of the array can operate when some of the configuration disks are not available Normally the Split Array Resolution flag is reset When the Split Array Resolution flag is reset and the secondary configuration disk can be accessed but no primary configuration disk drive can be accessed by an adapter the array goes into the Offline state to that adapter Note In the ssaraid command the Split Array Resolution Flag is known as split_resolution When the Split Array Resolution flag is set and the secondary configuration disk drive can be detected access to the array is permitted If the Split Array Resolution flag is set and the secondary configuration disk cannot be detected the array goes into the Offline state The Split Array Resolution flag affects initialization of the array e If an array appears with the Split Array Resolution flag set only member disk drives from the secondary half of the array are accepted If member disk drives from the primary half of the array appear they are exchanged into the array and a rebuilding process begins These actions are logged for each primary disk drive If all the member disk drives for the primary half of the array appear and they are rebuilding or they have completed rebuild
76. in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa RAID Array Type raid_5 Member Disks Enable Use of Hot Spares yes Member Disks Move cursor to desired item and press F7 ONE OR MORE items can be selected Press Enter AFTER making all selections Disks in Loop B are pdiskO 0004AC506C2900D free n a 4 5GB Physical Disk pdisk1 0004AC5119E000D free n a 4 5GB Physical Disk pdisk2 Q004AC7COOE800D free n a 4 5GB Physical Disk pdisk3 0004AC9C00E700D free n a 1 1GB Physical Disk F1 Help F2 Refresh F3 Cancel F7 Select F8 Image F1Q Exit Enter Do Find n Find Next The disks selected must all be on the same loop P If a list of disk drives is displayed and the list contains enough disk drives for the array you are creating go to step If no list is displayed or the list does not contain enough disk drives go to 42 for a description of how to assign disk drives as array candidates When you have enough candidate disk drives return to step Ponpa in this section 66 Advanced SerialRAID Adapters User and Maintenance Information 6 Select the disk drives that you want in the array You must select a minimum of Two disk drives if you are creating a RAID 0 array One primary and one secondary disk drive if you are creating a RAID 1 array e Three disk drives if you are creating a RAID 5 array Two primary and two secondary disk drives if yo
77. it It is therefore available for any new arrays that are to be created Specify also the u option If you use the ssaraid command with the I option to display information about a physical disk drive the following values for the use attribute can also be displayed member The disk drive is a member of an array rejected The disk drive was a member of an array It was rejected from the array because it reported a problem You cannot change the use of member disk drives You must first remove the disk drives from their array either by deleting the array or by exchanging them out of the array with the A and i exchange options of the ssaraid command You can assign new uses to disk drives that have been rejected You must however first check the disk drives to find the cause of the problem fastwrite on off default off This attribute enables and disables the fast write cache When using the fast write cache you can use the following attributes to control the operation of the cache fw_start_block default 0 See the definition for fw_end_block fw_end_block default array size This attribute and the fw_start_block attribute control the range of blocks for Chapter 11 Using the SSA Command Line Interface for RAID Configurations 203 which the fast write cache is enabled Write operations that are outside the default range of 0 through array size write data directly to the disk and do not use the fast write cache fw_m
78. loop configuration the START MAP for the enclosure in which the device is installed If no problem problem is found go to 7XXXX Description An SSA device is missing from the expected canfioutalien of An SSA enclosure diagnostic the SSA loop has detected a missing disk drive Action Go to the service information for the enclosure in which the missing device should be installed Note In this SRN an X represents a digit 0 through F 8XXXX Description SRNs in this range are used by the SSA enclosure Not applicable subsystem Action Go to the service information for your SSA enclosure Note In this SRN an X represents a digit 0 through F D0000 Description SRNs in this range are not adapter SRNs Not applicable to DOFFF Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem D4000 Description The diagnostics cannot configure the SSA adapter Possible FRUs ae SSA adapter card 100 Action Exchange the FRU for a new FRU using system Installation and Service Guide D4100 Description The diagnostics cannot open the SSA adapter Possible FRUs Action Exch he FRU f FRU SSA adapter card 100 ction Exchange we Or TON using system Installation and Service Guide D4300 Description The diagnostics have detected an SSA adapter POST failure Possible FRUs Action Exch he FRU f FRU SSA adapter card 100 ction Exchange ue OEN using system Installation and Service Guide D
79. make use of this ability by setting the SSA router node_number attribute if multiple adapters are to be configured as described here Configuring SSA Disk Drive Devices SSA disk drives are represented in AIX as SSA logical disks hdisk0 hdisk1 hdiskn and SSA physical disks pdisk0 pdisk1 pdiskn The properties of each are described in the SSA Subsystem Overview Normally the system boot process automatically configures all the disk drives that are connected to the using system You do not need to take any action to configure them Because SSA devices might be added to the SSA network while the using system is running and online you might need to configure SSA disks after the boot process has completed Under these conditions use the cfgmgr command to configure the devices An exception is to configure a specific device with a specific name You can do this with the mkdev command 220 Advanced SerialRAID Adapters User and Maintenance Information Using mkdev to Configure a Physical Disk To use mkdev to configure an SSA physical disk specify the following information Parent ssar Class pdisk Subclass ssar Type You can list the types by typing Isdev P c pdisk s ssar ConnectionLocation 15 character unique identifier of the disk drive You can determine the unique identifier in three ways e If the disk drive is already defined you can use the Isdev command to determine the unique identity as follows
80. member disk drive The hot spare disk drive must also have the size of the smallest member disk drive so that it can be exchanged for the failing disk drive Chapter 11 Using the SSA Command Line Interface for RAID Configurations 199 read_only_when_exposeds true false default false With the attribute set to false If the array enters the Exposed state and write operations are made to the array e The first write operation causes the array to enter the Degraded state The written data is not protected If another disk drive in the array fails or the power fails during a write operation data might be lost While the array is in the Degraded state however operations to the array continue e The rebuilding operation that runs on the replacement disk drive takes a long time to complete With the attribute set to true e lf the array enters the Exposed state and hot spare disk drives are not enabled the array operates in read only mode until the failing disk drive is exchanged for a replacement drive e lf the array enters the Exposed state and hot spare disk drives are enabled a hot spare disk drive is added to the array when the first write operation to that array is attempted If no suitable hot spare disk drive is available the array operates in read only mode spare_preferred default true This attribute is used with the spare attribute With the attribute set to true a hot spare disk drive is selected only from the
81. new disk drives the data is rebuilt and the array changes its state to the Good state ue the failed disk drive for a new one see Type smitty ssaraid and press Enter Select Change Member Disks in an SSA RAID Array Select Swap Members of an SSA RAID Array Select the degraded hdisk Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you reinstalled or selected in step ied When failed disk drives have been exchanged for new disk drives the data is rebuilt and the array changes its state to the Good state 17 from step n 410 Advanced SerialRAID Adapters User and Maintenance Information A RAID 5 array is in the Exposed state when one member disk drive of the array is not available to the array A RAID 1 or RAID 10 array is in the Exposed state when one or more mirrors are exposed A mirror is exposed when one disk drive in the mirror pair is not available to the array If the missing disk drives are returned to the array the array enters the Good state No data rebuilding is necessary If data is written to an array that is in the Exposed state that data is not protected and the array goes into the Degraded state see Je 29 for more information Command line parameters are available that allow you to prevent such write operations a Type smitty ssaraid and press Enter b Select Change Sh
82. node with which you are communicating The xx can be either im initiator mode interface or tm target mode interface The caller uses the initiator mode to transmit data and the target mode interface to receive data When the caller opens the initiator mode special file a logical path is set up This path allows data to be transmitted The user mode caller issues a write writev writex or writevx system call to start sending data The kernel mode user issues an fp_write or fp_rwuio service call to start sending data The SSA target mode device driver then builds a send command to describe the transfer and the data is sent to the device The data can be sent as a blocking write operation or as a nonblocking write operation When the write entry point returns the calling program can access the transmit buffer When the caller opens the target mode special file a logical path is set up This path allows data to be received The user mode caller issues a read readv readx or readvx system call to start receiving data The kernel mode caller issues an fp_read or fp_rwuio service call to start receiving data The SSA target mode device driver then returns data that has been received for the application program The SSA target mode device driver allows an initiator mode device to get access to the data transfer functions through the write entry point it allows a target mode device to get access through the read entry point The only rules t
83. of a computer network in which the data processing resources are under common control DMA Direct memory access E EEPROM Electrically erasable read only memory enclosure A device or unit that contains disk drives A disk subsystem for example a 7133 Exposed state The state that a RAID array enters if a member disk drive becomes missing logically or physically from that array 435 F Failed status The disk drive is not working fencing SSA disk fencing is a facility that is provided in the SSA subsystem It allows multiple using systems to control access to a common set of disk drives flag A character that shows that a particular condition exists FRU Field replaceable unit G GB Gigabyte gigabyte GB 1000000000 bytes Good state The state of a RAID array when all its member disk drives are present H hdisk A logical unit that can consist of one or more physical disk drives pdisks An hdisk in an SSA subsystem might therefore consist or one pdisk or several pdisks An hdisk is also known as a LUN hot spare disk drive A spare disk drive that is automatically added to a RAID array to logically replace a member disk drive that has failed hot sparing The process by which a spare disk drive is automatically added to a RAID array to logically replace a member disk drive that has failed interface Hardware software or both that links systems programs or devices IOC
84. of a set of commands that allow a program to control and access a storage device The ISAL command set is described in the Technical Reference for the adapter The SSADISK_ISAL_CMD operation allows the caller to issue an ISAL command to a selected logical or physical disk drive The caller must be root or have an effective user ID of root to issue this ioctl The following ISAL commands minor function codes that are defined in the usr include ipn ipnsal h file can be issued FN_ISAL_Read FN_ISALWrite FN_ISAL_ Format FN_ISAL_Progress FN_ISAL_Lock FN_ISAL_Unlock FN_ISAL_Test FN_ISAL_SCSI FN_ISAL_ Download FN_ISAL_ Fence Notes 1 Some of these commands are not valid for SSA hdisks but are valid for SSA pdisks others are valid for SSA hdisks but are not valid for SSA pdisks The adapter card not the device driver checks whether the commands are valid If the caller attempts to send a command to a device for which that command is not valid the adapter returns a non zero result The exception to this procedure occurs when any attempt is made to send a FN_ISAL_Fence command to a SSA physical disk The device driver rejects any such attempt with EINVAL 2 The adapter rejects the FN_ISAL_SCSI command with a non zero result if that command is sent to a device that has not been opened with the SSADISK_SCSIMODE extension parameter The arg parameter for the SSADISK_ISAL_CMD ioctl is the address of an ssadisk_ioctl_parms s
85. open or is not an initiator mode minor device number If a nonblocking write operation the transfer length is too long or the time out period is zero If the transfer length is too long try the operation again with a smaller transfer length If the time out period is zero use TMCHGIMPARM to set the time out value to another value EAGAIN A nonblocking write operation could not proceed because not enough buffer space was available Try the operation again later EIO One of the following I O errors occurred An error that cannot be produced again The number or retried operations reached the limit that is specified in TM_MAXRETRY without success on an error that cannot be reproduced The target mode device of the remote node is not initialized or open 252 Advanced SerialRAID Adapters User and Maintenance Information Do the appropriate error recovery routine ETIMEDOUT The command has timed out Do the appropriate error recovery routine ioctl Subroutine The following ioctl operations are provided by the target mode device driver Some are specific to either the target mode device or the initiator mode device All require the respective device instance be open for the operation run IOCINFO Returns a structure defined in the usr include sys devinfo h file TMCHGIMPARM Allows the caller to change some parameters that are used by the target mode device driver for a particular device instance TMIOSTAT Allows the c
86. reported each time that the health check is run If an error is intermittent it is logged each time that it occurs Because a particular error need be logged only a defined number of times for the automatic error log analysis to determine that service activity is needed the device driver stops the repeated logging of the same error If error logging were not managed in this way a repeated error could fill the error log and hide other errors that other components in the system might have logged If error logging management is active for one type of error a different type of error can still be sent to the error log All types of error are therefore logged Detailed Description Error logging management is performed for the following error types DISK_ERR4 SSA_HDW_ERROR SSA_CACHE_BATTERY SSA_HDW_RECOVERED SSA_CACHE_ERROR SSA_LINK_ERROR SSA_DEGRADED_ERROR SSA_LINK_OPEN SSA_DETECTED_ERROR SSA_LOGGING_ERROR SSA_DEVICE_ERROR SSA_REMOTE_ERROR SSA_DISK_ERR1 SSA_SETUP_ERROR SSA_DISK_ERR4 SSA_SOFTWARE_ERROR If one of these error types is permanent on a particular device it is reported each time that the health check is run The SSA adapter sends the resulting error log entries to the device driver The device driver error logger permits these error log entries to be sent on to the AIX error log until the number of entries for that error reaches a Chapter 10 SSA Error Logs 183 Adapter sends predetermined threshold value After that value
87. shows an example configuration that has two loops and two adapters Adapter SSA Disk Drives Adapter Figure 9 Two Loops with Two Adapters Chapter 2 Introducing SSALoops 15 Large Configurations Up to eight SSA adapters can be connected in a particular SSA loop and up to 48 disk drives can be included in that loop Figure 10 shows an example of a large configuration that has eight adapters in eight using systems Adapter Adapter Adapter SSA Disk Drives Adapter Adapter Adapter Adapter Figure 10 A Large Configuration of Thirty Two Disk Drives Connected to Eight SSA Adapters in Eight Using Systems Figure 11 shows an example of a large configuration that has eight adapters in four using systems
88. side that does not have the correct data The HotSpareSplits parameter can be used to control if Hot Spares are introduced when exactly half the member disk drives of an array are missing In a split site configuration when one site loses access to the other it may be desirable in that situation for Hot Spares not to be introduced when half the disks are no longer visible When HotSpareSplits is off and all the secondary disks and the other adapter are not 148 Advanced SerialRAID Adapters User and Maintenance Information visible Hot Spares are not introduced If Split Array Resolution has been set on secondary disks only are being used and HotSpareSplits is off Hot Spares are not introduced when all the primary disks and the other adapter are not visible Three types of array management problems can cause an array to be in the Offline state to the using system e One half of the array is not present e The adapter is not known to the remaining half of the array e The split and join procedure was not performed correctly This section describes those problems gives examples of possible causes and recommends recovery actions One Half of the Array Is Not Present This condition produces SRN 48750 This type of problem can be caused by e Disk drive failure e Power failure in the using system e Communication problems between two systems on the SSA network Chapter 7 Split Site Management 149 Single Host System with Primary D
89. smitty ssaraid and press Enter b Select Change Show Use of an SSA Physical Disk from the SSA RAID Arrays menu Are any disks listed as SSA physical disks that are rejected NO Go to step B4 on page 416 YES a Run diagnostics in System Verification mode to all the disk drives that are listed as rejected b Run the Certify service aid see to all the rejected disk drives c Go to step bd from step bah Is any disk drive failing NO A disk drive that is listed as rejected is not necessarily failing For example the array might have rejected the disk drive because a power problem or an SSA link problem caused that drive to become temporarily unavailable Under such conditions the disk drive can be reused If you think that a disk drive has been rejected because it is failing check the error log history for that disk drive For example if you suspect pdisk3 type on the command line ssa_ela 1 pdisk3 h 5 This command causes the error log for pdisk3 to be analyzed for the previous five days If a problem is detected an SRN is generated Go to step P4 on page 414 YES a are the areo disk drive for a new one see b Go to step B2 on page 418 to add the disk drive to the group of disk drives that are available for use by the RAID manager Chapter 17 SSA Problem Determination Procedures 415 24 from steps bd and a Type smitty ssaraid and press Enter b Select List All SSA RAID Arrays Connected
90. ssa0 is to be used t spare_pool specifies that a spare pool is to be created n pool_B1 specifies the name of the hot spare pool that is to be created The format of the name must match the pool_XY format where X defines the SSA loop and has a value A or B and Y is a number 1 through 31 s pdisk specifies the free pdisk that is to become the member disk of the hot spare pool Valid members are RAID array member disk drives and hot spare disk drives Note Not all RAID managers provide support for the hot spare pool function Example 6 To List All Defined SSA Objects This example shows how to list all the defined SSA objects that are at present connected in summary format to a particular RAID manager Type the command gt ssaraid I z 1 ssaQ where I specifies that this is a list operation z specifies that the output is to be presented in summary format t raid_5 specifies that a RAID 5 array object is to be created 1 ssa0 specifies that all SSA objects that are connected to RAID Manager ssa0 are to be listed A result similar to that shown here is displayed pdiskO 0004AC506C4000D member n a 4 5GB Physical disk pdiskl 0004AC506D6D00D member n a 4 5GB Physical disk pdisk2 0004AC50A44200D member n a 2 3GB Physical disk pdisk3 0004AC515EA400D free n a 4 5GB Physical disk hdisk5 900335FE80C84CK good 9 0GB RAID 5 array Example 7 To Change an Attribute of an Object This example shows how to change an attrib
91. switched off for more than seven days or if the Fast Write Option Card battery has been disconnected clear the contents of the fast write cache type the command ssa_format 1 AdapterName where AdapterName is the name of the adapter that contains the fast write cache for example ssa0 If the Fast Write Option Card has not been switched off exchange it for a new one 4 Ask the customer to re enable the Fast Write option for the devices that are attached to the reformatted or new Fast Write Option Card Possible FRUs Fast Write Cache Option 42523 Description The Fast Write Cache Option Card has a bad version number Action Install the correct adapter microcode for this cache card User or service action 366 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 42524 Description A fast write disk drive or drives contains unsynchronized data but the Fast Write Cache Option Card cannot be detected The disk drive or drives is offline Action If the Fast Write Cache Option Card has been removed reinstall it and test the disk drive subsystem If the Fast Write Cache Option card has failed 1 Ask the customer to disable the Fast Write option for Each device for which the Fast Write option is offline All other devices that are connected to the failing adapter and have the Fast Write option enabled For ins
92. system ree es system A1 at a2 R81 e2 B2 A1 at a2 Bet e2 B2 Disk Disk Disk Disk Disk Disk Disk Disk 16 15 14 13 12 11 10 9 Disk Disk Disk Disk Disk Disk Disk 1 2 4 5 6 7 8 Figure 51 Broken Loop Disk Drive Removed For this example the Link Verification service aid displays the following information 356 Advanced SerialRAID Adapters User and Maintenance Information Nk VERIFICATION 802386 N SSA Link Verification for systemname ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP systemname pdisk11 AC50AE43 0 Good systemname pdisk8 AC706EA3 1 Good 22222 systemname pdisk3 AC1DBEF4 4 Good systemname pdisk7 AC50AE58 3 Good systemname pdisk12 AC7C6E51 2 Good systemname pdiskO AC706E9A il Good systemname pdisk1 AC1DEEE2 0 Good systemname pdisk10 AC1DBE32 On 17 Good MORE 7 F3 Cancel F10 Exit ie A Note that the missing disk drive pdisk8 is represented by a line of question marks Chapter 16 SSA Service Aids 357 Finding the Physical Location of a Device The physical location of a device for example a disk drive or an SSA adapter cannot be reported directly by the using system because of the way in which the SSA interface works The address of an SSA device is related to the position of that device on the SSA loop The
93. the Error Threshold Alarm Level for a Hot Spare Pool Rules for Hot Spare Disk Drive Pools Hod tA Solving Hot Spare Pool Problems Chapter 6 Using the RAID Array Configurator Installing and Configuring SSA RAID Arrays Getting Access to the SSA RAID Arrays SMIT Menu Adding an SSA RAID Array p a ee Deleting an SSA RAID Array Creating a Hot Spare Disk Drive Changing or Showing the Status of a Hot Spare Pool Showing the Disks That Are Protected by Hot Spares Listing the Disks That Are in a Hot Spare Pool Adding a New Hot Spare Pool Adding Disks to or Removing Disks from a Hot Spare Pool iv Advanced SerialRAID Adapters User and Maintenance Information 27 27 29 29 29 30 31 31 31 32 33 33 33 33 34 34 35 36 36 37 37 37 37 38 38 39 39 40 42 43 43 49 49 50 51 55 56 57 58 68 70 72 75 78 81 84 Dealing with RAID Array Problems Getting Access to the SSA RAID Array SMIT Menu Identifying and Correcting or Removing Failed Disk Drives Installing a Replacement Disk Drive Using Other Configuration Functions Getting Access to the SSA RAID Array SMIT Menu Listing All Defined SSA RAID Arrays Listing All Supported SSA RAID Arrays Listing All SSA RAID Arrays That Are Connected to a RAID Manager Listing the Status of All Defined SSA RAID Arrays oe Aah Listing or Identifying SSA Physical Disk
94. the Identify function The service aids display the serial numbers of the devices By checking the serial number label on the device you can verify that the correct device has its Check light flashing Note Normally you can reset the Identify function by selecting to switch it off from inside a service aid display or by leaving that particular service aid display If however you remove or switch off a disk drive that has the Identify function set the function remains set on that disk drive When you reinstall or switch on the disk drive the disk drive Check light continues to flash Under these conditions you can reset the Identify function by either of the following methods Type on the command line ssaidentify 1 pdiskName n e Select the Link Verification service aid for that disk drive Chapter 16 SSA Service Aids 323 Starting the SSA Service Aids To start the SSA service aids 1 Start the using system diagnostics see the Diagnostic Information for Multiple Bus Systems manual and go to the Diagnostic Operating Instructions Follow the instructions to select Function Selection Select Task Selection from the Function Selection menu Select SSA Service Aids from the Tasks Selection list The SSA Service Aids menu is displayed ssa SERVICE AIDS 802380 D Move cursor onto selection then press Enter Set Service Mode Link Verification Configuration Verification Format Disk Certify Disk Display Dow
95. the SSA adapters and disk drives 3 Report the problem to your support center The center can tell you whether you have a known problem and can if necessary provide you with a correction for the software or microcode If the support center has no known correction for the SRN exchange for new FRUs the FRUs that are listed in the SRN SSA Loop Configurations that Are Not Valid Note This section is related to SRN 48000 SRN 48000 shows that the SSA loop contains more devices or adapters than are allowed The maximum numbers allowed depend on the pa pepe ao ca describes these details for each adapter If the SRN occurred when you or the customer switched on the using system 1 Switch off the using system 2 Review the configuration that you are trying to make and determine why that configuration is not valid 3 Correct your configuration by reconfiguring the SSA cables or by removing the excess devices or adapters from the loop 4 Switch on the using system Service Hint Cables can easily become crossed If you still have problems disconnect all the cables from the SSA adapter then reconnect them one at a time For each cable that you reconnect run the Link Verification service aid see to check whether the configuration is as you expect If the SRN occurred because additional devices or adapters were added to a working SSA loop 1 Remove the additional devices or adapters that are causing the problem and put
96. the stand alone diagnostics are available go to the problem determination procedures for the enclosure that contains the disk drives Chapter 17 SSA Problem Determination Procedures 391 3 from step B Run the diagnostics in Problem Determination mode Did the diagnostics produce an SRN NO Go to step H in YES Go to step 392 Advanced SerialRAID Adapters User and Maintenance Information MAP 2320 SSA Link This MAP helps you to isolate FRUs that are causing an SSA loop problem between a device and the SSA adapter or between two devices If you are not familiar with SSA before using this explains SSA links strings and loops Attention Unless the using system needs to be switched off for some other reason do not switch off the using system when servicing the SSA loop Enclosure power cables and external SSA cables that connect the devices to the using system can be disconnected while that system is running i Are the system service aids available NO Go to B YES Go to step ek 2 from step i Are any Ready link status lights flashing on this SSA loop NO YES Go to 3 from step i Run the Link Verification service aid see k and select the appropriate SSA adapter from the ceed Link Verification adapter menu If the service aid detects pdisks for the adapter you have selected a list of pdisks is displayed The diagram shows an example list Chapter 17 SSA Problem Determination Procedures 393
97. the two lugs are under the edges of the small slots H and the clip E is over the larger slot JJ Carefully press the battery assembly downward until the clip latches under the edge of the slot Reinstall the Fast Write Cache Option card see Reinstall the eer into the using Jay Gee the Installation and Service Guide for the using system Note The battery on the Fast Write Cache Option Card might be fully discharged If it is the diagnostics fail and generate SRN 42529 see Numbers SENs on paga 26S While the battery is discharged the adapter can be used the Fast Write Cache feature however remains disabled until the battery is charged The battery becomes fully charged approximately one hour after the adapter is connected to the power You must now reset the battery age counter To do this go to the command line and type the command ssa_format 1 SSA Adapter b where SSA Adapter is the name of the adapter onto which you have installed the Fast Write Cache Option Card for example ssa0 290 Advanced SerialRAID Adapters User and Maintenance Information Part Numbers e Advanced SerialRAID Adapter card without SDRAM module and without Fast Write Cache Option card 09L2090 e 64 MB module 09L2104 e 128 MB module 08J0663 e Fast Write Cache Option Card 09L2105 e Fast write cache battery O9L5609 Chapter 14 Removal and Replacement Procedures 291 292 Advanced SerialRAID Adapters User and Maintenance Inform
98. the using system fails at the site that contains the secondary member disk drive the using system that has access to the primary configuration disk drives continues to operate e Ifthe using system that has access to the primary configuration disk drives fails and the primary configuration disk drives also fail only the site that contains the secondary configuration disk drives remains operational Normally the using system that is at the secondary site is not allowed access to the array To allow this using system access to the array the user must use the RAID array configurator to set a flag that allows the using system to operate on only the secondary disk drives A RAID 10 array can be in one of several states A knowledge of those states is useful when you are configuring your arrays The states are described here A RAID 10 array is in the Good state when All the member disk drives of that array are present e No member disk drive is deconfigured e Read and write operations can be done on the array e No rebuilding operations need to be done The array is fully protected from the loss of multiple member disk drives if one copy of the mirrored data is still available Some unsynchronized records might still be under repair 36 Advanced SerialRAID Adapters User and Maintenance Information Exposed State A RAID 10 array is in the Exposed state when member disk drives are missing but still configured Read and write operations c
99. the using system to which the pdisk is connected adaptername is the physical disk drive resource identifier If the device is an adapter it is listed as systemname adaptername loop for example ssd32 ssa0 A where systemname is the name of the using system that contains the SSA adapter adaptername is the adapter resource identifier loop is the loop connection A indicates that the adapter is connected through ports A1 and A2 B indicates that the adapter is connected through ports B1 and B2 332 Advanced SerialRAID Adapters User and Maintenance Information e The Serial column lists the serial numbers of the pdisks This column is blank if the device is an adapter e The Adapter Port column shows the address of each adapter port to which a particular device is connected The device is connected to two ports except when the SSA loop is broken under which condition the device is connected to only one port e The Status column shows the existing status of the physical disk drive as known by the adapter Status conditions are Good The disk drive is working correctly Failed The disk drive has failed Power The disk drive has detected an enclosure fault Format The disk drive is being formatted An SSA link must be configured in a loop around which data can travel in either direction The loop is broken if a cable fails or is removed or if a disk drive fails Because each disk drive on the loop can be accessed from either d
100. to a RAID Manager c List the arrays that are connected to each SSA Adapter Are any arrays listed with a status other than Good or Rebuilding NO Go to step l YES Go to step Lon page 404 25 from step B4 a Type smitty ssaraid and press Enter b Select List Status Of All Defined SSA RAID Arrays c Select in turn each type of array that is used on your subsystem and press Enter Do any listed arrays have Invalid Data Strips NO Go to step bal YES Go to step Lan page 4021 26 from step bs Do any RAID 5 arrays have Unsynced Parity Strips or Unbuilt Data Strips NO Go to step b7 on page 417 YES The rebuilding operation is running or has stopped before completion a Note the number of unsynced parity strips and unbuilt data strips b Press the Cancel key to leave the status display c Wait for a few moments then reselect the status display d Again note the number of unsynced parity strips and unbuilt data strips If the numbers are lower than those that you noted earlier the rebuilding operation is running Wait for the rebuilding operation to complete before you continue If the numbers have not changed the rebuilding operation has stopped e If this is the first time you have been through this step while solving this particular problem return to step Fan paga 40a Otherwise 1 Delete the array see Deleting an 2 Run the Certify service aid see to each member disk drive the repair 41
101. to all the disk drives that are listed as rejected Run the ada service aid see to all the disk drives that are listed as rejected If ine occur on any disk drive exchange that disk drive for a new disk drive see Exchanging continue from step 14el in this procedure A disk drive that is listed as rejected is not necessarily failing For example the array might have rejected the disk drive because a power problem or an SSA link problem caused that drive to become temporarily unavailable Under such conditions the disk drive can be reused If you think that a disk drive has been rejected because it is failing check the error log history for that disk drive For example if you suspect pdisk3 type on the command line ssa_ela 1 pdisk3 h 5 This command causes the error log for pdisk3 to be analyzed for the previous five days If a problem is detected an SRN is generated Type smitty ssaraid and press Enter Select Change Show Use of an SSA Physical Disk and for all disks that you have tested or exchanged change the Current Use to Array Candidate Disk Select Change Member Disks in an SSA RAID Array Select Swap Members of an SSA RAID Array Select the degraded hdisk Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you tested or exchanged in step iai When failed disk drives have been e
102. to operate if e The member disk drive that holds the configuration sector in the secondary half of the array is available and e Neither of the member disk drives that hold configuration sectors in the primary half of the array is available Multiple States Different member disk drives of a RAID 10 array can be in different states For example one mirrored pair might be rebuilding while in a different pair one member disk drive is missing and the remaining member is in the Degraded state A priority of array states of the different members is used when the state of an array is reported highest priority first Unknown Offline Exposed Degraded Rebuilding OVP ON a An error is logged whenever the state of an array changes unless the state changes to Good or Rebuilding 38 Advanced SerialRAID Adapters User and Maintenance Information Chapter 4 Using the SSA SMIT Menus This chapter describes how to use the system management interface tool SMIT to display and change characteristics of the SSA devices and to access various service functions Three SSA menus are available through the SMIT Devices menu SSA Adapter SSA Disks SSA RAID Arrays Getting Access to the SSA Adapters SMIT Menu 1 For fast path access to the SSA RAID Array SMIT menus type smitty ssaa and press Enter Otherwise a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displa
103. to protect such parts If you are exchanging a new SDRAM for a failed SDRAM ensure that new SDRAM is the same size as the old SDRAM Refer to the label on each SDRAM 1 Refer to Figure 37 2 a i i l i l l v m f 1 I i 1 I 1 1 I 1 I I 1 i 1 I I 1 1 1 i I I 1 I if 1 I I 1 I x i TTT TTT TTT lat TTT Tal TT Figure 37 Checking the Clips Slots and Guides 2 Ensure that the clips are fully open 3 Hold the SDRAM module so that its slots J align with the guides E of the connector Chapter 14 Removal and Replacement Procedures 281 4 Refer to Figure 38 i Sat Ta E Figure 38 Installing the SDRAM Module 5 Carefully insert the SDRAM module into the connector 6 Press strongly on the module until it is fully home Close the clips by pivoting them in the directions shown by the arrows in the diagram You hear a click when the clips are fully closed If you cannot close
104. use the openx subroutine call set the ext parameter to 0 because the call does not use it 210 Advanced SerialRAID Adapters User and Maintenance Information Summary of SSA Error Conditions If an open or ioctl subroutine that has been issued to an SSA adapter fails the subroutine returns 1 and the global variable errno is set to a value from the file usr include sys errno h Possible errno values for the SSA adapter device driver are EINVAL An unknown ioctl was attempted or the parameters supplied were not valid EIO An I O error occurred ENOMEM The command could not be completed because not enough real memory or paging space was available ENXIO The requested device does not exist Managing Dumps The SSA adapter device driver is a target for the system dump facility The DUMPQUERY option returns a minimum transfer size of 0 bytes and a maximum transfer size that is appropriate for the SSA adapter To be processed calls to the SSA adapter device driver DUMPWRITE option should use the arg parameter as a pointer to the SSA_loreq_t structure which is defined in usr include sys ssa h Using this interface commands for which the adapter provides support can be run on a previously started opened target device The SSA adapter device driver ignores the uiop parameter Note Only the SsaMCB MCB_Result field of the SSA_loreq_t structure is set at completion of the DUMPWRITE During the dump no support is provided for err
105. 0 AC51DB47 00 02 Al 0 Good 00 02 A2 al Good F3 Cancel F1O Exit A If you select a pdisk a list of hdisks is displayed CONFIGURATION VERIFICATION 802392 R systemname pdiskO AC51DB47 4GB SSA C Physical Disk Drive Move cursor onto selection then press lt Enter gt systemname hdisk2 AC51DB47 SSA Logical Disk Drive Good F3 Cancel F10 Exit J Note If you select the hdisk from this screen the hdisk configuration is displayed Chapter 16 SSA Service Aids 337 Format Disk Service Aid The Format Disk service aid formats SSA disk drives Attention Formatting a disk drive destroys all the data on that disk drive Use this procedure only when instructed to do so by the service procedures To use the Format Disk service aid 1 Select Format Disk from the SSA Service Aids menu see FStarting the SSA 4 A list of pdisks is displayed Format DISK systemname pdisk11 AC50AE43 systemname pdisk8 AC706EA3 systemname pdisk2 AC1DBE11 systemname pdisk3 AC1DBEF4 systemname pdisk7 AC50AE58 systemname pdisk12 AC7C6E51 systemname pdisk0 AC706E9A systemname pdisk1l AC1DEEE2 systemname pdisk10 AC1DBE32 F3 Cancel F1O Exit Move cursor onto selection then press lt Enter gt 802395 9 1GB SSA C Physical Disk Drive 9 1GB SSA C Physical Disk Drive 4GB SSA C Physical Disk Drive 4GB SSA C Physical Disk Drive 9 1GB SSA C Physical Disk Drive 9 1GB SSA C Physical Disk Drive 4GB SSA C Physical Disk Drive 4GB SS
106. 15 Icssaraid 113 Ifssaraid 89 111 Ihssaraid 109 Is_hsm_array_components 78 Is_hsm_array_status 75 Is hsm_status 72 Isdssaraid 98 Isidssaraid 106 Ismssaraid 100 Issaraid 107 Isssaraid 99 Istssaraid 102 mkssaraid 58 nvrssaraid 128 redssaraid 136 Index 441 commands continued rmssaraid 68 smit smitty 57 88 96 167 ssa_certify 295 ssa_diag 298 ssa_ela 302 ssa_format 306 ssa_getdump 308 ssa_identify_cancel 127 ssa_progress 312 ssa_rescheck 313 ssa_servicemode 315 ssa_speed 316 ssaadap 293 ssacand 294 ssaconn 297 ssadisk 299 ssadload 300 ssadlog 167 ssaencl 303 ssafastw 170 ssaidentify 311 ssaraid 57 88 96 ssavfynn 318 ssaxlate 319 swpssaraid 135 configuration information tmssa device driver 248 configuration of RAID 1 and RAID 10 arrays split site management 147 Configuration Verification service aid 336 configuring and installing SSA RAID arrays 56 adding a disk drive to an SSA RAID array 138 adding a new hot spare pool 81 adding an SSA RAID array 58 adding disks to a hot spare pool 84 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RAID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 deleting an old RAID array recorded in an SSA RAID manager 131 deleting an
107. 160 SerialRAID Adapter 14109100 F1 Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the adapter whose AIX system disk drives you want to list Chapter 6 Using the RAID Array Configurator 115 3 A list of AIX system disk drives is displayed COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below pdisk3 0004AC5119E000D system 1 1G Physical disk pdisk5 08005AEA030D00D system 2 3G Physical disk Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next 116 Advanced SerialRAID Adapters User and Maintenance Information Identifying the Disk Drives in an SSA RAID Array This option allows you to identify the disk drives that are contained in a particular array 1 For fast path type smitty issaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select Identify Disks in an SSA RAID Array 2 A list of arrays is displayed in a window a List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks SSA RAID Array Move cursor to desired item and press Enter
108. 23173A02137K good 3 4G RAID 5 array F1l Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Ne A Select the array from which you want to remove a disk drive 136 Advanced SerialRAID Adapters User and Maintenance Information 3 The following information is displayed Remove a Disk from an SSA RAID Array D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa0 SSA RAID Array hdisk3 Connection Address Array Name 095231779F0737K Disk to Remove Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image aba F1O Exit Enter Do D Press the List key to list the disk drives 4 From the displayed list select the disk drive that you want to remove 5 Physically remove the disk drive from the subsystem see the Operator Guide or Service Guide for the unit Chapter 6 Using the RAID Array Configurator 137 Adding a Disk Drive to an SSA RAID Array This option allows you to install a replacement disk drive into a RAID 5 array that is running in the Exposed or Degraded state because a disk drive has been rejected or removed from the array You cannot use this procedure to add a disk drive to a RAID 1 or RAID 10 array When you install the replacement disk drive all the data that was contained on the original disk drive is automatically written to the replacement disk drive 1 For fast path type smitty addssar
109. 36537676 Failed If the disk drive cannot perform automatic reassign operations 1 Stop all operations to the disk drive 2 Use the a flag and rerun the Certify operation If the certify operation is successful the ssa_certify command returns no output If the ssa_certify command is issued to a RAID 5 hdisk that contains LBAs that have been marked as unreadable an LBA or an LBA count is printed to stout For example gt ssa_certify 1 hdisk2 12288 failed gt ssa_certify 1 hdisk2 c 4 pdisk Specifies the physical disk drive pdisk that the user wants to certify a Enables the reassign action on devices that cannot already perform automatic Chapter 15 Using the SSA Command Line Utilities 295 reassign operations You must not use this flag when the ssa_certify command is running concurrently on an active using system n MaxReadSize Specifies the maximum size in kilobytes of each read command that is sent to the disk drive Default size for this flag 3072 kilobytes Minimum value that can be specified for this flag 64 kilobytes Maximum value that can be specified for this flag 10240 kilobytes Larger values for the MaxReadSize can cause other requests to be delayed if the ssa_certify command is run concurrently on an active using system b StartLBA Specifies the RAID 5 array LBA from where the certify operation should start If this flag is not set the certify operation starts from LBA 0 C Specifies tha
110. 44XX Description The diagnostics have detected that the SSA adapter has Possible FRUs corrupted the microcode but cannot download a new version of the microcode Action Exchange the FRU for a new FRU Note In this SRN an X represents a digit 0 through F SSA adapter card 100 using system nstallation and Service Guide Chapter 17 SSA Problem Determination Procedures 385 SRN Problem Possible Causes D6PAA Description A high speed SSA link is running at low speed This error is Possible FRUs logged when the run_ssa_link_speed cron runs the ssa_speed utility External SSA cables 30 Action 30 h Internal connections in 1 oo J before you exchange any the device enclosure 30 enclosure service 2 If the SSA service aids are available run the Link Speed service aid information Devies 30 Exchanging ee Disk Drives on page 271 If the SSA service aids are not available note the oo of PAA in this SSA adapter Card 10 SRN and go to using system nstallation page 358 Then go to PSSA Link Enos on page 429 1 solve the and Service Guide problem DFFFF Note The description and action for this SRN are valid only if you have Software error run diagnostics to the SSA attachment If this SRN has occurred because you have run diagnostics to some other device see the service Possible FRUs information for that device SSA adapter card 100 E usi
111. 5 RAID 1 Failure of a Host System and a Primary Disk Drive Figure 28 shows system 2 disconnected from system 1 The array is in the Offline state If you set Split Array Resolution to Secondary the array goes into the Good state Split Array Resolution Primary System 2 SSA Adapter Secondary 1 Figure 28 RAID 1 Failure of a Host System and a Primary Disk Drive RAID 10 Failure of a Host System and a Primary Disk Drive Figure 29 shows system 2 disconnected from system 1 The array is in the Offline state If you set Split Array Resolution to Secondary the array goes into the Good state Split Array Resolution Primary System 2 SSA Adapter Secondary 1 Secondary 2 Figure 29 RAID 10 Failure of a Host System and a Primary Disk Drive 156 Advanced SerialRAID Adapters User and Maintenance Information Array is Offline because Adapter Is Not Known to the Remaining Half of the Array When this condition exists the host system generates SRN 48755 To maintain data consistency SSA RAID 1 and RAID 10 arrays keep a record of the adapters to which they are connected If exactly one half of the array is connected to a different adapter the array remains in the Offline state unless you take specific action to make the array available This type of problem can be caused by e Incorrect reconfiguration of an array Simultaneous failure of an SSA adapter and a disk drive Fai an Adapt
112. 5 files 236 purpose 235 return values 236 syntax 218 disk drive microcode maintenance 267 disk drives failed identifying correcting and removing 89 finding the physical location 358 formatted on different types of machine 336 identification 19 not in arrays 30 reservation of 27 unique IDs UIDs 21 disk fencing 242 Display Download Disk Drive Microcode service aid 342 dumps managing 211 duplicate node test error logging 183 E enabling or disabling Fast Write for multiple devices 170 enabling or disabling Fast Write for one disk drive 168 error codes for service aids 349 error conditions disk device driver 226 error log analysis detailed description 185 command line error log analysis 187 error log analysis routine 186 run_ssa_elacron 187 summary 184 error log analysis routine 186 error logging detailed description 178 detail data formats 181 duplicate node test 183 run_ssa_healthcheck cron 182 run_ssa_link_speed cron 182 summary 177 tmssa device driver 255 error logging management detailed description 183 summary 183 exchanging adapters and Rebuilding state RAID 5 34 exchanging disk drives 271 execution of Target Mode requests 246 Exposed state RAID 10 37 Exposed state RAID 5 33 read operations while in 33 write operations while in 33 exssaraid command 93 140 F fast write cache card installing 285 removing 283 fast write cache card battery assembly installing 289 power 165 removing 287 Fast Write
113. 6 Invert the adapter card so that its components are upward 7 Carefully unplug the Fast Write Cache Option card H from the connector E 284 Advanced SerialRAID Adapters User and Maintenance Information Installing the Fast Write Cache Option Card of an Advanced SerialRAID Adapter Attention The adapter card contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts 1 Remove the adapter from the using system if not already removed see the Installation and Service Guide for the using system 2 Place the adapter card with its components upward onto a nonconducting surface 3 Refer to Eigure 41 o o Figure 41 Installing the Fast Write Cache Option Card 4 Carefully plug the Fast Write Cache Option Card into the connector Ei Ensure that you push the cache card fully home 5 Invert the adapter card so that its components are downward Chapter 14 Removal and Replacement Procedures 285 6 Refer to Figure 42 Figure 42 Installing the Mounting Screw of the Fast Write Cache Option Card 7 Install the mounting screw J and tighten it fully The screw is supplied with the
114. 6 Advanced SerialRAID Adapters User and Maintenance Information 27 28 29 from step Be Have disk drives been going into the rejected state with no other failure indications NO Go to step YES This problem can occur if an array is accessed before all the member disk drives are available Verify that using system procedures ensure that the power system switches on power to all the disk drives before or when it switches on the power to the using system from step Z Was SRN 46000 logged but no error found when diagnostics were run in System Verification mode NO Go to step YES An array was in the Offline state but is now available Verify that using system procedures ensure that the power system switches on power to all the disk drives before or when it switches on the power to the using system from step bah Was SRN 49100 logged but no error found when diagnostics were run in System Verification mode NO Go to step 0 on page 418 YES An array was in the Exposed state but is now in the Good state This problem might have occurred because a disk drive was temporarily removed from the system Verify that using system procedures ensure that the power system switches on power to all the disk drives before or when it switches on the power to the using system Chapter 17 SSA Problem Determination Procedures 417 30 from step B9 on page 417 a Type smitty ssaraid and press Enter b Select List S
115. 68 170 172 173 173 175 175 177 177 177 178 183 183 183 184 184 185 Vv Good Housekeeping 2 ee ee ee ee ee 188 Chapter 11 Using the SSA Command Line Interface for RAID Configurations 189 Command Syntax 2 ee ee ee 19 OPIIONS iy e eS he ie He ES i See te a a Ge Sr ee ee ee OA Object Types 3 Lius 4 8 Ue ih ee Bone eae ee A ee a a we oe a 192 Instruct TlypeS os a ays a ogee ee ek Eade ae eee Ce 8 oy 192 Examples se sa d 4b od RR PA ok Bees hoe ce ee a HOB Example 1 To Create a RAID OArray 2 eee ee 198 Example 2 To Create a RAID 1 Array 2 2 2 2 eee 198 Example 3 To Create a RAID 5 Array 2 2 we 194 Example 4 To Create a RAID 10 Array 2 ee ee 194 Example 5 To Create a Hot Spare Pool 195 Example 6 To List All Defined SSA Objects 2 195 Example 7 To Change an Attribute of an Object sie 195 Example 8 To Exchange a Member Disk Drive of an Existing Array p a a of IQS Example 9 To Make a New AIX System Disk 196 Example 10 To Delete an Array 1 1 ee eee 197 SSARAID Command Attributes gh Nae Ay setae Sty a te od Ue QB RAID Arrays Creation and Change Attributes by as te eed a ee ed ce re fe AES RAID Arrays Change Attributes LT ew eee NGL 8 2O Hot Spare Pool Creation and Change Attribute Ba oy fe dhs
116. 7340C228635K cache_data_error 2 3GB RAID 5 array hdisk3 2327340C423235K cache_data_error 36 4GB RAID 5 array pdisk5 O8005AEA045E00D cache_data_error 9 1GB Physical disk This output shows the name of the device if available the 15 digit SSA serial number the device state and the device size and type The location of the corrupted data is not known and no simple data recovery procedure is possible To attempt data recovery you must disable the fast write cache then make the devices available again Chapter 9 Using the Fast Write Cache Feature 173 e To disable the fast write cache type ssaraid 1 ssaX H n Y a fastwrite off a force yes u where X is the number of the adapter that has reported the failure and Y is the name of the device The name of the device can be either the logical disk name or the SSA serial number A typical command line might be therefore ssaraid ssa3 H n pdisk5 a fastwrite off a force yes u or ssaraid 1 ssa3 H n 2327340C423235K a fastwrite off a force yes u The force attribute ensures that all data is lost from the fast write cache You cannot recover that data The force attribute also prevents the reattachment of the disk to AIX no logical disk can therefore be created The actions of the force attribute are important because the lost data might include file system metadata If that data is damaged as a result of the fast write cache failure further data loss and system cra
117. 85 installing the SSA adapter 265 instruct types Command Line Interface 192 interface adapter device driver head device driver 208 IOCINFO ioctl operation 213 257 description 213 257 disk device driver 229 description 229 files 229 purpose 229 files 213 purpose 213 257 ioctl subroutine tmssa device driver 253 issaraid command 117 L large configurations 16 switching off using systems 17 switching on using systems 17 lassaraid command 115 Icssaraid command 113 lfssaraid command 89 111 Inssaraid command 109 lights Advanced SerialRAID Adapter type 4 P 6 link error problem determination 423 link errors 423 link speed 18 Link Speed service aid 345 link status ready lights 425 Link Verification service aid 331 List AIX System Disks option 115 List All Defined SSA RAID Arrays option 98 List All SSA RAID Arrays Connected to a RAID Manager option 100 List All Supported SSA RAID Arrays option 99 List Array Candidate Disks option 113 List Components in a Hot Spare Pool option 78 List Disks in an SSA RAID Array option 107 List Hot Spares option 109 List Identify SSA Physical Disks option 106 List Rejected Array Disks option 111 List Status of All Defined SSA RAID Arrays option 102 List Status of Hot Spare Pools option 72 List Status of Hot Spare Protection for an SSA RAID Array option 75 listing the disks that are in a hot spare pool 78 location code format 19 loops links and data paths 7 configuring devices on a loop 18
118. 900335FE80C84CK rebuilding 9 0GB RAID 5 array Example 9 To Make a New AIX System Disk 196 This example shows how use a single SSA disk to make a new AIX system disk Type the command gt ssaraid H 1 ssa0 n pdiskO a use system d where H specifies that this is a change operation 1 ssa0 specifies the RAID manager that is to be used n pdiskspecifies the pdisk that is to be changed to an AIX system disk a use specifies the new use of the pdisk Advanced SerialRAID Adapters User and Maintenance Information d specifies that an AIX system disk is to be attached to the new array The result in summary format is similar to that shown here pdiskO pdiskl pdisk2 pdisk3 hdisk5 0004AC506C4000D system 0004AC506D6D00D member 0004AC50A44200D member 0004AC515EA400D member 900335FE80C84CK rebuilding Example 10 To Delete an Array This example shows how to delete an array Type the command gt ssaraid D 1 ssa n hdisk5 u where D specifies that this is a delete operation 1 ssa0 specifies the RAID manager that is to be used n hdisk specifies the hdisk that is to be deleted n a n a n a n a u specifies the AIX system disk must be detached 4 5GB 4 5GB 2 3GB 4 5GB 9 0GB Physical disk Physical disk Physical disk Physical disk RAID 5 array Chapter 11 Using the SSA Command Line Interface for RAID Configurations 197 SSARAID Command Attributes When using the ssaraid command y
119. 93 Good nunu pdisk2 AC7AA2D6 EE Good nunu pdisk3 AC7AAOBD 2 1 Good nunu pdisk4 AC7AAOB1 32 20 Good F3 Cancel F1Q Exit 400 Advanced SerialRAID Adapters User and Maintenance Information Example 2 If the SRN is 24104 the device in theory is connected to adapter port 1 shown as A2 on the screen The device however has an SSA address of 04 That address is higher than the highest address that is displayed for adapter port 1 The devices are therefore the SSA adapter and pdisk1 3 from step B The problem is in the SSA link between the two devices that you identified in step a Exchange in the sequence shown the following FRUs for new SS Ensure that for each FRU exchange you go to N to verify the repair a One of the two devices that are identified by the SRN see Exchanging DisH b The other of the two devices The internal SSA connections of the enclosure or enclosures in which the devices are installed d The external SSA cable Chapter 17 SSA Problem Determination Procedures 401 MAP 2324 SSA RAID This MAP helps you to solve problems that have occurred in SSA RAID arrays Attention Unless the using system needs to be switched off for some other reason do not switch off the using system when servicing an SSA link or an enclosure in which SSA devices are installed Enclosure power cables and external SSA cables that connect devices to the using system can be disconnected while that system is running
120. 98 allow_page_splits true false 198 bypass_cache if_oneway 199 fastwrite on off 198 fw_end_block 198 fw_max_length 199 fw_start_block 198 attributes common to logical and physical disks 223 attributes for logical disks only 223 attributes of the SSA router ssar 222 B battery assembly fast write cache card installing 289 power 165 440 Advanced SerialRAID Adapters User and Maintenance Information battery assembly fast write cache card continued removing 287 blue and black cables 266 bring up SSA adapter ID 6 broken loop SSA link 352 355 buffer management SSA Target mode 245 bypassing the cache in a one way fast write network 172 C cables blue and black 266 Cancel all SSA Disk Identifications option 127 Certify Disk service aid 340 change and creation attributes hot spare pool 202 change and creation attributes RAID arrays 198 change attributes hot spare pool minimum_spares 202 change attributes RAID arrays 201 array member disk drives spare_pool 202 force yes no 201 hot spare disk drives spare_pool 201 use system free 201 Change Member Disks in an SSA RAID Array option 135 Change Show Attributes of an SSA RAID Array 133 Change Show Attributes of an SSA RAID Array option 133 Change Show Delete a Hot Spare Pool option 84 Change Show Use of an SSA Disk option 142 changing or showing the status of a hot spare pool 72 changing pdisk and hdisk numbers 278 checking the level of adapter microcode 23
121. A C Physical Disk Drive 4GB SSA C Physical Disk Drive SS a 338 Advanced SerialRAID Adapters User and Maintenance Information 2 Select the pdisk that you want to format The following instructions are displayed Format DISK 802396 D systemname pdisk2 AC1DBE11 4GB SSA C Physical Disk Drive Move cursor onto selection then press lt Enter gt Set or Reset Identify Select this option to set or reset the Identify indicator on the disk drive Format Select this option only if you are sure that you have selected the correct disk drive FORMATTING DESTROYS ALL DATA ON THE DISK DRIVE F3 Cancel F1O Exit 3 If you are not sure of the identification pdisk number of the disk drive that you want to format use the Identify function to get a positive physical identification of the disk drive see You can further ensure that you have selected the correct disk drive by ienving that the serial number on the front of the disk drive is the same as the serial number that is displayed on the screen 4 When you are sure that you have selected the correct disk drive select Format Chapter 16 SSA Service Aids 339 Certify Disk Service Aid The Certify service aid verifies that all the data on a disk drive can be read correctly Other maintenance procedures tell you when you need to run this service aid To use the Certify Disk service aid 1 Select Certify Disk from the SSA Service Aids menu see Aids on pa
122. A RAID Array 75 Remove a Disk from an SSA RAID Array 136 Swap Members in an SSA RAID Array 140 SMIT menu getting access 57 88 96 SMIT menu using 38 SMIT menu for SSA adapters getting access 39 SMIT menu for SSA disks getting access 40 SMITTY or SMIT commands ssadlog 167 ssaraid 57 88 96 software and microcode errors 388 solving hot spare pool problems 51 solving problems with SSA links 349 examples broken loop cable removed 352 broken loop disk drive removed 355 normal loops 350 Spare Tool using 163 special files tmssa 256 description 256 implementation specifics 256 purpose 256 special files disk device driver 228 split site management 147 configuration of RAID 1 and RAID 10 arrays 147 operation after a loss of member disks 148 adapter not known to remaining half of the array 157 one half of the array is not present 149 split and join procedure not performed correctly 159 SRNs service request numbers 359 SSA description 3 SSA adapter removal and replacement 279 SSA adapter device driver head device driver interface 208 SSA adapter ID during bring up 6 SSA Adapters SMIT menu 39 SSA Adapters SMIT menu getting access 39 ssa_certify command 295 SSA Command Line Interface for RAID 189 SSA Command Line Interface for RAID 189 continued action attributes 204 command syntax 191 hot spare pool creation and change attributes 202 instruct types 192 object types 192 options 192 physical disk change attributes 203
123. A cables to connect 40 MB per second SSA nodes If you do however the run_ssa_link_speed shell script might cause errors to be logged that can be solved only by exchanging the black cables for 40 MB per second cables blue SSA cables If you are using 20 MB per second SSA cables to connect 40 MB per second SSA nodes therefore delete the run_ssa_link_speed cron entry Microcode Maintenance This section describes how to e Check the ID and the level of the microcode package e Maintain the adapter microcode e Maintain the disk drive microcode Checking the ID and Level of the Microcode Package For some problems the service request number SRN might ask you to check the microcode package ID or the microcode level before you exchange any field replaceable units FRUs To determine the microcode package ID give the following command lsattr E 1 adapter a ucode where adapter is the ID of the adapter that you want to check for example ssa0 An example of a response to this command is ucode 14109100 05 50 Name of adapter code download file False The microcode package ID is 14109100 05 50 Note The word False shows that this attribute cannot be changed To determine the adapter microcode level use the Display or Change Configuration or Vital Product Data VPD service aid to display the VPD for the adapter see the 266 Advanced SerialRAID Adapters User and Maintenance Information Diagnosti
124. AID arrays RAID Functions Availability Redundant Array of Independent Disks RAID technology provides e Larger disk size e Immediate availability and recovery of data e Redundancy of data at a level that you can choose RAID technology stores data across groups of disk drives that are known as arrays These arrays are contained in array subsystems which can be configured with one or more arrays All arrays except RAID 0 arrays can provide data redundancy that ensures that no data is lost if one disk drive in the array fails An Advanced SerialRAID Adapter which uses microcode below level 50 provides RAID 0 and RAID 5 functions to control the arrays of the RAID subsystem An Advanced SerialRAID Plus Adapter which uses microcode at or above level 50 provides RAID 0 RAID 1 RAID 5 and RAID 10 functions The main characteristics of the various RAID types are as follows e RAID O provides data striping across disk drives but provides no added protection against loss of data e RAID 1 provides data mirroring across two member disk drives to protect against loss of data e RAID 5 provides data striping with parity data across disk drives to provide protection against loss of data e RAID 10 provides data striping and data mirroring across disk drives to provide protection against loss of data Availability is an important consideration that can affect the way you configure your arrays It is the ability of a system to con
125. AIX versions 4 1 and upward readx and writex Subroutines The readx and writex subroutines provide additional parameters that affect the transfer of raw data that is data that has not been processed or reduced These subroutines pass the ext parameter which specifies request options The options are constructed by logically ORing zero or more of the following values HWRELOC Request for hardware relocation that is safe UNSAFEREL Request for hardware relocation that is not safe WRITEV Request for write verification Error Conditions Possible errno values that occur for ioctl open read and write subroutines when the SSA disk device driver is used include EBUSY One of the following conditions has occurred 226 Advanced SerialRAID Adapters User and Maintenance Information An attempt was made to open an SSA physical device that has already been opened by another process e The target device is reserved by another initiator EFAULT Illegal user address EINVAL One of the following circumstances has occurred e The read or write subroutine supplied an nbyte parameter that is not an even multiple of the block size The data buffer length exceeded the maximum length that is defined in the devinfo structure for an ioctl subroutine operation e The openext subroutine supplied a combination of extension flags that has no support e An ioctl subroutine operation that has no support was attempted An attem
126. Add an SSA RAID Array from the SSA RAID Array menu A list of adapters is displayed in a window a SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next 58 Advanced SerialRAID Adapters User and Maintenance Information Select the adapter to which you want to add the array A list of array types is displayed in a window Va SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools RAID Array Type Move cursor to desired item and press Enter raid_0 RAID 0 array raid_1 RAID 1 array raid_5 RAID 5 a
127. Advanced SerialRAID Adapters User s Guide and Maintenance Information SA33 3285 01 Advanced SerialRAID Adapters User s Guide and Maintenance Information SA33 3285 01 Second Edition September 1999 This major revision supersedes SA33 3285 00 Technical changes are shown by a vertical line to the left of each change The following paragraph does not apply to any country where such provisions are inconsistent with local law THIS PUBLICATION IS PRINTED AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This publication could contain technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication It is possible that this publication may contain reference to or information about products machines and programs programming or services that are not announced in your country Such references or information must not be construed to mean that such products programming or services will be offered in your country Any reference to a licensed program in this publication is not intended to state or imply that you can use only the licensed program indicated
128. All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools SSA RAID Manager Move cursor to desired item and press F7 ONE OR MORE items can be selected Press Enter AFTER making all selections ssa0 Available 04 06 IBM SSA 160 SerialRAID Adapter 14109100 ssal Available 04 07 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F7 Select F8 Image F1O Exit F Enter Do Find n Find Next NS Select the adapter whose hot spare pools you want to list 72 Advanced SerialRAID Adapters User and Maintenance Information 3 A list of hot spare pools and their status is displayed A COMMAND STATUS D Command OK stdout yes stderr no Before command completion additional instructions may appear below ssal Pool Components Spares Configured Minimum Status pool_AQ 0 1 1 1 unused pool_Al 7 0 1 1 empty pool_Bl 6 2 2 1 full Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel1 F1O Exit Find n Find Next Y The columns of information displayed on the screen have the following meanings Pool The pool identifier Note Until you have defined hot spare pools see Adding a New Hoi SAE TA all disk drives are in pool_AO and pool_BO Any RAID arrays that are in pool_AO and pool_BO cannot be restricted to make them select disk drives fro
129. Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool SSA Loops Move cursor to desired item and press Enter Loop A Loop B Fl Help F2 Refresh F3 Cancel F7 Select F8 Image F1O Exit F Enter Do Find n Find Next NS 7 Select the loop on which you want to create the hot spare pool 4 The Hot Spare Pool Creation menu is displayed ie Ss Add a Hot Spare Pool Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssal Spares Pool pool_B3 Components to Add oO Hot Spares Minimum 1 Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1O Exit Enter Do J This menu automatically assigns the next available pool number to the new pool 82 Advanced SerialRAID Adapters User and Maintenance Information The Hot Spares Minimum field contains a default value of 1 This value defines the minimum number of spares that can exist in the pool before an error condition is logged You should normally set this field to the number of hot spare disk drives that you intend to assign to this pool You can however set it to a lower number if you do not want
130. B per second SSA cables color coded black 40 MB per second SSA cables color coded blue The speed at which a link runs is automatically agreed between its two nodes Under some fault conditions a link that normally runs at 40 MB per second might run at 20 MB per second The automatic run_ssa_link_speed diagnostic searches for pairs of 40 MB per second nodes that are running at only 20 MB per second This diagnostic is started by an entry in the cron table If you are using 20 MB per second cables to connect 40 MB per second SSA nodes delete the run_ssa_link_speed eniry from the cron table This action prevents the logging of errors that can be solved only by the installation of 40 MB per second cables 18 Advanced SerialRAID Adapters User and Maintenance Information Identifying and Addressing SSA Devices This section describes how SSA adapters and devices are known to the using system programs Location Code Format Location codes identify the locations of adapters and devices in the using system and its attached subsystems and devices These codes are displayed when the diagnostic programs isolate a problem For information about the location codes that are used by the using system see the Operator Guide for the using system AB CD EF GH L Unused Unused Unused P Physical disk drive L Logical disk drive Adapter position number of the slot 1 through 8 containing the SSA adapter System I O bus identifier Expa
131. BS Flags oz 4 ee a eh eA Ee be eek BER ee Oe Cee So SIS Output us the ob A a Dee BS ee ek Ge a BIS EX Mples so on Sr oan OR Be a eee BP ck Ge Gee A a dd oe ee MFA Return Codes Sp ark Peel Re at OK ci ge ea cava ce wt is eT ssa_servicemode Command see ten oe Fie Oy ee oh oe Ct ce Ge a SAD Purpose lt 3 40 2 8 ae oh SR de ok ee Go A hom ak 4 4 oe BPD Syntax iS wie ca Be ote ae Se BA Ge me at ace GS a BE Ee BIS Description e e goo So de pk Oe ee ee OR Re amp a OTD Flags i nk fo hed ath te eas amp adem Of nee a S15 Output ats Spe ats thas BA ck a ey OS aaa Th wey Gy OY COD ssa_speed Command Oe ernest wh Ee eet ae oe IE PUIDOSE 25 fe ek te ee do Se tt ote Ge Gy oe Te eae woe ae ee oS ka STE Syntax ve Rods ade he Sea ie Ete ok a a GDA Ae St 4 amp 2816 Descriptione ao aes Ae ee apt oa A Oe ye ee ae Ge ae EO a ce STE Flags ma eee Og AO Ee EO en ek ce we Se ee 2 4 BT6 OUIDUE 2 we she Shed Aik at hed A Aa a aa amp aiken BY Ode EXQMpleS i Shom Sg ariga Cg a eee Eo a oe Me A aaa Se oe Go Oey ONL ssavfynn Command ee eee ee ee ee 818 P rp s sga Sei ae oh nk a Gok at et a ce ee ee Ae es ae B18 Syntax oe ck a a we ea me m oe B18 Description s oei he me eh ES GA a ae Seb ee Ge Se Ee a Se OTB Flags 3 eo og ER PO Oo Be Se a Se op ee amp 5 818 X Advanced SerialRAID Adapters User and Maintenance Information Quiput 222 ces Skee BOR Rae Bobet ee Oe ae Oe TB ssaxlateCo
132. C input output channel controller IPN Independent Packet Network ISAL Independent Network Storage Access Language K KB Kilobyte kernel The part of the AIX operating system for RS 6000 containing functions that are needed frequently kernel mode In the AIX operating system the state in which a process runs in kernel mode Contrast with user mode kilobyte KB L LBA Logical block address 1000 bytes logical disk An hdisk See hdisk LUN Logical unit See also hdisk maintenance analysis procedure MAP A service procedure for isolating a problem MAP See maintenance analysis procedure MB Megabyte megabyte MB 1000000 bytes Member disk A disk drive that is part of a RAID array microcode One or more microinstructions used in a product as an alternative to hard wired circuitry to implement functions of a processor or other system component mirrored pair Two disk drives that contain the same data and are referred to as one entity by the using system mirroring The process of writing the same data to two disk drives at the same time The two disk drives become a mirrored pair The system can therefore continue to operate correctly when one of the mirrored disk drives fails 436 Advanced SerialRAID Adapters User and Maintenance Information N node In a network a point at which one or more functional units connect channels or data circuits For example in an SSA subsystem
133. Cache feature configuring 165 Fast Write feature 5 bypassing the cache in a one way fast write network 172 enabling or disabling Fast Write for multiple devices 170 enabling or disabling Fast Write for one disk drive 168 Fast Write menus getting access 167 fencing 242 files adapter device driver 212 IOCINFO ioctl operation 213 229 SSA_GET_ENTRY_POINT ioctl operation 216 SSA_TRANSACTION ioctl operation 215 SSADISK_ISAL_CMD ioctl operation 232 SSADISK_ISALMgr_CMD ioctl operation 234 SSADISK_LIST_PDISKS ioctl operation 238 444 Advanced SerialRAID Adapters User and Maintenance Information files continued SSADISK_SCSI_CMD ioctl operation 236 ssadisk SSA disk device driver 228 finding the physical location of a device 358 flowchart for RAID 5 array states 35 Format Disk service aid 338 FRU part numbers 291 full stride writes definition 224 G getting access to the Fast Write menus 167 getting access to the SSA Adapters SMIT menu 39 getting access to the SSA Disks SMIT menu 40 getting access to the SSA RAID Array SMIT menu 57 good housekeeping 188 Good state RAID O 31 Good state RAID 10 36 Good state RAID 5 33 H hdisks and pdisks changing numbers 278 explanation of 19 reformatting a pdisk as an hdisk 336 head device driver adapter device driver interface 208 hot spare management 43 choosing how many hot spare disk drives to include in each pool 49 choosing the error threshold alarm level for a hot spare pool 49
134. D 1 array states 32 RAID 10 array states 36 Degraded 37 Exposed 37 Good 36 multiple 38 Offline 37 Rebuilding 37 Unknown 38 RAID 5 action attributes 204 RAID 5 array states 33 Degraded 33 Exposed 33 read operations while in 33 write operations while in 33 flowchart 35 Good 33 initial rebuilding operation 34 Offline 34 Rebuilding 34 adapter replacement 34 disk drive replacement 34 RAID 5 physical disk change attributes 203 RAID array configurator adding a disk drive to an SSA RAID array 138 adding a new hot spare pool 81 adding an SSA RAID array 58 adding disks to a hot spare pool 84 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RAID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 deleting an old RAID array recorded in an SSA RAID manager 131 deleting an SSA RAID array 68 getting access to the SMIT menu 57 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 installing and configuring SSA RAID arrays 56 listing AI
135. Drives Listing or Deleting Old RAID Arrays Recorded in an SSA RAID Manager Changing or Showing the Attributes of an SSA RAID Array Changing Member Disks in an SSA RAID Array Changing or Showing the Use of an SSA Disk Drive Changing the Use of Multiple SSA Physical Disks Chapter 7 Split Site Management Configuration of RAID 1 and RAID 10 Arrays Operation after a Loss of Member Disks One Half of the Array Is Not Present Array is Offline because Adapter Is Not Known to the Remaining Half of the Array Array is Offline because the Split and Join Procedure Was Not Performed Correctly Chapter 8 Using the SSA Spare Tool Chapter 9 Using the Fast Write Cache Feature Fast Write Cache Card Battery a Configuring the Fast Write Cache Feature Getting Access to the Fast Write Menus Enabling or Disabling Fast Write for One Disk Drive Enabling or Disabling Fast Write for Multiple Devices Bypassing the Cache in a One Way Fast Write Network Dealing with Fast Write Problems sagr leas SRN 42521 SRN 42524 SRN 42525 Chapter 10 SSA Error Logs Error Logging Summary Detailed Description Error Logging Management Summary d Detailed Description Error Log Analysis Summary Detailed Description Contents 87 88 89 93 95 96 98 99 100 102 106 128 133 135 142 145 147 147 148 149 157 159 163 165 165 165 167 1
136. Fast Write Cache Option Card 8 Reinstall the adapter into the using system see the nstallation and Service Guide for the using system Note The battery on the Fast Write Option Card is not fully charged After the adapter is connected to the power initial battery charging completes in 5 to 60 minutes During this time the fast write disks can be enabled and used but the fast write function remains inactive and the diagnostics generate SRN 42529 see 9 286 Advanced SerialRAID Adapters User and Maintenance Information Removing the Battery Assembly from the Fast Write Cache Option Card of an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts The Fast Write Cache Option card might contain customer data 1 Remove the adapter from the using system see the nstallation and Service Guide for the using system Figure 43 Releasing the Battery Assembly 4 Attention The battery falls when it is released from the Fast Write Cache Option card Hold the Fast Write Cache Option card approximately 10 mm 0 5 in above a work surface 5 Press the clip J The battery assembly falls through the hole in the Fast Write Cache Option card Chapter 14 Removal and R
137. ID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 deleting an old RAID array recorded in an SSA RAID manager 131 deleting an SSA RAID array 68 getting access to the SMIT menu 57 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 listing AIX system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 listing all supported SSA RAID arrays 99 listing array candidate disk drives 113 listing hot spare disk drives 109 listing old RAID arrays recorded in an SSA RAID manager 129 listing rejected array disk drives 111 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks from a hot spare pool 84 Index 445 installing and configuring SSA RAID arrays 56 continued showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 installing the fast write cache card 2
138. If a pdisk name is used that pdisk must be in an SSA SES enclosure S Displays output in colon separated format V Displays also VPD information i Displays the enclosure identifier as shown in the operator panel if present b card Displays the status of the bypass cards If no parameters are given the status for all the bypass cards is displayed Valid values for the card parameter are 1 4 5 8 9 12 13 16 Chapter 15 Using the SSA Command Line Utilities 303 t threshold Displays all the temperature thresholds or only the specified temperature thresholds The valid values for the threshold parameter are lowarn The low temperature warning threshold locrit The low temperature critical threshold hiwarn The high temperature warning threshold hicrit The high temperature critical threshold a Displays the ambient temperature of the enclosure f fan Displays the status of all the fans or of only the specified fans Valid values for the fan parameter are 1 2 3 and so on d drive_bay Displays the status of all the disk drive bays slots or of only the specified disk drive bays Valid values for the drive_bay parameter are 1 2 3 and so on p PSU Displays the status of all the power supply assemblies or of only the specified power supply assemblies Valid values for the PSU parameter are 1 2 3 and so on 0 Displays the status of the operator panel C Displays the status of the
139. If you want to select other uses for other disk drives repeat this procedure for each different use 146 Advanced SerialRAID Adapters User and Maintenance Information Chapter 7 Split Site Management This chapter describes how to configure and manage a system in which the computing and disk drive resources are split between two or more sites so that the system can continue to operate if one site is lost Configuration of RAID 1 and RAID 10 Arrays RAID 1 and RAID 10 arrays hold data on mirrored pairs of disk drives that is the two disk drives of a particular pair contain the same data If either disk drive fails the data is still available This characteristic of these array types allows the mirrored copies of the data to be held on disk drives that are in different domains For example the disk drives can be in different disk subsystems or on different sites If one domain loses power the array continues to operate because one copy of the data is still available The RAID manager ensures that the two copies of the data are synchronized It is possible for an array to become split in half and for the adapters to become unable to communicate with each other The design of the system must include precautions therefore that prevent both using systems from continuing to operate on the half of the array that each system can access Such a condition causes the data on each mirrored pair to be inconsistent The RAID manager allows only one
140. SA RAID Arrays SMIT Menu ie For fast path access to the SSA RAID Array SMIT menus type smitty ssaraid and press Enter Otherwise a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displayed c Select SSA RAID Arrays The SSA RAID Arrays menu is displayed 4 SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool Add an SSA RAID Array Delete an SSA RAID Array Change Show Attributes of an SSA RAID Array Change Member Disks in an SSA RAID Array Change Show Use of an SSA Physical Disk Change Use of Multiple SSA Physical Disks Change Show Delete a Hot Spare Pool F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do XS 2 From the following list find the option that you want and go to the place that is indicated Chapter 6 Using the RAID Array Configurator 57 Adding an SSA RAID Array This option lets you add an array to the configuration 1 For fast path type smitty mkssaraid and press Enter Otherwise select
141. SA link problem caused that drive to become temporarily unavailable Under such conditions the disk drive can be reused If you think that a disk drive has been rejected because it is failing check the error log history for that disk drive For example if you suspect pdisk3 type on the command line ssa_ela 1 pdisk3 h 5 This command causes the error log for pdisk3 to be analyzed for the previous five days If a problem is detected an SRN is generated d to verify the repair 8 from step m An attempt has been made to create a new array but the adapter already has the maximum number of arrays defined a Type smitty ssaraid and press Enter Select List Delete Old RAID Arrays in an SSA RAID Manager b c Delete any array names that are no longer used d Olto verify the repair Chapter 17 SSA Problem Determination Procedures 405 9 from step A Attention Part of the data that is on the array has been damaged and cannot be recovered Before any other action is taken the user must recover all the data that is not damaged and create a backup of that data a Type smitty ssaraid and press Enter b Select List Status Of All Defined SSA RAID Arrays c Select in turn each array type that is used in your subsystem and press Enter Are any arrays listed as having an invalid data strip as shown in the following screen Note This example screen shows the status of RAID 5 arrays The screen shows simila
142. SSA C Physical Disk Drive systemname pdisk6 AC706E9A 2GB SSA C Physical Disk Drive systemname pdisk7 AC1DEEE2 2GB SSA C Physical Disk Drive systemname pdisk8 amp AC1DBE32 2GB SSA C Physical Disk Drive F3 Cancel F10 Exit The columns of information displayed on the screen have the following meanings systemname pdiskO through pdisk8 AC50AE43 through AC1DBE32 2 GB SSA C Physical Disk Drive Name of the using system to which the disk drives are connected Physical disk drive resource identifiers Serial numbers of the physical disk drives The actual serial number of a disk drive disk drive is shown on a label on the disk drive Descriptions of the disk drives Chapter 16 SSA Service Aids 327 2 Select the pdisk that you want to identify or put into Service Mode for example pdisk3 The following display appears with details of the disk drive that you have just selected Es EN SET SERVICE MODE 802382 systemname pdiskO AC50AE43 4GB SSA C Physical Disk Drive Move cursor onto selection then press lt Enter gt Set or Reset Identify Select this option to set or reset the Identify indicator on the disk drive gt Set or Reset Service Mode Select this option to set or reset Service Mode on the disk drive ENSURE THAT NO OTHER HOST SYSTEM IS USING THIS DISK DRIVE BEFORE SELECTING THIS OPTION F3 Cancel F1O Exit ic s 328 Advanced SerialRAID Adapters User and Maintenance Information 3
143. SSA Disk Enclosure might contain bypass cards Each bypass card can switch the internal strings of the subsystem or enclosure if it detects that neither of its connectors is connected to a powered on SSA adapter or device Therefore if the two SSA adapters fail or are held reset but remain powered on the bypass card does not operate and the disk drives become isolated For more information about bypass cards see the publications for your disk subsystem or enclosure In Eigure 4 SSA adapters J and H are in using system 1 SSA adapters and Bf are in using system 2 In each using system the two adapters are connected to each other If the two SSA adapters of either using system fail or are held reset but remain powered on all the disk drives can still communicate with the other using system Using System 1 Disk Disk Disk Disk Disk Disk Disk Disk 16 15 14 13 12 11 10 9 Disk Disk Disk Disk Disk Disk Disk Disk 1 2 3 4 5 6 7 8 B2 B1 fe a2 at B2 B1 Ef a2 at Using System 2 Figure 6 One Loop Two Adapters in Each of Two Using Systems 12 Advanced SerialRAID Adapters User and Maintenance Information If however disk drives are connected into the link between two SSA adapters that are in the same using system those disk drives become isolated if both SSA adapters fail or are held reset but remain powered on see also disk drives 13 through 16 have been connected
144. Secondary Reserved Adapter Adapter In Use Access Access to hdisk2 ssal ssa0 ssal Open OK abcd location com Return Codes 0 The command has completed successfully 1 A system error has occurred Any other value An error that is more serious that 0 or 1 has occurred 314 Advanced SerialRAID Adapters User and Maintenance Information ssa_servicemode Command Purpose Syntax Description Flags Output To put the disk drive into Service Mode set Service Mode or to remove the disk drive from Service Mode reset Service Mode ssa_servicemode 1 a AdapterName y n The ssa_servicemode command opens the adapter special file and sends the appropriate IACL command to put the disk drive into or remove it from Service Mode When the Service Mode has been successfully set or reset the IACL command closes the adapter special file If Service Mode cannot be set or reset for any reason the cop command prints the appropriate error message pdisk Specifies the pdisk that you want to put into or remove from Service Mode a AdapterName Specifies the adapter to which the pdisk is connected y Puts the pdisk into Service Mode set Service Mode n Removes the pdisk from Service Mode reset Service Mode The ssa_servicemode command sends all error messages to stderr Chapter 15 Using the SSA Command Line Utilities 315 ssa_speed Command Purpose Syntax Description Flags To determine the operating speed
145. Statement Korean Government Ministry of Communication MOC Statement New Zealand Compliance Statement Fs ikea 28 International Electrotechnical Commission IEC Statement Avis de conformit a la r glementation d Industrie Canada Industry Canada Compliance Statement F United Kingdom Telecommunications Requirements European Union EU Statement Radio Protection for Germany Taiwan Class A Compliance Statement Glossary Index Advanced SerialRAID Adapters User and Maintenance Information 431 431 431 432 432 432 432 432 432 433 435 439 Safety Notices For a translation of the danger and caution notices contained in this book see the Safety Information manual SA23 2652 Definitions of Safety Notices A danger notice indicates the presence of a hazard that has the potential of causing death or serious personal injury This book contains no danger notices A caution notice indicates the presence of a hazard that has the potential of causing moderate or minor personal injury This book contains two caution notices Those caution notices are in this safety section An attention notice indicates an action that could cause damage to a program device system or data Safety Notice for Installing Relocating or Servicing Before connecting or removing any cables to or from connectors at the using system be sure to follow the steps in the installation or relocation che
146. Status Ready Lights If a fault occurs that prevents the operation of a particular link the link status lights of the various parts of the complete link show that the error has occurred You can find the failing link by looking for the flashing green status light at each end of the affected link Some configurations might have other indicators along the link for example SSA connector cards to help with FRU isolation Chapter 17 SSA Problem Determination Procedures 425 The meanings of the disk drive and adapter lights are summarized here Status of Light Meaning Off Both SSA links are inactive Permanently on Both SSA links are active Slow flash two seconds on two seconds off Only one SSA link is active If your subsystem has other link status lights see the subsystem service information for the subsystem for more details Service Aid If service aids are available you can use the Link Verification service aid to show that the SSA loop is broken TSE aa a E LINK VERIFICATION 802386 SSA Link Verification for systemname ssaQ 00 04 SSA Enhanced RAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 B1 B2 Status TOP systemname pdisk11 AC50AE43 0 5 Good systemname pdisk8 AC706EA3 1 4 Good systemname pdisk2 AC1DBE11 23 Failed systemname pdisk3 AC1DBEF4 3 2 Good systemname pdisk7 AC50AE58 4 1 Good systemname pdisk12 AC7C6E51 5 0 Good
147. This health check is started by a cron table entry that instructs the run_ssa_healthcheck shell script to run once each hour When an SSA adapter receives a health check it logs any currently active errors and conditions that it knows exist on the SSA subsystem 177 Detailed Description SSA error logs are grouped into types of errors Each type of error is assigned to an AIX Error Label and an Error ID The Error Label specifies the text that appears when the error log is displayed It also specifies the priority that is applied to each error type when the cause of a problem is determined The Error ID is a numeric identifier for the Error Label Table J shows the error labels that SSA subsystems use Table 2 Error Labels Error Label Error ID Error Description DISK_ERR1 368AE575 An unrecovered media error has been detected The problem will be solved automatically when data is next written to the failing block If you are using RAID 5 no application has failed If you are not using RAID 5 an application might have had a media error Run error log analysis to determine whether the disk drive has become unreliable and should be exchanged for a new one DISK_ERR4 5173762C A recovered media error has been detected An occasional recovered media error is not serious Multiple media errors per day on one disk drive however might indicate that the disk drive is failing Run error log analysis to determine whether
148. Using the RAID Array Configurator 123 3 The following information is displayed Identify Array Candidate Disks Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ Array Candidate Disks Flash Disk Identification Lights yes F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1Q Exit Enter Do 4 Select yes in the Flash Disk Identification Lights field 5 Press the List key to list the disk drives 6 From the displayed list select the disk drives that you want to identify The Check light flashes on each disk drive that you have selected 124 Advanced SerialRAID Adapters User and Maintenance Information Identifying AIX System Disk Drives This option allows you to identify disk drives that are used by the using system These disk drives are not member disk drives of any array 1 For fast path type smitty iassaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select Identify AIX System Disks A list of adapters is displayed in a window List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identi
149. Voluntary Control Council for Interference by Information Technology Equipment VCCI In a domestic environment this product might cause radio interference in which event the user might be required to take adequate measures Korean Government Ministry of Communication MOC Statement Please note that this device has been approved for business purposes with regard to electromagnetic interference If you find that this device is not suitable for your use you can exchange it for one that is approved for non business purposes New Zealand Compliance Statement This is a Class A product In a domestic environment this product might cause radio interference in which event the user might be required to take adequate measures 431 International Electrotechnical Commission IEC Statement This product has been designed and built to comply with IEC Standard 950 Avis de conformit a la r glementation d Industrie Canada Cet appareil num rique de la classe A est conforme a la norme NMB 003 du Canada Industry Canada Compliance Statement This Class A digital apparatus complies with IECS 003 United Kingdom Telecommunications Requirements This apparatus is manufactured to the International Safety Standard EN60950 and as such is approved in the U K under approval number NS G 1234 J 100003 for indirect connection to public telecommunications systems in the United Kingdom European Union EU Statement This product is in conformity wi
150. X system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 Index 447 RAID array configurator continued listing all supported SSA RAID arrays 99 listing array candidate disk drives 113 listing hot spare disk drives 109 listing old RAID arrays recorded in an SSA RAID manager 129 listing rejected array disk drives 111 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks from a hot spare pool 84 showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 RAID arrays continued listing rejected array disk drives 111 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks from a hot spare pool 84 showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 RAID arrays change attributes 201 RAID arrays creation and change attributes 198 RAID Command Line Interface 189 action attributes 204 command syntax 191 RAID array problems 87 hot spare pool creation and change attributes 202 RAID Array SMIT menu getting access 57 instruct types 192 RAID arrays object typ
151. You can use any functionally equivalent program instead Copyright International Business Machines Corporation 1996 1999 All rights reserved Note to U S Government Users Documentation related to restricted rights Use duplication or disclosure is subject to restrictions set forth in the GSA ADP Schedule Contract Contents Safety Notices Definitions of Safety Notices Safety Notice for Installing Relocating or Servicing About This Book Who Should Use This Book What This Book Contains If You Need More Information Web Support Pages Numbering Convention Part 1 User Information Chapter 1 Introducing SSA and the Advanced SerialRAID Adapters Serial Storage Architecture SSA The Advanced SerialRAID Adapters Oe 4 P Fast Write Cache Feature 128 MB Memory Module Feature Lights of the Advanced SerialRAID Adapters Port Addresses of the Advanced SerialRAID Adapters SSA Adapter ID during Bring Up a 2 hs Chapter 2 Introducing SSA Loops Loops Links and Data Paths Simple Loop Simple Loop One Disk Drive Missing Simple Loop Two Disk Drives Missing One Loop with Two Adapters in One Using System One Loop with Two Adapters in Each of Two Using Systems Two Loops with One Adapter n ha cae S Two Loops with Two Adapters Large Configurations s Switching Off Using Systems Switching On Using Systems Configuring Devices on an SSA Loop SSA Link Speed Identifying and Addressi
152. _parms structure is valid The return code indicates whether the adapter was able to process the command successfully dev pdiskO0 dev pdisk1 dev pdiskn Provide an interface to allow SSA device drivers to access physical SSA disks dev hdiskO dev hdisk1 dev hdiskn Provide an interface to allow SSA device drivers to access logical SSA disks 234 Advanced SerialRAID Adapters User and Maintenance Information SSADISK_SCSIL_CMD SCSI Command SSA Disk Device Driver ioctl Operation Purpose Description To provide a method of sending Serial Storage Architecture Small Computer Systems Interface SSA SCSI commands to an SSA physical disk drive that has been opened with the SSADISK_SCSIMODE extension flag The SSADISK_SCSIL_CMD operation allows the caller to issue an SSA SCSI command to a selected physical disk The caller must be root or have an effective user ID of root to issue this ioctl The arg parameter for the SSADISK_ISALMgr_CMD operation is the address of an ssadisk_ioctl_parms structure This structure is defined in the usr include sys ssadisk h file The SSADISK_SCSI_CMD operation uses the following fields of the ssadisk_ioctl_parms structure dsb Contains the directive status byte that is returned for the command The byte contains a value from the usr include ipn ipndef h file A non zero value indicates an error result Contains the IPN result word that is returned by IPN for the command The word
153. a4 The connections between nodes can be modified while they are in use and the target mode interface tries to recover The TMSSA uses either of two methods to read and write data The blocking method which waits until the I O is complete or an error occurs before it returns control to you e The nonblocking method which returns control to you immediately With this method the write operation occurs at a later time The read operation returns the amount of data that is available at the time of the operation The amount of returned data is not necessarily the same as the amount that you requested The tmssa device driver provides support for multiple concurrent read and write operations for different devices It does not provide support for multiple read or write operations on the same device The device driver blocks the operation until the device is free Read and write operations can run concurrently on a particular device If a working path exists between two nodes communication works The path must be stable long enough for the driver to transmit the data The maximum time taken to fail a write operation is A R T where A is the number of adapters in the using system R is the number of retries as defined by TM_MAXRETRY in the usr include sys tmscsi h file and T is the retry time out period The minimum time taken to fail a write operation is the write time out period You can adjust the write time out period and the retry ti
154. able to a value of EPERM The ext parameter that is passed to the openx subroutine selects the operation for the target device The usr include sys ssadisk h file defines possible values for the ext parameter The ext parameter can contain any combination of the following flag values logically ORed together SSADISK_PRIMARY Opens the device by using the primary adapter as the path to the device As a result of hardware errors the device driver might automatically switch to the secondary path if one exists You can prevent this switch by additionally specifying the SSADISK_NOSWITCH flag 224 Advanced SerialRAID Adapters User and Maintenance Information This flag has support both for SSA logical disk drives and for SSA physical disk drives You cannot specify this flag and the SSADISK_SECONDARY flag together SSADISK_SECONDARY Opens the device using the secondary adapter as the path to the device As a result of hardware errors the device driver might automatically switch to the primary path if one exists You can prevent this switch by additionally specifying the SSADISK_NOSWITCH flag This flag has support both for SSA logical disk drives and for SSA physical disk drives You cannot specify this flag and the SSADISK_PRIMARY flag together SSADISK_NOSWITCH If more than one adapter provides a path to the device the device driver normally switches from one adapter to the other as part of its error recovery This flag prevents the s
155. adapter device driver 207 disk device driver 207 tmssa 247 configuration 248 description 247 device dependent subroutines 248 IOCINFO ioctl operation 257 purpose 247 syntax 247 TMCHGIMPARM change parameters 260 TMIOSTAT status 259 trace formatting 208 devices finding the physical location 358 diagnostic aids adapter POSTs power on self tests 268 SRNs service request numbers 359 direct call entry point 217 description 217 purpose 217 return values 217 disk device driver configuration issues 218 configuring SSA disk drive devices 220 logical and physical disks and RAID arrays 218 multiple adapters 219 description 218 device attributes 222 device dependent subroutines 224 Index 443 disk device driver continued error conditions 226 IOCINFO ioctl operation 229 description 229 files 229 purpose 229 open read write and close subroutines 224 purpose 218 readx and writex subroutines 226 responsibilities 207 special files 228 SSA disk concurrent mode of operation interface 239 device driver entry point 239 top kernel extension entry point 240 SSADISK_ISAL CMD ioctl operation 230 description 230 files 232 purpose 230 return values 231 SSADISK_ISALMgr_CMD ioctl operation description 233 SSADISK_ISALMgr CMD ioctl operation 233 files 234 purpose 233 return values 234 SSADISK_LIST_PDISKS ioctl operation 237 description 237 files 238 purpose 237 return values 238 SSADISK_SCSI_CMD ioctl operation 235 description 23
156. ade to open a device in Service mode and the device is in an SSA network that is not a loop The ssadisk device driver uses raw and block special files to perform its functions Attention Corruption of data loss of data or loss of system integrity system crash occurs if block special files are used to access devices that provide support for paging logical volumes or mounted file systems Block special files are provided for logical volumes and for disk devices They must be used only by the using system for managing file systems for paging devices and for logical volumes These files should not be used for other purposes The special files that the ssadisk device driver uses include the following listed by type of device e SSA logical disk drives dev hdiskO dev hdisk1 dev hdiskn Provide an interface that allows SSA device drivers to have block I O access to logical SSA disk drives dev rhdiskO dev rhdisk1 dev rhdiskn Provide an interface that allows SSA device drivers to have character access raw I O access and control functions to logical SSA disk drives e SSA physical disk drives dev pdiskO dev pdisk1 dev pdiskn Provide an interface that allows SSA device drivers to have character access control functions only to physical SSA disk drives Note The prefix r on a special file name indicates that the drive is accessed as a raw device rather than as a block device To perform raw I O with
157. ag on the new adapters Attention This method helps you to recover the system from severe errors Use this method only if the other half of the array has failed completely and will never be used again Array is Offline because the Split and Join Procedure Was Not Performed Correctly When this condition occurs the host system generates SRN 48760 The condition can be caused if a RAID 1 or a RAID 10 array has been split exactly in half and a separate write operation has been performed to each half of the array This problem can occur in a dual host configuration if Only one adapter can be detected on the SSA loop you change the state of the Split Array Resolution flag and a separate write operation is performed to each half of the array Both adapters can be detected on the SSA loop but one half of the RAID array cannot be detected and the following sequence of events occurs 1 A write operation is performed 2 The half of the array that could originally be detected can no longer be detected 3 The half of the array that could not originally be detected can now be detected and data is written to it 4 The half of the array that could originally be detected can now be detected again The problem can also occur in a single host system if only one half of the RAID array can be detected and the following sequence of events occurs 1 A write operation is performed 2 The half of the array that could not originally
158. aid and press Enter Otherwise a Select Change Member Disks of an SSA RAID Array from the SSA RAID Array menu b Select Add a Disk to an SSA RAID Array 2 A list of arrays is displayed in a window fe Change Member Disks in an SSA RAID Array Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array SSA RAID Array Move cursor to desired item and press Enter hdisk2 095231779F0737K degraded 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Select the array to which you are adding the disk drive 138 Advanced SerialRAID Adapters User and Maintenance Information The following information is displayed i Add a Disk to an SSA RAID Array D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa SSA RAID Array hdisk3 Connection Address Array Name 09523177F0737K Disk to Add F1l Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do J Press the List key to list the disk drives From the displayed list select the name of the disk drive that you are adding Chapter 6 Using the RAID Array Configurator 139 Swapping Members of an SSA RAID Array This option allows you to swap a disk drive for a replacement disk drive 1 For fast path type sm
159. aller to get status information about the previously run write operation Possible return values for the errno global variable include EFAULT The kernel service failed when it tried to access the caller buffers EINVAL The device not open or not configured The operation is not applicable to mode of this device A parameter that is not valid was passed to the device driver select Entry Point The select entry point allows the caller to know when a specified event has occurred on one or more target mode devices The event input parameter allows the caller to specify about which of one or more conditions it wants to be notified by a bitwise OR of one or more flags The target mode device driver provides support for the following select events POLLIN Check whether received data is available POLLSYNC Return only events that are currently pending No asynchronous notification occurs The additional events POLLOUT and POLLPRI are not applicable The target mode device driver does not therefore provide support for them The reventp output parameter points to the result of the conditional checks The device driver can return a bitwise OR of the following flags Chapter 12 Using the Programming Interface 253 POLLIN Received data is available The chan input parameter is used for specifying a channel number This parameter is not applicable for nonmultiplexed device drivers It should be set to O for the target mode device dr
160. alue through the TMCHGIMPARM operation The actual period that elapses before a time out occurs can be up to 10 seconds longer than the calculated value because it is related to the operation of the hardware at the time of the write operation A time out value of zero means that no time out occurs A value of zero is not allowed when the write operation is nonblocking because a deadlock might occur Under this condition EINVAL is returned for the write operation If the caller opened the initiator mode device with the O_NDELAY flag set the write operation is nonblocking In this mode the device checks whether enough buffer space is available for the write operation If enough buffer space is not available the write operation fails and the errno global variable is set to EAGAIN If enough buffer space is available the write operation immediately ends with all the data written successfully The write operation now occurs asynchronously If you want to track the progress of this write operation use the TMIOSTAT operation The driver keeps the status of the last write operation which is then reported by the TMIOSTAT operation Possible return values for the errno global variable include EFAULT The write operation was unsuccessful because of a kernel service error This value is applicable only during data gathering EINTR Interrupted by signal EINVAL Attempted to execute a write operation for a device instance that is not configured not
161. an SSA logical disk all data transfers must be in multiples of the device block size Also all Iseek subroutines that are made to the raw device driver must result in a file pointer value that is a multiple of the device block size 228 Advanced SerialRAID Adapters User and Maintenance Information IOCINFO Device Information SSA Disk Device Driver ioctl Operation Purpose Description Files To return a structure that is defined in the usr include sys devinfo h file The IOCINFO operation returns a structure that is defined in the usr include sys devinfo h header file The caller supplies the address to an area of type struct devinfo in the arg parameter to the IOCINFO operation The device type field for this component is DD_SCDISK the subtype is DS_PV The information that is returned includes the block size in bytes and the total number of blocks on the disk drive dev pdiskO dev pdisk1 dev pdiskn Provide an interface that allows SSA device drivers to have access to SSA physical disk drives dev pdiskO dev pdisk1 dev pdiskn Provide an interface that allows SSA device drivers to have access to SSA logical disk drives Chapter 12 Using the Programming Interface 229 SSADISK_ISAL_CMD ISAL Command SSA Disk Device Driver ioctl Operation Purpose Description To provide a method of sending Independent Network Storage Access Language ISAL commands to an SSA physical or logical disk drive ISAL consists
162. an be performed on the array although write operations put the array into the Degraded state When the missing member disk drives are reintroduced the array returns to the Good state Degraded State A RAID 10 array is in the Degraded state when one or more member disk drives are missing or deconfigured and a write operation has occurred Read and write operations can be performed on the array The missing member disk drives are deconfigured so that they are permanently excluded from the array If they become available again they can be introduced only as new members A RAID 10 array is in the Degraded state also if the secondary half of the array operates while the primary half is deconfigured Under this condition the secondary half holds information about the members of the primary half to track recovery Rebuilding State Offline State A RAID 10 array is in the Rebuilding state when a rebuilding operation is running on one or more member disk drives Read and write operations can be performed on the array When an array is created it enters the Rebuilding state to synchronize the member disk drives When the rebuilding operation is complete the array returns to the Good State If the medium error table fills during a rebuilding operation the array remains in the Rebuilding state until space becomes available in the table A RAID 10 array can be in the Offline state for any of the following reasons e No NVRAM is available to o
163. annot be called Trace Formatting The SSA adapter device driver and the SSA disk device driver can both make entries in the kernel trace buffer The hook ID for the SSA adapter device driver is 45A The hook ID for the SSA disk device driver is 45B For information on how to use the kernel trace feature refer to the trace command for the kernel debug program With the PCI SSA Multi Initiator RAID EL Adapter the Micro Channel SSA Multi Initiator RAID EL Adapter or the Advanced SerialRAID Adapter the Target Mode SSA device driver can make entries in the kernel trace buffer its hook ID is 3B4 208 Advanced SerialRAID Adapters User and Maintenance Information SSA Adapter Device Driver Purpose Syntax Description To provide support for the SSA adapter include usr include sys ssa h include usr include sys devinfo h The dev ssan special files provide an interface that allows client application programs to access SSA adapters and the SSA devices that are connected to those adapters Multiple head device drivers and application programs can all access a particular SSA adapter and its connected devices at the same time Configuring Devices All the SSA adapters that are connected to the using system are normally configured automatically during the system boot sequence PCI SSA Adapter ODM Attributes The PCI SSA adapter has a number of object data manager ODM attributes that you can display by using the Isattr command
164. ast Write Cache Option Card of an Advanced SerialRAID Adapter a ee eee 289 Part Numbers ss oy eis aw Gok cs Soe CA de eth ee ee le Se Ee 2 viii Advanced SerialRAID Adapters User and Maintenance Information Chapter 15 Using the SSA Command Line Utilities ssaadap Command Purpose Syntax Description Flags ssacand Command Purpose Syntax Description Flags i ssa_certify Command Purpose Syntax Description Flags ssaconn Command Purpose Syntax Description Flags ssa_diag Command Purpose Syntax Description Flags Output ssadisk Command Purpose Syntax Description Flags ssadload Command Purpose Syntax Description Flags Examples ssa_ela Command Purpose Syntax Description Flags Output ssaencl Command Purpose Syntax Description Flags Examples 293 293 293 293 293 293 294 294 294 294 294 295 295 295 295 295 297 297 297 297 297 298 298 298 298 298 298 299 299 299 299 299 300 300 300 300 301 301 302 302 302 302 302 302 303 303 303 303 303 305 Contents ix ssa_format Command 2 ee ee ee es 806 PUrDOS a Sr a Ge we ae i A eo BE A a a B06 Syntaks te LE a he a a ee a es cP a eh Mee a ak ee 806 Description 2 2 2 ee eee e
165. at 05 01 each day for all SSA devices that are configured in the using system The shell script analyzes the error log If it finds any problems the script warns the user in the following ways It sends A message to dev console This message is displayed on the system console e An OPMSG to the error log This message indicates the source of the error A mail message to ssa_adm Note ssa_adm is an alias address that is set up in etc aliases By default this address is set to root but you can change it to any valid mail address for the using system Chapter 10 SSA Error Logs 187 Good Housekeeping The items described here can help you ensure that your SSA subsystem works correctly When you are installing your SSA subsystem ensure that ssa_adm is set to an address that is suitable for your installation Regularly view the mail messages or OPMSGs that are in the error log to determine whether the automatic error log analysis has detected any errors If the automatic error log analysis has detected errors but the diagnostics do not generate an SRN run an error log analysis with the history option set Type ssa_ela 1 Device h timeperiod where timeperiod is the number of 24 hour periods Set timeperiod to include at least the 24 hours that preceded the error For example if at 09 00 on Monday you find that the error log analysis has reported an error on pdisk3 at 05 01 on Sunday type ssa_ela 1 pdisk3
166. ate Read Operations while in the Exposed State When a read operation is performed on an array that is in the Exposed state the array management software recreates the data that was contained on the missing disk drive On the Advanced SerialRAID Adapter the array management software immediately exchanges a hot spare disk drive for the missing disk drive if a hot spare disk drive is enabled and available when the read command is sent Write Operations while in the Exposed State When a write command is sent to an array that is in the Exposed state the array management software does the following e If a hot spare disk drive is enabled and available when the write command is sent the array management software immediately exchanges the hot spare disk drive for the missing disk drive and returns the array to the Rebuilding state If no hot spare disk drive is enabled and available the first write operation causes the array to enter the Degraded state The written data is not protected If the power fails during a write operation data might be lost 64 KB unless the array is configured to allow read only operations while in the Exposed state Most application programs however cannot be run when write operations are not allowed Degraded State A RAID 5 array enters the Degraded state if while in the Exposed state it receives a write command If a hot spare disk drive is available the array management software Chapter 3 RAID Fun
167. ated should both adapters fail or be held reset in one of the using systems See information If two using systems are switched off disk drives can become isolated if the SSA subsystem does not have bypass cards see more than one using system is rebooted at the same time disk drives can become isolated while the boot is running 26 Advanced SerialRAID Adapters User and Maintenance Information Reserving Disk Drives The Advanced SerialRAID Adapter the Micro Channel SSA Multi Initiator RAID EL Adapter and the PCI SSA Multi Initiator RAID EL Adapter implement reservation by using commands that are sent directly from adapter to adapter They do not use the SCSI reservation command The advantages of this method are The AIX Physical Volume ID PVID can be read from a reserved drive by system software e It is possible to determine which adapter is holding a reservation to a disk using the ssa_rescheck command e The diagnostics can detect particular failure conditions on reserved drives that they cannot detect with the other reservation method e Fencing can be used on a reserved disk Node_number locking is supported With node_number locking the drive is not locked to an adapter but rather to a using system To do this each using system in an SSA network must have a unique node number The node number is stored as the node_number attribute of ssar It can be queried with the Isattr command and set by us
168. ation Chapter 15 Using the SSA Command Line Utilities The commands that are described here allow you to get access from the command line to some of the functions that are available in the SSA service aids The commands are very simple and are intended for use mainly from within shell scripts They do not provide many error checking routines or error messages If you need such facilities use the SSA service aids see Under most conditions a command prints a usage string if the syntax is incorrect No message is printed however if the command fails If the command runs without error the return code is 0 If an error occurs the return code is a value other than 0 ssaadap Command Purpose Syntax Description Flags To list the adapters to which a logical disk or physical disk is connected ssaadap 1 LogicalDiskName ssaadap 1 PhysicalDiskName The output is the list of SSA adapters to which the logical or physical disk is connected If the list contains more than one adapter the first adapter in the list is the primary adapter I DiskName Specifies the logical or physical disk 293 ssacand Command Purpose To display the unused connection locations for an SSA adapter Syntax ssacand a AdapterName P L Description The ssacand command lists the available connection locations of an SSA adapter These connection locations are related to devices that are connected to the adapter but for which no AIX devices
169. ation fastwrite on off default off This attribute enables and disables the fast write cache When using the fast write cache you can use the following attributes to control the operation of the cache fw_start_block default 0 See the definition for fw_end_block fw_end_block default array size This attribute and the fw_start_block attribute control the range of blocks for 198 Advanced SerialRAID Adapters User and Maintenance Information which the fast write cache is enabled Write operations that are outside the default range of 0 through array size write data directly to the array and do not use the fast write cache fw_max_length default 128 This attribute sets the maximum size in blocks of write operations to the cache Write operations that are larger than the specified value write data directly to the array and do not use the fast write cache bypass_cache_if_oneway default false With the attribute set to true If the partner fast write cache becomes not available the fast write cache operations to this disk drive are disabled and an entry is made in the error log With the attribute set to false If the partner fast write cache becomes not available fast write operations to this disk drive continue If the SSA adapter fails during these operations some data might not be flushed to the disk drive until the adapter has been repaired Creation and Change Attributes for RAID 1 RAID 5 and RAID 10 Arrays O
170. ation program waits until more space becomes available in the device buffers As each buffer is sent the tmssa device driver checks whether any more data is to be sent If more data is to be sent the device driver continues to send that data If no more data is to be sent and the write operation is in blocking mode the device driver starts the waiting application program If the write operation is in nonblocking mode the write status is updated If an unrecoverable error occurs the write operation is ended and the remaining buffers are discarded The read operation transfers received data from the device buffers to your application program When the read operation ends or the write operation stops sending data the read operation returns the number of bytes read 246 Advanced SerialRAID Adapters User and Maintenance Information SSA tmssa Device Driver Purpose Syntax Description To provide support for using system to using system communications through the SSA target mode device driver include usr include sys devinfo h include usr include sys tmscsi h include usr include sys scsi h include usr include sys tmssa h The Serial Storage Architecture SSA target mode device driver provides an interface to allow using system to using system data transfer by using an SSA interface You can access the data transfer functions through character special files that are named dev tmssann xx where nn is the node number of the
171. ax_length default 128 This attribute sets the maximum size in blocks of write operations to the fast write cache Write operations that are larger than the specified value write data directly to the disk and do not use the fast write cache force yes no If a disk is using a fast write cache that is failing you must specify this attribute as yes to allow the fast write cache to be disabled Action Attributes RAID 1 RAID 5 and RAID 10 Only You can specify the following attributes with the a option when you are using the ssaraid command with the A and i exchange options to do maintenance on an array new_member disk This attribute specifies the disk drive that is to be added to the array either in exchange for a failing disk drive that has caused the array to enter the Exposed state or in exchange for a disk drive that the old_member attribute has specified old_member disk This attribute specifies the member disk drive that is to be removed from the array You can use the attribute on its own or with the new member attribute Use the old_member attribute on its own if you want only to remove the disk drive from the array Use the old_member attribute and the new_member attribute together if you want to exchange the disk drives in one action and the subsystem has a spare slot available for the new disk drive If no spare slot is available use the following method to exchange the disk drives 1 Logically remove the fai
172. ay Swap Members of an SSA RAID Array ERROR MESSAGE Press Enter or Cancel to return to the application Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do 1800 051 There are no items of this type For example if you select Add a Disk to an SSA RAID Array and no exposed or degraded arrays exist the error popup window is displayed 55 Installing and Configuring SSA RAID Arrays You can get to the required SMIT menu by using fast path commands or by working through other menus In this chapter the fast path command for a particular option is given at the start of the description of that option Notes 1 Although this book always refers to the smitty commands you can use either the smitty command or the smit command The procedures that you follow remain the same whichever of the two commands you use If you send the smit command from a graphics terminal however the menus are displayed slightly differently from those shown in this book If you are not familiar with the selection of items from the graphics versions of the menus use the smitty command The menus will then appear as shown in this book 2 If you use fast path commands you might need to go through intermediate steps that are not shown in this book Also some menus might be displayed slightly differently from those shown in this book 56 Advanced SerialRAID Adapters User and Maintenance Information Getting Access to the S
173. between the SSA adapters in using system 1 If both adapters fail or are held reset but remain powered on disk drives 1 through 12 can still communicate with using system 2 Disk drives 13 through 16 however cannot communicate with using system 2 because their data paths are through the adapters in using system 1 When using system 1 is rebooted disk drives 13 through 16 remain unavailable for a long time Using System 1 Disk Disk Disk Disk 16 15 14 13 Disk Disk Disk Disk 12 11 10 9 Disk Disk Disk Disk Disk Disk Disk Disk Pree r tel hele B2 B1 Ry a2 at B2 B1 a2 at Figure 7 Disk Drives Isolated by Failing Using System Using System 2 Chapter 2 Introducing SSALoops 13 Two Loops with One Adapter If only one SSA adapter is contained in the SSA loops the adapter can provide support for up to 96 disk drives a maximum of 48 per loop Eigure 8 shows an example configuration that has two loops and one adapter Adapter SSA Disk Drives Figure 8 Two Loops with One Adapter 14 Advanced SerialRAID Adapters User and Maintenance Information Two Loops with Two Adapters The two adapters can provide support for up to 96 SSA disk drives a maximum of 48 per loop Figure 9
174. c Information for Multiple Bus Systems manual The microcode level is shown in the ROS level field Alternatively give the following command Iscfg v1 adapter where adapter is the ID of the adapter that you want to check You can determine the disk drive microcode level by using the Display Download Disk Drive Microcode SSA service aid see ED Aid on page 342 Maintaining the Adapter Microcode Updates to microcode can be delivered on several types of media or you can get them from web page http www rs6000 ibm com support micro download html 1 Install the microcode as described in the instructions that are provided with the installation media 2 Run the cfgmgr command if you have not already done so to download the new microcode into the SSA adapter 3 If the SSA loops that are connected to this adapter contain two or more SSA adapters and those adapters are installed in two or more using systems load the adapter microcode then run the cfgmgr command on each using system If the level of the microcode that is stored in the using system is higher than the level of the microcode that is installed on the SSA adapter the higher level microcode is automatically downloaded to the adapter when the using system runs its configuration method Maintaining the Disk Drive Microcode To download disk drive microcode use the Display Download Disk Drive Microcode SSA service aid see ED Chapter 13 SSA Adapter Info
175. calling programs however default values can be changed to fine tune timing parameters that are related to error recovery When a parameter is changed it remains changed until another TMCHGIMPARM operation occurs or until the device is closed When the device is opened the parameters are set to the default values Parameters that can be changed with this operation are The delay in seconds between device driver initiated retries of send commands the retry parameter e The time allowed before the write operation times out the time out parameter To indicate which of the possible two parameters the caller is changing the caller sets the appropriate bit in the chg_option field The caller can change either the retry parameter or the time out parameter or it can change both parameters To change the delay between send command retries the caller sets the TM_CHG_RETRY_DELAY flag in the chg_option field and puts the required delay value in seconds into the new_delay field of the structure With this command the retry delay can be changed to any value 0 through 255 where 0 instructs the device driver to use as little delay as possible between retries The default value is approximately two seconds To change the send command time out value the caller sets the TM_CHG_SEND_TIMEOUT flag in the chg_option field sets the desired flag in the timeout_type field and puts the desired time out value into the new_timeout field of the st
176. change a RAID 5 array strip_size default 64 KB or 128 x 512 byte blocks This attribute is used only when the array is created The strip size is the maximum amount of contiguous data that is mapped to one member disk drive Valid values are 32 KB 64 blocks and 64 KB 128 blocks Creation and Change Attribute for RAID 10 Arrays Only You can specify the following attribute with the a option when you are using the ssaraid command with the C or H option to create or change a RAID 10 array strip_size default 16 KB or 32 x 512 byte blocks This attribute is used only when the array is created The strip size is the maximum amount of contiguous data that is mapped to one member disk drive Valid values are 16 KB 82 blocks 32 KB 64 blocks and 64 KB 128 blocks RAID Arrays Change Attributes This section describes the creation and change attributes that you can use for All RAID arrays Hot spare disk drives only Array member disk drives only Change Attributes for All RAID Arrays You can specify the following attributes with the a option only when you are using the ssaraid command with the H option to change a RAID array use system free With the attribute set to system The array is made usable by the AIX operating system If you specify also the d option a corresponding AIX hdisk device is created for the array With the attribute set to free The array has no use assigned to it and AIX cannot use it a
177. ched to the adapter ks n a n a n a n a disks n a 4 56 F3 Cancel F1O Exit Physical Physical Physical Physical Physical SSA RAID Arrays SSA Physical Dis Move cursor to desired item and press F7 Use arrow keys to scroll ONE OR MORE items can be selected Press Enter AFTER making all selections SSA physical disks that are free pdisk7 0004AC51848900D free pdisk8 amp 0004AC51965300D free pdisk10 0004AC51BD8F00D free SSA physical disks that are hot spares pdisk9 0004AC51BD8000D spare SSA physical disks that are AIX system pdiskO 0004AC50A30300D system F1l Help F2 Refresh F7 Select F8 Image Enter Do Find n Find Next Chapter 6 Using the RAID Array Configurator 4 Use the Select key to select the disk drives whose use you want to change Select only those disk drives that are to have the same use For example select only disk drives that are to become hot spare disk drives or select only disk drives that are to become AIX system disks The following screen is displayed for the disk drives that you have chosen fe gt Change Use of Multiple SSA Physical Disks Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ SSA physical disk pdisk6 pdisk7 pdisk8 New use AIX System Disks Be Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1Q Exit Enter Do J 5
178. chg_hsm_pool_adap command 84 chgssadisk command 70 142 chgssadisks command 145 chgssardsk command 168 choosing how many hot spare disk drives to include in each pool 49 choosing the error threshold alarm level for a hot spare pool 49 chssaraid command 133 close subroutine tmssa device driver 249 command line error log analysis 187 Command Line Interface for RAID 189 action attributes 204 command syntax 191 hot spare pool creation and change attributes 202 instruct types 192 object types 192 options 192 physical disk change attributes 203 RAID arrays change attributes 201 Command Line Interface for RAID 189 continued RAID arrays creation and change attributes 198 return codes 205 SSARAID command attributes 198 command line utilities ssa_certify command 295 ssa_diag command 298 ssa_elacommand 302 ssa_format command 306 ssa_getdump command 308 ssa_progress command 312 ssa_rescheck command 313 ssa_servicemode command 315 ssa_speed command 316 ssaadap command 293 ssacand command 294 ssaconn command 297 ssadisk command 299 ssadload command 300 ssaencl command 303 ssaidentify command 311 ssavfynn command 318 ssaxlate command 319 command syntax of the RAID Command Line Interface 191 commands add_hsm_pool_adap 81 addssaraid 138 chg_hsm_pool_adap 84 chgssadisk 70 142 chgssadisks 145 chgssardsk 168 chssaraid 133 exssaraid 93 140 iassaraid 125 icssaraid 123 ifssaraid 90 121 inssaraid 119 issaraid 117 lassaraid 1
179. cklist specified in the Installation and Service Guide for your using system For safety checks when servicing refer to that manual and to the nstallation and Service Guide for your subsystem CAUTION A lithium battery can cause fire explosion or a severe burn Do not recharge disassemble heat above 100 C 212 F solder directly to the cell incinerate or expose cell contents to water Keep away from children Replace only with the part number specified with your system Use of another battery might present a risk of fire or explosion The battery connector is polarized do not try to reverse the polarity Dispose of the battery according to local regulations Each Advanced SerialRAID Adapter card contains a lithium battery CAUTION The Fast Write Cache Option Card contains a nickel cadmium NiCad battery To avoid possible explosion do not incinerate the battery Exchange it only with a manufacturer approved part Recycle or discard the battery as instructed by local regulations and where recycling facilities exist xiii Xiv Advanced SerialRAID Adapters User and Maintenance Information About This Book Who Should Use This Book This book is for people who operate or service a RISC system that contains one or more Advanced SerialRAID Adapters To follow the instructions in this book you should be familiar with the basic operational procedures for a RISC system What This Book Contains Part 1 of this book is mai
180. comes available but remains in the Exposed state or the Degraded state until the missing array members are added 4 Add the missing members of the array a Select Change Member Disks in an SSA RAID Array from the SSA RAID Arrays menu b Select Add a Disk to an SSA RAID Array once for each disk drive that you need to add to the array 48760 Description An array is in the Offline state because the split join This problem can occur if a procedure was not performed correctly RAID 1 array or a RAID 10 array has been split exactly in Action The data on the array is not constant See half and a write operation has Management on page 147 before you attempt to recover the array been performed independently to both halves of the array 374 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 48800 Description The Invalid strip table is full Because of failures on multiple member disk drives of an array at least 128 blocks of data are not accessible Other data on the array might still be readable Action 1 Type smitty ssaraid and press Enter 2 Select List Status of All Defined SSA RAID Arrays 3 The failed hdisk is listed with Invalid data strips Make a note of the hdisk number 4 Ask the customer to make a backup of all data that is still readable and then to delete the failed array 5 When the array has been deleted run the following to each disk drive that was
181. command gt ssaraid C 1 ssa0 t raid_1 s pdisk pdiskl d where C specifies that this is a create operation 1 ssaQ specifies that RAID Manager ssa0 is to be used t raid_1 specifies that a RAID 1 array object is to be created s pdisk specifies the free pdisk that is to become the member disk of the new array RAID 1 arrays provide support for only two member disk drives The first disk drive that is specified becomes the primary member disk drive d specifies that an AIX system disk is to be attached to the new array Chapter 11 Using the SSA Command Line Interface for RAID Configurations 193 Example 3 To Create a RAID 5 Array This example shows how to use three SSA physical disks to create a RAID 5 array The attributes of the disks are all set to their default values Type the command gt ssaraid C 1 ssaQ t raid_5 s pdiskO pdiskl pdisk2 d where C specifies that this is a create operation 1 ssa0 specifies that RAID Manager ssa0 is to be used t raid_5 specifies that a RAID 5 array object is to be created s pdisk specifies the free pdisk that is to become the member disk of the new array d specifies that an AIX system disk is to be attached to the new array This command causes a new SSA logical disk hdiskX to be created and attached to the new array X is the next available hdisk number for example hdisk5 Example 4 To Create a RAID 10 Array This example shows how to use four SSA phys
182. controller card I ID U Modifies the enclosure ID The ID must be a four character alphanumeric string The optional U flag causes the object data manager ODM to be updated to show the change B mode Modifies all bypass cards to the given mode B card mode Modifies the specified bypass cards to be in the given modes The valid values for the mode parameter are Automatic Bypass e Inline Open Valid values for the card parameter are 1 4 5 8 9 12 13 16 S Resets the exchanged flag of the selected FRU d drive_bay Resets the flag for the selected disk drive bay slot Valid values for drive_bay are 1 2 3 and so on 304 Advanced SerialRAID Adapters User and Maintenance Information b card Resets the flag for the bypass card Valid values for card are 1 4 5 8 9 12 13 16 p PSU Resets the flag for the selected PSU power supply assembly Valid values for PSU are 1 2 r Resets the flag for remote power on RPO c Resets the flag for the controller card o Resets the flag for the operator panel T threshold value Modifies the specified temperature thresholds to the given values The valid values for the threshold parameter are lowarn The low temperature warning threshold hiwarn The high temperature warning threshold The value parameter is a temperature in degrees C Examples e To display the status of all bypass cards on enclosure0 give the command
183. correct 11 Problem communicating with back end method 12 Problem with environment variable message catalog and so on 100 Problem with self defining structure for RDVs 101 The argument in the command line is not valid and given to back end 102 Problem with FC_CandidateList transaction 103 Problem with FC_ResrcList transaction 104 Problem with FC_ResrcView transaction Chapter 11 Using the SSA Command Line Interface for RAID Configurations 205 206 Advanced SerialRAID Adapters User and Maintenance Information Chapter 12 Using the Programming Interface SSA Subsystem Overview Device Drivers Two types of device driver provide support for all SSA subsystems The SSA adapter device driver which deals with the SSA adapter e The SSA head device drivers which deal with devices that are attached to the SSA adapter The SSA disk device driver is an example of an SSA head device driver For subsystems that use the Micro Channel SSA Multi Initiator RAID EL Adapter the PCI SSA Multi Initiator RAID EL Adapter or the Advanced SerialRAID Adapter the Target Mode SSA TMSSA device driver is also available This device driver provides support for communications from using system to using system For information about SSA Target Mode and the TMSSA device driver see Responsibilities of the SSA Adapter Device Driver The SSA adapter device driver provides a consistent interface to all SSA head device drivers of which the SSA
184. cted through the SSA network The names shown are the DNS names of the machines W Turns on the network wide check It checks local node numbers against remote node numbers and remote node numbers against other remote node numbers The normal check is local node numbers against remote node numbers The ssavfynn command sends all error messages to stderr It sends all configuration problem messages to stdout 318 Advanced SerialRAID Adapters User and Maintenance Information ssaxlate Command Purpose To translate between logical disks hdisks and physical disks pdisks Syntax ssaxlate 1 LogicalDiskName ssaxlate 1 PhysicalDiskName Description If the parameter is a logical disk the output is a list of names of the physical disks that provide support for that logical disk If the parameter is a physical disk the output is a list of names of the logical disks that use that physical disk Flags I DiskName Specifies the logical or physical disk Chapter 15 Using the SSA Command Line Utilities 319 320 Advanced SerialRAID Adapters User and Maintenance Information Chapter 16 SSA Service Aids Note For some problems you can use the SSA command line utilities instead of the SSA service aids For information about the command line utilities see SSA service aids are resident in the using system They help you to service SSA subsystems This section describes those service aids and tells how to use them Attention Do
185. cted to an SSA adapter These names are related to devices that are in the customized device data base and have the SSA adapter as their adapter_a or adapter_b attribute Flags a AdapterName Specifies the adapter to which the disk drives are connected P Produce a list of physical disks L Produce a list of logical disks Chapter 15 Using the SSA Command Line Utilities 299 ssadload Command Purpose Syntax Description To download microcode to SSA physical disk drives ssadload d PhysicalDiskName f CodeFileName ssadload u d PhysicalDiskName ssadload s d PhysicalDiskName The ssadload command performs microcode downloads to SSA physical disk drives The command has three modes of operation Load a specific level of microcode into a specific SSA physical disk drive Using the command in this mode you can force load any available level of microcode into any compatible SSA disk drive Ensure that either a specific SSA physical disk drive or all the physical disk drives that are connected to the system are using the latest levels of microcode that are available on the system Using the command in this mode you can ensure that the latest available level of microcode has been loaded onto all compatible SSA disk drives in the system Show the existing microcode level that is installed on either a specific SSA physical disk drive or on all the SSA physical disk drives that are connected to the s
186. ction go to step 170 Advanced SerialRAID Adapters User and Maintenance Information 3 If data for your selected devices is present in the fast write cache and you want to disable the fast write function set the Enable Fast Write option to no and the Force Delete option to yes The Force Delete screen is displayed S Enable Disable Fast Write for Multiple Devices Force Delete Setting Force Delete to yes will allow the system to disable Fast Write for this SSA Logical Disk even if this involves discarding data in an inaccessible Fast Write Cache card The data in the Fast Write Cache card is the most recent copy of some portions of the data on the SSA Logical Disk Discarding this data may destroy the integrity of the data on the disk resulting in system crashes data corruption and loss of system integrity It is suggested that you try selecting no for this option first Force Delete is applicable only if you are setting Enable Fast Write to no yes no Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n find next Chapter 9 Using the Fast Write Cache Feature 171 Bypassing the Cache in a One Way Fast Write Network If you are using the two way fast write function that is two adapters have access to a fast write disk drive you can choose whether you want fast write operations to continue if the partner adapter fails or becomes not accessible By default fast write operations co
187. ctions and Array States 33 immediately exchanges the hot spare disk drive for the missing disk drive and returns the array to the Rebuilding state If no hot spare disk drive is available and a write operation is performed on the array the array remains in the Degraded state until you take action to return that array to the Good state While in Degraded state an array is not protected If another disk drive in the array fails or the power fails during a write operation data might be lost You can return the disk drive to the array or install another disk drive by using the procedure in step B2 on page 418 of IMAP 2324 SSA RAID to logically add the device to the array The array management software starts a rebuilding operation to synchronize the new disk drive with the data that is contained in the other disk drives of the array This action returns the array to the Good state Rebuilding State Offline State A RAID 5 array enters the Rebuilding state when That array is first created A member disk drive is replaced e An adapter is replaced but a correct shutdown has not been performed Initial Rebuilding Operation When an array is first created it enters the Rebuilding state while parity is rebuilt If a disk drive fails during the initial rebuilding operation no hot spare disk drive is exchanged for the failing disk drive Disk Drive Replacement An array enters Rebuilding state after a missing disk drive has been
188. curs that error might be logged by the adapter device driver Chapter 12 Using the Programming Interface 255 tmssa Special File Purpose Description To provide access to the SSA tmssa device driver The Serial Storage Architecture SSA target mode device driver provides an interface that allows the SSA interface to be used for data transfer from using system to using system You can access the data transfer functions through character special files that are named dev tmssann xx where nn is the node number of the node with which you are communicating The xx can be either im initiator mode interface or tm target mode interface The caller uses the initiator mode to transmit data and the target mode interface to receive data The least significant bit of the minor device number indicates to the device driver which mode interface is selected by the caller When the least significant bit of the minor device number is set to 1 the target mode interface is selected When the least significant bit is set to 0 the initiator mode interface is selected For example tmssat1 im should be defined as an even numbered minor device number to select the initiator mode interface tmssa1 tm should be defined as an odd numbered minor device number to select the target mode interface When the caller opens the initiator mode special file a logical path is set up This path allows data to be transmitted The user mode caller issues a write wri
189. d List all types of object Notes about the ssaraid Command 1 You can specify RAID object names arrays or member disk drives as either the 15 character connection location or as the AIX device name The preferred name is the 15 character connection location This name is the same as the SSA serial number for the device 2 You can specify Boolean attribute values as any of the following 0 1 f t false true n y no yes off on The attributes must be in lowercase 190 Advanced SerialRAID Adapters User and Maintenance Information Command Syntax ssaraid ssaraid M o 1 RaidManager ssaraid 1 RaidManager n Name m p x t ObjectType c ssaraid I 1 RaidManager n Name m p x t ObjectType c a Attribute Value o z h S o ssaraid C 1 RaidManager t CreateType s Member Member a Attribute Value d k DeviceName n Name ssaraid D 1 RaidManager n Name u ssaraid H 1 RaidManager n Name u d k DeviceName a Attribute Value ssaraid A 1 RaidManager n Name i InstructType a Attribute Value ssaraid Y c a o 1 RaidManager Legend RaidManager The name of the SSA adapter that has RAID array support Name The name of the specific device upon which the operation is to be performed Object Type The aps of device upon which the operation is to be performed See lObjedd Attribute The name of the attribute Value The value of the a
190. d Arrays in pool zero can never use hot spare disk drives that are assigned to other hot spare pools Each pdisk can be assigned to a hot spare pool Each member disk drive of a RAID array can be assigned to a different hot spare pool Disk drives can be added to a new pool only if they are in pool zero If a disk drive is removed from a hot spare pool that disk drive moves to pool zero A hot spare pool can exist only on an SSA loop For example hot spare pool B1 on adapter ssa0 has no physical or logical connection to hot spare pool B1 on adapter ssal A hot spare pool can contain any number of hot spare disk drives For instructions on If the Choose Hot Spare Only from Preferred Pool option is set to yes hot spare disk drives are selected only from the hot spare pool that contains the failing member disk drive If the Choose Hot Spare Only from Preferred Pool option is set to no the selected hot spare disk drive can be A hot spare disk drive that is in the hot spare pool that contains the failing member disk drive A hot spare disk drive that is in hot spare pool zero Ahot spare disk drive that is in any other hot spare pool If more that one hot spare disk drive is available in a pool and the hot spare disk drives are of different sizes the smallest appropriate disk drive is selected 50 Advanced SerialRAID Adapters User and Maintenance Information Solving Hot Spare Pool Problems Hot spare pool pr
191. d SSA_DISK_ERR4 CD815F62 One of the following has occurred e The disk drive has had an unrecovered hardware error e The disk drive has had a hardware error that is now recovered but the disk drive is reporting that it might be going to fail SSA_HDW_ERROR OEA8952E A hardware failure has occurred Run diagnostics in Problem Determination mode to determine which FRUs to exchange for new FRUs SSA_HDW_RECOVERED B8AEC405 A hardware error has occurred that has been recovered by the error recovery procedures Run error log analysis to determine whether a FRU needs to be exchanged for a new FRU SSA_LINK_ERROR 7FFB7C60 Link errors might be detected by any node in the SSA loop The adapter is notified of these errors It performs any necessary error recovery and logs the error Link errors are normally associated with some other failure on the SSA loop Link errors might be logged when other devices on the loop are switched on or off or when cables or devices are disconnected during service activity Intermittent link errors are not serious If many link errors occur however one of the SSA links might be going to fail Run error log analysis to determine whether any repair action is needed Chapter 10 SSA Error Logs 179 Table 2 Error Labels continued Error Label Error ID Error Description SSA_LINK_OPEN D9EBBAEF SSA devices are normally configured in a closed loop The loop consists of a series of links eac
192. d 115 Icssaraid 113 Ifssaraid 89 111 Ihssaraid 109 Is_hsm_array_components 78 Is_hsm_array_status 75 Is hsm_status 72 Isdssaraid 98 Isidssaraid 106 Ismssaraid 100 Issaraid 107 Isssaraid 99 Istssaraid 102 mkssaraid 58 nvrssaraid 128 redssaraid 136 rmssaraid 68 smit smitty 96 ssa_identify_cancel 127 ssafastw 170 swpssaraid 135 SMIT or SMITTY options Add a Disk to an SSA RAID Array 138 Add a Hot Spare Pool 81 Add an SSA RAID Array 58 Cancel all SSA Disk Identifications 127 Change Member Disks in an SSA RAID Array 135 Change Show Characteristics of an SSA Logical Disk 168 Change Show Delete a Hot Spare Pool 84 Change Show Use of an SSA Disk 142 Delete an SSA RAID Array 68 Enable Disable Fast Write for Multiple Devices 170 Identify AIX System Disks 125 Identify Array Candidate Disks 123 Identify Disks in an SSA RAID Array 117 Identify Hot Spares 119 Identify Rejected Array Disks 121 List AIX System Disks 115 List All Defined SSA RAID Arrays 98 Index 449 SMIT or SMITTY options continued List All SSA RAID Arrays Connected to a RAID Manager 100 List All Supported SSA RAID Arrays 99 List Array Candidate Disks 113 List Components in a Hot Spare Pool 78 List Disks in an SSA RAID Array 107 List Hot Spares 109 List Identify SSA Physical Disks 106 List Rejected Array Disks 111 List Status of All Defined SSA RAID Arrays 102 List Status of Hot Spare Pools 72 List Status of Hot Spare Protection for an SS
193. d Next Chapter 6 Using the RAID Array Configurator 109 3 A list of hot spare disk drives is displayed A COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below pdisk3 0004AC5119E000D spare n a 1 1G Physical disk pdisk5 08005AEA030D00D spare n a 2 3G Physical disk F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next 110 Advanced SerialRAID Adapters User and Maintenance Information Listing Rejected Array Disk Drives This option allows you to list disk drives that have been rejected probably because of failure from arrays 1 For fast path type smitty 1fssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List Rejected Array Disks 2 A list of adapters is displayed in a window E D List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n F
194. d in the usr include sys devinfo h file Description This operation allows you to supply a pointer to the address of an area of type struct devinfo in the arg parameter to the IOCINFO operation This structure is defined in the usr include sys devinfo h file The SCSI target mode union is used for this as follows Initiator Device buf_size Size of transmit buffer num_bufs Number of transmit buffers max_transfer Unused Set to zero adap_devno Major or Minor devno of SSA adapter to be used for the next transmit operation Use TM_GetDevinfoNodeNum to read the node number to which the data is sent Target Device buf_size Size of receive buffer num_bufs Number of receive buffers max_transfer Unused Set to zero adap_devno Major or Minor devno of SSA adapter initially used by the paired initiator mode device Use TM_GetDevinfoNodeNum to read the node number from which the data is received The remainder of the structure is filled as follows Chapter 12 Using the Programming Interface 257 devtype DD_TMSCSI flags Set to zero devsubtype DS_TM 258 Advanced SerialRAID Adapters User and Maintenance Information TMIOSTAT Status tmssa Device Driver ioctl Operation Purpose Description To allow the caller to put the status information for the current or previous write operation into a structure that is defined in the usr include sys tmscsi h file This operation returns information abo
195. d off for some other reason do not switch off the using system when servicing an SSA loop Power cables and external SSA cables can be disconnected while that system is running 1 a Run the Link Verification s service aid to the SSA adapter for which this error has been logged see k A list of pdisks similar to the example given here is dieplayed AINE VERIFICATION 802386 gt SSA Link Verification for nunu ssa0 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdiskl AC7AAO9A 0 3 Good nunu pdisk2 AC7AA2D6 V2 Good nunu pdisk3 AC7AAQBD 2 Good nunu pdisk4 AC7AAOB1 3F O Good F3 Cancel F10 Exit Xe oy Note On the Link Verification screen each adapter port is identified by the number of its related connector on the adapter card Adapter port 0 is identified as A1 Adapter port 1 is identified as A2 Adapter port 2 is identified as B1 e Adapter port 3 is identified as B2 SRNs 21xx through 29xxx and SRN 33xxx include the adapter port number 0 3 b Go to step a 2 from step il 398 Advanced SerialRAID Adapters User and Maintenance Information a Observe the SRN that sent you to this MAP The last three characters are in the format PAA where P is the number of the SSA adapter port and AA is the SSA address of the device Note the value of PAA in the SRN For example I
196. de interrupt handler entry point of the top kernel extension Top Kernel Extension Entry Point The top kernel extension must have a concurrent mode command interrupt handler entry point which is called directly from the interrupt handler of the SSA disk device This entry point function can take four arguments conc_cmd pointer e cmd_op field e message_code field e devno field The conc_cmd pointer points at a conc_cmd structure These arguments must be of the same type that is specified by the conc_intr_addr function pointer field of the dd_conc_register structure The following valid concurrent mode commands are defined in the usr include sys ddcon h file For each command the devno field specifies the appropriate SSA disk drive DD_CONC_SEND_REFRESH The DD_CONC_SEND_REFRESH device driver entry point has completed The error field in the conc_cmd structure contains the return code that is necessary for the completion of this command The possible values are defined in the usr include sys errno h file The conc_cmd pointer argument 240 Advanced SerialRAID Adapters User and Maintenance Information to the special interrupt handler entry point of the top kernel extension is non null The cmd_op message_code and devno fields are 0 DD_CONC_LOCK The DD_CONC_SEND_LOCK device driver entry point has completed The error field of the conc_cmd structure contains the return code that is necessary for the completion of this command
197. description 216 files 216 purpose 216 return values 216 SSA_TRANSACTION ioctl operation 214 description 214 files 215 purpose 214 return value 215 summary of SSA error conditions 211 adapter microcode checking the level 23 adapter microcode maintenance 267 adapter POSTs power on self tests 268 adapter takeover 219 adapters Advanced SerialRAID Adapter type 4 P 128 MB Memory Module feature 5 description 4 Fast Write feature 5 lights 6 port addresses 6 ID during bring up 6 installing 265 Add a Disk to an SSA RAID Array option 138 Add a Hot Spare Pool option 81 Add an SSA RAID Array option 58 add_hsm_pool_adap command 81 adding a new hot spare pool 81 adding disks to a hot spare pool 84 addresses port Advanced SerialRAID Adapter type 4 P 6 addressing SSA Devices location code format 19 unique IDs UIDs 21 addssaraid command 138 Advanced SerialRAID Adapter type 4 P description 4 lights 6 port addresses 6 array states RAID 0 31 Good 31 Offline 31 array states RAID 1 32 array states RAID 10 36 Degraded 37 Exposed 37 Good 36 multiple 38 Offline 37 Rebuilding 37 Unknown 38 array states RAID 5 33 Degraded 33 Exposed 33 read operations while in 33 write operations while in 33 flowchart 35 Good 33 initial rebuilding operation 34 Offline 34 Rebuilding 34 adapter replacement 34 disk drive replacement 34 arrays adding a disk drive to an SSA RAID array 138 adding a new hot spare pool
198. detected 316 Advanced SerialRAID Adapters User and Maintenance Information Output Examples The ssa_speed command sends all error messages to stderr and output to stdout Link speeds can be 20 20 MB 40 40 MB 00 not operational 2 not determined To display the link speed of pdiskO give the command ssa_speed 1 pdisk0 To display the adapter link speeds of ports A1 and A2 on ssa0 give the command ssa_speed a ssa0 p A To display the adapter link speeds of all the devices in network B on ssa0 give the command ssa_speed a ssa0 n B To find link speed exception conditions give the command ssa_speed x Chapter 15 Using the SSA Command Line Utilities 317 ssavfynn Command Purpose Syntax Description Flags Output To check for duplicated node numbers Note It is recommended that this command be used only when all the adapters on the network are SSA RAID adapters ssavfynn w The ssavfynn command is in the usr Ipp diagnostics bin file It has no flags If the ssavfynn command runs and finds no duplicate node numbers on the SSA network it returns no message If the command finds duplicate node numbers it returns a message that is similar to that shown here SSA User Configuration Error Node Number 1 is set on both Local Host abc somewhere ibm com and Remote Host xyz This message says that a problem exists between your machine abc and another machine xyz that is conne
199. disk drive microcode might become corrupted The microcode cannot be corrected Normally exchange the disk drive for a new one If you need to try to save data you might be able to exchange the electronics card assembly of the disk drive For more details see the nstallation and Service Guide for the unit that contains the disk drive To download microcode to one specific disk drive select Download Microcode to selected SSA Physical Disk Drives and follow the instructions that are displayed You normally select this option when you do not want the microcode on the selected disk drive to be at the latest available level 4 lf you have a new level of microcode to install or if you have replaced a disk drive and want to upgrade it to the present level select Download Microcode to all SSA Physical Disk Drives This option ensures that all disk drives have the latest level of microcode installed It downloads microcode only to those disk drives whose level of microcode is lower than that in the microcode directory or on the microcode diskette Note Different types of SSA disk drive might need different versions of the microcode Microcode download files are provided for each type of disk drive Where a system contains more than one type of SSA disk drive this Service Aid selects the correct microcode file for each of those types 344 Advanced SerialRAID Adapters User and Maintenance Information Link Speed Service Aid The Link Speed serv
200. disk or pdisks if it is a RAID array that makes up the hdisk Chapter 10 SSA Error Logs 185 e If SD 6000 is installed on the using system and a hardware error is logged the SD 6000 runs error log analysis and reports an incident if problems are found that need service activity Error Log Analysis Routine The purpose of the SSA error log analysis routine that is contained in the diagnostics is to generate an SRN for any logged errors that need service action Normally the error log analysis is related to the previous 24 hour period If you want to perform an error log analysis that is related to a period longer than 24 hours use the ssa_ela command see If the detail data field for the error record contains SCSI sense data e SSA_DISK_ERR2 or SSA_DISK_ERR3 type errors do not generate an SRN e DISK_ERR1 or DISK_ERR4 type errors media errors generate an SRN if more than a predetermined number of these errors exist in the log The SRN is 1XXXX where XXXX is the contents of bytes 20 and 21 of the detail data SSA _DISK_ERR1 or SSA_DISK_ERR4 type errors generate the SRN 1XXXX where XXXX is the contents of bytes 20 and 21 of the detail data If the detail data field contains SSA error code data the first character of the data is used as an error log analysis threshold value If the number of times that a particular error has been logged during the previous 24 hours is greater than the threshold value for that error an SRN is
201. disk drive by verifying that the serial number on the front of the disk drive is the same as the serial number that is displayed on the screen 4 When you are sure that you have selected the correct disk drive select Certify Chapter 16 SSA Service Aids 341 Display Download Disk Drive Microcode Service Aid The Display Download Disk Drive Microcode service aid allows you to e Display the level of microcode that is installed on all available disk drives e Change the level of microcode for a specific available disk drive to any level that is available in the using system microcode directory or on diskette Change the level of microcode for all available disk drives to the latest level that is available in the using system microcode directory or on diskette Attention Usually you can download the microcode to disk drives that are in use By doing so however you might cause a temporary delay in the AIX operating system or in the user s application program Do not download microcode to a disk drive that is in use unless you have the user s permission Always refer to the download instructions that are supplied with the microcode and check for any special restrictions that might be applicable If you are not sure do not download to disk drives that are in use When you download new microcode to a disk drive the new level of microcode is not shown by the Display the Microcode Levels option until the disk drives have been
202. disk drive to the replacement disk drive e Prepare the spare disk drive so that it can again be used if another disk drive fails To obtain the SSA Spare Tool go to the uniform resource locator URL address and follow the instructions that are given there The address is hitp www hursley ibm com ssa rs6k SpareTool sparetool html 163 164 Advanced SerialRAID Adapters User and Maintenance Information Chapter 9 Using the Fast Write Cache Feature This chapter describes how to configure the Fast Write Cache feature and how to deal with any fast write problems that might occur during fast write operations Fast Write Cache Card Battery The Fast Write Cache Option Card receives its power from a rechargeable battery This battery can maintain data in the write cache for seven days after power has been removed from the adapter card When an adapter is connected to the power the Fast Write Option Cache Card performs a fast charge operation on the battery This fast charge operation lasts from 5 to 60 minutes as determined by the charge state of the battery During the fast charge operation you can enable and get access to fast write disk drives The fast write function however remains inactive until the battery is fully charged Note If you run diagnostics to an adapter that contains a Fast Write Option Card whose battery is on a fast charge operation SRN 42529 is generated The Fast Write Cache Option Card keeps a record of
203. drive or select a new disk drive for addition to the array Type smitty ssaraid and press Enter Select Change Member Disks in an SSA RAID Array Select Swap Members of an SSA RAID Array Select the degraded hdisk Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you reinstalled or selected in step Podl When failed disk drives have been exchanged for new disk drives the data is rebuilt and the array changes its state to the Good state Q to verify the repair perange the failed disk drive for a new one see Type smitty ssaraid and press Enter Select Change Member Disks in an SSA RAID Array Select Swap Members of an SSA RAID Array Select the degraded hdisk Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you reinstalled or selected in step Boal When failed disk drives have been exchanged for new disk drives the data is rebuilt and the array changes its state to the Good state Q to verify the repair Chapter 17 SSA Problem Determination Procedures 413 21 from step th No spare disk drives are available for an array that is configured for hot spare disk drives a Ifthe subsystem contains disk drives that have failed repair tose disk drives o
204. drive that is in the same physical domain as are the other disk drives in the pool see Fehapier Hat Spard 80 Advanced SerialRAID Adapters User and Maintenance Information Adding a New Hot Spare Pool configure hot spare pools read you proceed 1 For fast path type smitty add_hsm_pool_adap and press Enter Otherwise select Add a Hot Spare Pool from the SSA RAID Array menu 2 A list of adapters is displayed in a window j before SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool SSA RAID Manager Move cursor to desired item and press Enter ssaQ Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 F1l Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the adapter to which you want to add the hot spare pool Chapter 6 Using the RAID Array Configurator 81 3 A list that shows Loop A or Loop B is displayed a i SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID
205. dung mit der entsprechenden Kostenverordnung Amtsblatt 14 93 kostenpflichtig Nach der EN 55022 Dies ist eine Einrichtung der Klasse A Diese Einrichtung kann im Wohnbereich Funkst rungen verursachen in diesem Fall kann vom Betreiber verlangt werden angemessene Massnahmen durchzuf hren und daf r aufzukommen Anmerkung Um die Einhaltung des EMVG sicherzustellen sind die Ger te wie in den Handb chern angegeben zu installieren und zu betreiben Taiwan Class A Compliance Statement Soe is te Ase Sado Cee aa Pe Re ARE B IS REE ToS Rai T FA OR ER AE Appendix Communications Statements 433 434 Advanced SerialRAID Adapters User and Maintenance Information Glossary This glossary explains terms and abbreviations that are used in the manual The glossary contains terms and definitions from the BM Dictionary of Computing If you do not find the term or abbreviation for which you are looking try the index or refer to the IBM Dictionary of Computing at URL http www networking ibm com nsg nsgmain htm A AIX Advanced Interactive Executive AIX system disk A disk that is owned by AIX that is it does not belong to an array and it is not a hot spare disk array See disk array attribute A named property of an entity for example the attributes of a RAID array include state current use and size of array B boot To prepare a computer system for operation by loading an operating system
206. dvanced SerialRAID Adapters User and Maintenance Information a Ensure that the external SSA cables are correctly connected to the enclosures in which the devices are installed and to the SSA adapter b Go to repair All the disk drives are switched off Go to the START MAP for the enclosure in which the SSA devices are installed Q to verify the e The SSA adapter is failing a Exchange the SSA adapter for a new one see the using system Installation and Service Guide Q to verify the repair YES Go to step 4 from step B Observe the Status column on the screen If the status of any pdisk is Power that pdisk has detected a loss of redundant power or cooling In the example shown here pdisk2 has detected such a loss Link VERIFICATION 802386 D SSA Link Verification for nunu ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 B1 B2 Status TOP nunu pdisk11 AC7AA09A 0 5 Good nunu pdisk8 AC7AA2D6 1 4 Good nunu pdisk2 AC7AAOBD 2 3 Power nunu pdisk3 AC7AA0B1 ey Good nunu pdisk7 AC7AAQB5 4 1 Good nunu pdisk12 AC7AA052 5 0 Good nunu pdisk AC7AAQB9 0 5 Good nunu pdisk1 AC7AAQB3 1 4 Good nunu pdisk10 AC7AAQB4 2 33 Good MORE 4 F3 Cancel F1O Exit Does one of the pdisks have a Power status NO Go to step Bon page 396 YES Go to the START MAP for the enclosure in which
207. e Fast Write Cache Option Card is Possible FRUs low The card has switched to Self Refresh mode Fast Write Cache Option Card 90 Action In the sequence shown exchange the FRUs for new FRUs 00 SSA adapter card 10 using system Installation and Service Guide 4252B Description The Fast Write Cache Option Card battery has reached the Possible FRUs end of its life The fast write cache is disabled Fast Write Cache Option Card battery 100 Action Exchange the FRU for a new FRU 5 y o 4252C Description The Fast Write Cache Option Card battery needs to be Possible FRUs exchanged for a new one Action Exchange the FRU for a new FRU Fast Write Cache Option Chapter 17 SSA Problem Determination Procedures 369 Action If the SSA service aids are available run the Link Verification service aid see failing device If no device is listed with a status of Failed use the PAA part of the SRN to determine which device is failing Before you exchange the failing device run diagnostics in System Verification mode to that device to determine the cause of the problem If the SSA service aids are not available note the value of PAA in this SRN and go to Exchange the failing FRU for a new FRU 370 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 42540 Description Two way fast write for a disk drive is configured to
208. e Guide a Verify with the customer that the fast write configuration can be deleted for the disk drives Type smitty devices and press Enter Select SSA Disks Select SSA Logical Disks Select Enable Disable Fast Write for Multiple Devices mo aos Select all the pdisks against which the message Fast Write is enabled for these devices appears Press Enter h Select no in the Enable Fast Write field i Select yes in the Force Delete field j Press Enter Chapter 17 SSA Problem Determination Procedures 365 SRN Problem Possible Causes 42521 Description A Fast Write Cache Option Card has failed Data has been written to the cache card and cannot now be recovered The disk drives that have lost the data cannot be identified All unsynchronized fast write disk drives that are attached to this adapter are offline Action 1 Ask the customer to refer to De to determine e Which disk drives are affected by this error e How much data has been lost e Which data recovery procedures can be done 2 Ask the customer to disable the Fast Write option for e Each device for which the Fast Write option is offline e All other devices that are connected to the failing adapter and have the Fast Write option enabled For instructions on how to disable the Fast Write option see ONTO no The a At B acne a e on bade ote I 3 If this error has occurred because the Fast Write Option Card has been
209. e commands are queued to SSA logical disks The default value is 0 for all SSA logical disks that do not use the fast write cache with this setting the SSA disk device driver maintains a single seek ordered queue of queue_depth operations on the disk Read operations and write operations are queued together in this mode If write_queue_mod is set to a non zero value the SSA disk device driver maintains two separate seek ordered queues one for read operations and one for write operations In this mode the device driver issues up to queue_depth read commands and up to write_queue_mod write commands to the logical disk This facility is provided because in some environments it might be beneficial to hold back write commands in the device driver so that they can be coalesced into larger operations that can be handled as full stride writes by the RAID software in the adapter This facility is not likely to be useful unless a large percentage of the workload to a RAID 5 device consists of sequential write operations Device Dependent Subroutines The open read write and close subroutines start typical physical volume operations open read write and close Subroutines The open subroutine is mainly for use by the diagnostic commands and utilities Correct authority is required for execution If an attempt is made to run the open subroutine without the correct authority the subroutine returns a value of 1 and sets the errno global vari
210. e configuration 222 Advanced SerialRAID Adapters User and Maintenance Information Attributes Common to SSA Logical and SSA Physical Disks adapter_a Specifies either the name of one adapter that is connected to the device or none if no adapter is connected as adapter_a now adapter_b Specifies either the name of one adapter that is connected to the device or none if no adapter is connected as adapter_b now primary_adapter Specifies whether adapter_a or adapter_b is to be the primary adapter for this device You can use the chdev command to modify this attribute to one of the values adapter_a adapter_b or assign If you set the value to assign static load balancing is performed when this device is made available and the system sets the value to either adapter_a or adapter_b connwhere_shad Holds a copy of the value of the connwhere parameter for this disk drive SSA disks drives cannot be identified by the location field that the Isdev command gives because they are connected in a loop and do not have the hardware selectable addresses of SCSI devices The serial numbers of the disk drives are the only method of identification The serial number of a particular disk drive is written in the connwhere field of the CuDv entry for that disk drive This connwhere_shad attribute which shadows the connwhere value allows you to display the connwhere value for an SSA device for a pdisk or hdisk location Describes in text the desc
211. e ee ee ee 806 Flags sir Ke tea ce Se he Bln a cd a me Cee bow eee oe a B06 Output beets he ee ob dh Ge UB ge oh oe OE Ae kh ode at 4 2 oe 807 ssa_getdump Command Se ee ot oR Gs Se ek oe ea a ee we a a 808 P rp se i s a eee AE ke ay es a eee 808 Syna eae H 26 a Fok we bh Re Go ee e A a a G308 Descriptions os tp Owe Mee Se a a a a Amy AO eee ak iba Seon BOB Flags a a Sai ee Ga ee ot ie re oe 809 Output rk Gat for dt se d Arce oR Se at ah a or Rok a 810 ssaidentify Command D Me Rye ae te UE ah dete te ok te a ok A TT P fposes s ae sae a eR te ca ee es A ae ae et TT Syntaxe it aie te ee Cy ee a ek cee we A8 OX Wot oh ae oh et a OTA Description s i Ge a as ee Oh ow Se a ah ee He ee a ST Flags a tse AR wt Se ed ee oy th ae a a ase ee TT ssa_progress Command PA tr Gal Be AT A ee era a a ee a 2812 Purpose so mo Hoe ck 4S Sep be ble amp Bc oe a ul a MS eek eo 8 ole SYNGE fh do Ade Bo He cl Cok de da 22 4G he ana 282 Deseriptlone ao as eae Re w apt Bae GA Oe OR ae ee ee eae EO a 2 Flags ea g we a eA EA BO ee BR Re ee eC ee a 812 Output 2 we A wf Ok A De ke ck ce Ae ek a BT2 Examples au Ca Wee a nm a adi eh Gee caw oa de aad aks Se Be Me Bl ssa_rescheck Command Oo hy er GEL ae ee Oh Ee ee Ae ee oe TS PUIDOSE isa a ce eer Ad oe Se tt ote Ge Gy oe Tw ae cE eae a ha BIS Syntax 2 Bods Abode Sea ie e ok a a GDA Ae St 4 2818 D Scriptlone so aves Ae w ee a GA Oe OR ye eh ee a EE a
212. e fails a hot spare disk drive is available to replace it That hot spare disk drive is selected from the listed hot spare pool or if no hot spare disk drives are available in that pool and Choose Hot Spare Only from Preferred Pool is set to no x ging g the hot spare disk drive is selected from another pool If set to no this field indicates that the array member disk drive is not protected No suitable hot spare disk exists in the listed pool and if Choose Hot Spare Only from Preferred Pool is set to no see no suitable hot spare disk exists in any other hot spare pool 76 Advanced SerialRAID Adapters User and Maintenance Information Status The status of the array member disk drive Valid values for status are good The disk drive is working not_present The disk drive cannot be detected It has been removed or it has failed too_large The member disk drive is too large to be protected by any hot spare disk drive that is in the pool Note The size of the member disk drive is not the physical size of the disk drive but the size that the array manager assigns to it For example if a RAID 10 array is created from three 9 GB disk drives and one 18 GB disk drive the size that is assigned to each array member disk drive is 9 GB The 18 GB disk drive can still be protected by a 9 GB hot spare disk drive wrong_pool This member disk drive of the array has been replaced with a hot spare disk drive from another
213. e loop with two adapters in one using system 11 open read write and close subroutines disk device driver 224 open and close subroutines adapter device driver 210 open subroutine tmssa device driver 248 operation after a loss of member disks split site management 148 adapter not known to remaining half of the array 157 one half of the array is not present 149 split and join procedure not performed correctly 159 options of the RAID Command Line Interface 192 P part numbers 291 paths data SSA link 7 examples broken loop cable removed 352 broken loop disk drive removed 355 normal loops 350 PCI adapter ODM attributes 209 pdisks and hdisks changing numbers 278 explanation of 19 identification 19 reformatting a pdisk as an hdisk 336 physical disk change attributes RAID 5 203 physical relationship of disk drives and adapters 24 one pair of adapter connectors in the loop 24 pairs of adapter connectors in the loop mainly shared data 26 pairs of adapter connectors in the loop some shared data 25 port addresses Advanced SerialRAID Adapter type 4 P 6 POSTs power on self tests adapter 268 powering off using systems in a large configuration 17 powering on using systems in a large configuration 17 problem determination for SSA links 349 POSTs adapter power on self tests 268 procedures 359 SRNs service request numbers 359 SSA link error 423 problems RAID array 87 R RAID O array states 31 Good 31 Offline 31 RAI
214. ected condition If you have just installed the SSA subsystem ensure that the latest versions of microcode and software have been installed If the system is still operational and you have any hot spare disk drives attached to the adapter an automatic dump might have been performed Run ssa_getdump l to see if any dump data is present Software errors can result from hardware failures Always solve hardware problems therefore before looking for software errors Disk drive errors on SSA subsystems are logged against the physical disk drive pdisk rather than the logical disk drive hdisk If you are looking for the cause of a problem where the failing hdisk is known you can use either of the following methods to find that cause e Use the Configuration Verification service aid or give the ssaxlate I1 hdisk command to determine which pdisks are associated with the hdisk e Give the ssa_ela I hdisk command to run error log analysis When ssa_ela is run to an hdisk it performs an error log analysis for all the devices that support that hdisk Those devices are one or more adapters and one or more pdisks The following example shows a part of an SSA error log See the using system documentation for a detailed description of all the fields that appear in the error log display 180 Advanced SerialRAID Adapters User and Maintenance Information LABEL SSA_LINK_OPEN IDENTIFIER 625E6B9A Date Time Tue 23 Sep 03 00 00 Seq
215. ed Possible FRUs re SSA adapter card 100 Action Exchange the FRU for a new FRU using system Installation and Service Guide 50100 Description An attempt was made to log an error against a pdisk that is Disk drive error during system not available to the using system configuration Action This problem has occurred for one of the following reasons e A user has deleted a pdisk from the system configuration In such an instance the hdisk that is using the pdisk continues to operate normally If the disk drive tries to log an error however this SRN 50100 is produced Give the cfgmgr command to return the pdisk to the system configuration e A device has tried to log an error during system configuration To find the failing device run diagnostics to the devices that are connected to this SSA adapter 50200 Description A duplicate node number has been detected SSA loop configuration problem Action This problem is a user error See FSSA Disk Concurrent Mode of line utility see gt node has the duplicate node number 50411 Description The SSA adapter has detected an SS_SIC_CLASS1 error Possible FRUs Action This error can be caused by an adapter hardware failure or by excessive electrical interference on the SSA loop Exchange the FRUs for new FRUs in the given sequence SSA adapter card 40 using system nstallation and Service Guide External SSA cables 30 Device 30 Chapter 17 SSA
216. ed devices are all those that contain unsynchronized data when the cache card fails or is removed To list these devices type ssaraid 1 ssaX Iz a state no_cache where X is the adapter number Use the recovery procedure that is described for SRN 42521 You must recover all the devices that are listed SRN 42525 If a Fast Write Cache Option Card fails or is removed from the adapter the affected devices are all those that contain unsynchronized data when the cache card fails or is removed To list these devices type ssaraid 1 ssaX Iz a state wrong_cache where X is the adapter number Use the recovery procedure that is described for SRN 42521 You must recover all the devices that are listed Chapter 9 Using the Fast Write Cache Feature 175 176 Advanced SerialRAID Adapters User and Maintenance Information Chapter 10 SSA Error Logs This chapter describes Error logging Error logging management Error log analysis Good housekeeping Each topic is discussed as a summary then as a detailed description The summaries provide all the information that you need for routine service operations on SSA subsystems For these operations you have no need to inspect the system error log or to attempt to analyze the contents of the log The detailed descriptions help you understand the meaning of the error log data so that you can further analyze the error log For example you might decide to fail over an HACMP
217. ed to a particular RAID manager 1 For fast path type smitty Ismssaraid and press Enter Otherwise select List All SSA RAID Arrays Connected to a RAID Manager from the SSA RAID Array menu A list of RAID managers is displayed in a window Va SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next S Select the RAID manager for which you want a list of connected arrays 100 Advanced SerialRAID Adapters User and Maintenance Information A list of arrays is displayed a COMMAND STATUS D Command OK stdout yes stderr no Before command completion additional instructions may appear below hdisk4 09523173A02137K good 3 4G RAID 5 array hdisk3 095231779F0737K good 3 4G RAID 5 array F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel1 F1O Exit Find n Find Next o Chapter 6 Usin
218. eir mirrors that have corresponding LBAs on each component U unconfigure a To take a device from the available configured state to the defined state b To take out of use by the existing computer system unrecoverable error An error for which recovery is impossible without the use of recovery methods that are outside the normal computer programs user mode In the AIX operating system a mode in which a process is run in the user s program rather than in the kernel V vary off To make a device control unit or line not available for its normal intended use vary on To make a device control unit or line available for its normal intended use vital product data VPD In the AIX operating system information that uniquely defines system hardware software and microcode elements of a processing system VPD Vital product data 438 Advanced SerialRAID Adapters User and Maintenance Information Index Numerics 128 MB Memory Module feature 5 A action attributes RAID 5 204 adapter PCI ODM attributes 209 adapter device driver description 209 device dependent subroutines 210 direct call entry point 217 description 217 purpose 217 return values 217 files 212 head device driver interface 208 IOCINFO ioctl operation 213 description 213 files 213 purpose 213 managing dumps 211 open and close subroutines 210 PCI ODM attributes 209 responsibilities 207 SSA_GET_ENTRY_POINT ioctl operation 216
219. el F8 Image F1Q Exit Enter Do Find n Find Next Select the adapter whose candidate disk drives you want to list Chapter 6 Using the RAID Array Configurator 113 3 A list of candidate disk drives is displayed A COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below pdisk3 0004AC5119E000D free 1 1G Physical disk pdisk5 08005AEA030D00D free 2 3G Physical disk Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next 114 Advanced SerialRAID Adapters User and Maintenance Information Listing AIX System Disk Drives This option allows you to list disk drives that are used by the using system These disk drives are not member disk drives of any array 1 For fast path type smitty lassaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List AIX System Disks A list of adapters is displayed in a window a List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA
220. em Possible Causes 45PAA Description The SSA adapter has detected an open SSA loop Possible FRUs Device 40 Exchanging Action If the SSA service aids are available run the Link Verification A A service aid see to determine Tiaa i which part of the SSA na is tailing SSA adapter card 40 using system Installation If the SSA service aids are not available note the value of PAA in this and Service Guide SRN and go to External SSA cables Then go to FSSA Link Erare on page 424 to solve the problem Fibre Optic Extenders fiber optic cables or internal connections in the device enclosure 20 enclosure service information 46000 Description An array is in the Offline state because not enough disk For RAID 0 at least one drives are present in the array to maintain data availability member disk drive of the array is missing Action If the SSA service aids are available run the Link Verification y g service aid see 8 to find power For RAID 5 at least two faults or broken SSA links that might be causing this problem member disk drives are missing If the SSA service aids are not available or the problem remains go to For RAID 10 at least one mirrored pair of disk drives is missing e Power problem System configuration problem 46500 Description A member disk drive is missing from an array or the original At least one disk drive missing SSA adapter is not available from an array and that ar
221. ember disk drives RAID 10 defines the first and third disk drives to be primary member disk drives RAID 1 defines the first disk drive to be the equivalent of the first and third disk drives together If the first disk drive is missing in RAID 1 it is equivalent to the first and third disk drives being missing in RAID 10 32 Advanced SerialRAID Adapters User and Maintenance Information RAID 5 Array States Good State A RAID 5 array can be in one of several states A knowledge of those states is useful when you are configuring your arrays The states are described here A flowchart for the RAID 5 array states is shown in Eigura 15 on page 39 A RAID 5 array is in the Good state when all the member disk drives of that array are present Exposed State A RAID 5 array enters the Exposed state when a member disk drive becomes missing logically or physically from that array When an array is in the Exposed state you can reintroduce the missing disk drive or exchange it for a new one If the missing disk drive is reintroduced the array returns to the Good state The array management software does not need to rebuild the data If a new disk drive is exchanged for the missing disk drive the array management software rebuilds the data that was on the original disk drive before it became missing then writes that rebuilt data to the replacement disk drive When the data is correct the array management software returns the array to the Good st
222. embers of an array The SSA RAID adapter handles such disk drives in the same way as a non RAID SSA adapter does It transfers data directly between the disk drives and the system and uses no RAID functions When first installed all disk drives are by default defined as AIX disks that is they are not members of an array Before they can be added to arrays you must redefine them so that the system no longer has direct access to them 30 Advanced SerialRAID Adapters User and Maintenance Information RAID 0 Array States A RAID O array can be in either of two states A knowledge of those states is useful when you are configuring your arrays The states are described here Good State A RAID 0 array is in the Good state when all the member disk drives of that array are present Offline State A RAID O array enters Offline state when one or more member disk drives become missing Read and write operations are not allowed Chapter 3 RAID Functions and Array States 31 RAID 1 Array States RAID 1 array states are the same as RAID 10 array states For details see FRAID 1d Bray Slates on page dA In RAID 1 arrays the first member disk drive of the array is defined as the primary disk drive and the second member disk drive is defined as the secondary disk drive These definitions prevent operation on separate member disk drives of the array when the array becomes split but separate systems can still access one of the m
223. en do the appropriate actions Note If you still do not have any of these SRNs you are in the wrong MAP Action 46000 An array is in the Offline state Go to step fl 47000 You have more than the maximum Go to step Bon page 405 number of arrays allowed 47500 A partial loss of data has occurred Go to step Ban page 404 49000 An array is in the Degraded state Go to step 13 on page 40d 49100 An array is in the Exposed state Go to stepiZ on page 410 5 from step n An array is in the Offline state if it contains at least one member disk drive but does not contain enough member disk drives to maintain data availability Are any disk drives missing or without power or have any disk drives been recabled not necessarily by you NO Go to step 6 on page 404 YES Restore the original configuration a Type smitty ssaraid and press Enter b Select List All SSA RAID Arrays Connected to a RAID Manager The status of the array changes to Good when the adapter can find all the member disk drives of the array c Go to EMAP repair Q to verify the Chapter 17 SSA Problem Determination Procedures 403 6 from step B Either one or more disk drives have failed or an array that is not complete has been connected to the SSA adapter e f one or more disk drives have been added to this system and those disk drives were previously members of an array on this system or on another system do the
224. en either in this book or in the Service Guide for the SSA subsystem See fe nies Denies Nee for more information about SRNs Error log analysis can be started in several ways e If you run diagnostics in Problem Determination mode to an SSA device one of the following procedures occurs An error log analysis is performed for all SSA devices if any SSA device has a permanent PERM error in the error log Anerror log analysis is performed for that device before the physical device is tested If errors are found no test is performed on the hardware Error log analysis is performed every 24 hours by the run_ssa_ela cron see e You can use the AIX diag command to run error log analysis On the command line enter diag ecd device Error log analysis runs for the selected device If the analysis determines that service action is needed a message is displayed This message indicates that a problem was detected and requests that diagnostics be run to that device e You can run error log analysis to all SSA devices On the command line enter ssa_ela A list of SRNs for all SSA devices that need service action is displayed e You can run error log analysis for selected SSA devices On the command line enter ssa_ela device The device that is selected can be an SSA adapter a pdisk or an hdisk If an hdisk is selected the error log analysis runs for the adapters that control the selected hdisk and the p
225. en rejected by the array that disk drive is listed as BlankReservedZ 8 Select the required disk drive and press Enter 9 Select Disk to Add 10 Press the List key to display the disk drive to add Disk drives that are free or hot spare disk drives are listed 11 Select the required disk drive and press Enter 12 Press Enter to perform the swap operation 94 Advanced SerialRAID Adapters User and Maintenance Information Using Other Configuration Functions This part of the chapter describes the maintenance procedures that are available for your Advanced SerialRAID Adapter You can use these procedures at any time You can get to the required SMIT menu by using fast path commands or by working through other menus Notes 1 Although this book always refers to the smitty commands you can use either the smitty command or the smit command The procedures that you follow remain the same whichever of the two commands you use If you send the smit command from a graphics terminal however the menus are displayed slightly differently from those shown in this book If you are not familiar with the selection of items from the graphics versions of the menus use the smitty command The menus will then appear as shown in this book 2 If you use fast path commands you might need to go through intermediate steps that are not shown in this book Also some menus might be displayed slightly differently from those shown in this boo
226. en tested The hardware consists of only the adapter card memory module and if installed Fast Write Cache Option Card and battery Some POST failures cause the adapter to become unavailable to the using system Other POST failures allow the adapter to be available although some function might not be enabled The particular tests that are run are related to the type of SSA adapter that is being used If a POST 268 Advanced SerialRAID Adapters User and Maintenance Information fails and prevents the adapter from becoming available exchange the adapter card for a new one If a POST fails but does not prevent the adapter from becoming available an error is logged That error indicates which FRUs must be exchanged for new FRUs Chapter 13 SSA Adapter Information 269 270 Advanced SerialRAID Adapters User and Maintenance Information Chapter 14 Removal and Replacement Procedures Exchanging Disk Drives 1 2 If you are removing a disk drive under concurrent maintenance see the service information for the device that contains the disk drive you must first determine which hdisk is using the pdisk that you want to remove To do this you can either use ine Configuration Verification service aid see e If no hdisk is using the pdisk go to Jo TA e If an hdisk is using the pdisk you must now determine the type of the hdisk The hdisk might be an SSA disk drive or a RAID disk To determine whether the hdisk is a RAID disk type
227. ent Configuration data for the hot spare pool is saved on all hot spare disk drives The hot spare disk drives that are in the pool however do not all contain the same configuration data mixed An array that is in this pool has used a hot spare disk drive that is from another pool unused Hot spare disk drives exist in a pool but they are protecting no member disk drives 74 Advanced SerialRAID Adapters User and Maintenance Information Showing the Disks That Are Protected by Hot Spares This option shows you which member disk drives of an array are protected by hot spare disk drives 1 For fast path type smitty 1s_hsm_array_status and press Enter Otherwise select List Status of Hot Spare Protection for an SSA RAID Array from the SSA RAID Array menu 2 A list of adapters is displayed in a window iz SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools SSA RAID Manager Move cursor to desired item and press F7 ONE OR MORE items can be selected Press Enter AFTER making all selections ssaQ Available 04 06 IBM SSA 160 SerialRAID Adapter 14109100 ssal Available 04 07 IBM SSA 160 SerialRAID Adapter 14109100
228. eplacement Procedures 287 6 Refer to Figure 44 Figure 44 Disconnecting the Battery Assembly 7 Invert the Fast Write Cache Option card 8 Carefully unplug the battery assembly from the connector 288 Advanced SerialRAID Adapters User and Maintenance Information Installing a Battery Assembly into the Fast Write Cache Option Card of an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts The Fast Write Cache Option card might contain customer data 1 Refer to Figure 45 M Figure 45 Connecting the Battery Assembly 2 Hold the Fast Write Cache Option card so that the battery assembly connector is upward 3 Connect the battery assembly to the connector Chapter 14 Removal and Replacement Procedures 289 4 Refer to Figure 46 OG N E lt Figure 46 Installing the Battery Assembly 5 Locate the battery assembly so that
229. er and a Disk Drive In an SSA adapter and a disk drive have failed When a new adapter is installed the array remains in the Offline state until the state of the Split Array Resolution flag is changed back to Primary System 1 SSA Adapter Primary 1 Secondary 1 bmatecliacdcecesecessescencad Figure 30 Failure of an Adapter and a Disk Drive Chapter 7 Split Site Management 157 Moving an Array between Systems In exactly half of a RAID 10 array is being moved from its original connections adapter A and adapter B to a new configuration where it is connected to adapter C and adapter D System 1 SSA Adapter A System 3 SSA Adapter C Figure 31 Moving a RAID 10 Array Secondary 1 Primary 2 Secondary 2 System 2 SSA Adapter B Primary 1 Primary 2 Under these conditions e The half of the array that is still connected to adapter A and adapter B is in the Exposed state System 4 SSA Adapter D The half of the array that is connected to adapter C and adapter D is in the Offline state System 3 and system 4 generate SRN 48755 You can solve this problem if you do one of the following e Return the primary half of the array to its original adapters e Move the secondary half of the array to the new adapters 158 Advanced SerialRAID Adapters User and Maintenance Information e Change the state of the Split Array Resolution fl
230. erformed once when the devices are configured for the first time You can use the chdev command to modify the primary path Because of the dynamic nature of the relationship between SSA adapters and disk drives SSA pdisks and hdisks are not children of an adapter but of an SSA router This router is called ssar It does not represent any actual hardware but exists only to be the parent device for the SSA logical disks and SSA physical disks Note When the SSA disk device driver switches from using one adapter to using the other adapter to communicate with a disk it issues a command that breaks any SSA SCSI reserve condition that might exist on that disk The reservation break Chapter 12 Using the Programming Interface 219 is performed only if this using system has successfully reserved the disk drive through the original adapter This check is to prevent adapter takeover from breaking reservations that are held by other using systems If multiple using systems are connected to the SSA disks SSA SCSI reserve should not therefore be used as the only method for controlling access to the SSA disks Fencing is provided as an alternative method for controlling access to disks that are connected to multiple using systems The PCI SSA Multi Initiator RAID EL Adapter the Micro Channel SSA Multi Initiator RAID EL Adapter and the Advanced SerialRAID Adapter can reserve to a node number rather than to an adapter see highly recommended that you
231. ermine carefully the retry period total write time out period and the amount of data that is being sent For example to write 64 KB of data with no retry operations you need 64 KB read and write buffers If you allow one retry operation you need only 32 KB buffers Using SSA Target Mode SSA Target Mode does not attempt to manage the data transfer between devices It does however take action if buffers become full and it ensures that read operations can read data from only one write operation Any protocol that is needed to manage the communication of data must be implemented in user supplied programs The only delays that can occur when data is being received are delays that are characteristics of the SSA system and of the environment in which it operates and delays that are caused by full buffers SSA Target Mode can concurrently send data to and receive data from all attached nodes Blocking read and blocking write operations do nothing until data is available to be read or until the write operation is complete Execution of Target Mode Requests The write operation transfers the data into the device buffers When a buffer is full the SSA adapter starts to transfer the data to the remote using system At the same time the user s application program continues to fill the device buffer with the remaining data that is being transferred If the amount of data that is being written is larger than the available buffer space the applic
232. ermine the best relationship between the disk drives and the adapter on an SSA loop that contains only one pair of adapter connectors 1 Determine which data is accessed most frequently 2 Assign that data to those disks drives that are farthest round the loop from the adapter connectors By doing this you prevent the activity of the busiest disk drive from obstructing the data path to the other disk drives For example the loop that is shown in igure 14 contains 16 disk drives and the adapter connectors are between disk drives 1 and 16 The most frequently accessed data therefore should be on disk drives 8 and 9 Disk _ Disk _ Disk _ Disk Disk _ Disk _ Disk _ Disk 1 2 3 4 5 6 7 8 g Q o xe lt Disk _ Disk Disk _ Disk Disk _ Disk _ Disk Disk 16 15 14 13 12 11 10 9 Figure 12 One Pair of Connectors in the Loop 24 Advanced SerialRAID Adapters User and Maintenance Information Pairs of Adapter Connectors in the Loop Some Shared Data The following sequence enables you to determine the best relationship between the disk drives and the adapter on an SSA loop that contains two or more pairs of adapter connectors Some of the disk drives share data access with other disk drives 1 For each pair of connectors identify all the data that the loop is to access 2
233. ernal or object data manager ODM error has occurred An error occurred during a read operation in Copy mode 310 Advanced SerialRAID Adapters User and Maintenance Information ssaidentify Command Purpose To set or clear Identify mode for a physical disk Syntax ssaidentify 1 PhysicalDiskName y ssaidentify 1 PhysicalDiskName n Description If the y parameter is specified the disk is set into Identify mode While the disk is in Identify mode its amber Ready light flashes at approximately one second intervals The n flag switches off Identify mode Flags I PhysicalDiskName Specifies the device to place into Identify mode y Switches on Identify mode n Switches off Identify mode Chapter 15 Using the SSA Command Line Utilities 311 ssa_progress Command Purpose To show how much by percentage of a format operation has been completed and to show the status of the format operation The status can be Complete Formatting or Failed Syntax ssa_progress 1 pdisk Description The sSa_progress command opens the pdisk special file and uses the ISAL Progress command to determine the percentage of the formatting operation that is complete Flags Pdisk Specifies the pdisk of whose format operation you want to check progress and status Output The ssa_progress command sends error messages to stderr and progress messages to stdout Examples e Ifthe disk has been 30 formatted the following mes
234. ervice aids are not available go to the service information for using system Installation the enclosure in which the device is installed and Service Guide External SSA cables 6 Internal SSA connections 4 enclosure service information 21PAA Description An SSA Threshold exceeded link error has been detected Possible FRUs to l Device 45 29PAA Action Go to N SSA adapter card 45 using system nstallation and Service Guide External SSA cables 6 Internal SSA connections 4 enclosure service information 2A002 Description Async code 02 has been received Probably a software error Possible FRUs has occurred Action Go to ge 388 before exchanging any FRUs SSA adapter card 50 using system nstallation and Service Guide 2A003 Description Async code 03 has been received Probably a software error Software error has occurred Possible FRUs Action Go to ge 389 before exchanging any FRUs SSA adapter card 50 using system nstallation and Service Guide 2A004 Description Async code 04 has been received Probably a software error Software error has occurred Action Go to 88 before exchanging any FRUs Possible FRUs SSA adapter card 50 using system nstallation and Service Guide Chapter 17 SSA Problem Determination Procedures 361 SRN Problem Possible Causes 2A005 Descrip
235. es hot spare disk drives and free disk drives that are in pool zero on the selected loop The popup list is in the same format as the list that is used when a hot spare pool is created 2 Select the member disk drives to add to the pool and press Enter 3 If necessary change the Hot Spares Minimum field 4 Press Enter To remove disk drives from the pool 1 Select Components to Remove and press the List key A list of disk drives that are now in the pool is displayed 2 Select the member disk drives that are to be removed from the pool and press Enter 3 If necessary change the Hot Spares Minimum field 4 Press Enter The member disk drives that have been removed from the pool are now moved to pool zero of the selected loop Notes 1 If all member disk drives are removed from the pool the pool is automatically deleted 2 When all member adding and deleting tasks have been completed if the pool status is anything other than full go to e 86 Advanced SerialRAID Adapters User and Maintenance Information Dealing with RAID Array Problems This part of the chapter describes how to solve problems that might occur on your SSA RAID arrays You can get to the required SMIT menu by using fast path commands or by working through other menus During problem determination you can use any of the maintenance procedures described in A hot spare disk drive automatically replaces a failed or missing disk drive in a RAID
236. es 192 options 192 adding a disk drive to an SSA RAID array 138 adding a new hot spare pool 81 adding disks to a hot spare pool 84 adding to the configuration 58 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RAID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 deleting an old RAID array recorded in an SSA RAID manager 131 deleting from the configuration 68 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 installing and configuring 56 listing AIX system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 listing all supported SSA RAID arrays 99 listing array candidate disk drives 113 listing hot spare disk drives 109 listing old RAID arrays recorded in an SSA RAID manager 129 physical disk change attributes 203 RAID arrays change attributes 201 RAID arrays creation and change attributes 198 return codes 205 SSARAID command a
237. es or bypass cards The first device that you reach represents SSA address count 0 Continue to follow the SSA links from device to device increasing the SSA address count by 1 for each device until you reach the device that is indicated in the SRN 358 Advanced SerialRAID Adapters User and Maintenance Information Chapter 17 SSA Problem Determination Procedures SSA problem determination procedures are provided by power on self tests POSTs service request numbers and maintenance analysis procedures MAPs Some of these procedures use the service aids that are described in Service Request Numbers SRNs Service request numbers SRNs are generated by the system error log analysis system configuration code diagnostics and customer problem determination procedures SRNs help you to identify the cause of a problem the failing field replaceable units FRUs and the service actions that might be needed to solve the problem The SRN Table The table in this section lists the SRNs and describes the actions you should do The table columns are SRN The service reference number Problem A description of the problem and the action you must take Possible Causes The condition or FRUs that might be causing the problem and how likely it is by percentage that a particular FRU is causing the problem Abbreviations used in the table are DMA Direct memory access FRU Field replaceable unit IOCC Input output channel co
238. et mode data pacing 245 the Fast Write menus 167 the SMIT menu 57 TMCHGIMPARM change parameters tmssa device driver ioctl operation 260 description 260 purpose 260 TMIOSTAT status tmssa device driver ioctl operation 259 description 259 purpose 259 tmssa device driver 247 description 247 IOCINFO ioctl operation 257 description 257 purpose 257 purpose 247 syntax 247 TMCHGIMPARM ioctl operation 260 description 260 purpose 260 TMIOSTAT ioctl operation 259 description 259 purpose 259 tmssa special file 256 description 256 implementation specifics 256 purpose 256 top kernel extension entry point 240 trace formatting 208 two loops with one adapter 14 two loops with two adapters 15 U unique IDs SSA UIDs 21 Unknown state RAID 10 38 using mkdev to configure a logical disk 221 using mkdev to configure a physical disk 221 using SSA Target Mode 246 using the SSA Command Line Interface for RAID 189 using the SSA command line utilities 293 using the SSA SMIT menus 38 using the SSA Spare Tool 163 using the ssaraid command instead of SMIT 189 V vital product data 268 VPD vital product data 268 W write subroutine tmssa device driver 251 452 Advanced SerialRAID Adapters User and Maintenance Information Part Number 34L5399 Printed in the U S A SA33 3285 01 34L5399
239. evice response status is received for the write operation the target mode device driver automatically retries the write operation It retries the operation up to the number of times that is specified by the value TM_MAXRETRY This value is defined in the usr include sys tmscsi h file By default the target mode device driver delays each retry attempt by approximately two seconds to allow the target device to respond successfully The caller can change the time delayed through the TMCHGIMPARM operation If the write operation is still unsuccessful after the specified number of retries it tries another SSA adapter If this write operation has already tried all the SSA adapters it fails The calling program can Chapter 12 Using the Programming Interface 251 retry the write operation or perform other appropriate error recovery No other error conditions are retried but are returned with the appropriate errno global variable The target mode device driver by default generates a time out value which is the amount of time allowed for the write operation to end If the write operation does not end before the time out value expires the write operation fails The time out value is related to the length of the requested transfer in bytes and is calculated as follows timeout_value transfer_length 65536 1 20 In the calculation 20 is the default scaling factor that generates the time out value The caller can customize the time out v
240. f the SRN is 24002 PAA 002 If the SRN is 24104 PAA 104 b Observe the Link Verification screen and identify the physical device that is represented by PAA in the SRN This device is the first of the two devices that are connected by the failing link If the SRN is in the series 21xxx through 29xxx the second device of the two is located at PAA 1 If the SRN is 33xxx the second device of the two is located at PAA 1 Note If the SSA address AA in the SRN is higher than the highest SSA address that is displayed for the adapter port P that address is the address of the SSA adapter Read through the following examples if you need help in identifying the device then go to Ean paredi Otherwise go directly to TEATER Chapter 17 SSA Problem Determination Procedures 399 Example 1 If the SRN is 24002 the device is connected to adapter port 0 shown as A1 on the screen and has an SSA address of 02 shown as 2 on the screen In the example screen that device is pdisk3 which is the first device of the two The second device is pdisk2 PAA 1 If the SRN is 33002 the first device of the two is again pdisk3 The second device is pdisk4 PAA 1 M 802386 A N LINK VERIFICATION SSA Link Verification for nunu ssa0 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdiskl AC7AAQ9A Oi
241. finds an unrecoverable problem It also allows the adapter device driver to log errors against the adapter The ability of the device driver to log errors against the adapter is especially useful if the adapter is in an SSA loop that is used by another adapter because failure of this adapter can affect the availability of the SSA loop to the other adapter You can use the chdev command to change the value of this attribute host_address Holds the host address using system address for this adapter scat_gat_pages Specifies the number of 4 kilobyte pages that the device driver has kept for the management of scatter gather lists If many large transfer operations are to be performed think about increasing the value of this attribute if the I O does not reach the expected rate dma_mem Specifies the size of the DMA memory On AIX 4 3 systems only the memory should be big enough to hold the biggest expected I O load If you specify too small a size the system cannot reach the best possible I O rate Device Dependent Subroutines The SSA adapter device driver provides support only for the open close and ioctl subroutines It does not provide support for the read and write subroutines open and close Subroutines The open and openx subroutines must be called by any application program that wants to send ioctl calls to the device driver You can use the open or the openx subroutine call to open the SSA adapter device driver If you
242. fined SSA RAID Arrays This option lists all the arrays that are connected to the SSA adapter 1 For fast path type smitty Isdssaraid and press Enter Otherwise select List All Defined SSA RAID Arrays from the SSA RAID Array menu 2 A list of defined arrays is displayed A COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09523173A02137K good 3 4G RAID 5 array F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next 98 Advanced SerialRAID Adapters User and Maintenance Information Listing All Supported SSA RAID Arrays This option lists all the types of array that are supported by the installed SSA RAID managers 1 For fast path type smitty lsssaraid and press Enter Otherwise select List All Supported SSA RAID Arrays from the SSA RAID Array menu 2 A list of supported arrays is displayed ie Command OK raid_0 raid_5 Fl Help F8 Image n Find Next COMMAND STATUS stdout yes stderr no RAID 0 array RAID 5 array F2 Refresh F3 Cancel F9 Shel F1O Exit Before command completion additional instructions may appear below F6 Command Find NS Chapter 6 Using the RAID Array Configurator 99 Listing All SSA RAID Arrays That Are Connected to a RAID Manager This option lists all the SSA RAID disk drives that are connect
243. fy Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssaQ Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 F1 Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Chapter 6 Using the RAID Array Configurator Select the adapter whose AIX system disk drives you want to identify 125 3 The following information is displayed Identify AIX System Disks Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ AIX System Disks Flash Disk Identification Lights yes F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1Q Exit Enter Do 4 Select yes in the Flash Disk Identification Lights field 5 Press the List key to list the disk drives 6 From the displayed list select the disk drives that you want to identify The Check light flashes on each disk drive that you have selected 126 Advanced SerialRAID Adapters User and Maintenance Information Canceling all SSA Disk Drive Identifications This option allows you to cancel all disk drive identifications For fast path type smitty ssa_identify_cancel and press Enter Otherwise 1 Select List Identify SSA Physical Disks from the SSA RAID Array menu 2 Select Cancel all SSA Disk Identifications The Check lights of all identified disk drives stop flashing Chapte
244. g the RAID Array Configurator 101 Listing the Status of All Defined SSA RAID Arrays This option lists the status of each defined array 1 For fast path type smitty Istssaraid and press Enter Otherwise select List Status of All Defined SSA RAID Arrays from the SSA RAID Array menu 2 The following information is displayed a gt SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array RAID Array Type Move cursor to desired item and press Enter raid_l raid_5 raid_10 Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next oY Select the type of RAID array for which you want to display the status Note No additional status information is available for RAID 0 arrays 102 Advanced SerialRAID Adapters User and Maintenance Information The following information is displayed for RAID 5 arrays A COMMAND STATUS D Command OK stdout yes stderr no Before command completion additional instructions may appear below Unsynced Parity Strips Unbuilt Data Strips hdisk3 0 hdisk4 0 0 F1 Help F2 Refresh F3 Cancel F6 Command F8 Ima
245. ge OPMSG to the error log 2 Displays an error message on dev console 3 Sends a mail message to ssa_adm The name ssa_adm is an alias alternative address that is set up in etc aliases By default ssa_adm is set to root You can however change this alias to any valid mail address for your using system See your using system documentation for information about how to change alias addresses 184 Advanced SerialRAID Adapters User and Maintenance Information Error log analysis also runs automatically each time that diagnostics run in Problem Determination mode In this mode the error log analysis runs before any diagnostic test is run to the SSA devices Diagnostics in Problem Determination mode therefore generate an SRN if any SSA error logs show that service activity is need If you run the ssa_ela command from the command line you can also run error log analysis to all SSA devices that are attached to a system If SD 6000 is installed on the system it runs error log analysis whenever a hardware error is logged and raises an incident if problems are found that need service activity Detailed Description Error log analysis determines whether the data that is in the error log indicates that service activity is needed on the subsystem The analysis uses the detailed data that is logged with each error If service activity is needed an SRN is produced This SRN provides an entry point into the maintenance procedures that_are giv
246. ge 324 A list of pdisks is displayed EE TE ST Se CERTIFY DISK 802404 Move cursor onto selection then press lt Enter gt systemname pdisk11 AC50AE43 9 1GB SSA C Physical Disk Drive systemname pdisk8 amp AC7Q06EA3 9 1GB SSA C Physical Disk Drive systemname pdisk2 AC1DBE11 4GB SSA C Physical Disk Drive systemname pdisk3 AC1DBEF4 4GB SSA C Physical Disk Drive systemname pdisk7 AC50AE58 9 1GB SSA C Physical Disk Drive systemname pdisk12 AC7C6E51 9 1GB SSA C Physical Disk Drive systemname pdiskO AC7Q06E9A 4GB SSA C Physical Disk D Drive systemname pdisk1 ACIDEEE2 4GB SSA C Physical Disk D Drive systemname pdisk10 AC1DBE32 4GB SSA C Physical Disk Drive F3 Cancel F1O Exit y A 340 Advanced SerialRAID Adapters User and Maintenance Information 2 Select the pdisk that you want to certify The following instructions are displayed 3 N certiFy DISK 802405 systemname pdisk0 AC706E9A 4GB SSA C Physical Disk Drive Move cursor onto selection then press lt Enter gt Set or Reset Identify Select this option to set or reset the Identify indicator on the disk drive Certify Select this option to start the Certify operation F3 Cancel F1O Exit o A If you are not sure of the identification pdisk number of the disk drive that you want to certify use the Identify function to get_a positive physical identification of the disk drive see g j You can further ensure that you have selected the correct
247. ge F9 Shel1 F1O Exit Find n Find Next o Chapter 6 Using the RAID Array Configurator 103 The following information is displayed for RAID 1 and RAID 10 arrays a 5 COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below Components Primary Secondary Status hdisk4 degraded pdisk13 pdisk15 good pdisk3 pdisk6 good pdisk7 BlankReserved5Z degraded F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next Status data is given for the array and for each mirrored pair of disk drives in the array The status values for the array are good The status of all mirrored pairs is good exposed The status of one or more mirrored pairs is exposed No mirrored pair is degraded degraded The status of one or more mirrored pairs is degraded rebuilding The status of one or more mirrored pairs is rebuilding No mirrored pair is exposed or degraded offline One of the following conditions exists e The status of one or more mirrored pairs is offline e The first two member disk drives of the primary half are missing and the Split Array Resolution flag is set to Primary e The first member disk drive of the secondary half is missing and the Split Array Resolution flag is set to Secondary unknown Not enough configuration data is available to determine the state of the array Under these conditions ignore the primary and secondary des
248. generated This SRN is generated from the next 5 characters of the detail data Examples The following is logged for ssa0 0400 0000 0000 00 sess Error log analysis produces SRN 40000 The following is logged for ssa0 2450 1000 0000 00 ses Error log analysis produces SRN 45010 only if this error has occurred three times for ssa0 during the previous 24 hours If more than one type of error exists in the error log for a device the error log analysis determines which error code has the highest priority and returns this as the result of the analysis Usually the action of correcting the highest priority error also corrects the lower priority problems 186 Advanced SerialRAID Adapters User and Maintenance Information Command Line Error Log Analysis A command line utility has been provided that allows you to run SSA error log analysis from a manually entered command or from shell scripts The utility is ssa_ela It can perform SSA error log analysis on e All SSA devices e A selected hdisk e A selected pdisk A selected adapter Any of the above items for a history period of up to seven days 02 for details of how to use the utility run_ssa_ela cron During installation of the SSA device drivers the following entry is added to the cron table 01 5 usr Ipp diagnostics bin run_ssa_ela 1 gt dev null 2 gt dev null This cron entry instructs the run_ssa_ela shell script to run
249. h 3 where 3 is the number of 24 hour periods An SRN for the error is generated Note The error occurred on Sunday When running the error log analysis you need to include at least the 24 hours that preceded the error that is Saturday In this example therefore timeperiod includes Saturday Sunday and Monday If application programs fail run diagnostics in Problem Determination mode to find the SRN Have no concerns about events that occur in the error log unless an application program fails or error log analysis generates an SRN 188 Advanced SerialRAID Adapters User and Maintenance Information Chapter 11 Using the SSA Command Line Interface for RAID Configurations You can use the ssaraid command from the command line instead of the from the SMIT panels see configure and manage your arrays The Command Line inertas includes a README file that explains the syntax for the ssaraid command The README file is located at usr lpp devices ssa IBM_raid ssaraid README Using the ssaraid command from the Command Line Interface you can do the following List all the SSA adapters that provide support for RAID arrays in a system Those adapters are called RAID Manager List SSA objects that are connected to a particular RAID Manager List all objects of a given type for example RAID 5 arrays List the preferred name serial number of an object List all member objects of another object for example
250. h link connecting two SSA devices A device can be an adapter card or a disk drive If this loop becomes broken the alternative signal path round the loop is automatically used A link might be broken if e A device is removed from the loop e A device on the loop is reset or switched off or it fails e An SSA cable is removed or it fails Each SSA device has a Ready light that indicates the operational status of the SSA loop to which that device is attached The light is permanently on when the device can communicate with the two SSA devices that are logically next to it on the SSA loop The light flashes if the device can communicate with only one of those two devices The light is off if the device cannot communicate with either of the two SSA devices Usually an SSA device is present at each side of the point where the SSA loop is broken Each of those devices has its Ready light flashing SSA_LOGGING_ERROR 6A5A3542 The adapter has passed error log data for a disk drive to the device driver error logger but the disk drive to which the data is related is not configured into the AIX system This problem usually occurs because the disk drive was not available to the adapter when the cfgmgr command was previously run SSA_SETUP_ERROR 48489B00 A user procedure has not been performed correctly Use the SRN to determine the procedure that has caused the problem SSA_SOFTWARE_ERROR _ EE34C798 The software has detected an unexp
251. hat the SSA target mode device driver observes to manage the sending and receiving of data are e Separate write operations need separate read operations e Receive buffers that are full delay the send operation when it tries to resend after a delay Chapter 12 Using the Programming Interface 247 The calling program must observe any other rules that are needed to maintain or otherwise manage the communication of data Delays that occur when data is received or sent through the target mode device driver are that are characteristics of the hardware and software driver environment Configuration Information When tmssan is configured where n is the remote node number the tmssan im and tmssan tm special files are both created An initiator mode pair or a target mode pair must exist for each device whether either or both modes are being used The target mode node number for an attached device must be the same as the initiator mode node number Each time that you use the cfgmgr command to configure the node the target mode device driver finds the remote nodes that are already connected and automatically configures them Each node is expected to be identified by a unique node number The target mode device driver configuration entry point must be called only for the initiator mode device number The device driver configuration routine automatically creates the configuration data for the target mode device minor number This data is re
252. he SSA disk device driver and an entry point in the top kernel extension Two ioctls register and unregister the top kernel extension with the SSA disk device driver The SSA Disk Device Driver entry point provides the method of sending messages and of locking unlocking and testing the disk drive The top kernel extension entry point processes interrupts which might include the receiving of messages from other using systems Note To ensure that the concurrent mode interface works s set the node_number attribute of the ssar router see different non zero value for each using system that is kaia a disk drive Device Driver Entry Point The SSA disk device driver concurrent mode entry point sends commands from the top kernel extension that is related to a specified SSA disk drive The top kernel extension calls this entry point directly The DD_ CONC_REGISTER ioctl operation registers entry points This entry point function takes one argument that is defined in the usr include sys ddconc h file The argument is a pointer to a conc_cmd structure The conc_cmd structures must be allocated by the top kernel extension The concurrent mode command operation is specified by the cmd_op field in the conc_cmd structure For each operation the devno field of the conc_cmd structure specifies the appropriate SSA disk drive The concurrent mode command operation can have the following values DD_CONC_SEND_REFRESH Broadcasts the one byte me
253. he SSA links on each side of the indicated physical so that the disk can be removed from the loop for service and no errors are caused on the loops Chapter 12 Using the Programming Interface 225 This flag has support only for SSA physical disk drives You cannot specify this flag and the SSADISK_SCSIMODE flag together SSADISK_SCSIMODE Opens an SSA physical disk in SCSI passthrough mode This action allows SSADISK_IOCTL_SCSI ioctls to be issued to the physical disk This flag has support only for SSA physical disk drives You cannot specify this flag and the SSADISK_SERVICEMODE flag together SSADISK_NORETRY Opens a device in no retry mode When a device is opened in this mode commands are not retried if an error occurs SSADISK_FENCEMODE Opens an SSA logical disk drive in fence mode The open subroutine succeeds although the using system might be fenced out from access to the disk drive Only ioctls can be issued to the device while it is open in this mode Any attempt to read from or write to a device that is opened in this mode is rejected with an error This flag has support only for SSA logical disk drives You cannot specify this flag and the SSADISK_NO_RESERVE flag SSADISK_FORCED_OPEN flag or SSADISK_RETAIN_RESERVATION flag together You can find more specific information about the open operations in SSA Options to the openx Subroutine in the Kernel Extensions and Device Support Programming Concepts manuals for
254. he use of the disk drive and do not want to change it go no further with these instructions Otherwise go to step 5 Note If the Current Use field shows that the disk drive is owned by an array you cannot change that use Move the cursor to Current Use and press the List key 6 A list of uses is displayed Make your selection and press Enter 144 Advanced SerialRAID Adapters User and Maintenance Information Changing the Use of Multiple SSA Physical Disks 1 For fast path type smitty chgssadisks and press Enter Otherwise select Change Use of Multiple SSA Physical Disks from the SSA RAID Array menu 2 A list of adapters is displayed in a window a SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Status of Hot Spare Pools List Components in a Hot Spare Pool Add a Hot Spare Pool F1l Help F2 Refresh F8 Image F1O Exit Find n Find Next Move cursor to desired item and press Enter List All SSA RAID Arrays Connected to a RAID Manager List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Protection for an SSA RAID Array F3 Cancel Enter Do SSA RAID Manager ssaQ Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 3 Select the adapter A list is displayed of the disk drives that are atta
255. hot spare pool that contains the failed member disk drive With the attribute set to false a hot spare disk drive if available is selected from the hot spare pool that contains the failed member disk drive If no hot spare disk drive is available in that pool a hot spare disk drive is selected from the default hot spare pool for that SSA loop Pool AO or BO Creation and Change Attributes for RAID 1 and RAID 10 Arrays Only You can specify the following attributes with the a option when you are using the ssaraid command with the C or H option to create or change a RAID 1 or RAID 10 array split_resolution default primary This attribute selects the copy of the data that is to remain available if the primary disk drive is completely separated from the secondary disk drive hot_spare_splits With the attribute set to no the RAID manager does not attempt to use hot spare disk drives to replace missing member disk drives if a RAID 1 or RAID 10 array is split exactly in half or all the secondary member disk drives are present It is recommended that this attribute be set to no if the RAID 1 or RAID 10 array is configured to provide protection against the loss of a physical domain 200 Advanced SerialRAID Adapters User and Maintenance Information Creation and Change Attribute for RAID 5 Arrays Only You can specify the following attribute with the a option when you are using the ssaraid command with the C or H option to create or
256. ia that are supplied with the adapter A README sheet of installation instructions is also supplied Install the adapter into a slot in the using system see the Installation and Service Guide for the using system Switch on the using system This action ensures that the latest version of the microcode that is available on the using system is downloaded into the adapter before the disk drives are connected Connect the SSA cables to the adapter and to the devices that are to be attached to the adapter For information about how the cables are to be attached see the configuration plan that was created when the subsystem was ordered If the configuration plan is not available use the example configuration information that is given in the service information for the devices See also EChapte otrodu on page 7i for general information about SSA loops and links Note If for any reason an adapter is exchanged for a replacement adapter all associated arrays that were not synchronized when the adapter failed are rebuilt Cron Table Entries During the installation of the SSA software the following four entries are made in the system cron table 01 5 x usr Ipp diagnostics bin run_ssa_ela 1 gt dev null 2 gt dev null O x x usr Ipp diagnostics bin run_ssa_healthcheck 1 gt dev null 2 gt dev null 30 x x usr Ipp diagnostics bin run_ssa_encl_healthcheck 1 gt dev null 2 dev null 30 4 x x usr Ipp diagnostics bin run_
257. ical disks to create a RAID 10 array The attributes of the disks are all set to their default values Type the commana gt ssaraid C 1 ssaQ t raid_10 s pdiskO pdiskl pdisk3 pdisk2 d where C specifies that this is a create operation 1 ssa0 specifies that RAID Manager ssa0 is to be used t raid_10 specifies that a RAID 10 array object is to be created s pdisk specifies the free pdisk that is to become the member disk of the new array RAID 10 arrays provide support for only even numbers of member disk drives The sequence in which the disk drives are specified is important when you are determining which disk drives are primary and which are secondary members of the array The first third fifth and so on disk drives are primary disk drives The second fourth sixth and so on disk drives are secondary disk drives In this example pdiskO and pdisk3 are the primary disk drives d specifies that an AIX system disk is to be attached to the new array 194 Advanced SerialRAID Adapters User and Maintenance Information Example 5 To Create a Hot Spare Pool This example shows how to create a hot spare pool that contains an array member disk drive and a hot spare disk drive The attributes of the disks are all set to their default values Type the command gt ssaraid C 1 ssaQ t spare_pool n pool_Bl s pdisk0O pdisk3 where C specifies that this is a create operation 1 ssa0 specifies that RAID Manager
258. ice aid allows you to display the operating speed of each link on an SSA adapter To use the Link Speed service aid 1 Select Link Speed from the SSA Service Aids menu see Aids on page 324 A list of adapters is displayed LINK SPEED 802437 Move cursor onto selection then press lt Enter gt systemname ssaQ 00 03 IBM SSA 160 SerialRAID Adapter systemname ssal 00 04 IBM SSA 160 SerialRAID Adapter systemname ssa2 00 05 IBM SSA 160 SerialRAID Adapter F3 Cancel F1O Exit K 2 Chapter 16 SSA Service Aids 345 2 Select the adapter that you want to inspect A list of link speeds is displayed as shown in this example screen sys To se sys sys sys sys sys sys sys sys XX Link SPEED emname or reset Identify move cursor onto selection then press lt Enter gt Source emname emname emname emname emname emname emname emname F3 Cancel SSA Link Speed for ssa0 00 03 Speed ssa0 Al 40 pdisk3 40 pdisk2 20 pdiskl 40 pdisko 40 ssa0 B1 40 pdisk5 40 pdisk4 40 F10 Exit IBM SSA 160 SerialRAID Adapter Destination systemname systemname systemname systemname systemname pdisk5 systemname systemname systemname pdisk3 pdisk2 pdisk1 pdiskd ssa0 A2 pdisk4 ssa0 B2 802438 oy The screen shows an adapter that has four disk drives connected between ports A1 and A2 and two disk drives connected between ports B1 and B2
259. ide a means of asynchronous notification of received data on one or more target devices Possible return values for the errno global variable include EAGAIN Indicates that a nonblocking read request would have blocked because data is available EFAULT An error occurred while copying data to the caller buffer EINTR Interrupted by a signal 250 Advanced SerialRAID Adapters User and Maintenance Information EINVAL Attempted to run a read operation for a device instance that is not configured not open or is not a target mode minor device number EIO An I O error occurred write subroutine Support for the write entry point is provided only for the initiator mode device driver The write entry point generates one write operation in response to a calling program write request If the device is opened with the O_NDELAY flag set and the write request is for a length that is greater than the total buffer size of the device the write request fails The errno global variable is set to EINVAL The total buffer size for the device is determined by multiplying the value of the XmitBufferSize attribute by the value of the XmitBuffers attribute These values are in the configuration database Support for data gathering is through the user mode writev or writevx subroutine or through the kernel mode fp_rwuio service call The write buffers are gathered so that they are transferred in sequence as one write operation The returned errno global
260. ignations and the array pair status The status values for mirrored pairs are good Both member disk drives of the mirrored pair are present and working 104 Advanced SerialRAID Adapters User and Maintenance Information exposed One member disk drive of a mirrored pair is missing or has failed but no write operation has been issued to the pair degraded One member disk drive of a mirrored pair is missing or has failed and a write operation has been issued to the working member disk drive rebuilding A failed member disk drive in a mirrored pair has been exchanged and data is rebuilding offline Both member disk drives of a mirrored pair are missing or have failed Chapter 6 Using the RAID Array Configurator 105 Listing or Identifying SSA Physical Disk Drives This option allows you to list the disk drives that are being used by a particular array and to identify particular disk drives 1 For fast path type smitty Isidssaraid and press Enter Otherwise select List Identify SSA Physical Disks from the SSA RAID Array menu 2 The following information is displayed fe List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System D
261. igurator 79 Component The array member disk drive of the hdisk that is listed on the screen or hot spare disk drives that are assigned to the pool Location The physical location of the array member disk drive Size The size of the array member disk drive This value is useful to know if you have assigned a hot spare disk drive to a pool but the array member disk drive is too large to be protected by the hot spare disk drive Status The status of the array member disk drive Valid values for status are good The disk drive is working not_present The disk drive cannot be detected It has been removed or it has failed too_large The member disk drive is too large to be protected by any hot spare disk drive in the pool Note The size of the member disk drive is not the physical size of the disk drive but the size that the array manager assigns to it For example if a RAID 10 array is created from three 9 GB disk drives and one 18 GB disk drive the size that is assigned to each array member disk drive is 9 GB The 18 GB disk drive can still be protected by a 9 GB hot spare disk drive wrong_pool This member disk drive of the array has been replaced with a hot spare disk drive from another pool This action has occurred because no hot spare disk drive was available in this pool when the array member disk drive failed When all failed disk drives have been replaced this array member disk drive should be exchanged with a disk
262. ind Next S J Select the adapter whose rejected disk drives you want to list Chapter 6 Using the RAID Array Configurator 111 3 A list of rejected disk drives is displayed A COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below pdisk3 Q004AC5119E000D rejected n a 1 1G Physical disk pdisk5 08005AEA030D00D rejected n a 2 3G Physical disk F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F10 Exit Find n Find Next 112 Advanced SerialRAID Adapters User and Maintenance Information Listing Array Candidate Disk Drives This option allows you to list disk drives that are available for adding to an array 1 For fast path type smitty 1cssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List Array Candidate Disks 2 A list of adapters is displayed in a window a List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Canc
263. ing the Split Array Resolution flag is reset If in a RAID 10 array the first two primary disk drives and the first secondary disk drive are all in separate power domains you can configure that array so that it can 147 always continue to operate after a power failure of a single power domain After the loss of any power domain in this configuration a using system continues to detect either all the primary configuration disk drives or one primary and one secondary configuration disk drive and continues to access the array without the need to set the Split Array Resolution flag Operation after a Loss of Member Disks An array goes into the Offline state if after any component failure or change in configuration it becomes possible for the disk drives of mirrored pairs each to receive different data from different systems Under such conditions the disk drives of a mirrored pair might no longer contain matching data that is they are not synchronized An array can continue to operate although one of the following conditions might exist e The number of managing adapters is increased or decreased when all the primary and secondary configuration disk drives are working A primary disk drive is missing cannot be read or cannot be written but the other primary and secondary disk drives are working e The secondary configuration disk drive is missing cannot be read or cannot be written but both primary configuration disk drive
264. ing disk drive that the array management software has removed from a RAID array Reserved status The disk drive is used by another using system also router A computer that determines the path of network traffic flow S SCSI Small computer system interface SDRAM Synchronous dynamic random access memory secondary half The term that distinguishes one half of a split array The term primary half distinguishes the other half of the split array Serial Storage Architecture An industry standard interface that provides high performance fault tolerant attachment of I O storage devices service request number A number that helps you to identify the cause of a problem the failing field replaceable units FRUs and the service actions that might be needed to solve the problem Service request numbers are generated by the system error log analysis system configuration code and customer problem determination procedures SMIT System management interface tool SRN Service request number SSA Serial Storage Architecture Glossary 437 SSA unique ID The specific identifier for a particular SSA device Each SSA device has a specific identifier that is not used by any other SSA device in the whole world stretch A set of stripes that is used to perform a particular level of array management strip The maximum amount of contiguous user data that is mapped to one component stripe A set of strips with th
265. ing menu is displayed a Add an SSA RAID Array Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa RAID Array Type raid_5 Member Disks Strip Size KB 64 zi Enable Use of Hot Spares yes Choose Hot Spare only from Preferred Pool no Allow Page Splits yes Enable Fast Write no F1l Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1Q Exit Enter Do For the meanings of the fields see page bd 62 Advanced SerialRAID Adapters User and Maintenance Information If you select RAID 10 the following menu is displayed A Type or select values in entry fields Press Enter AFTER making all desired changes SSA RAID Manager RAID Array Type Primary Disks Secondary Disks Strip Size KB Split Array Resolution Enable Use of Hot Spares Choose Hot Spare only from Preferred Pool Allow Hot Spare Splits Allow Page Splits Initial Rebuild Enable Fast Write Fl Help F2 Refresh F3 Cancel F5 Reset F6 Command F7 Edit F9 Shel1 F10 Exit Enter Do Add an SSA RAID Array Entry Fields ssa0 raid_10 16 Primary yes no no yes no no F4 List F8 Image tet eee te tste For the meanings of the fields see page bd Chapter 6 Using the RAID Array Configurator 63 Meanings of the Fields SSA RAID Manager The name of an SSA RAID Manager SSA RAID Managers are devices that contr
266. ing the Programming Interface 233 u isal receive_descriptor Set by the caller to indicate the buffer for received data uQ isal status_descriptor Set by the caller to indicate the buffer for status data uQ isal minor_function Set by the caller to one of the ISAL Manager Commands that is defined in the usr include ipn ipnsal h file and listed at the start of the description of this operation Note Structures are provided in the usr include ipn ipnsal h file This file can be used to format the contents of the parameter buffer for the various commands The resource ID that is located in the first four bytes of the parameter buffer is always overwritten with the correct Resource ID for the device by the device driver Return Values Files If the command was successfully sent to the adapter card this operation returns a value of 0 Otherwise a value of 1 is returned and the errno global variable set to one of the following values EIO Indicates an unrecoverable O error EINVAL Indicates that the caller has specified an ISAL manager command that is not in the list of supported ISAL manager commands The commands are listed at the start of the description of this operation EPERM Indicates that caller did not have an effective user ID EUID of 0 ENOMEM Indicates that the device driver was unable to allocate or pin enough memory to complete the operation If the return code is 0 the result field of the ssadisk_ioctl
267. ing the chdev command The ssavfynn command described in Essavfynd Sa TERT can be used to verify that no duplicate node numbers exist e f a reservation is challenged that is a node that does not hold the reservation attempts to access a reserved SSA logical disk the adapter verifies that a valid path still exists to the node that is holding the reservation If no path exists the reservation is removed and the new node is allowed access to the disk This means that if an adapter is used to reserve a disk and is then disconnected or powered off that disk becomes effectively unreserved Fast Write Cache SSA adapters that are on SSA loops of up to two SSA adapters can use the Fast Write cache feature For a two way configuration the two adapters can be in the same or in different using systems Fast write functions can be enabled for single disk drives or for RAID arrays Performance improvements are related to the type of disk drive single disk or RAID array type and the workload If two way fast write functions are used in a two host system configuration the performance improvements are greater when concurrent access is not permitted to disk drives When concurrent access is permitted performance improvements are less Chapter 2 Introducing SSA Loops 27 28 Advanced SerialRAID Adapters User and Maintenance Information Chapter 3 RAID Functions and Array States This chapter describes the RAID functions and the states of R
268. installed the disk drive under concurrent maintenance give the cfgmgr command to configure that disk drive If you installed the disk drive while the using system was switched off switch on the using system when you are ready to do so When you switch on the using system the disk drive is automatically configured Use the Display Download Microcode service aid to check whether the microcode is at the latest available level on the disk one el you have just installed see Select Download Microcode to all SSA Physical Disk Drives Select Continue with Microcode Installation Note No microcode is downloaded if the latest available level of microcode is already on the disk drive The disk drive might have been configured with new hdisk and pdisk numbers You can change these numbers For example if the disk drive is a replacement disk drive you might want to make its pdisk and hdisk numbers match those of the original disk drive If you want to change the numbers see k When you have changed the numbers return to this sgalan and go to step If you do not want to change the numbers go to step bal If the disk drive that you are installing is a replacement for a disk drive that was a member of an SSA RAID array go to step Otherwise go no further with these instructions Type smitty ssaraid and press Enter Select Change Show Use of an SSA Physical Disk The pdisk that has been exchanged is listed under SSA Physical Disks that
269. ion Figure 15 RAID 5 Array State Flowchart Chapter 3 RAID Functions and Array States 35 RAID 10 Array States Good State Configuration information of the array is held in a reserved area sector on each of the first three member disk drives of the array If fewer than two of these sectors can be read or written the array normally goes into the Offline state An important characteristic of RAID 10 is that the mirrored pairs can be located in different sites in different power domains The availability of a RAID 10 array is therefore better than that of RAID 5 array However if both domains of a two site configuration are both operational but communication is lost between the sites it is important to ensure that each system does not continue to operate on its own copy of the array Under this condition the data might not be consistent To prevent this problem from occurring the first third and fifth member disk drives of the array are the primary members the second fourth and sixth member disk drives are the secondary members Access to at least one of the primary disk drives that contain the configuration information is normally required for array operations to continue Therefore e Ifa network partition exists the using system that has access to the primary configuration disk drives continues to operate The using system that has access to only the secondary configuration disk drives cannot normally access the array e If
270. ion e The concurrent command interrupt handler routine must have a short path length because it runs on the SSA disk device driver interrupt level If much command processing is needed this routine should schedule an off level interrupt to its own off level interrupt handler e The top kernel extension must have an interrupt priority that is no higher than the interrupt priority of the SSA disk device driver e The concurrent command interrupt handler routine might need to disable interrupts at INTCLASSO if it is expected to use concurrent mode on SSA disk drives and on other types of disk drives The other types of disk drives need their own device drivers to provide support for concurrent mode A kernel extension that uses the DD_CONC_REGISTER ioctl must issue a DD_CONC_UNREGISTER ioctl before it closes the SSA disk drive Chapter 12 Using the Programming Interface 241 SSA Disk Fencing SSA disk fencing is a facility that is provided in the SSA subsystem It allows multiple using systems to control access to a common set of disks Using the fencing commands that are provided by the hardware you can prevent particular using systems from accessing a particular disk drive Each disk drive has an access list that is independent of the access lists for the other disk drives Fencing is a function that is provided by the hardware and manipulated by hardware commands The device driver also has some effect The SSA disk device driver
271. ion The array filter has detected a link configuration that is not SSA loop configuration valid problem Action See configuration 48600 Description All the member disk drives of an array are not on the SSA SSA loop configuration loop The array is in the Exposed state and write operations to the array problem are inhibited Action All the member disk drives of an array must be on the same SSA loop Find all the members of the array 1 Type smitty devices and press Enter 2 Select SSA RAID Arrays 3 Select List Identify SSA Physical Disks 4 Select List Disks in an SSA RAID Array 5 Select the hdisk that is in the Exposed state and note all the pdisks If necessary use the Identify function to identify the disk drive 6 Move all the member disk drives to the same SSA loop 48700 Description All the member disk drives of an array are not on the SSA SSA loop configuration loop The array is in the Offline state problem Action All the member disk drives of an array must be on the same SSA loop Find all the members of the array 1 Type smitty devices and press Enter 2 Select SSA RAID Arrays 3 Select List Identify SSA Physical Disks 4 Select List Disks in an SSA RAID Array 5 Select the hdisk that is in the Offline state and note all the pdisks If necessary use the Identify function to identify the disk drives 6 Move all the member disk drives to the same SSA loop 372 Advanced SerialRAID Adapters User and Main
272. irection the broken loop does not prevent access to any data unless that data is on the failed disk drive If the loop is broken between two disk drives the Ready lights on those disk drives flash to show that only one SSA path is active Also the Link Verification service aid shows that only one path is available to each disk drive on the broken loop You can find the physical location of any disk drive on the loop by using the Identify function see i Chapter 16 SSA Service Aids 333 Notes a In the lists of physical disk drives pdisks that are displayed by the service aids you might see 22222 These question marks show where an SSA loop is broken The service aid cannot display which if any devices are missing from this configuration pots These asterisks indicate an unconfigured device that is an SSA device that is in the SSA network but whose type is not known Such a condition can occur if the device has not been configured on the SSA network or it has not been configured into the AIX system If you have just switched on an SSA device or a disk drive enclosure subsystem you might need to wait for up to 30 seconds before the device is configured on the SSA network If a new device has been added to the SSA network you must give the cfgmgr command to configure that device into AIX For example Link VERIFICATION 802386 A SSA Link Verification for nunu ssaQ 04 03 IBM SSA 160 SerialRAID Adapter
273. ired Flags for Both Modes You must use one of these flags l Specifies that the program is to operate in List mode The program searches for dumps C Specifies that the program is to operate in Copy mode The program copies the dump if one is found from the specified location to the specified output point Required Flags for Copy Mode You must use both of these flags d pdiskxx Specifies the disk drive from which the data is to be copied for example pdisk2 o OutputFile Specifies where the tar command is to write its output You must use at least one of these flags a AdapterName Specifies the adapter name for which the program must search for example ssa1 The adapter must be known to the searching machine n AdapterUID Specifies the adapter UID for which the program must search The adapter need not be known to the searching machine s SlotNumber Specifies the slot that contains the disk drive as shown in the List Output Optional Flags for List Mode You can choose either or both of these flags h Prevents the heading lines from being displayed This option is useful for scripts d pdiskxx Allows the you to specify which disk drive is to be searched By specifying the disk drive you reduce the range of the search You can choose either but not both of these flags Chapter 15 Using the SSA Command Line Utilities 309 Output a AdapterName Specifies the adapter name for which the program mu
274. is reached no more entries of that type are made for that device until the first error has been in the log for at least six hours The example in Figure 34 shows an open link error occurring This type of error has a logging threshold value of three The error is logged when the link is first broken in this example at about 04 30 The error is then logged each hour as a result of the heath check 04 00 05 00 06 00 07 00 08 00 09 00 10 00 11 00 12 00 13 00 LINK_OPEN log to Device Driver Device Driver sends LINK_OPEN log to AIX SSA Error Logger AIX Error Log Figure 34 Example of an Open Link Error The example also shows that during any six hour period no more than three errors of this type are sent to the error log If other types of error occur for this device or errors occur for another device they are sent immediately to the error log The actual threshold values that are used for any given error type are regularly reviewed and might change with any new version of the device driver They always permit however enough errors to be logged to ensure that the error log analysis produces an SRN when any service action is required Error Log Analysis Summary The error log is analyzed automatically every 24 hours This automatic error log analysis is started by the run_ssa_ela cron job If the results of the analysis show that any service activity is needed the automatic error log analysis 1 Sends an operator messa
275. isk Drive Missing shows a single host system that has just been switched on The system contains a RAID 1 array whose primary disk drive is missing The array remains in the Offline state until either of the following occurs The primary disk drive becomes available e The Split Array Resolution flag is set to Secondary System 1 SSA Adapter Primary 1 Secondary 1 Figure 22 Single Host System with Primary Disk Drive Missing 150 Advanced SerialRAID Adapters User and Maintenance Information Dual Host System with Primary Disk Drive Missing shows a dual host system that has just been switched on The system contains a RAID 1 array whose primary disk drive is missing The array remains in the Offline state on both systems until either of the following occurs The primary disk drive becomes available e The Split Array Resolution flag is set to Secondary Split Array Resolution Primary System 1 System 2 SSA Adapter SSA Adapter Primary 1 Secondary 1 Figure 23 Dual Host System with Primary Disk Drive Missing Chapter 7 Split Site Management 151 Dual Host System with Only One System Switched On shows a dual host system that has just been switched on The system contains a RAID 1 array but the primary disk drive is missing because system 1 in not switched on The array remains in the Offline state on both systems until either of the following occurs The primary disk
276. isk drives or as array candidate disk drives e Have a size equal to or greater than the largest disk drive that they will be protecting Are in pool 0 on the SSA loop on which the hot spare pool exists Chapter 5 Hot Spare Management 51 2 If you are not sure whether your disk drives are assigned correctly a Ensure that the required number of disk drives of the correct size are assigned as hot spare disk drives or as array candidate disk drives Reduced Critical The number of hot spare disk drives that are in the pool is less than the number of hot spare disk drives that were in the pool when the pool was last configured but greater than the minimum number that is specified for this pool This condition does not cause an error to be logged If you removed a disk drive from the configuration on purpose 1 Select Change Show Delete a Hot Spare Pool from the smit ssaraid menu ae 2 Select the reduced hot spare pool 3 Verify that the contents of the pool are as required 4 Press Enter If you have exchanged a failed disk drive you might now want to add the The number of hot spare disk drives that are in the pool is less than the specified minimum number for that pool If you removed a disk drive from the configuration on purpose 1 Select Change Show Delete a ilat Spare Pool from the smit Seata menu A 2 Select the critical hot spare pool 3 Verify that the contents of the pool are as re
277. isks Cancel all SSA Disk Identifications F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do Select the option that you want and go to the instructions for that option 106 Advanced SerialRAID Adapters User and Maintenance Information Listing the Disk Drives in an SSA RAID Array This option allows you to list the disk drives that are contained in a particular array T For fast path type smitty Issaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select List Disks in an SSA RAID Array A list of arrays is displayed in a window a List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09253173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the array whose disk drives you want to list Chapter 6 Using the RAID Array Configurator 107 3 A list of disk drives is displayed a pdisk1 pdisk4 pdisk7 pdisk8 Fl Help F8 Image n Find Next Command OK
278. ist of disk drives is displayed From the displayed list select the disk drive that you want to remove Press Enter to remove the disk drive from the array If the Check light of the disk drive that you are removing is off use the Set Service Mode service aid to put that disk drive into Service Mode see If the Check light of the disk drive that you are removing is on you do not need to select Service Mode before you remove that disk drive Physically remove the disk drive See the service information for the device that contains the disk drive then return to here Physically install the replacement disk drive See the service information for the device that contains the disk drive then return to here If the gisk drive is in Service Mode reset Service Mode See FSet Service Modd then return to here Now you must remove from the system configuration the reference to the pdisk that you have just removed Type rmdev 1 pdisknumber d where pdisknumber is the pdisk number of the disk drive that you have just removed Chapter 14 Removal and Replacement Procedures 275 18 19 20 21 22 23 24 25 26 27 If the pdisk that you have just removed did not belong to a RAID array you must also remove from the system configuration the reference to the hdisk Type rmdev 1 hdisknumber d where hdisknumber is the hdisk number of the disk drive that you have just removed If you
279. ittent step Blin MAP 2324 SSA RAID Have you exchanged a FRU NO a Run diagnostics in System Verification mode to the device that reported the problem Note Do not run Advanced Diagnostics otherwise errors might be logged on other using systems that share the same loop b Go to step Han page 421 YES Go to step A 2 from step hh Before you arrived at this MAP you exchanged one or more FRUs for new FRUs Some of those FRUs have Power lights for example disk drives and fan and power supply assemblies If none of the FRUs that you exchanged has a Power light go to step H if some or all of the FRUs that you exchanged have Power lights check whether all those Power lights are on Do the FRUs that you have exchanged have their Power lights on NO a Exchange for a new one the FRU whose Power light is off b Go to step H YES Go to step B 3 from step b Are all Check lights off Note For FRUs that do not have a Check light answer YES NO Go to the START MAP for the enclosure in which the device that has its Check light on is installed YES a Run diagnostics in System Verification mode to the device that reported the problem 420 Advanced SerialRAID Adapters User and Maintenance Information Notes 1 Do not run Advanced Diagnostics otherwise errors might be logged on other using systems that share the same loop 2 If you have just exchanged a disk drive or an SSA adapter you might need
280. itty exssaraid and press Enter Otherwise a Select Change Member Disks in an SSA RAID Array from the SSA RAID Array menu b Select Swap Members of an SSA RAID Array 2 Alist of arrays is displayed in a window a Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array SSA RAID Array Move cursor to desired item and press Enter Change Member Disks of an SSA RAID Array Use arrow keys to scroll hdisk3 095231779F0737K rebuilding 3 4G RAID 5 array hdisk3 09523173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Select the array whose disk drives you want to swap 140 Advanced SerialRAID Adapters User and Maintenance Information 3 The following information is displayed A Swap Members of an SSA RAID Array D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa SSA RAID Array hdisk3 Connection Address Array Name 09523173A02137K Disk To Remove Disk To Add F1l Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do J Select Disk to Remove and press the List key From the displayed list select the disk drive that you want to remove and press Enter Note If the disk drive that you are replacing has been rem
281. itty exssaraid and press Enter Otherwise a Select Change Member Disks of an SSA RAID Array from the SSA RAID Array menu b Select Swap Members of an SSA RAID Array A list of arrays is displayed Change Member Disks of an SSA RAID Array D Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array SSA RAID Array Move cursor to desired item and press Enter hdisk3 00703795D3F7COG system good 9 2GB raid_1 hdisk4 00703784C540C00 system degraded 27 5GB raid_10 hdisk5 007037943540C00 system good 27 5GB raid_10 Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the array into which you are installing the replacement disk drive This array is listed as exposed or degraded Chapter 6 Using the RAID Array Configurator 93 5 The following information is displayed a Swap Members of an SSA RAID Array N Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssal SSA RAID Array hdisk4 RAID Array Type raid_10 Connection Address Array Name 00703784C540C00 Disk To Remove Disk To Add Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1Q Exit Enter Do Ne J 6 Select Disk to Remove Press the List key to display the disk drive to remove If the disk drive that you are replacing has be
282. ive status byte and transaction result fields which are set up in the SSA MCB For details see the Technical Reference for the adapter Chapter 12 Using the Programming Interface 217 ssadisk SSA Disk Device Driver Purpose To provide support for Serial Storage Architecture SSA disk drives Syntax include lt sys devinfo h gt include lt sys ssa h gt include lt sys ssadisk h gt Configuration Issues SSA Logical Disks SSA Physical Disks and SSA RAID Arrays Serial Storage Architecture SSA disk drives are represented in AIX as SSA logical disks hdiskO hdisk1 hdiskN and SSA physical disks pdisk0 pdisk1 pdisk SSA RAID arrays are represented as SSA logical disks hdisk0 hdisk1 hdisk N SSA logical disks represent the logical properties of the disk drive or array and can have volume groups and file systems mounted on them SSA physical disks represent the physical properties of the disk drive By default e One pdisk is always configured for each physical disk drive e One hdisk is configured either for each disk drive that is connected to the using system or for each array By default all disk drives are configured as system AIX disk drives The array management software deletes hdisks to create arrays SSA physical disks have the following properties They e Are configured as pdiskO pdisk1 pdiskn e Have errors logged against them in the system error log e Provide support for a charac
283. iver The POLLIN event is indicated by the device driver when any data is received for this target instance A nonblocking read subroutine if subsequently issued by the caller returns data For a blocking read subroutine the read does not return until either the requested length is received or the write operation ends whichever comes first Asynchronous notification of the POLLIN event occurs when received data is available This notification occurs only if the select event POLLSYNC was not set The initiator mode device driver provides support for the following select events POLLOUT Check whether output is possible POLLPRI Check whether an error occurred with the write operation POLLSYNC Return only events that are currently pending No asynchronous notification occurs An additional event POLLIN is not applicable and has no support from the initiator mode device driver The reventp output parameter points to the result of the conditional checks The device driver can return a bitwise OR of the following flags POLLOUT If the initiator device is opened with the O_NDELAY flag some buffer space is not being used now Otherwise this event is always set for the initiator mode device POLLPRI An error occurred with the latest write operation Asynchronous notification of the POLLOUT event occurs when buffer space is made available for further write operations Asynchronous notification of the POLLPRI event occurs if an erro
284. iver ioctl Operation 216 vi Advanced SerialRAID Adapters User and Maintenance Information Purpose Description Return Values Files SSA Adapter Device Driver Direct Call Entry Point Purpose nps n Se yen oe e bE G Description Return Values ssadisk SSA Disk Device Driver Purpose Syntax Configuration Issues Device Attributes Device Dependent Subroutines Error Conditions Special Files IOCINFO Device Information SSA Disk Device Driver ioctl Operation Purpose be cis A dng EOE EG a A ae ee Y Description Files SSADISK_ISAL_ CMD ISAL Command SSA Disk Device Driver ioctl Operation Purpose Description Return Values Files SSADISK_ISALMgr_ CMD SAL Manager Command SSA Disk Device Driver ioctl Operation Purpose Description Return Values Files SSADISK_ SCSI CMD SCSI Command SSA Disk Device Driver ioctl Operation Purpose Description Return Values Files SSADISK_LIST_ PDISKS SSA Disk Device Driver ioctl Operation Purpose fia fe ds de Ath Yaa ae Gy Ada w ke tae Fey te 28 Description Return Values Files SSA Disk Concurrent Mode of Operation Interface Device Driver Entry Point Top Kernel Extension Entry Point SSA Disk Fencing SSA Target Mode Configuring the SSA Target Mode Buffer Management Understanding Target Mode Data Pacing Using SSA Target Mode o Contents 216 216 216 216 217 217 217 217 218 218 218
285. ives 89 creating a hot spare 70 creation and change attributes all RAID arrays 198 allow_page_splits true false 198 bypass_cache if_oneway 199 fastwrite on off 198 fw_end_block 198 fw_max_length 199 fw_start_block 198 creation and change attributes hot spare pool 202 creation and change attributes RAID 1 5 and 10 arrays 199 read_only_when_exposeds true false 200 spare_exact true false 199 spare_preferred 200 spare true false 199 creation and change attributes RAID 1 and 10 arrays 200 hot_spare_splits 200 split_resolution 200 creation and change attributes RAID 10 arrays 201 strip_size 201 creation and change attributes RAID 5 arrays 201 442 Advanced SerialRAID Adapters User and Maintenance Information creation and change attributes RAID 5 arrays 201 continued strip_size 201 creation and change attributes RAID arrays 198 cron table entries 265 D data paths loops and links 7 large configurations 16 one loop with two adapters in each of two using systems 12 one loop with two adapters in one using system 11 simple loop 8 simple loop one disk drive missing 9 simple loop two disk drives missing 10 two loops with one adapter 14 two loops with two adapters 15 data paths loops and links configuring devices 18 data paths and loops examples broken loop cable removed 352 broken loop disk drive removed 355 normal loops 350 dealing with RAID array problems 87 deciding how to configure hot spare disk drive pools
286. ives that can be included in a hot spare pool is limited only by the number of disk drives that are permitted on a single SSA loop When choosing how many disk drives to include in a hot spare pool think about how many disk drives the hot spare is protecting and how much time might elapse before a failed disk drive can be replaced Choosing the Error Threshold Alarm Level for a Hot Spare Pool Normally a hot spare pool reports an error when any hot spare disk drive has been used Under some conditions such as a disk drive failure at an unattended site you might prefer to delay service activities until more than one disk drive in a hot spare pool has failed You can do this when you create a hot spare pool When you create a hot spare pool see set the Hot Spare Chapter 5 Hot Spare Management 49 Minimum parameter to be equal to the minimum number of hot spare disk drives that is needed to protect the array in the selected pool No error log entry is made until the number of hot spare disk drives that remains in the pool is less than the Hot Spare Minimum parameter Rules for Hot Spare Disk Drive Pools By default all hot spare disk drives are in pool zero Pool zero is called AO for hot spare disk drives that are on SSA loop A and BO for hot spare disk drives that are on SSA loop B Hot spare pool numbers are in the range AO through A31 and BO through B31 The pool number is automatically assigned when a hot spare pool is create
287. k Chapter 6 Using the RAID Array Configurator 95 Getting Access to the SSA RAID Array SMIT Menu 1 For fast path access to the SSA RAID Array SMIT menus type smitty ssaraid and press Enter Otherwise a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displayed c Select SSA RAID Arrays 2 The SSA RAID Arrays menu is displayed 4 gt SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool Add an SSA RAID Array Delete an SSA RAID Array Change Show Attributes of an SSA RAID Array Change Member Disks in an SSA RAID Array Change Show Use of an SSA Physical Disk Change Use of Multiple SSA Physical Disks Change Show Delete a Hot Spare Pool F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do X J From the following list find the option that you want and go to the place that is indicated 96 Advanced SerialRAID Adapters User and Maintenance Information Chapter 6 Using the RAID Array Configurator 97 Listing All De
288. k Verification for nunu ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdisk11 AC7AA09A 0 5 Good nunu pdisk8 AC7AA2D6 1 4 Good 222 nunu pdisk3 AC7AAOQB1 3 2 Good nunu pdisk7 AC7AA0B5 4 1 Good nunu pdisk12 AC7AA052 5 0 Good nunu pdisk AC7AAQB9 0 5 Good nunu pdisk1 AC7AAQB3 1 4 Good nunu pdisk10 AC7AAQB4 2 3 Good MORE 4 F3 Cancel F1O Exit Na Is a link broken between two pdisks NO No trouble found YES a Find the devices that are on each side of the broken link The Identify function which is available on this display helps you to find the locations of pdisks See if you need more information about finding the disk drive j The information that is provided there can help you solve the problem For information on how to identify and exchange the FRU see the service information for the enclosure that contains the device Chapter 17 SSA Problem Determination Procedures 397 MAP 2323 SSA Intermittent Link Error This MAP helps you to isolate FRUs that are causing an intermittent SSA link problem You are here because you have an SRN from the series 21xxx through 29xxx or you have SRN 33xxx If you are not familiar with the SSA link read the section ECh a oend NA T SSA links strings and loops j explains Attention Unless the using system needs to be switche
289. ks across Enclosures Chapter 5 Hot Spare Management 47 Figure 20 shows an alternative method of protecting RAID 5 arrays against the complete failure of an SSA Enclosure This method uses a different hot spare disk drive to protect each member of the array Enclosure 1 Figure 20 Pools along and Hdisks across Enclosures 48 Advanced SerialRAID Adapters User and Maintenance Information Figure 21 shows how a RAID 10 array can be protected against the complete failure of an SSA enclosure Enclosure 1 Pool A1 hdisk1 Primary Disks hdisk2 Primary Disks Os a as hdisk1 Secondary Disks hdisk2 Secondary Disks Soge Figure 21 Pools and Hdisks along Enclosures The primary disk drives of the array are in enclosure 1 the secondary disk drives are in enclosure 2 The secondary disk drives contain the same data as do the primary disk drives Pool A1 contains all the primary disk drives of the arrays and a hot spare disk drive pool A2 contains all the secondary disk drives and a hot spare disk drive If one enclosure fails completely the other enclosure can still recover from a disk drive failure because its disk drives and the hot spare disk drive are in the same pool Choosing How Many Hot Spare Disk Drives to Include in Each Pool The number of hot spare disk dr
290. lRAID Adapters User and Maintenance Information SSA Link Errors SSA link errors can be caused if e Power is removed from an SSA device An SSA device is failing e An SSA device is removed A cable is disconnected Such errors might be indicated by e SRN 45PAA A flashing link status Ready light on the SSA device at each end of the failing link e The indication of an open link by the Link Verification service aid SSA Link Error Problem Determination Instead of using the normal MAPs to solve a link error problem you can refer directly to the link status lights to isolate the failing FRU The descriptions given here show you how to do this In an SSA loop SSA devices are connected through two or more SSA links to an SSA adapter Each SSA link is the connection between two SSA nodes devices or adapters for example disk drive to disk drive adapter to disk drive or adapter to adapter An SSA link can contain several parts When doing problem determination think of the link and all its parts as one complete item Here are some examples of SSA links Each link contains more than one part Chapter 17 SSA Problem Determination Procedures 423 Example 1 In Figure 52 the link is between two disk drives that are in the same subsystem It has three parts SSA Subsystem lt D Disk Internal Disk Drive 1 Connection Drive 2 Figure 52 Three Part Link in One Subsystem Exa
291. lated to the initiator mode data Device Dependent Subroutines The target mode device driver provides support for the following subroutines open close read e write ioctl select open Subroutine The open subroutine allocates and initializes target or initiator device dependent structures No commands are sent to the device as a result of running the open subroutine The initiator mode device or target mode device must be configured but not already opened for that mode otherwise the open subroutine does not work Before the initiator mode device can be successfully opened its special file must be opened for write operations only Before the target mode device can be successfully opened its special file must be opened for read operations only Possible return values for the errno global variable include 248 Advanced SerialRAID Adapters User and Maintenance Information EBUSY Attempted to run an open subroutine for a device instance that is already open EINVAL Attempted to run an open subroutine for a device instance but either a wrong open flag was used or the device is not yet configured EIO An I O error occurred ENOMEM The SSA device does not have enough memory resources close Subroutine The close subroutine deallocates resources that are local to the target device driver for the target or initiator device No commands are sent to the device as a result of running the close subroutine Possible
292. le one disk drive missing 9 simple two disk drives missing 10 two loops with one adapter 14 two loops with two adapters 15 ssa_progress command 312 SSA RAID Array SMIT menu getting access 57 SSA RAID arrays adding a disk drive to an SSA RAID array 138 adding a new hot spare pool 81 adding disks to a hot spare pool 84 adding to the configuration 58 canceling all SSA disk drive identifications 127 changing member disks in an SSA RAID array 135 changing or showing the attributes of an SSA RAID array 133 changing or showing the status of a hot spare pool 72 changing or showing the use of an SSA disk drive 142 changing the use of multiple SSA physical disks 145 creating a hot spare disk drive 70 deleting an old RAID array recorded in an SSA RAID manager 131 deleting from the configuration 68 identifying AIX system disk drives 125 identifying and correcting or removing failed disk drives 89 identifying array candidate disk drives 123 identifying hot spare disk drives 119 identifying rejected array disk drives 121 identifying the disk drives in an SSA RAID array 117 installing a replacement disk drive 93 installing and configuring 56 listing AIX system disk drives 115 listing all defined SSA RAID arrays 98 listing all SSA RAID arrays that are connected to a RAID manager 100 listing all supported SSA RAID arrays 99 listing array candidate disk drives 113 listing hot spare disk drives 109 listing old RAID array
293. le disk drive a Type smitty ssaraid and press Enter b Select Change Show Use of an SSA Physical Disk The disk drive that has been restored to the system is listed under SSA Physical Disks that are rejected c Select the disk drive that has been restored to the system Change the Current Use parameter to Hot Spare Disk or to Array Candidate Disk Note It is the user who should make the choice of Current Use parameter That choice should be 418 Advanced SerialRAID Adapters User and Maintenance Information 33 Hot Spare Disk if the use of hot spares is enabled for the arrays on the subsystem Array Candidate Disk if the use of hot spares is disabled for the arrays on the subsystem e Go to step Ba YES When a new disk drive has been added to the system it is configured as an AIX disk drive If the disk drive replacement procedure that you used has not already instructed you to do so change the Current Use parameter of the disk drive to Hot Spare Disk or to Array Candidate Disk a Type smitty ssaraid and press Enter b Select Change Show Use of an SSA Physical Disk The pdisk that has been exchanged is listed under SSA Physical Disks that are system disks c Select the pdisk from the list Change the Current Use parameter to Hot Spare Disk or to Array Candidate Disk Note Itis the user who should make the choice of Current Use parameter That choice should be Hot Spare Disk if the use of hot
294. ling disk drive For this action use the ssaraid command with only the old_member attribute specified 2 Physically remove the disk drive from the slot 3 Install the new disk drive into the slot that contained the old disk drive 4 Logically add the new disk drive to the array For this action use the ssaraid command with only the new_member attribute specified Notes 1 If you specify the new_member attribute and the old_member attribute together an in place exchange is attempted the old_member disk drive is replaced by the new_member disk drive in one operation 2 You can remove disk drives only from arrays that are not in the Exposed state When you remove a disk drive the array enters the Exposed state and remains in that state until you add the new disk drive 3 RAID 5 arrays cannot operate if they lose more than one disk drive at a time 204 Advanced SerialRAID Adapters User and Maintenance Information 4 To generate a list of suitable exchange candidates use the x flag with the list command Return Codes Code Description 0 Successful 1 Some changes made but finally not successful 2 General problem accessing the object data manager ODM 3 Specified object file record ODM object not found 4 Heap allocation failed 5 Open ioctl failure for RAID manager 6 Bad Transaction result 7 Array already known to AIX cfgmgr 8 System call failed 9 Internal logic error 10 Method not found not executable or not
295. ll entry point 217 SSA_GET_ENTRY_POINT ioctl operation 216 SSA_TRANSACTION ioctl operation 215 SSADISK_ISAL_CMD ioctl operation 231 SSADISK_ISALMgr_CMD ioctl operation 234 SSADISK_LIST_PDISKS ioctl operation 238 SSADISK_SCSI_CMD ioctl operation 236 rmssaraid command 68 rules for SSA loops 22 relationship between disk drives and adapters 24 one pair of adapter connectors in the loop 24 pairs of adapter connectors in the loop mainly shared data 26 pairs of adapter connectors in the loop some shared data 25 rules for hot spare disk drive pools 50 run_ssa_ela_cron 187 run_ssa_healthcheck cron error logging 182 run_ssa_link_speed cron error logging 182 S SDRAM module installing 281 removing 280 select entry point tmssa device driver 253 serial storage architecture SSA 3 service aids 321 Certify Disk 340 Configuration Verification 336 Display Download Disk Drive Microcode 342 Format Disk 338 Identify function 323 Link Speed 345 Link Verification 331 Set Service Mode 326 SRNs 349 starting 324 Set Service Mode service aid 326 showing the disks that are protected by hot spares 75 simple loop 8 simple loop one disk drive missing 9 simple loop two disk drives missing 10 SMIT or SMITTY commands add_hsm_pool_adap 81 addssaraid 138 chg_hsm_pool_adap 84 chgssadisk 70 142 chgssadisks 145 chgssardsk 168 chssaraid 133 exssaraid 93 140 iassaraid 125 icssaraid 123 ifssaraid 90 121 ihssaraid 119 issaraid 117 lassarai
296. llow a program to control and access a storage device The ISAL command set is described in the Technical Reference for the adapter The SSADISK_ISALMgr_CMD operation allows the caller to issue an ISAL command to a selected logical or physical disk The caller must be root or have an effective user ID of root to issue this ioctl The following ISAL commands minor function codes that are defined in the usr include ipn ipnsal h file can be issued FN_ISALMgr_Inquiry FN_ISALMgr_Hardwarelnquiry FN_ISALMgr_GetPhysicalResourcelDs FN_ISALMgrVPDInquiry FN_ISALMgr_Characteristics FN_ISALMgr_Statistics FN_ISALMgr_Flashindicator The arg parameter for the SSADISK_ISALMgr_CMD ioctl is the address of an ssadisk_ioctl_parms structure This structure is defined in the usr include sys ssadisk h file The SSADISK_ISALMgr_CMD ioctl uses the following fields of the ssadisk_ioctl_parms structure dsb Contains the directive status byte that is returned for the command The byte contains a value from the usr include ipn ipndef h file A non zero value indicates an error result Contains the IPN result word that is returned by IPN for the command The word contains values from the usr include ipn ipntra h file A non zero value indicates an error u isal parameter_descriptor Set by the caller to indicate the buffer for parameter data u isal transmit_descriptor Set by the caller to indicate the buffer for transmit data Chapter 12 Us
297. loops links and data paths large configurations 16 one loop with two adapters in each of two using systems 12 one loop with two adapters in one using system 11 simple loop 8 simple loop one disk drive missing 9 10 two loops with one adapter 14 two loops with one adapter in each of two using systems 15 loops and data paths examples broken loop cable removed 352 broken loop disk drive removed 355 normal loops 350 Is_hsm_array_components command 78 Is_hsm_array_status command 75 Is_hsm_status command 72 Isdssaraid command 98 Isidssaraid command 106 Ismssaraid command 100 Issaraid command 107 Isssaraid command 99 Istssaraid command 102 maintenance analysis procedures MAPs 390 managing dumps 211 MAP 2010 391 MAP 2320 393 MAP 2323 398 MAP 2324 402 MAP 2410 420 microcode adapter checking the level 23 microcode and software errors 388 microcode maintenance 266 adapter 267 checking microcode package ID and level 266 disk drive 267 microcode package ID and level 266 mkdev configuring a logical disk 221 mkdev configuring a physical disk 221 mkssaraid command 58 multiple states RAID 10 38 N node_number locking 27 normal loops SSA link 350 nvrssaraid command 128 O object types Command Line Interface 192 ODM attributes PCI 209 Offline state RAID 10 37 Offline state RAID 5 34 446 Advanced SerialRAID Adapters User and Maintenance Information one loop with two adapters in each of two using systems 12 on
298. lowing menu is displayed fe Change Member Disks in an SSA RAID Array D Move cursor to desired item and press Enter Remove a Disk From an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array Fl Help F2 Refresh F3 Cancel F8 Image F9 Shel F10 Exit Enter Do If you have an available disk drive select Swap Members of an SSA RAID Array and go to step kon page 140 of Swapping Members af an SSA RAID Array If you do not have an available disk drive select Remove a Disk Ls an SSA RAID wal and go to step Chapter 6 Using the RAID Array Configurator 135 Removing a Disk Drive from an SSA RAID Array This option allows you to remove a disk drive from an array so that you can install a replacement disk drive Use this option when you do not have either an available online disk drive or a spare slot for a replacement disk drive 1 For fast path type smitty redssaraid and press Enter Otherwise a Select Change Member Disks in an SSA RAID Array from the SSA RAID Array menu b Select Remove a Disk from an SSA RAID Array 2 A list of arrays is displayed in a window Change Member Disks in an SSA RAID Array Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 095
299. ly this operation returns a value of 0 Otherwise a value of 1 is returned and the errno global variable is set to the following value EINVAL Indicates that the caller was not in kernel mode Files dev ssa0 dev ssa1 dev ssan 216 Advanced SerialRAID Adapters User and Maintenance Information SSA Adapter Device Driver Direct Call Entry Point Purpose To allow another kernel extension to send transactions to the SSA adapter device driver This function is not valid for a user process When the function completes its run an off level interrupt notifies the caller See SSA_GET_ENTRY_POINT SSA adapter ioctl operation Description The entry point address is the address that is returned in EntryPoint by the SSA_GET_ENTRY_POINT ioctl operation The function takes a single parameter of type SSA_loreq_t which is defined in the usr include sys ssa h file The fields of the SSA_loreq_t structure are used as follows SsaDPB_ An array of size SSA_DPB_SIZE which is used by the SSA adapter device driver and should be initialized to all NULLs SsaNotify The address of the function in the SSA head device driver that the SSA adapter device driver calls when the directive has completed ud The transaction to be executed Valid transactions are described in the Technical Reference for the adapter Return Values This function does not return errors You can determine success or failure of the directive by examining the direct
300. ly with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits Neither the provider nor the manufacturer is responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment Unauthorized changes or modifications could void the user s authority to operate the equipment This device complies with Part 15 of FCC Rules Operation is subject to the following two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Japanese Voluntary Control Council for Interference VCCI Statement This product is a Class A Information Technology Equipment and conforms to the standards set by the
301. m Verification mode to all disk drives that are listed as rejected if any are listed If the diagnostics run successfully run the Certify service aid see 40 to the disk drive that caused this SRN Run the Certify service aid see to all the disk drives that were members of the failed array Run the Certify service aid to all the disk drives that were members of the failed array If problems occur on any disk drive exchange that disk drive for a new one Ask the user to recreate the array A disk drive has failed during an array building operation Because the failure occurred before an initial array building operation had completed a hot spare disk drive has not replaced the failed disk drive Possible FRUs Device 100 376 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 49000 Description An array is in the Degraded state ARAID 5 array causes this SRN if a disk drive is not Action A disk drive might not be available for one of the following available to the array and a rQasons write command is sent to the e The disk drive has failed array e The disk drive has been removed from the subsystem An SSA link has failed e ARAID 1 or RAID 10 array A power failure has occurred causes this error if the array has one or more degraded If the SSA service aids are available run the Link Verification service aid mir
302. m a hot spare pool 84 showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 Attention notices formatting disk drives 338 fragility of disk drives 390 service aids 321 attributes action new_member disk 204 old_member disk 204 array member disk drives spare_pool 202 disk device driver 222 adapter_a 223 adapter_b 223 connwhere_shad 223 location 223 max_coalesce 223 node_number 222 primary_adapter 223 pvid 223 queue_depth 223 reserve _lock 223 size_in_mb 223 write_queue_mod 224 attributes continued hot spare disk drives change spare_pool 201 hot spare pool minimum_spares 202 ODM PCI 209 bus_intr_level 209 bus_io_addr 209 bus_mem_start 209 bus_mem_start2 209 bus_mem_start3 209 bus_mem_start4 209 daemon 210 dma_mem 210 host_address 210 intr_priority 210 scat_gat_pages 210 ucode 209 physical disk change attributes 203 physical disk drive change fastwrite on off 203 force yes no 204 fw_end_block 203 fw_max_length 204 fw_start_block 203 use system spare free 203 RAID 1 5 and 10 creation and change read_only_when_exposed true false 200 spare_exact true false 199 spare_preferred 200 spare true false 199 RAID 1 and 10 creation and change hot_spare_splits 200 split_resolution 200 RAID 10 creation and change strip_size 201 RAID 5 creation and change 202 strip_size 201 RAID arrays change 201 force yes no 201 use system free 201 RAID arrays creation and change 1
303. m only that pool Components The number of array member disk drives that the hot spare disk drives in the pool are protecting Spares The number of hot spare disk drives that are now in the pool Configured The number of hot spare disk drives that were in the pool when it was created or changed Minimum The value that is selected to be the minimum number of hot spare disk drives that can exist in a pool before an error condition is logged This number is normally set to be the same as the number of disk drives that were originally configured in the pool You can however set the minimum to a lower number if you do not want to be alerted when a single hot spare disk drive has been used Status The status of the hot spare pool Valid values for status are full The number of hot spare disk drives that are in the pool equals the number of hot spare disk drives that are configured for the pool Chapter 6 Using the RAID Array Configurator 73 empty The pool contains no hot spare disk drives or the hot spare disk drives that are in the pool are not suitable as member disk drives of the pool reduced The number of hot spare disk drives that are in the pool is less than the number of hot spare disk drives that were originally configured but greater than the configured minimum number critical The number of hot spare disk drives that are in the pool is less than the specified number of hot spare disk drives for that pool inconsist
304. me out period see HMCHGIMPABM Changd You can use the select and poll routines to check for read and write capability and can also be notified of the possibility of a read or write operation The amount of data that can be sent by one write operation in blocking mode has no limit but the driver and adapter interface has been optimized for transfers of 512 bytes or less In nonblocking mode enough buffer space must be available for the write operation Each separate write operation is treated separately by the target so when reading each separate write operation requires a separate read operation Configuring the SSA Target Mode Each using system requires its own unique node number The SSA adapter software specifies this node number which is used by Target Mode SSA The configuration database contains the ssar device The node_number attribute sets the number for the node Failure to have unique node numbers in the SSA loops causes unpredictable results with the target mode interface Node numbers that are not unique cause error logs You can use the ssavfynn command to check for duplicate node numbers 244 Advanced SerialRAID Adapters User and Maintenance Information When the node is configured it automatically inspects the existing SSA loops It detects all nodes that are using the target mode SSA interface now Each detected node is then added to the configuration database if it is not already part of it For each node that i
305. mmand ee ee ee ee BN E PUIPOSE p mos a Sa Oe em a ee d Gt ee Se A tw Go a BAY SVNLAX un Baw ce Law Se ee Be SE A ee en a ee ee ot 319 Description s s 2 fan amp of sb amp wl ae Poke we Roce eS ge k 2 2819 Flags ue oh do we eee BO oe A Bee da ok ae obs Gh ade El ee GND Chapter 16 SSA Service Aids 821 The Identify Function ete he Boa a Aig MA Se ra ee ee S828 Starting the SSA Service Aids soh aiia et oar tie te et ee de a ae D Pe 2A Set Service Mode Service Aid 2 eee ee ee 826 Link Verification Service Aid 1 ee ee ee 88 Configuration Verification Service Aid 1 ee 886 Format Disk Service Aid 2 2 ee ee ee ee 888 Certify Disk Service Aid boty amp ae da ok geod ee 2 40 Display Download Disk Drive Microcode Service Aid Sow on Ae ew ore 842 Link Speed Service Aid bt Ake Piet ta A te ey a BAD Service Aid Service Request Numbers SRNs i gt 4 i oa B ae a 25849 Using the Service Aids for SSA Link Problem Determination oh Sn A ote a 1 BAY Example 1 Normal Loops Pog oe ie ad he Se er ae 25350 Example 2 Broken Loop Cable Removed Sed Bes Avs he S a g a8b2 Example 3 Broken Loop Disk Drive Removed 355 Finding the Physical Location of a Device Wnt te og ce 28 7 4858 Finding the Device When Service Aids Are Available ct gs a Poe amp Ae a S08 Finding the Device When No Service Aid
306. mple 2 In Eigure 54 the link is between two disk drives that are in the same subsystem It has five parts SSA Subsystem lt gt Disk Internal An Internal Disk Drive 1 Connection Die Connection Drive 2 Figure 53 Five Part Link in One Subsystem Example 3 In Figure 54 on page 425 the link is between two disk drives that are not in the same subsystem It has seven parts 424 Advanced SerialRAID Adapters User and Maintenance Information SSA Subsystem K D SSA Drive Connection Connector 2 9 Card Cable SSA Subsystem lt SSA Internal Disk Connector Connection Drive Card Figure 54 Seven Part Link in Two Subsystems Example 4 Figure 551 the link is between a disk drive and an SSA adapter It has five parts SSA Subsystem lt Disk Internal SSA Cable hase Drive Connection Connector Card Figure 55 Five Part Link between Disk Drive and Adapter Example 5 In Figure 56 the link is between two SSA adapters It has five parts Note that it has fiber optic cables and optical connectors instead of normal SSA cables Fiber Optic Cables Adapter Optical Connector Optical Connector Adapter Figure 56 Five Part Link between Two Adapters Link
307. n SSA loop contains three or more SSA adapters that are installed in two or more using systems you must ensure that all those using systems are switched on and that all the disk drives in all those using systems are configured as follows e If all the using systems are switched off Micro Channel or PCI 1 For each Micro Channel system a Set Secure mode on each using system b Switch on all the using systems c Wait for 200 to be displayed on the operator panel of each system For each PCI system a Switch on one using system only b Wait for the first display logo to appear on the screen Press F1 immediately The using system goes into System Management Services mode 2 When each using system is in the state described in the preceding steps For Micro Channel systems set Normal mode to continue the boot process For PCI systems press F10 Exit to continue the boot process If one or more using systems are switched on Micro Channel or PCI 1 Switch on the remaining using systems 2 On each using system a Run the cfgmgr command to configure all the disk drives b Manually vary on the volume groups and mount the file systems as required SSA Link Speed Some SSA devices can run at 20 MB per second others can run at 40 MB per second Both types of devices can exist in a particular configuration but for best performance all links should run at the same speed Two types of SSA cable are available e 20 M
308. n which you want to change the hot spare pool 84 Advanced SerialRAID Adapters User and Maintenance Information 3 A list of hot spare pools is displayed SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager SSA Hot Spare Pools Move cursor to desired item and press Enter HEE EEE EE HEE EE EE EE Hot Spare Pools in Loop A are pool_Al pool_A2 EE EE ETE EEE EE EE EE EE Hot Spare Pools in Loop B are pool Bl pool_B2 Fl Help F2 Refresh F3 Cancel F7 Select F8 Image F1O Exit F Enter Do Find n Find Next Select the hot spare pool that you want to change Chapter 6 Using the RAID Array Configurator 85 4 The hot spare pool is displayed D SSA Hot Spare Pools Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssal Spares Pool pool_B2 Status full Components in Pool 3 Hot Spares Previously Configured 1 Hot Spares in Pool 1 Components to Add g Components to Remove go Hot Spares Minimum 1 Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1Q Exit Enter Do 7 To add disk drives to the pool 1 Select Components to Add and press the List key A list of valid hot spare pool candidates is displayed This list contains RAID disk driv
309. nd Replacement Procedures 273 7 Attention You should be here only if you are working with a RAID 1 RAID 5 or RAID 10 array For fast path type smitty redssaraid and press Enter Otherwise a Select Change Member Disks in an SSA RAID Array from the SSA RAID Array menu b Select Remove a Disk from an SSA RAID Array 8 A list of arrays is displayed in a window a Change Member Disks in an SSA RAID Array Move cursor to desired item and press Enter Remove a Disk from an SSA RAID Array Add a Disk to an SSA RAID Array Swap Members of an SSA RAID Array SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09523173A02137K good 3 4G RAID 5 array F1l Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Select the SSA RAID array from which you are removing the disk drive 274 Advanced SerialRAID Adapters User and Maintenance Information 10 11 12 13 14 15 16 17 The following information is displayed Remove a Disk from an SSA RAID Array D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa0 SSA RAID Array hdisk3 Connection Address Array Name 095231779F0737K Disk to Remove Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image G F10 Exit Enter Do D Press F4 to list the disk drives A l
310. ng SSA Devices Location Code Format Pdisks Hdisks and Disk Drive Identification SSA Unique IDs Rules for SSA Loops Checking the Level of the Adapter Microcode Rules for the Physical Relationship between Disk Drives and Adapters One Pair of Adapter Connectors in the Loop Pairs of Adapter Connectors in the Loop Some Shared Data Pairs Of Adapter Connectors in the Loop Mainly Shared Data xiii xiii xiii XV XV XV XV Xvi Xvi Doonoawn k Ww oO ONN PO pO PPMDPMDPYNMDH HA ABA aBa aaa oa E OaRRWNH ODDADAWAAONNDOAAND Reserving Disk Drives Fast Write Cache Chapter 3 RAID Functions and gee States RAID Functions Ee ta sae a he Availability Disk Drives That Are Not in Arrays RAID O Array States BA Good State Offline State RAID 1 Array States RAID 5 Array States Good State Exposed State Degraded State Rebuilding State Offline State RAID 5 Array State Flowchart RAID 10 Array States Good State Exposed State Degraded State Rebuilding State Offline State Unknown State Multiple States Chapter 4 Using the SSA SMIT Menus Getting Access to the SSA Adapters SMIT Menu Getting Access to the SSA Disks SMIT Menu Getting Access to the SSA RAID Arrays SMIT Menu Chapter 5 Hot Spare Management Deciding how to Configure Hot Spare Disk Drive Pools Choosing How Many Hot Spare Disk Drives to Include in Each Pool Choosing
311. ng level of microcode of the available disk drives Chapter 15 Using the SSA Command Line Utilities 301 ssa_ela Command Purpose Syntax Description Flags Output To look for the most significant error in the error log ssa_ela 1 Device h timeperiod ssa_ela 1 pdisk ssa_ela 1 hdisk ssa_ela l adapter The ssa_ela I device h timeperiod command scans the error log and looks for all SSA errors The command returns the SRN for the most significant error The ssa_ela I pdisk command scans the error log and looks for errors that are logged against the specified pdisk The command returns the SRN for the most significant error The ssa_ela I hdisk command scans the error log and looks for errors that are logged against any hardware that provides support for the specified hdisk pdisks and adapters The command returns the SRN for the most significant error The ssa_ela I adapter command scans the error log and looks for errors that are logged against the specified adapter The command returns the SRN for the most significant error I Device Specifies the device whose error log you want to analyze for the most significant error h timeperiod Instructs the program to start searching the error log from a previous time that is a multiple of 24 hours For example h 1 the default setting starts a search through the previous 24 hours h 2 starts a search through the previous 48 hours If an error occurs
312. ng system Installation Description A command or parameter that has been sent or received is and Service Guide not valid This problem is caused either by the SSA adapter or by an error in the microcode Action Go to 88 before exchanging the FRU SSA01 Description Not enough using system memory is available for this service None aid to continue Action Take one of the actions described here e This problem might be caused by a failed application program Ask the user to end any failed application program then try to run the service aid again e Run diagnostics in Problem Determination mode to the system unit If you find any problems solve them then try to run the service aid again e Close down and reboot the using system then try to run the service aid again Run diagnostics from diskette or CD ROM to isolate the problem If you do not find a problem the operating system might have failed SSA02_ Description An unknown error has occurred None Action Take one of the actions described here e Run diagnostics in Problem Determination mode to the system unit If you find any problems solve them then try to run the service aid again e If diagnostics fail or if the same problem occurs when you try the service aid again run diagnostics from diskette or CD ROM to isolate the problem If you do not find a problem the operating system might have failed 386 Advanced SerialRAID Adapters User and Maintenance Information
313. nload Disk Drive Microcode Link Speed Physical Link Configuration Enclosure Configuration Enclosure Environment Enclosure Settings SMIT SSA RAID Arrays SMIT SSA Disks F3 Cancel F1O Exit Ne H Notes a In some configurations of the using system console Esc and 0 Esc and 3 Exit Cancel In such configurations however the displayed instructions for the function keys remain the same as those shown in the screen above b For some versions of AIX and for stand alone diagnostics the format of the service aid displays might be slightly different from that shown in this chapter Functionally however the displays remain the same 324 Advanced SerialRAID Adapters User and Maintenance Information 5 Select the service aid that you require then go to the relevant instructions in this chapter Chapter 16 SSA Service Aids 325 Set Service Mode Service Aid The Set Service Mode service aid enables you to determine the location of a particular disk drive and to remove that disk drive from the unit in which it is installed It causes the Check light of that disk drive to come on for identification and stops all SSA loop activity through the disk drive It also causes the Subsystem Check light if present of the unit containing the selected disk drive to come on Only one disk drive at a time can be in Service Mode Before using this service aid you must make the selected disk drive unavailable to the using system
314. nly You can specify the following attributes with the a option when you are using the ssaraid command with the C or H option to create or change a RAID 1 RAID 5 or RAID 10 array spare true false default true Normally if the array is in the Exposed state and a write operation to that array is attempted the array enters the Degraded state You can prevent this if you enable the spare attribute of the array and provide a suitable hot spare disk drive to the RAID manager that is controlling the array When the spare attribute is enabled and a write operation is attempted to an array that is in the Exposed state the RAID manager searches for an available hot spare disk drive to exchange for the failing disk drive This action prevents the array from entering the Degraded state spare_exact true false default false When used with the spare attribute the spare_exact attribute modifies the action of the RAID manager when the RAID manager attempts to exchange a hot spare disk drive for a failing disk drive Normally the RAID manager uses any hot spare disk drive that is large enough to replace the failing disk drive The spare_exact attribute causes the RAID manager to use only a hot spare disk drive that has the exact size that the array requires The size of the hot spare disk drive is determined by the size of the other member disk drives of the array The sizes of all the member disks are logically truncated to the size of the smallest
315. nly for the user It describes The Advanced SerialRAID Adapters SSA loops The RAID facilities that are provided by the adapter How to use the SSA SMIT menus How to use the RAID configuration utility to configure arrays of SSA disk drives and how to deal with problems such as the failure of a disk drive in a RAID array How to use the SSA Spare Tool How to configure the Fast Write feature SSA error logs How to use the SSA Command Line Interface How to use the programming interface Part 2 of this book is mainly for service representatives It describes General technical topics about the Advanced SerialRAID Adapters Removal and replacement procedures How to use the SSA Command Line Utilities The SSA service aids Problem determination procedures including Service Request Numbers SRNs and Maintenance analysis procedures MAPs The appendix contains the communications statements for the adapter A glossary and an index are provided If You Need More Information The Problem Solving Guide and Reference SC23 2204 is the first book you should use if you have a problem with your system Other books that you might need are The operator guide for your system Diagnostic Information for Multiple Bus Systems SA38 0509 Technical Reference for your adapter XV Web Support Pages When you are installing an SSA device or subsystem upgrading your SSA subsystem or doing preventive maintenance on your SSA subsystem refer
316. not run the service aids from more than one using system at a time otherwise unexpected results might occur The SSA service aids are e Set Service Mode This service aid enables you to determine the location of a particular disk drive on the SSA loop and to remove that disk drive from the loop Link Verification This service aid tells you the operational status of the links that make an SSA loop Configuration Verification This service aid lets you determine the relationship between physical and logical disk drives e Format Disk This service aid formats an SSA disk drive e Certify Disk This service aid verifies that all the data on a disk drive can be read correctly Display Download Disk Drive Microcode This service aid allows you to observe and modify the microcode level on all the SSA disk drives Link Speed This service aid allows you to observe the operating speed of each link on an SSA loop Physical Link Configuration This service aid provides support for SES enabled SSA enclosures subsystems See your enclosure service information for a description of this service aid Enclosure Configuration This service aid provides support for SES enabled SSA enclosures subsystems See your enclosure service information for a description of this service aid Enclosure Environment This service aid provides support for SES enabled SSA enclosures Subsystems See your enclosure service information f
317. ns may appear below pdisk4 08005AEA030D00D member rejected 2 3G Physical disk Fl Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next Z Check the list of rejected disk drives against other error reports to find out why the disk drive was rejected from the array If you know the physical location of the rejected disk drive go to step 12 onl Otherwise go to step Ato identify the rejected disk drive For fast path type smitty ifssaraid and press Enter Otherwise a Return to the List Identify SSA Physical Disks menu b Select Identify Rejected Array Disks The list of adapters that was displayed in step 2_on page 89 is displayed again 90 Advanced SerialRAID Adapters User and Maintenance Information 9 10 11 12 Select the adapter that contains the rejected disk drive The following menu is displayed m Identify Rejected Array Disks N Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa Rejected Array Disks Flash Disk Identification Lights yes Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do WASE Select yes in the Flash Disk Identification Lights field Press the List key to list the disk drives From the displayed list select the disk drives that you want to identify The Check light flashes on each disk drive that you have selec
318. nsion adapter position Expansion drawer The location code shows only the position of the SSA adapter in the using system and the type of device that is attached The location of the device within the SSA loop must be found by use of a service aid The service aids use the IEEE standard 16 digit unique ID of the device Pdisks Hdisks and Disk Drive Identification The physical disk drives pdisks in an SSA subsystem can be configured as logical units LUNs A LUN is also known as an hdisk and can consist of one or more physical disk drives An hdisk in an SSA subsystem might therefore consist of one pdisk or several pdisks The configuration software allocates an identification hdisk and pdisk number to each disk drive during the configuration of the SSA link The disk drives do not have fixed physical addresses The numeric identifiers of pdisks hdisks and the disk drive slots are not related to each other For example pdisk1 is not necessarily in slot 1 of the physical unit in which it is installed Chapter 2 Introducing SSALoops 19 The configuration software first recognizes the disk drive by its machine readable serial number The serial number of the disk drive is also displayed by the service aids The service aids show the number as the last eight digits of the IEEE SSA Unique ID Service actions are always related to physical disk drives For this reason errors that occur on SSA disk drives are always logged agains
319. nt to the adapter card this operation returns a value of 0 Otherwise a value of 1 is returned and the errno global variable is set to one of the following values EIO An unrecoverable I O error has occurred ENOMEN The device driver was unable to allocate or pin enough memory to complete the operation dev pdiskO0 dev pdisk1 dev pdiskn Provide an interface to allow SSA device drivers to access SSA physical disks dev hdiskO dev hdisk1 dev hdiskn Provide an interface to allow SSA device drivers to access SSA logical disks 238 Advanced SerialRAID Adapters User and Maintenance Information SSA Disk Concurrent Mode of Operation Interface The SSA subsystem provides support for the broadcast of one byte message codes from one using system to all other using systems that are connected to the same disk drive This ability to pass messages can be used to synchronize access to the disk drive The operating system has a concurrent mode interface to handle the sending and receiving of messages The concurrent mode of operation requires that a top kernel extension run on all the using systems that are sharing a disk drive The top kernel extensions use the concurrent mode interface of the SSA disk device driver to communicate with each other through the SSA subsystem The interface allows a top kernel extension to send and receive messages between using systems The concurrent mode interface consists of an entry point in t
320. nt to use the mkdev command to give that disk drive a specific hdisk number Chapter 2 Introducing SSA Loops 21 Rules for SSA Loops For SSA loops that include an Advanced SerialRAID Adapter type 4 P the following rules apply Each SSA loop must be connected to a valid pair of connectors on the SSA adapter that is either connectors A1 and A2 or connectors B1 and B2 A maximum of one pair of adapter connectors can be connected in a particular SSA loop All member disk drives of an array must be on the same SSA loop A maximum of 48 SSA devices can be connected in a particular SSA loop When an SSA adapter is connected to two SSA loops and each loop is connected to other adapters all adapters must be connected to both loops The number of adapters that are supported in an SSA loop is determined by whether any disk drives are configured for RAID or fast write operations and by the type of adapter see Table 1 Number of Adapters that are Supported in an SSA Loop Array Type Number of Type of Adapters Allowed Adapters in Loop Non RAID 8 Advanced SerialRAID Adapter PCI SSA Multi Initiator RAID EL Adapter Micro Channel SSA Multi Initiator RAID EL Adapter RAID 0O 1 Advanced SerialRAID Adapter RAID 1 2 Advanced SerialRAID Adapter at microcode level above 50 RAID 5 2 Advanced SerialRAID Adapter PCI SSA Multi Initiator RAID EL Adapter Micro Channel SSA Multi Initiator RAID EL Adapter
321. ntinue 1 2 For fast path access to the Change Show Characteristics of an SSA Logical Disk menu a Type smitty chgssardsk and press Enter b From the menu displayed select the logical disk that you want to change Otherwise a Select Change Show Characteristics of an SSA Logical Disk from the SSA Logical Disks menu b From the menu displayed select the logical disk that you want to change A list of options for the logical disk drives is displayed C N Change Show Characteristics of an SSA Logical Disk Type or select values in entry fields Press Enter AFTER making all desired changes MORE 6 Entry Fields Location Label Parent ssar Size in Megabytes 4512 adapter_a ssa adapter_b ssal primary_adapter adapter_a Connection address 0004AC506C3600E Physical volume IDENTIFIER 00406fdac2fb8203000000 gt ASSIGN physical volume identifier no RESERVE disk on open yes Queue depth 5 Maximum Coalesce 0x20000 Enable Fast Write yes Bypass Cache In 1 Way Fast Write Network no BOTTOM Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do Ne J If you do not want the fast write function to continue on a particular disk drive if the partner adapter becomes not accessible set the Bypass Cache in 1 Way Fast Write Network flag to yes for that disk drive With the flag set to yes an error is logged when the cache is bypassed If you want
322. ntroller PAA P Adapter port number AA SSA address see also Available on page 358 POS Programmable option select POS registers POST Power On Self Test SDRAM Synchronous dynamic random access memory Using the SRN Table Note You should have been sent here from either diagnostics or a START MAP Do not start problem determination from the SRN table always go to the START MAP for the enclosure in which the device is installed 1 Locate the SRN in the table If you cannot find the SRN refer to the documentation for the subsystem or device If you still cannot find the SRN you have a problem with the diagnostics the microcode or the documentation Call your support center for assistance 2 Read carefully the Action you must do for the problem Do not exchange FRUs unless you are instructed to do so 359 4 When exchanging an adapter always use the instructions that are sipas with the system unit 360 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 1xxxx Description SRNs in this range are not adapter SRNs Not applicable Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem 20PAA Description An open SSA link has been detected Possible FRUs Action Run the Link Verification service aid to isolate the failure see NK e auon e e SSA adapter card 45 If the SSA s
323. o Ne A 42 Advanced SerialRAID Adapters User and Maintenance Information Chapter 5 Hot Spare Management With all levels of adapter code disk drives can be configured to be hot spare disk drives These hot spare disk drives can be used in any array that is on the same SSA loop If the adapter microcode level is at or higher than level 50 each hot spare disk drive can be configured to a particular hot spare pool The pdisks of arrays can also be configured to hot spare pools You can therefore control which hot spare disk drive is to replace a particular failed member of an array This chapter describes the ways in which you can use hot spare pools Deciding how to Configure Hot Spare Disk Drive Pools RAID 1 and RAID 10 arrays provide data protection by writing the same data to two disk drives at the same time You can provide more data protection if you put the two disk drives into separate physical domains These physical domains can be separate SSA disk enclosures separate power sources or separate rooms or buildings When you use separate physical domains you provide some capability to recover from an unrecoverable loss of power For a RAID 1 or RAID 10 array to be able to recover after the failure of a physical domain at least one copy of the data must remain available It is important therefore that the action of replacing a failing disk drive with a hot spare disk drive does not cause an array member to move to anothe
324. o disk drives that are in use 300 Advanced SerialRAID Adapters User and Maintenance Information Flags Examples d PhysicalDiskName Specifies the physical disk drive that is to receive the microcode f CodeFileName S Specifies the microcode file to be downloaded Ensure that all SSA physical disk drives are loaded with the latest level of microcode that is available on the system By default this flag ensures that all SSA physical disk drives are loaded with the latest microcode To update a specific disk drive use this flag and the d flag Show the existing levels of microcode that are installed on SSA physical disk drives By default this flag shows the existing level of microcode that is installed on all SSA physical disk drives To list a specific disk drive use this flag and the d flag Using the f flag ssadload d pdisk f ssadisk ros 7899 With this flag the command loads microcode file ssadisk ros 7899 onto pdiskO Using the u flag ssadload u With this flag the command identifies the latest level of SSA disk drive microcode that is available in the etc microcode directory It then ensures that all the disk drives are using microcode that is at that level or at a higher level If it finds a disk drive that is using a lower level of microcode the command downloads the latest level of microcode to that disk drive Using the s flag ssadload s With this flag the command lists the existi
325. o the initiator Data that is read from a node is read from the target The special files are dev tmssaXX im The initiator mode device which has an even minor device number and is write only dev tmssaXX tm The target mode device which has an odd minor device number and is read only The device is tmssaXX where XX is the node number of the using system with which these files communicate You are not aware of which path connects the two nodes The path can change if for example SSA loops are changed nodes are switched off or any other physical change is made to the connected SSA loops The TMSSA device driver can use any available path to the other node but does not tell you which path is being used Each node must have in its device configuration database a unique node number that is defined by the node_number attribute of the ssar device Node 1 Node 2 Adapter Adapter Adapter Adapter Adapter Adapter ssa0 ssal ssa2 ssa3 ssa4 ssa5 Figure 35 An Example of Node to Node Communications Chapter 12 Using the Programming Interface 243 Figure 35 on page 243 shows an example configuration of two nodes In this example tmssa is at first using adapter ssa0 on node 1 and adapter ssa5 on node 2 Suddenly the link between the adapters fails The tmssa device driver automatically switches to adapters ssa1 and ssa3 or adapters ssa1 and ss
326. o to 130 Advanced SerialRAID Adapters User and Maintenance Information Deleting an Old RAID Array Recorded in an SSA RAID Manager This option allows you to delete the records of RAID managers that have been disconnected but whose records remain in the RAID manager 1 Select List Delete Old RAID Arrays in an SSA RAID Manager from the SSA RAID Array menu 2 Select Delete an Old RAID Array Recorded in an SSA RAID Manager 3 Alist of RAID managers is displayed in a window a List Delete Old RAID Arrays in an SSA RAID Manager D Move cursor to desired item and press Enter List Old RAID Arrays Recorded in an SSA RAID Manager Delete an Old RAID Array Recorded in an SSA RAID Manager SSA RAID Manager Move cursor to desired item and press Enter ssa Available 00 02 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next Select the RAID manager from which you want to delete an old array Chapter 6 Using the RAID Array Configurator 131 4 The following information is displayed Delete an Old RAID Array Recorded in an SSA RAID Manager Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ Old SSA RAID Array Record to Delete F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do Pres
327. oblems are indicated by the state of the pool and by error codes in the system error log When configuring or reconfiguring hot spare pools it is recommended that you use the state of the hot spare pool to help guide your actions If hot spare pool problems occur during normal operations use the Service Request Number SRN that is generated by the diagnostics to guide your actions To display the operating state of a hot spare pool 1 Type smitty ssaraid and press Enter 2 Select List Status of Hot Spare Pools 3 Select the SSA adapter that you want to inspect The status of the hot spare pool is displayed a COMMAND STATUS N Command OK stdout yes stderr no Before command completion additional instructions may appear below ssal Pool Components Spares Configured Minimum Status pool_AQ 0 1 1 1 unused pool_Al 3 2 2 1 full pool Bl 6 1 1 1 full F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel1 F10 Exit Find n Find Next A The normal operating state for a hot spare pool is Full Any other state indicates that a problem exists or some configuration actions are required The possible states are Full The number of hot spare disk drives that are in the pool is equal to the number of hot spare disk drives that were in the pool when the pool was last configured Empty No hot spares are in the pool To add a hot spare disk drive to a pool 1 Ensure that you have disk drives that Are assigned as hot spare d
328. of SSA links ssa_speed 1 pdisk s ssa_speed a AdapterName p Loop n Network s ssa_speed x e The ssa_speed command either tests the existing link speeds of the selected pdisk or adapter or searches for link speed exceptions on all SSA adapters in the using system pdisk Specifies the pdisk that you want to test a AdapterName Specifies the adapter that you want to test If you select the a flag you must also select the p or the n flag S Specifies the supported link speed p Loop Causes the ssa_speed command to show the operating speed of both ports Valid Loop parameters are A a B b for example p A p b n Network Causes the ssa_speed command to show the operating speed of all ports on the selected network Valid Network parameters are A a B b for example n A n b X Causes the ssa_speed command to test each adapter on the using system for link speed exceptions on all nodes To do this the command inspects the Supported Speed and the Current Speed for each pair of neighboring nodes in each network If the Current Speed of a particular pair of nodes is less than the Supported Speed of the slowest device in that pair of nodes the command returns the message lt adapter_name gt lt port_hop gt where lt port_hop gt is the lowest lt port_hop gt count of the tested pair e When used with the x flag the e flag generates an error log entry if a link speed exception condition is
329. of disk drives that are in the same loop The data that is contained on the secondary disk drives is a mirror copy of the data that is contained on the primary disk drives Ensure that you choose a quantity of secondary disk drives that matches the quantity of primary disk drives Sirip Size The maximum amount of contiguous data that is mapped to a single member disk drive Enable Use of Hot Spares If you enable this option the SSA RAID Manager can use any available hot spare disk drive to replace a failing member disk drive dynamically The failing disk drive is rejected from the array and the hot spare disk drive is put into the available place 64 Advanced SerialRAID Adapters User and Maintenance Information If you select Exact the replacement disk drive is chosen only from hot spare disk drives whose size exactly matches the size of the failing disk drive Choose Hot Spare only from Preferred Pool If you select yes for this option a hot spare disk drive is selected only from the hot spare pool that contains the failed member disk drive If you select no for this option a hot spare disk drive is selected if available from the hot spare pool that contains the failed member disk drive If no hot spare disk drive is available in that pool a hot spare disk drive is selected from the default hot spare pool for that SSA loop Pool AO or BO If no hot spare disk drives are available in pool 0 a hot spare disk drive is selected from
330. ogical disk the device driver does attempt to access the disk drive through the alternative adapter if the path through the original adapter experiences reservation conflict or fenced out status A medium error on the disk drive does not cause takeover to occur Takeover occurs only after extensive error recovery activity within the adapter and several retries by the device driver Intermittent errors that last for only approximately one second usually do not cause adapter takeover When takeover has successfully occurred and the device driver has accessed the disk drive through the alternative adapter the original adapter becomes the standby adapter Takeover can therefore occur repeatedly from one adapter to another so long as one takeover event is completed before the next one starts Completion of a takeover event is considered to have occurred when the device driver successfully accesses the disk drive through the alternative adapter When takeover has occurred the device driver continues to use the alternative adapter to access the disk drive until either the system is rebooted or takeover occurs back to the original adapter Each time the SSA disks are configured the SSA disk device driver is informed which path or paths are available to each disk drive and which adapter is to be used as the primary path By default primary paths to disk drives are shared equally among the adapters to balance the load This static load balancing is p
331. ol SSA RAID arrays RAID Array Type The type of the SSA RAID array Member Disks For a RAID 0O or a RAID 5 array member disks are the disk drives that are to be added to the SSA RAID array The array must consist of disk drives that are in the same loop Primary Disk The primary disk drive of a RAID 1 array A RAID 1 array must consist of two disk drives one primary and one secondary that are in the same loop The data that is contained on the primary disk drive is a mirror copy of the data that is contained on the secondary disk drive Secondary Disk The secondary disk drive of a RAID 1 array A RAID 1 array must consist of two disk drives one primary and one secondary that are in the same loop The data that is contained on the secondary disk drive is a mirror copy of the data that is contained on the primary disk drive Primary Disks The primary disk drives of a RAID 10 array A RAID 10 array consists of an even numbered quantity 4 through 16 of disk drives that are in the same loop The minimum RAID 10 array consists of two primary and two secondary disk drives The data that is contained on the primary disk drives is a mirror copy of the data that is contained on the secondary disk drives Ensure that you choose a quantity of primary disk drives that matches the quantity of secondary disk drives Secondary Disks The secondary disk drives of a RAID 10 array A RAID 10 array consists of an even numbered quantity 4 through 16
332. ommand returns the device Type for the disk Make a note of this device type you will need it later in this procedure Remove the existing pdisk or hdisk number from the configuration Give the command rmdev 1 disknumber d where disknumber is the pdisk or hdisk number for example pdiskO that you want to remove Give the command mkdev p ssar t Type c Class s ssar w ConnectionLocation 1 NewDiskName where Type is the disk type that you noted in step H Class is pdisk for a pdisk or disk for an hdisk ConnectionLocation is the number that you noted in step NewDiskName is the pdisk or hdisk number for example pdiskO that you want for the disk For example mkdev p ssar t scsd c pdisk s ssar w 004AC5119E000D 1 pdisk50 278 Advanced SerialRAID Adapters User and Maintenance Information Removing and Replacing an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts I Remove the adapter from the using system see the nstallation and Service Guide for the using system If you are exchanging this adapter for another remove from it the SDRAM module and if present the Fast Write Cache Option Card You must keep these items for the replacement adapter card Note The Fast Write Cache Option Card if present on contain customer data
333. ondary side the array enters the Offline state to both systems Chapter 7 Split Site Management 153 Split Array Resolution Split Array Resolution Primary System 1 SSA Adapter 0011 0011 1111 0000 0000 1111 1010 1010 Primary 2 Figure 26 Reconnection of a Split Array Primary Normal Reconnection When the systems are reconnected the secondary disk drives are resynchronized with the primary disk drives as shown in Figure 24 0011 0011 1111 1111 0000 1111 1010 1010 System 2 SSA Adapter Secondary 2 The array enters the Good state for both systems 154 Advanced SerialRAID Adapters User and Maintenance Information Failure of a Primary Disk Drive in a Dual Host System Figure 27 shows a dual host system in which the primary disk drive of a RAID 1 array has failed Split Array Resolution System 1 SSA Adapter Primary System 2 SSA Adapter Primary 1 Secondary 1 Figure 27 RAID 1 Disk Drive Failure Because both adapters can still detect the secondary disk drive of the array the Split Array Resolution flag is automatically set to Secondary and I O operations continue The array is in the Exposed or Degraded state When the primary disk drive is reconnected it is resynchronized from the secondary disk drive and the Split Array Resolution flag is automatically set to Primary Chapter 7 Split Site Management 15
334. ons communicate with the hdisks error data is logged against the pdisks 2 lf a disk drive that has been formatted on a machine of a particular type for example a Personal System 2 is later installed into a using system that is of a different type for example an RS 6000 that disk drive is configured only as a pdisk during the configuration of the using system In such an instance use the Format service aid to reformat the disk drive then give the cfgmgr command to correct the condition To use the Configuration Verification service aid 1 Select Configuration Verification from the SSA Service Aids menu see Starting l A list of pdisks and hdisks is displayed CONFIGURATION VERIFICATION 802390 D Move cursor onto selection then press lt Enter gt systemname pdisk0 AC51DB47 4GB SSA C Physical Disk Drive systemname pdisk1 AC9EDE7F 9 1GB SSA C Physical Disk Drive systemname hdisk2 AC51DB47 SSA Logical Disk Drive systemname hdisk3 AC9EDE7F SSA Logical Disk Drive F3 Cancel F1O Exit Ne A 336 Advanced SerialRAID Adapters User and Maintenance Information Select the hdisk or pdisk that you want to verify If you select an hdisk a list of pdisks is displayed CONFIGURATION VERIFICATION 802391 D systemname hdisk2 AC51DB47 SSA Logical Disk Drive Good To set or reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port SSA Addr Status systemname pdisk
335. oop configuration problem Chapter 17 SSA Problem Determination Procedures 381 SRN Problem Possible Causes 4A100 Description The adapter cannot initialize a disk drive Possible FRUs Device 100 Action The failing disk drive might or might not be configured on this Aa a AG e system Run diagnostics in System Verification mode to all pdisks EEF If the diagnostics fail exchange the pdisk for a new disk drive If the diagnostics do not detect a failing paix use the Link Verification service aid see to search for disk drives that are not configured Such disk drives are listed as Note Other adapters in the SSA loop might also be listed as Exchange for new disk drives all pdisks that are not configured 4BPAA Description A disk drive at PAA cannot be configured because its UID Possible FRUs cannot be read Device 100 Action If the SSA service aids are available 1 Run the Link Verification service aid see to find the failing device The service aid lists the device as 2 Exchange the FRU for a new FRU If the service aids are not available 1 Note the value of PAA in this SRN then go to 2 Exchange the FRU for a new FRU 50000 Description The SSA adapter failed to respond to the device driver Possible FRUs SSA adapter card 100 Action Exchange the FRU for a new FRU cae pac rs and Service Guide 50001 Description A data parity er
336. operate e Failure in another using only when both caches are available One cache however is now not system available A user action has set Action abet Cache when way 1 If the using system that contains the partner adapter is switched off y 4 switch it on e Configuration change 2 If the configuration has been changed review the configuration rules and restore a valid configuration 3 Run diagnostics on the partner adapter and correct all problems The partner adapter is the other adapter on the SSA loop that includes the adapter that reported the problem 4 If while the other adapter is not available the user wants to use the fast write function on disk drives that are attached to this adapter change the state of the Bypass Cache In 1 Way Fast Write Network 43PAA Description An SSA device on the link is preventing the completion of the Possible FRUs loop configuration pete 90 Exchanging Action If the SSA service aids are avail ble run the Link Verification E o service aid see to determine ssa adapter card 10 which device is preventing Sora That device is the one beyond using system nstallation the last configured device on an open SSA loop and Service Guide If the SSA service aids are not available note the value of PAA in this SRN and go to g 44PAA Description An SSA device has a Failed status Possible FRUs Device 100 SRN Probl
337. operation returns a list of the SSA physical disks pdisks that make up the specified logical disk drive The arg parameter for the SSADISK_LIST_PDISKS operation is the address of an ssadisk_ioctl_parms structure This structure is defined in the usr include sys ssadisk h file The SSADISK_LIST_PDISKS operation uses the following fields of the ssadisk_ioctl_parms structure u 1ist_pdisks name_array Pointer to the array of ssadisk_name_desc_t structures that is in the caller memory On return from the ioctl this array is filled with the names of the hdisks u 1ist_pdisks name_array_elements Set by the caller to indicate the number of elements that are in the array at which the u0 1ist_pdisks name_array parameter is pointing u 1ist_pdisks name_count On return from the ioctl this field indicates the number of names that are in the name array at which the u0 1ist_pdisks name_array parameter is pointing u 1ist_pdisks resource_count On return from the ioctl this field indicates the number of physical disk drives that make up the logical disk drive This number might be less than u 1ist_pdisks name_count if in the user memory not enough elements were allocated in the named array to hold all the pdisk names or if one or more physical disks that make up the logical disk have not been configured as AIX physical disk drives Chapter 12 Using the Programming Interface 237 Return Values Files If the command was successfully se
338. or RAID 10 array causes this error if the array has one or more exposed mirrors A RAID 1 or RAID 10 mirror becomes exposed when one disk drive in the mirror pair is not available to the array Chapter 17 SSA Problem Determination Procedures 377 SRN Problem Possible Causes 49500 Description No hot spare disk drives are available for an array that is configured for hot spare disk drives Action Determine whether any disk drives have failed or have been rejected To do this 1 10 11 Display the use of the disk drives that are attached to the SSA are attached to the adapter that logged this error If any disk drives have failed first exchange those disk drives for new disk drives and assign them to the use that has been specified by the user If the problem remains continue with the next step Type smitty ssaraid and press Enter Select List Status of Hot Spare Protection for an SSA RAID Array Select the adapter that logged the error Observe the displayed list Note which SSA loop contains any array member disk drives that are listed with a protected state of no Devices that are in pool_AO are connected to loop A Devices that are in pool_B are connected to loop B If the status field for the unprotected array member disk drive is too_large the hot spare disk drive is not large enough to support that array component Otherwise no hot spare disk drive exists on the loop that y
339. or a description of this service aid Enclosure Settings This service aid provides support for SES enabled SSA enclosures subsystems See your enclosure service information for a description of this service aid The selection menu for the SSA service aids allows you direct access to the SMIT menus for fast write and RAID functions on SSA disks Before you use the service aids ensure that you are familiar with the principles of SSA loops and physical disk drives pdisks If you are not familiar with these principles first 321 Note The service aids refer to the Advanced SerialRAID Adapter as IBM SSA 160 SerialRAID Adapter 14109100 On some service screens this name is shortened 322 Advanced SerialRAID Adapters User and Maintenance Information The Identify Function The Identify function can be accessed from many of the service aid menus This function enables you to determine the location of a particular disk drive that you want to identify but do not want to remove When set the Identify function causes the Check light of the disk drive to flash for identification two seconds on two seconds off but has no effect on the normal operation of the disk drive It also causes the Subsystem Check light if present of the unit containing the selected disk drive to flash You can use the Identify function on any number of disk drives at the same time Instructions displayed by the service aids tell you when you can select
340. or logging If the dddump entry point completes successfully it returns a 0 If the entry point does not complete successfully it returns one of the following EINVAL A request that is not valid was sent to the adapter device driver for example a request for the DUMPSTART option was sent before a DUMPINIT option had been run successfully EIO The adapter device driver was unable to complete the command because the required resources were not available or because an I O error had occurred ETIMEDOUT The adapter did not respond with status before the passed command time out value expired Chapter 12 Using the Programming Interface 211 Files dev ssa0 dev ssa1 dev ssan Provide an interface to allow SSA head device drivers to access SSA devices or adapters 212 Advanced SerialRAID Adapters User and Maintenance Information IOCINFO Device Information SSA Adapter Device Driver ioctl Operation Purpose Description Files To return a structure that is defined in the usr include sys devinfo h file The IOCINFO ioctl operation returns a structure that is defined in the usr include sys devinfo h header file The caller supplies the address to an area that is of the type struct devinfo This area is in the arg parameter to the IOCINFO operation The device type field for this component is DD_BUS the subtype is DS_SDA The IOCINFO operation is defined for all device drivers that use the ioctl subroutine as foll
341. ot Spare Pool Add to the correct pool the hot spare disk drive that you created in step id An array member has used a hot spare disk drive from a pool other than its specified pool If the hot spare pools have been correctly configured this error indicates that more than one disk drive might have failed Possible FRUs Device 100 380 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 49530 Description The number of disk drives that remain in a hot spare pool is less than the specified number Action 1 Type smitty ssaraid and press Enter Select Change Show Use of an SSA Physical Disk Note all the disk drives that are listed as rejected Exchange all the rejected disk drives for new disk drives Select Change Show Use of Multiple SSA Physical Disks Change the Current Use parameter of the exchanged disk drives to Hot Spare Disks oar wD al Select List Status of Hot Spare Pools 8 Select the adapter that logged the error If the adapter is not known select all adapters The hot spare pool that is listed as empty or critical is the pool to which the hot spare disk drives must now be added Attention If more than one hot spare pool is listed as empty critical or reduced refer to the user s pool assignment records to determine the correct pool to which the hot spare disk drives must now be assigned If the user has no such record see
342. ou can specify the following types of attribute e RAID array Creation and Change attributes e RAID array Change attributes e Physical Disk Drive Change attributes e Action attributes RAID Arrays Creation and Change Attributes This section describes the creation and change attributes that you can use for All RAID arrays e RAID 1 RAID 5 and RAID 10 arrays only e RAID 1 and RAID 10 arrays only e RAID 5 arrays only e RAID 10 arrays only Creation and Change Attributes for All RAID Arrays You can specify the following attributes with the a option when you are using the ssaraid command with the C or H option to create or change a RAID array allow_page_splits true false default true With the attribute set to true When large blocks of data are sent to an array those blocks can be internally split into smaller 4096 byte blocks that can then be written in parallel to the member disk drives of the array This action greatly improves the performance of write operations to the array although the blocks are not written sequentially to the member disk drives With the attribute set to false The blocks of data are written sequentially to the member disk drives of the array This action can have a negative effect on the performance of write operations to the array The sequence in which the data is written to the array might be critical to the application program that is using the data if an error occurs during the write oper
343. ou noted earlier Return to the SSA RAID Arrays menu and select Change Show Use of an SSA Physical Disk Select the adapter that logged the error Find an appropriate disk drive and change its use to hot spare see A RAID array is configured to use hot spare disk drives but no disk drive can be found that is configured as a hot spare This error code is used only when no hot spare pools have been assigned All arrays and hot spare disk drives are in the default poolo 378 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 49510 Description Hot spare configuration is not synchronized Action This problem has occurred because the cabling has changed or because new hot spare disks have been added to the SSA loop 1 9 10 If the changes were not planned restore the system to its original configuration If the changes were planned go to step Type smitty ssaraid and press Enter Select List Status of Hot Spare Pools Select the adapter that logged the error If the adapter is not known select all adapters Note the RAID Manager and pool number of spare pools that have a status of Inconsistent Select Change Show Delete a Hot Spare Pool Select the RAID Manager and pool that you noted in step A For each inconsistent spare pool a Check whether the number of hot spare disk drives that are in the pool matches the user s requirements
344. oved or the array has rejected it it is listed as BlankReservedZ Select Disk to Add and press the List key From the displayed list select the name of the disk drive that you want to add and press Enter Press Enter to perform the swap operation Chapter 6 Using the RAID Array Configurator 141 Changing or Showing the Use of an SSA Disk Drive This option allows you to change or see how particular disk drives are used 1 For fast path type smitty chgssadisk and press Enter Otherwise select Change Show Use of an SSA Physical Disk from the SSA RAID Array menu 2 A list of adapters is displayed in a window a S List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks dentify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks dentify Array Candidate Disks Identify AIX System Disks SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 F1l Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next A r4 Select the adapter whose disk drives you want to list 142 Advanced SerialRAID Adapters User and Maintenance Information 3 A list of disk drives and their usage is displayed in a window a SSA RAID Arrays D Move c
345. ow Use of an SSA Physical Disk The status of the disk drives that are connected to the using system is displayed c Go to step 18 on page 414 Chapter 17 SSA Problem Determination Procedures 411 18 from step 17 Are any disk drives listed as SSA physical disks that are rejected NO A disk drive has not been detected by the adapter Go to step Lood YES a Run diagnostics in System Verification mode to all the disk drives that are listed as rejected b Run the Certify service aid see to all the disk drives that are listed as rejected c If problems occur on any disk drive exchange that disk drive for a new disk drive see Exchanging Di continue from step 8d in this procedure d A disk drive that is listed as rejected is not necessarily failing For example the array might have rejected the disk drive because a power problem or an SSA link problem caused that drive to become temporarily unavailable Under such conditions the disk drive can be reused If you think that a disk drive has been rejected because it is failing check the error log history for that disk drive For example if you suspect pdisk3 type on the command line ssa_ela 1 pdisk3 h 5 This command causes the error log for pdisk3 to be analyzed for the previous five days If a problem is detected an SRN is generated e Type smitty ssaraid and press Enter f Select Change Show Use of an SSA Physical Disk and for all disks tha
346. ows The operation returns a devinfo structure The caller supplies the address of this structure in the argument to the IOCINFO operation The device type in this structure is DD_BUS and the subtype is DS_SDA The flags field is set to DF_FIXED dev ssa0 dev ssa1 dev ssan Chapter 12 Using the Programming Interface 213 SSA_TRANSACTION SSA Adapter Device Driver ioctl Operation Purpose Description To send an SSA transaction to an SSA adapter The SSA_TRANSACTION operation allows the caller to issue an IPN Independent Packet Network transaction to a selected SSA adapter IPN is the language that is used to communicate with the SSA adapter The caller must be root or have an effective user ID of root to issue this operation IPN is described in the Technical Reference for the adapter The arg parameter for the SSA_TRANSACTION operation specifies the address of a SSA_TransactionParms _t structure This structure is defined in the usr include sys ssa h file The SSA_TRANSACTION operation uses the following fields of the SSA_TransactionParms t structure DestinationNode Contains the target node for the transaction DestinationService Contains the target service on that node MajorNumber Major number of the transaction MinorNumber Minor number of the transaction DirectiveStatusByte Contains the directive status byte for the transaction This contains a value that is defined in the usr include ipn ipndef
347. page 41l 40 Advanced SerialRAID Adapters User and Maintenance Information 4 The SSA Logical Disks menu is displayed 7 SSA Logical Disks Move cursor to desired item and press Enter List All Defined SSA Logical Disks List All Supported SSA Logical Disks Add an SSA Logical Disk Change Show Characteristics of an SSA Logical Disk Remove an SSA Logical Disk Configure a Defined SSA Logical Disk Generate Error Report Trace an SSA Logical Disk Show Logical to Physical SSA Disk Relationship List Adapters Connected to an SSA Logical Disk List SSA Logical Disks Connected to an SSA Adapter Identify an SSA Logical Disk Cancel all SSA Disk Identifications Enable Disable Fast Write for Multiple Devices Fl Help F2 Refresh F3 Cancel F8 Image F9 Shel1 F1O Exit Enter Do XS If you need help with an item move the cursor to that item and press F1 Help 5 The SSA Physical Disks menu is displayed a SSA Physical Disks Move cursor to desired item and press Enter List All Defined SSA Physical Disks List All Supported SSA Physical Disks Add an SSA Physical Disk Change Show Characteristics of an SSA Physical Disk Remove an SSA Physical Disk Configure a Defined SSA Physical Disk Generate Error Report Trace an SSA Physical Disk Show Physical to Logical SSA Disk Relationship List Adapters Connected to an SSA Physical Disk List SSA Physical Disks Connected to an SSA Adapter Identify an SSA Physical Di
348. perate the array e The array is split across SSA loops e Allthese three conditions exist Inthe secondary half of the array the member disk drive that contains the configuration sector is present Inthe primary half of the array no members that hold configuration sectors are present The Split Array Resolution flag is not set e Allthese three conditions exist Inthe primary half of the array disk drive members that hold configuration sectors are present Inthe secondary half of the array the member disk drive that contains the configuration sector is not present Chapter 3 RAID Functions and Array States 37 The Split Array Resolution flag is set e Inthe primary and secondary halves of the array member disk drives that hold configuration sectors are present and the Split Array Resolution flag is set on the secondary half The array however was not initialized correctly e Two failures in a configuration update configuration sectors fence sector label sector medium error table or unsync table Both member disk drives of a mirrored pair are missing deconfigured or rebuilding Unknown State A RAID 10 array is in the Unknown state when not enough array members are present for the array configuration to be determined that is fewer than two of the first three members are present Unless the Split Array Resolution flag is set the array enters the Offline state to allow split arrays
349. pool This action has occurred because no hot spare disk drive was available in this pool when the array member disk drive failed When all failed disk drives have been replaced this array member disk drive should be exchanged with a disk drive that is in the same physical domain as are the other disk drives in the pool see Ta a Ha Epad Chapter 6 Using the RAID Array Configurator 77 Listing the Disks That Are in a Hot Spare Pool This option shows you all the disk drives that are in a hot spare pool and shows the status of each disk drive 1 For fast path type smitty 1s_hsm_array_components and press Enter Otherwise select List Components in a Hot Spare Pool from the SSA RAID Array menu 2 A list of adapters is displayed in a window Va SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 00 04 IBM SSA 160 SerialRAID Adapter 14109100 F1l Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next S
350. provides support for fencing by allowing the SSADISK_ISALCMD ioctl operation to issue the FN_ISAL_FENCE command to SSA logical disk drives The FN_ISAL_FENCE command is defined in the Technical Reference for the adapter To use fencing set the node_number attribute of the ssar router to a different value on each using system that is included in fencing Use the chdev command to do this For example to set the node_number to a value of 3 type chdev 1 ssar a node_number 3 Note The command fails if any target mode SSA devices are active By default the value of node_number is 0 This value has particular importance because it is not possible to exclude a using system with node number 0 from access to the disk drive Therefore if a disk drive is moved from a machine that has been using fencing to a machine that has not been using fencing the new machine can communicate with the disk drive If a using system attempts to use the open subroutine to open a disk drive to which it is not allowed access the return code is 1 and the global variable errno is set to the value ENOCONNECT Similarly if an application already has a SSA logical disk open but that logical disk has been fenced out since the open calls to the read or write subroutine fail with errno set to ENOCONNECT The hardware fencing commands provide a method by which you can break through a fence You can use the SSADISK_ISALCMD ioctl operation to give the command but you mu
351. ps This chapter describes the principles of SSA loops how SSA devices are known to the system programs and the rules that you must observe when you configure your SSA loops Loops Links and Data Paths In the simplest SSA configuration SSA devices are connected through two or more SSA links to an SSA adapter that is located in a using system The devices SSA links and SSA adapter are configured in loops Each loop provides a data path that starts at one connector of the SSA adapter and passes through a link SSA cable to the devices The loop continues through the devices then returns through another link to a second connector on the SSA adapter The maximum permitted length for an external copper cable that connects two SSA nodes for example disk drives is 25 meters 82 feet The maximum permitted length for an external fiber optic cable that connects two SSA nodes for example disk drives is 10 kilometers 32800 feet Some devices however can operate only at shorter distances See your subsystem documentation for details Details of the rules for configuring SSA loops are given for each SSA adapter in Ruled Simple Loop Eigure 2 shows a simple SSA loop The devices that are attached to the SSA adapter card are connected through SSA links H These SSA links are configured as a loop Data and commands to a particular device pass through all other devices on the link between the adapter and the target device Data can t
352. pt was made to configure a device that is still open An illegal configuration command has been given The data buffer length exceeded the maximum length that is defined for a strategy operation EIO One of the following conditions has occurred e The target device cannot be located or is not responding e The target device has indicated an unrecovered hardware error ESOFT The target device has reported a recoverable media error EMEDIA The target device has found an unrecovered media error ENODEV One of the following conditions has occurred An attempt was made to access a device that is not defined An attempt was made to close a device that is not defined ENOTREADY An attempt was made to open an SSA physical device in Service mode while an SSA logical device that uses it was in use ENXIO One of the following conditions has occurred e The ioctl subroutine supplied a parameter that is not valid e The openext subroutine supplied extension flags that selected a non existent or nonfunctional adapter path A read or write operation was attempted beyond the end of the fixed disk drive EPERM The attempted subroutine requires appropriate authority ENOCONNECT The using system has been fenced out from access to this device Chapter 12 Using the Programming Interface 227 Special Files ENOMEM The system does not have enough real memory or enough paging space to complete the operation ENOLCK An attempt was m
353. pter card has four SSA connectors that are arranged in two pairs Connectors A1 and A2 are one pair connectors B1 and B2 are the other pair The SSA links must be configured as loops Each loop is connected to a pair of connectors at the SSA adapter card These connectors must be a valid pair that is A1 and A2 or B1 and B2 otherwise the disk drives on the loop are not fully configured and the diagnostics fail Operations to all the disk drives on a particular loop can continue if that loop breaks at any one point This adapter also contains array management software that provides RAID functions to control the arrays of the RAID subsystem see also A An array can contain several member disk drives Each array is handled as one disk by the operating system The array management software translates requests to this disk into requests to the member disk drives Although this adapter is a RAID adapter it can be configured so that all some or none of the disk drives that are attached to it are member disk drives of arrays The Advanced SerialRAID Adapter can be connected by way of one or two SSA loops to other SSA adapters These adapters can be either in the same using system or in separate using systems See for details of valid configurations Fast Write Cache Feature An optional 32 MB Fast Write Cache feature is available for the Advanced SerialRAID Adapter This feature improves performance for jobs that include many
354. ption Card onto this adapter Card 100 e If the adapter card has been switched off for more than seven days the battery is discharged and data has been lost If the adapter card has been switched off for fewer than seven days exchange the Fast Write Cache Option Card for a new one then do the following 1 Ask the customer to disable the Fast Write option for Each device for which the Fast Write option is offline All other devices that are connected to the failing adapter and have the Fast Write option enabled For instructions on how to disable the Fast Write option see 2 If the Fast Write option has been disabled for a RAID 5 array the hdisk for that array can no longer be configured Delete the RAID 5 array then recreate it For instructions on how to delete the array see 3 Ask the customer to re enable the Fast Write option for the devices that are attached to the Fast Write Cache Option Card 42527 Description A dormant fast write cache entry exists User or service action Action The fast write cache contains unsynchronized data for a disk drive that is no longer available If possible reconnect the disk drive to the adapter to enable the data to be synchronized If you cannot reconnect the disk drive for example because the disk drive has failed the user should delete the dormant fast write cache entr 368 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes
355. quired 4 Press Enter If you have exchanged a failed disk drive you must now add the exchanged disk drive to this pool see Spare Pool on a a Inconsistent The member disk drives in the pool do not agree about the size of the hot spare disk drives or about the minimum number of hot spare disk drives that is required 52 Advanced SerialRAID Adapters User and Maintenance Information Mixed Unused This state is probably caused by changes to the SSA loop for example the addition of disk drives or changes to the SSA cabling If you did not intend to make such changes and you correct them the pool returns to its original state If you did intend to make the changes 1 Select Change Show Delete a Hot Spare Pool from the smit saray 2 Select the reduced hot spare pool 3 Verify that the contents of the pool are as required 4 Press Enter An array in this pool has used a hot spare disk drive from another pool When replacement disk drives are installed in exchange for failed disk drives the replacement disk drives are assigned as hot spare disk drives or as free disk drives The hot spare pools however are no longer configured as intended To correct the configuration 1 select List Components in a Hot Spare Pool see 2 Select the mixed hot spare pool 3 From the displayed list note the number of the pdisk that has a status of wrong_pool 4 Note the number of the hdisk to which the pdisk belongs
356. r 6 Using the RAID Array Configurator 127 Listing or Deleting Old RAID Arrays Recorded in an SSA RAID Manager If an array becomes disconnected from a RAID manager by some method other than the method described in Deleting an 68 a record of that array remains in the RAID manager The record nut be deleted manually This option allows you to list the serial numbers of such arrays and to delete the records of those arrays from the SSA RAID manager 1 For fast path type smitty nvrssaraid and press Enter Otherwise select List Delete Old RAID Arrays in an SSA RAID Manager from the SSA RAID Array menu The following menu is displayed ie y List Delete Old RAID Arrays in an SSA RAID Manager Move cursor to desired item and press Enter List Old RAID Arrays Recorded in an SSA RAID Manager Delete an Old RAID Array Recorded in an SSA RAID Manager F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do J If you want to list the arrays select List Old RAID Arrays Recorded in an SSA RAID Manager and go to step 3 on page 124 of Listing Old RAID Arrays Recnrdad If you want to delete the arrays aeai Delete an Old RAID Array Recorded in an SSA RAID Manager ard go to step ron page 13 of Deleting an Oid BAID Array 128 Advanced SerialRAID Adapters User and Maintenance Information Listing Old RAID Arrays Recorded in an SSA RAID Manager This option allows you to list the serial numbers of disconnected ar
357. r H Rees system eee system A1 at a2 Ee e2 B2 A1 at a2 B1 e2 B2 Disk Disk Disk 11 10 9 Disk Disk Disk 16 15 14 Disk Disk Disk Disk Disk Disk Disk Disk 1 2 3 4 5 6 7 8 Figure 49 Normal Loop 350 Advanced SerialRAID Adapters User and Maintenance Information For this example the Link Verification service aid displays the following information Nk VERIFICATION 802386 D SSA Link Verification for systemname ssaQ 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP systemname pdisk11 AC50AE43 op I5 Good systemname pdisk8 AC706EA3 1 4 Good systemname pdisk2 AC1DBE11 De w3 Good systemname pdisk3 AC1DBEF4 I2 Good systemname pdisk7 AC50AE58 ue Good systemname pdisk12 AC7C6E51 5s 930 Good systemname pdiskO AC706E9A 0 5 Good systemname pdisk1 AC1DEEE2 i ae Good systemname pdisk10 AC1DBE32 Ze 33 Good MORE 4 F3 Cancel F10 Exit N A Note Scroll the display to see all the connected disk drives Chapter 16 SSA Service Aids 351 Example 2 Broken Loop Cable Removed Each disk drive normally communicates with the adapter through one data path Because data can pass round the loop in either direction the adapter automatically reconfigures the loop to enable communication to continue to each disk drive if the loop becomes broken
358. r a new one Repeat steps Plana B until either the problem is solved or all the related FRUs have been exchanged Do the next action indicated by the MAP Attention Disk drives are fragile Handle them with care and keep them well away from strong magnetic fields 390 Advanced SerialRAID Adapters User and Maintenance Information MAP 2010 START This MAP is the entry point to the MAPs for the adapter If you are not familiar with these MAPs read e N You might have been sent here because The system problem determination procedures sent you here A problem occurred during the installation of a disk subsystem or a disk drive Another MAP sent you here A customer observed a problem that was not detected by the system problem determination procedures Attention Unless the using system needs to be switched off for some other reason do not switch off the using system when servicing the SSA loop Enclosure power cables and external SSA cables that connect the devices to the using system can be disconnected while that system is running 1E Do you have an SSA subsystem 5 character SRN NO Go to step Zi YES Go to 2 from step Hh e Ifthe system diagnostics are available go to step Ban page 394 If the system diagnostics are not available but the stand alone diagnostics are available a Load the stand alone diagnostics b Go to step B on page 394 e If neither the system diagnostics nor
359. r exchange them for new disk drives see Type smitty ssaraid and press Enter Select Change Show Use of an SSA Physical Disk Are any disks listed as SSA Physical disks that are hot spares NO Review with the user the requirement for hot spare disk drives If the customer wants hot spare disk drives one or more disk drives must have their use changed to Hot Spare Disk If the customer does not want hot spare disk drives a b c Return to the SSA RAID Arrays menu Select Change Show Attributes of an SSA RAID Array Change the Enable Use of Hot Spares attribute to No YES The following conditions must be met to make a hot spare disk drive available for use by an array a The hot spare disk drive and the array must be on the same SSA loop see If the spare_exact parameter is set to true the size of the hot spare disk drive must be the same as the size of the smallest member disk determine the sizes of the disk drives that are in the array If the spare_exact parameter is set to false the size of the hot spare disk drive must be at least that of the smallest member disk in the array Ensure that these conditions have been met d to verify the repair 414 Advanced SerialRAID Adapters User and Maintenance Information 22 23 from step Zlin MAP ation and from steps BI fa ana id in this MAP m RAID Checkout You are now starting the RAID checkout procedure a Type
360. r information if you select a RAID 1 array or a RAID O array i gt COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below Unsynced Parity Strips Unbuilt Data Strips hdisk3 0 0 Invalid data strip hdisk4 0 0 F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next NO Review the symptoms then go to MAP start the problem determination procedure again YES a Note the hdisk number of the failing array b Go to step Ho on page 4071 406 Advanced SerialRAID Adapters User and Maintenance Information 10 from step bh 11 a Type smitty ssaraid and press Enter b Select List Identify SSA Physical Disks c Select List Disks in an SSA RAID Array d Select the failing disk drive and note the pdisk numbers of the disk drives that are members of the array e Ask the user to create a backup of all the data from this array Some data might not be accessible f When the backup has been created ask the user to delete the array g Run diagnostics in System Verification mode to each of the pdisks that you noted previously Do the diagnostics fail when they are run to a particular disk drive NO Go to step H YES a RTT the zm disk drive for a new one see FExchanging Dish b Go to step B2 on page 418 to add the disk drive to the group of disk drives that are available for use by the RAID manager from step m
361. r log SSA_ARRAY_ERROR SSA_HDW_RECOVERED SSA_CACHE_BATTERY SSA_LINK_ERROR SSA_CACHE_ERROR SSA_LINK_OPEN SSA_DEGRADED ERROR SSA_LOGGING_ERROR SSA_DETECTED_ ERROR SSA _REMOTE_ERROR SSA_DEVICE_ERROR SSA_SETUP_ERROR SSA_HDW_ERROR SSA_SOFTWARE_ERROR The SSA Error code data format consists of three bytes of error code followed by up to 153 bytes of debug data See 84 to find out how this data is used run_ssa_healthcheck cron The run_ssa_healthcheck program checks for SSA subsystem problems that do not cause I O errors but cause some loss or redundancy or functionality It reports such errors each hour until the problem is solved During SSA device driver installation the following entry is added to the cron table O x x usr Ipp diagnostics bin run_ssa_healthcheck 1 gt dev null 2 gt dev null This run_ssa_healthcheck program sends a command to the adapter The command causes the adapter to write a new error log entry for any problems that it can detect although those problems might not be causing any failure in the user s applications Such problems include Adapter hardware faults e Adapter configuration problems e RAID array problems e Fast write cache problems Open serial link conditions e Link configuration faults e Disk drives that are returning Check status to an inquiry command Redundant power failures in SSA enclosures The test runs hourly at a specific time in the hour run_ssa_link_speed cron
362. r occurs with a write operation Note that the error might be recovered successfully by the device driver Possible return values for the errno global variable include EINVAL A specified event has no support or the device instance is not configured or not open 254 Advanced SerialRAID Adapters User and Maintenance Information Errors Errors that are detected by the target mode device driver can be one of the following e A hardware error that occurred while receiving data and cannot be reproduced A hardware error that occurred during an adapter command and cannot be reproduced A hardware error that has not been recovered A software error that has been detected by the device driver The target mode device driver passes error recovery responsibility for all detected errors to the caller For these errors the target mode device driver does not know if this type of error is permanent or temporary These types of errors are handled as temporary errors Only errors that the target mode device driver can itself recover through retry operations can be determined to be either temporary or permanent The error is ignored if it succeeds during retry a recovered error The return code to the caller indicates success if a recovered error occurs or failure if an unrecovered error occurs The caller can retry the command or operation but success is probably low for unrecovered errors TMSSA does no error logging If an error oc
363. r physical domain 43 Figure 16 shows an array that has its primary disk drives pdisk2 pdisk3 pdisk10 and pdisk11 in building 1 and its secondary disk drives pdisk5 pdisk6 pdisk7 and pdisk8 in building 2 Pdisk1 and pdisk4 have been assigned as hot spare disk drives but no hot spare pool has been defined Building 1 Building 2 pdisk3 __ A A D D A A P P T T E E R oR O A A n pdisk10 pdisk9 pdisk8 Primary Disks Secondary Disks Figure 16 Primary Disks in Building 1 Secondary Disks in Building 2 44 Advanced SerialRAID Adapters User and Maintenance Information If pdisk2 fails the hot spare disk drive pdisk4 might replace pdisk 2 as one of the primary disk drives in the array as shown in Building 1 Egue id Building 2 pdisk2 pdisk3 Failed mAP UP pdisk4 pdisk10 i Primary Disks pdisk9 pdisk8 Figure 17 Primary Disk in Building 1 Secondary Disks in Building 2 Distributed Spares DmAaAvroe r Secondary Disks Now assume that for some reason the disk drives in building 2 are no longer available The example array is now in the Offline state because one of its four primary disk drives is in building 2 Only the three primary disk drives that are in building 1 are operational Chapter 5 Hot Spare Management 45 This problem can be sol
364. ravel in either direction round the loop The adapter can therefore get access to the devices disk drives in this example through two data paths The adapter always however uses the path that has the fewest interconnecting devices between the adapter and the destination device The using system cannot detect which data path is being used Using system A1 A2 fei B2 A A Disk Disk Disk Disk Disk Disk Disk Disk 1 2 3 4 5 6 7 8 Figure 2 Simple Loop 8 Advanced SerialRAID Adapters User and Maintenance Information Simple Loop One Disk Drive Missing If a disk drive fails or is switched off the loop is broken and one of the data paths to a particular disk drive is no longer available The disk drives on the remainder of the loop continue to work but an error is reported to the system The adapter now uses the alternative path to some of the devices In Eigure 3 disk drive number 3 has failed Disk drives 1 and 2 can communicate with the using system only through connector A1 of the SSA adapter Disk drives 4 through 8 can communicate only through connector A2 of the SSA adapter Using system a1 A2 Bi B2 A A Disk Disk Disk Disk Disk Disk Disk 1 2 4 5 6 7 8 Figure 3 Simple Loop with One Disk Drive Missing Chapter 2 Introducing SSA Loops 9 Simple Loop Two Disk Drives Missing If two or more disk drives are switched off fail or are removed from the loop some disk d
365. ray but the Split Array Resolution flag is set to Primary e The SSA adapter can detect the primary half of the array but the Split Array Resolution flag is set to Secondary This problem can be caused by a power failure on one half of the array or by a broken SSA loop between the two halves of the array Chapter 17 SSA Problem Determination Procedures 373 SRN Problem Possible Causes 48755 Description One of the following conditions exists An SSA adapter and a pdisk One member of a RAID 1 array has been detected but the adapter is have failed unknown to that array member ARAID member disk drive is All the primary or all the secondary disk drives of a RAID 10 array are connected to another SSA present but the adapter is unknown to the array adapter Action If th bieriih ited f i dch h e A split site configuration has ction the pro lem has resu ted from an unplanned change to the only one SSA adapter using system configuration return the using system to its original configured and the adapter configuration and all the primary or If the problem has resulted from the failure of an SSA adapter and the secondary aiskdrives fall failure of half the members of an array do the following actions to attach the array to the adapter 1 Type smitty ssaraid and press Enter 2 Select Change Show Attributes of an SSA RAID Array 3 Change the setting of the Split Array Resolution flag The array be
366. ray is not now connected to the SSA Action The array is in the Offline state adapter that opened it The If the missing disk drive is still operational reconnect it to the SSA array remains in the Offline loop state because its data integrity as F cannot be verified This If the original SSA adapter is operational reconnect the offline array to problem might have occurred that adapter f f because iai adapter and the disk drive have failed delete the array An SSA adapter card and a f disk drive both failed e The using system configuration was changed while an array was still open 47000 Description An attempt has been made to store in the SSA adapter the User action details of more than 128 arrays Action The system user must delete from the SSA adapter the details of old arrays see Deleti Chapter 17 SSA Problem Determination Procedures 371 SRN Problem Possible Causes 47500 Description Part of the array data might have been lost e An unreadable data sector Action Go to En existed on a disk drive when enone an array was created e An unreadable data sector was detected during a rebuilding operation on an array The SSA adapter was reset during an attempt to recover a failed disk drive 48000 Description The SSA adapter has detected a link configuration that is not SSA loop configuration valid problem Action See o e 48500 Descript
367. rays whose records remain in the RAID manager 1 Select List Delete Old RAID Arrays in an SSA RAID Manager from the SSA RAID Array menu 2 Select List Old RAID Arrays Recorded in an SSA RAID Manager 3 A list of RAID managers is displayed in a window a List Delete Old RAID Arrays in an SSA RAID Manager Move cursor to desired item and press Enter List Old RAID Arrays Recorded in an SSA RAID Manager Delete an Old RAID Array Recorded in an SSA RAID Manager SSA RAID Manager Move cursor to desired item and press Enter ssa Available 00 02 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1O Exit Enter Do Find n Find Next 4 Select the RAID manager for which you want a list of old arrays Chapter 6 Using the RAID Array Configurator 129 5 If any old arrays are in the RAID manager a list of those arrays appears a COMMAND STATUS Command OK stdout yes stderr no Before command completion additional instructions may appear below TOP 0952314698B637K 09523146994837K 0952314699A437K 0952314699CE37K 095231469A9337K 095231469B6D37K 095231469C4537K 095231469CEE37K 095231469D7A37K 095231469E2C37K 095231469F7C37K 09523146A42637K 09523146A4B737K MORE 15 F1 Help F2 Refresh F3 Cancel F6 Command F8 Image F9 Shel F1O Exit Find n Find Next 6 If you want to delete any records note the names of those records and g
368. request blocks and waits for data However if the target device is opened with the O_NDELAY flag set the read does not block it returns immediately If no data is available for the read request the read is not successful and the errno global variable Chapter 12 Using the Programming Interface 249 is set to EAGAIN If data is available it is returned The return value indicates the number of bytes that were received whether the write operation for this data has ended or not Note If the O_NDELAY flag is not set the read subroutine can block for an undefined time while it waits for data Because in a read operation the data can come at any time the device driver does not maintain an internal timer to interrupt the read Therefore if a time out function is required it must be started by the calling program If the calling program wants to break a blocked read subroutine the program can generate a signal The target mode device driver receives the signal and ends the current read subroutine If no bytes were read the errno global variable is set to EINTR otherwise the return value indicates the amount of data that was read before the interrupt occurred The read operation returns with whatever data has been received whether the write operation has completed or not If the remaining data for the write operation is received it is put into a queue where it waits for either another read request or a close command When the target recei
369. return values for the errno global variable include EINVAL Attempted to run a close subroutine for a device instance that is not configured or not opened EIO An I O error occurred EBUSY The device is busy read Subroutine Support for the read subroutine is provided only for the target mode device Support for data scattering is provided through the user mode readv or readvx subroutine or through the kernel mode fp_rwuio service call If the read subroutine is not successful the return value is set to 1 and the errno global variable is set to the return value from the device driver If the return value is something other than 1 the read operation was successful and the return code indicates the number of bytes that were read The caller should verify the number of bytes that were read File offsets are not applicable and are ignored for target mode read operations The adapter write operations provide the boundary that determines how read requests are controlled If more data is received than is requested in the current read operation the requested data is passed to the caller and the remaining data is retained and returned for the next read operation for this target device If less data is received in the send command than is requested the received data is passed for the read request and the return value indicates how many bytes were read If a write operation has not been completely received when a read request is made the
370. returned to the array or exchanged for a replacement disk drive When the array is in this state all the member disk drives are present but the data and parity are being rebuilt on the returned or replacement disk drive The array management software allows read and write operations on a disk drive that is in Rebuilding state If the power fails before the rebuilding is complete the array management software restarts the complete rebuilding operation when the power returns Adapter Replacement If for any reason an adapter is exchanged for a replacement adapter and a correct shutdown has not been performed the parity is rebuilt on all the associated arrays when the replacement adapter powers on A RAID 5 array enters Offline state when two or more member disk drives become missing Read and write operations are not allowed 34 Advanced SerialRAID Adapters User and Maintenance Information RAID 5 Array State Flowchart Original disk replaced A New disk Array Good y y VDISK Disk fails is removed al y y Array Exposed A Disk rejected Second disk fails or is removed Write operation Array Degraded Array enabled for Hot Spare Hot Spare available Array Rebuilding oy Array Offline Allow Write while Exposed Write Op Array Degraded rejected no protect
371. riptions of the disk drives and their locations for example drawer number 1 slot number 1 The user enters the information for this attribute Attributes for SSA Logical Disks Only pvid Holds the ODM copy of the PVID for this disk drive for an hdisk queue_depth Specifies the maximum number of commands that the SSA disk device driver dispatches for a single disk drive for an hdisk You can use the chdev command to modify this attribute The default value is correct for normal operating conditions reserve_lock Specifies whether the SSA disk device driver locks the device with a reservation when it is opened for an hdisk size_in_mb Specifies the size of the logical disk in megabytes max_coalesce The maximum number of bytes that the SSA disk device driver attempts to transfer to or from an SSA logical disk in one operation Chapter 12 Using the Programming Interface 223 The default value is appropriate for most environments For applications that perform very long sequential write operations performance improves when data is written in blocks of 64 KB multiplied by n 1 where n is the number of disks in the array For example if the array contains six member disks the data would be written in blocks of 64 KB x 5 These operations are known as full stride writes To use full stride writes increase the value of this attribute to 64 KB x n 1 or to some multiple of this number write_queue_mod Alters the way in which writ
372. rive that you have selected 120 Advanced SerialRAID Adapters User and Maintenance Information Identifying Rejected Array Disk Drives This option allows you to identify disk drives that have been rejected probably because of failure from arrays 1 For fast path type smitty ifssaraid and press Enter Otherwise a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select Identify Rejected Array Disks 2 A list of arrays is displayed in a window E A List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09253173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next S J Select the array whose rejected disk drives you want to identify Chapter 6 Using the RAID Array Configurator 121 3 The following information is displayed Identify Rejected Array Disks Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ Rejected Array Disks Flash Disk Identification Lights yes
373. rives might become isolated from the SSA adapter In Figure 4 disk drives 3 and 7 have been removed Disk drives 1 and 2 can communicate with the using system only through connector A1 of the SSA adapter Disk drive number 8 can communicate with the using system only through connector A2 of the SSA adapter Disk drives 4 5 and 6 are isolated from the SSA adapter Using system A1 A2 jai B2 A A Disk Disk Disk Disk Disk Disk 1 2 4 5 6 8 Figure 4 Simple Loop with Two Disk Drives Missing 10 Advanced SerialRAID Adapters User and Maintenance Information One Loop with Two Adapters in One Using System In Figure 5 the loop contains two SSA adapters and H that are both in the same using system In this configuration all the disk drives can still communicate with the using system if one SSA adapter fails Using System Disk Disk Disk Disk Disk Disk Disk Disk 16 15 14 13 12 11 10 9 Disk Disk Disk Disk Disk Disk Disk Disk 1 2 3 4 5 6 7 8 Figure 5 One Loop with Two Adapters in One Using System Chapter 2 Introducing SSA Loops 11 One Loop with Two Adapters in Each of Two Using Systems If the loop contains four SSA adapters with two adapters in each of two using systems disk drives become isolated if they are connected between the two adapters of one using system and both those adapters fail or are held reset but remain powered on Bypass Note Your SSA Disk Subsystem or
374. rmation 267 Vital Product Data VPD for the SSA Adapter The vital product data VPD for the SSA adapter can be displayed by using the using system service aids This section shows the types of information that are contained in the VPD Part number The part number of the adapter card FRU number The part number of the adapter card field replaceable unit FRU Serial number The serial number of the adapter card Engineering change level The engineering change level of the adapter card Manufacturing location Manufacturer and plant code ROS level and ID The version of read only storage ROS code that is loaded on the adapter Loadable microcode level The version of loadable code that is needed for the satisfactory operation of this card Device driver level The minimum level of device driver that is needed for this level of card Description of function A message that can be displayed Device specific Z0 The size in megabytes of the installed synchronous dynamic random access memory SDRAM modules Device specific Z1 If the adapter contains a pluggable fast write cache module Z1 indicates the cache size in megabytes Device specific Z2 The SSA unique ID that is used to identify this adapter Adapter Power On Self Tests POSTs Power on self tests POSTs are resident in the SSA adapter These tests ensure that the adapter does not run the functional code until the hardware that uses the code has be
375. ror has occurred Possible FRUs SSA adapter card 100 Action Exchange the FRU for a new FRU iene pein ot and Service Guide 50002 Description An SSA adapter DMA error has occurred Possible FRUs ae SSA adapter card 100 Action Exchange the FRU for a new FRU using system Installation and Service Guide 50007 Description The IOCC detected an internal error Possible FRUs se SSA adapter card 100 Action Exchange the FRU for a new FRU using system Installation and Service Guide 50008 Description Unable to read or write the POS registers or PCI Possible FRUs configuration space SSA adapter card 100 ing system nstallati Action Exchange the FRU for a new FRU PEE anon 382 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 50010 Description An SSA adapter or device drive protocol error has occurred Possible FRUs a SSA adapter card 100 dees j Go pi FRU BA before using system Installation excnangng INe and Service Guide 50012 Description The SSA adapter microcode has hung Possible FRUs OESP te er SSA adapter card 100 Action Run diagnostics in System Verification mode to the SSA adapter using system Installation If the diagnostics fail exchange the FRU for a new FRU and ence Guide If the diagnostics do not fail go to before exchanging the FRU 50013 Description The SSA adapter card has fail
376. rors A RAID 1 or to find any failed disk RAID 10 mirror becomes drives failed SSA is or power failures that might have caused the degraded when one disk problem drive in the mirror pair is not available and a write If you find any faults go to the Start MAP or equivalent in the enclosure command is sent to the service information to isolate the problem then go to B2 on page 414 of array to return the array to the Good state If the SSA service aids are not available or ihe Link Verification service aid does not find any faults go to EA isolate the problem 49100 Description An array is in the Exposed state Action A disk drive can become not available for several reasons e The disk drive has failed e The disk drive has been removed from the subsystem e An SSA link has failed A power failure has occurred If the SSA service aids are available run the Link Verification service aid see k to find any failed disk drives failed SSA links or power failures that might have caused the problem If you find any faults go to the Start MAP or equivalent in the enclosure service information to isolate the problem then go to of to return the array to the Good state If the SSA service aids are not available or the Link Verification service aid does not find any faults go to MAP isolate the problem e ARAID 5 array causes this error code if a disk drive is not available to the array e ARAID 1
377. rray raid_10 RAID 10 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Chapter 6 Using the RAID Array Configurator 59 3 Select the type of array that you want to create If you select RAID O the following menu is displayed te SSA RAID Manager Add an SSA RAID Array Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields ssaQ RAID Array Type raid_0 Member Disks Allow Page Splits yes Enable Fast Write no Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel F1O Exit Enter Do N For the meanings of the fields see page bd 60 Advanced SerialRAID Adapters User and Maintenance Information If you select RAID 1 the following menu is displayed A Add an SSA RAID Array D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa0 RAID Array Type raid_l Primary Disk Secondary Disk Split Array Resolution Primary Enable Use of Hot Spares yes F Choose Hot Spare only from Preferred Pool no Allow Hot Spare Splits no Allow Page Splits yes Initial Rebuild no Enable Fast Write no Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image eis F1O Exit Enter Do p For the meanings of the fields see page bd Chapter 6 Using the RAID Array Configurator 61 If you select RAID 5 the follow
378. ructure One flag must be set in the timeout_type field to indicate the required form of the time out If the TM_FIXED_TIMEOUT flag is set in the timeout_type field the value that is put into the new_timeout field is a fixed time out value for all send commands If the TM_SCALED_TIMEOUT flag is set in the timeout_type field the value that is put into the new_timeout field is a scaling factor used in the calculation for time outs as 260 Advanced SerialRAID Adapters User and Maintenance Information shown under the description of the write entry point The default send command time out value is a scaled time out with a scaling factor of 20 Regardless of the value of the timeout_type field if the new_timeout field is set to a value of 0 the caller specifies no time out for the send command allowing the command to take an indefinite amount of time If the calling program wants to end a write operation it generates a signal This option is allowed only for blocking type write operations Chapter 12 Using the Programming Interface 261 262 Advanced SerialRAID Adapters User and Maintenance Information Part 2 Maintenance Information 263 264 Advanced SerialRAID Adapters User and Maintenance Information Chapter 13 SSA Adapter Information For a description of the SSA adapter port addresses and the rules for SSA loops see Installing the SSA Adapter i Install the adapter and disk drive microcode from the med
379. s added tmssaXX is created where XX is the node number of the detected node When configuration is complete special files exist in the dev directory These files allow you to use the target mode interface with each node that is defined in the configuration database Configuration does not need communication to be actually possible between the relevant using systems Communication is needed only for the write operation Buffer Management You can set the buffer sizes that are used by each device To set the transmit buffer sizes use the chdev command to adjust the XmitBuffers and XmitBufferSize attributes in the configuration database To set the receive buffer size use the chdev command to adjust the RecvBuffers and RecvBufferSize attributes in the configuration database The buffer sizes must be multiples of 128 bytes The maximum buffer size is 512 bytes A device can have as many buffers as it needs Data can be written into the buffers for the initiator mode device at any time whether or not nonblocking write operations are also transferring data from these buffers The buffers for the target mode device can be read at any time even if a write operation to those buffers is occurring at the same time It is not important if the sizes of the initiator mode device buffers are different from the sizes of the target mode device buffers to which the data is being sent The total buffer space for the target mode device however must
380. s Are Available 358 Chapter 17 SSA Problem Determination Procedures 359 Service Request Numbers SRNs 2 ee eee ee BBY The SRN Table eee ee ee 859 Using the SRN Table 2 ee ee 859 Software and Microcode Errors n Mp gh tab wb ah es AyD ae BO 7 888 SSA Loop Configurations that Are Not Valid Oe PR OB a oR ok ce ow ae Uh 2888 SSA Maintenance Analysis Procedures MAPs 890 How to Use the MAPs 2 2 ee ee ee ee 890 MAP 2010 START are Ge BAR de ce SP ear ede ei ah a ae ae 2 89 MAP 2320 SSALink to ie ah oe ee Se Aes AR do Te St as 89S MAP 2323 SSA Intermittent Link Error bo ke GOERS Bee Ave eG otek amp 26398 MAP 2324 SSA RAID ha Ae The Me Shetek Me da he Getto ae eh 2 MAP 2410 SSA Repair Verification Deun dette rate ih Gas Sota we a ey wh 420 SSA Link Errors PR opt che thet a A a ar te w 423 SSA Link Error Problem Determination ean Heh ok Oe te Se ae of 2 428 Link Status Ready ae nea Le Kes Saer ia a eoa mA Raie Any pt cal Ge a2 Service Aid bates Ho Re pes OR SE ed ey So er ee 26 Repair Actions 2 eee ee 426 Part 3 Appendixes 2 2 2 429 Appendix Communications Statements EY wi tin tte MR sea Federal Communications Commission FCC Statement Ef oh de ht RS y poe tid Ger 6 AG Contents X xii Japanese Voluntary Control Council for Interference VCCI
381. s Of Adapter Connectors in the Loop Mainly Shared Data The following sequence enables you to determine the best relationship between the disk drives and the adapter or adapters on an SSA loop that contains two or more pairs of adapter connectors Most of the disk drives share data access with each other 1 Determine which data is shared between the pairs of adapter connectors 2 Assign this data to the disk drives that are equally spaced between the sharing pairs of adapter connectors For example the loop that is shown in Figure 14 contains 16 disks and four adapters In this loop e The pairs of adapter connectors should be spaced between the disk drives e Data that is shared by adapters A and B should be put onto disk drives 1 through 4 Data that is shared by adapters B and C should be put onto disk drives 5 through 8 AdapterB Disk _ Disk _ Disk _ Disk Disk Disk Disk _ Disk 1 2 3 4 5 6 7 8 lt O g g a a oy wv me To lt lt E Disk _ Disk Disk _ Disk Disk _ Disk _ Disk _ Disk E 16 15 14 13 12 11 10 9 Adapter D Figure 14 Pairs of Connectors in the Loop Mainly Shared Data Note For configurations such as that shown here we recommend that the adapters be installed in separate using systems Otherwise disk drives can become isol
382. s an hdisk If you specify the u option you ensure that no corresponding AIX device exists for the array force yes no If an array is using a fast write cache that is failing you must specify this attribute as yes to allow the fast write cache to be disabled Change Attribute for Hot Spare Disk Drives Only You can specify the following attribute with the a option only when you are using the ssaraid command with the C or H option to change a hot spare disk drive Chapter 11 Using the SSA Command Line Interface for RAID Configurations 201 spare_pool default pool_A0O or pool_BO as determined by the network ID If you set this attribute the hot spare disk drive is assigned to the specific hot spare pool If the spare_preferred attribute is set to true the hot spare disk drive protects only the array member disk drives that are in the same pool If the spare_preferred is set to false the hot spare disk drive protects the member disk drives of any array Change Attribute for Array Member Disk Drives Only You can specify the following attribute with the a option only when you are using the ssaraid command with the H option to change an array member disk drive spare_pool default pool_A0 or pool_BO as determined by the network ID If you set this attribute the array member disk drive is assigned to the specific hot spare pool If the spare_preferred attribute is set to true this member disk drive if it fails can be replaced only b
383. s are working Both primary configuration disk drives are missing but the secondary configuration disk drive is working and all the adapters in the management list can be detected The adapter microcode automatically sets the Split Array Resolution flag Both primary disk drives can be detected but they cannot be read or written and the secondary configuration disk drive is working The adapter microcode automatically sets the Split Array Resolution flag The array goes into the Offline state for the following errors or reconfiguration e Both primary configuration disks are missing and less than all the managing adapters on the list are visible Split Array Resolution needs to be set before operations to the array can continue e The secondary disk drives are missing and all the managing adapters are missing The primary side of the array initializes read or write operations are performed on the array and the Split Array Resolution flag is not set on the primary configuration disk drives Later the secondary configuration disk drive appears Its Split Array Resolution flag is set Under these conditions both the primary side and the secondary side might have been written independently and the data might not be consistent on the mirrored pair members You must determine whether the correct data is on the primary side or on the secondary side Then you must reinitialize by changing the value of the Split Array Resolution flag on the
384. s for adapter dumps on unused SSA disk drives It searches the disk drives sequentially and provides information about all the dumps that it finds An example of the output from List mode is shown here ADAPTER DUMPS DATE TIME ADAPTER UID DISK SLOT SIZE STATUS SEQ ADAP 961031 10 31 12 123 1234567890ABCDEF pdisk22 12 1 5 4 12345 ssa 22 _xx 10 32 12 456 234567890ABCDEF1 pdisk22 3 13 5 3 12346 ssal 961120 10 50 12 123 1234567890ABCDE7 pdisk22 7 1 5 4 12345 You can switch off the headings by using the h flag Where possible the ssa_getdump command translates the adapter UID into the adapter name for example ssa0 If the command cannot translate the adapter UID it leaves the ADAP field blank see the third line of output in the example You can limit the search to specific disk drives or adapters by adding various optional arguments to the command Attention The command uses space in the tmp file when it copies a file If the available space is not large enough the command fails Some dumps can be large Copy Mode In Copy mode the command copies data from a specified disk drive to a specified output location You must specify the disk drive and the output location 308 Advanced SerialRAID Adapters User and Maintenance Information Flags The ssa_getdump command uses several types of flag e Required flags for both modes e Required flags for Copy mode e Optional flags for List mode e Optional flags for Copy mode Requ
385. s is not known the error is logged against the adapter The SRN indicates the service procedures to be performed 178 Advanced SerialRAID Adapters User and Maintenance Information Table 2 Error Labels continued Error Label Error ID Error Description SSA_DEVICE_ERROR F5CF7C4B This error can be logged against the adapter or disk drive resource When the error is logged against a disk drive it indicates that the adapter has detected a failure on the disk drive It is possible however that the failure was detected because the disk drive was unavailable for a short period Run the error log analysis to determine whether the disk drive should be exchanged for a new one When the error is logged against the adapter it indicates that the adapter has received a report of a status that is not valid The adapter cannot however determine which disk drive sent the bad data Run diagnostics to all SSA disk drives If no failure is found the log might have been caused by a link error SSA_DISK_ERR1 C939BCA6 An SSA disk drive has received a command or parameter that is not valid This error might be caused by A software error in the adapter e A software error in the disk drive A hardware error SSA_DISK_ERR2 99DEBE79 The disk drive has performed an internal error recovery operation No action is needed SSA_DISK_ERR3 808CB45E The disk drive has performed internal media maintenance No action is neede
386. s more information N A The adapter cannot return reservation information This occurs when the adapter is not an SSA Enhanced RAID Adapter None The disk drive is not reserved If an adapter name or UID is shown the disk drive is reserved to a specific adapter If a node number or using system name is shown the disk drive is reserved to a specific node Chapter 15 Using the SSA Command Line Utilities 313 Examples The following examples show typical output from the rescheck command The Adapter In Use field shows which adapter path the using system is using ssa_rescheck 1 hdisk1 produces this type of output Disk Primary Secondary Adapter Primary Secondary Reserved Adapter Adapter In Use Access Access to hdiskl ssaQ ssaQ OK none ssa_rescheck 1 hdisk1 h produces this type of output hdiskl ssaQ ssaQ OK none The next example shows the disk drive Open by adapter ssa1 The disk drive is reserved to ssa1 and adapter ssa0 has a Busy status Because the two adapters are in the same using system the Busy status indicates that the node number is not set Disk Primary Secondary Adapter Primary Secondary Reserved Adapter Adapter In Use Access Access to hdisk2 ssal ssaQ ssal Open Busy ssal The next example shows that the disk drive is reserved to a node because the secondary access is OK not Busy and the Reserved To field shows the using system name Disk Primary Secondary Adapter Primary
387. s recorded in an SSA RAID manager 129 listing rejected array disk drives 111 listing the disk drives in an SSA RAID array 107 listing the disks that are in a hot spare pool 78 SSA RAID arrays continued listing the status of all defined SSA RAID arrays 102 removing a disk drive from an SSA RAID array 136 removing disks from a hot spare pool 84 showing the disks that are protected by hot spares 75 swapping members of an SSA RAID array 140 ssa_rescheck command 313 ssa_servicemode command 315 SSA SMIT menus using 38 ssa_speed command 316 SSA Target mode buffer management 245 configuring 244 execution of Target Mode requests 246 target mode data pacing 245 using 246 SSA Target Mode 243 SSA_TRANSACTION ioctl operation 214 description 214 files 215 purpose 214 return values 215 SSA unique IDs UIDs 21 ssaadap command 293 ssacand command 294 ssaconn command 297 ssadisk command 299 SSADISK_ISAL_CMD ioctl operation disk device driver 230 description 230 files 232 purpose 230 return values 231 SSADISK_ISALMgr_CMD ioctl operation disk device driver 233 description 233 files 234 purpose 233 return values 234 SSADISK_LIST_PDISKS ioctl operation disk device driver 237 description 237 files 238 purpose 237 return values 238 SSADISK_SCSI_CMD ioctl operation disk device driver 235 description 235 files 236 purpose 235 return values 236 ssadisk SSA disk device driver 218 configuration issues 218 Index 451 ssadisk SSA disk
388. s the List key to list the records 5 From the displayed list select the record that you want to delete and follow the instructions that are given on the screen 132 Advanced SerialRAID Adapters User and Maintenance Information Changing or Showing the Attributes of an SSA RAID Array Each array type has several attributes associated with it This option allows you to see and possibly change those attributes 1 For fast path type smitty chssaraid and press Enter Otherwise select Change Show Attributes of an SSA RAID Array from the SSA RAID Array menu A list of arrays is displayed in a window i SSA RAID Arrays A Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool SSA RAID Array Move cursor to desired item and press Enter hdisk2 095231779F0737K good 3 4G RAID 5 array hdisk3 09523173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next Select the array whose attributes you want to see or change Chapter 6 Using the RAID Array Configurator 133 3 A list of attributes is displayed
389. sages are displayed gt ssa_progress 1 pdisk Formatting 30 e If the disk is not formatting and is not format degraded the following messages are displayed gt ssa_progress 1 pdisk Complete 100 e If the disk is format degraded the following messages are displayed gt ssa_progress 1 pdisk Failed 0 312 Advanced SerialRAID Adapters User and Maintenance Information ssa_rescheck Command Purpose To report the reservation status of an hdisk Syntax ssa_rescheck 1 hdisk h Description The ssa_rescheck command tests the access paths to the specified hdisk It checks whether the disk is reserved If the disk is reserved the command attempts to determine why the disk is reserved Flags hdisk Specifies the hdisk that you want to test h Switches off the header output Output The ssa_rescheck command sends error messages to stderr It sends header information and status output to stdout The messages can be OK Access to the disk drive is possible Open Another program has opened the disk drive Fail Access to the disk drive is not possible Busy The disk drive is reserved to another adapter or using system Notes 1 For an SSA Enhanced Adapter Busy means that another adapter has reserved the disk drive If both adapters are in the same using system the other adapter shows OK or Open 2 For an SSA Enhanced RAID Adapter Busy means that the disk drive is reserved The Reserved To field provide
390. scroll the information until you find the list of SSA physical disks that are not used 70 Advanced SerialRAID Adapters User and Maintenance Information 3 Select the disk drive that you want to designate as a hot spare The following screen is displayed for the disk drive that you have chosen a Change Show Attributes of an SSA Physical Disk D Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssa SSA physical disk pdisk6 CONNECTION address 08005AEA080800D Current use Hot Spare Disk Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1O Exit Enter Do J Move the cursor to Current Use and press the List key Note If the Current Use field shows that the disk drive is owned by an array you cannot change that use 4 Select Hot Spare Disk in the Current Use field 5 Press Enter Chapter 6 Using the RAID Array Configurator 71 Changing or Showing the Status of a Hot Spare Pool This option shows you the existing configuration of the arrays and the status of each hot spare pool 1 For fast path type smitty 1s_hsm_status and press Enter Otherwise select List Status of Hot Spare Pools from the SSA RAID Array menu 2 A list of adapters is displayed in a window he SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List
391. se a Select List Identify SSA Physical Disks from the SSA RAID Array menu b Select Identify Hot Spares 2 A list of arrays is displayed in a window E D List Identify SSA Physical Disks Move cursor to desired item and press Enter List Disks in an SSA RAID Array List Hot Spares List Rejected Array Disks List Array Candidate Disks List AIX System Disks Identify Disks in an SSA RAID Array Identify Hot Spares Identify Rejected Array Disks Identify Array Candidate Disks SSA RAID Array Move cursor to desired item and press Enter hdisk3 095231779F0737K good 3 4G RAID 5 array hdisk4 09253173A02137K good 3 4G RAID 5 array Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next S J Select the RAID manager whose hot spare disk drives you want to identify Chapter 6 Using the RAID Array Configurator 119 3 The following information is displayed Identify Hot Spares Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ Hot Spare Disks Flash Disk Identification Lights yes F1 Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1Q Exit Enter Do 4 Select yes in the Flash Disk Identification Lights field 5 Press the List key to list the disk drives 6 From the displayed list select the disk drives that you want to identify The Check light flashes on each disk d
392. shes might occur when you attempt to restart the file system When the fast write cache has been disabled you can attempt to recover the data on the device Attention Ensure that the disk is not returned with its current use defined as System Disk until you are sure that the file system is safe e To reattach the disk and create a logical disk type ssaraid 1 ssaX H n Y a use system k Z d where X is the adapter number Y is the 15 digit device serial number from the list function that you ran earlier and Z is the name of a logical disk For the logical disk choose a name that is different from the names of existing logical disks This action ensures that the logical disk that you have created is not automatically attached if the using system crashes and reboots When this operation has completed a message is displayed This message tells you that the logical disk Z has been attached and that the device dev Z can be accessed For example ssaraid 1 ssa3 H n 2327340C228635K a use system k ZZDataRecovery d 2327340C228635K attached ZZDataRecovery Available where dev ZZDataRecovery is the device You can now use standard AIX commands for example fsck and fsdb to attempt to repair any possible damage to the file system before you attempt data recovery 174 Advanced SerialRAID Adapters User and Maintenance Information SRN 42524 If a Fast Write Cache Option Card fails or is removed from the adapter the affect
393. sk Cancel all SSA Disk Identifications Show Connection Paths to an SSA Physical Disk F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do X If you need help with an item move the cursor to that item and press F1 Help Chapter 4 Using the SSA SMIT Menus 41 Getting Access to the SSA RAID Arrays SMIT Menu 1 For fast path access to the SSA RAID Array SMIT menus type smitty ssaraid and press Enter Otherwise a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displayed c Select SSA RAID Arrays The SSA RAID Arrays menu is displayed a 5 SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool Add a Hot Spare Pool Add an SSA RAID Array Delete an SSA RAID Array Change Show Attributes of an SSA RAID Array Change Member Disks in an SSA RAID Array Change Show Use of an SSA Physical Disk Change Use of Multiple SSA Physical Disks Change Show Delete a Hot Spare Pool F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter D
394. spares is enabled for the arrays on the subsystem Array Candidate Disk if the use of hot spares is disabled for the arrays on the subsystem e Go to step Ba from step Bah You have changed the use of a disk drive You must now ensure that the hot spare pools are correctly configured To do this a b c d Type smitty ssaraid and press Enter Select List Status of Hot Spare Pools Select in turn each SSA adapter If you are using pools other than AO and BO the hot spare pool to which the exchanged disk drive must now be added is listed with a status of reduced critical or empty If multiple disk drives have been exchanged and multiple hot spare pools exist either ask the customer which disk drives are to be assigned to cua hot spare pools or see guidance Chapter 17 SSA Problem Determination Procedures 419 MAP 2410 SSA Repair Verification This MAP helps you to verify that FRUs that you have exchanged for new FRUs or repair actions that you have done have solved all the problems on the subsystem Attention Unless the using system needs to be switched off for some other reason do not switch off the using system when servicing an SSA link or an enclosure in which SSA devices are installed Enclosure power cables and external SSA cables that connect devices to the using system can be disconnected while that system is running 1 on steps 8 and B in IMAP 2320 SSA Link step E in IMAP 2323 SSA Interm
395. ssa_link_speed 1 gt dev null 2 gt dev null The first entry instructs the run_ssa_ela shell script to run at 05 01 each day This shell script analyzes the error log If it finds any problems the script warns the user in the following ways It sends An error message to dev console This message is displayed on the system console An OPMSG to the error log This message indicates the source of the error A mail message to ssa_adm Note ssa_adm is an alias mail address that is set up in etc aliases By default the address is set to root but you can set it to any valid mail address for the using system 265 The second entry instructs the run_ssa_healthcheck shell script to run once each hour This shell script causes the SSA adapter to log any errors that might exist in the SSA subsystem but that are not causing application programs to fail The third entry instructs the run_ssa_encl_healthcheck shell script to run at 30 minutes past each hour This shell script searches for SSA enclosures that provide support for SCSI Enclosure Services SES If any of those enclosures detects errors the shell script causes entries to be made in the error log The fourth entry instructs the run_ssa_link_speed shell script to run at 04 30 each day This shell script searches for SSA links that are not running at the best speed If one is found an entry is made in the system error log Note You can use 20 MB per second black SS
396. ssaencl 1 enclosureQ b e To display the status and VPD of the controller card in enclosure0 give the command ssaencl 1 enclosure c v To modify the ID for enclosureO to R2D2 give the command ssaencl 1 enclosure I R2D2 e To display the contents of disk bay slot 8 in enclosureO give the command ssaencl 1 enclosure d 8 Chapter 15 Using the SSA Command Line Utilities 305 ssa_format Command Purpose Syntax Description Flags To format the specified device ssa_format 1 pdisk or ssa_format 1 SSA Adapter b The ssa_format I pdisk command opens the pdisk special file and uses the ISAL Format command to format the device You can close the device while the format operation is running If the command cannot format the device it prints an error message The ssa_format I SSA_Adapter command attempts to format the Fast Write Cache Option Card if present If the data that is on the Fast Write Cache Option Card has been moved onto a disk drive destaged the formatting operation sets all the data on the Fast Write Cache Option Card to zero for security reasons The ssa_format I SSA_Adapier b command resets the battery age counter on the Fast Write Cache Option Card Use this option only when you have exchanged the Fast Write Cache Option Card battery Possible failure conditions for the ssa_format command include e No Fast Write Cache Option Card is present on the adapter card e The fast
397. ssage code that is specified by the message field of the conc_cmd structure The code is sent to all using systems that are connected to the SSA disk drive DD_CONC_LOCK Locks the specified SSA disk drive for this using system only No other using systems can modify data that is on the disk drive Chapter 12 Using the Programming Interface 239 DD _CONC_UNLOCK Unlocks the SSA disk drive Other using systems can lock and modify data that is on the disk drive DD_CONC_TEST Issues a test disk command to verify that the SSA disk drive is still accessible to this using system The concurrent mode entry point returns a value of EINVAL if any of the following is true The top kernel extension did not perform a DD_CONC_REGISTER operation The conc_cmd pointer is null e The devno field in the conc_cmd structure is not valid The cmd_op field of the conc_cmd structure is not one of the four valid values that were previously listed If the concurrent mode entry point accepts the conc_cmd structure the entry point returns a value of 0 If the SSA disk device driver does not have resources to issue the commana the driver queues the command until resources are available The concurrent commands that are queued in the SSA disk device driver are issued before any read or write operations that are queued by the strategy entry point of the device driver The completion status of the concurrent mode commands are returned to the concurrent mo
398. st first open the disk drive To open a disk drive from which the using system has been excluded use the openx subroutine and specify SSADISK_FENCEMODE extension flag as described in the section on SSA disk device driver device dependent subroutines While the disk drive is open in this mode no read or write operations are permitted If fencing has excluded a using system from access to a disk drive but that disk drive is also reserved to another using system the reservation takes priority The return code from the open subroutine is 1 and the global variable errno is set to EBUSY If the 242 Advanced SerialRAID Adapters User and Maintenance Information using system attempts to break through the reservation by passing the ext parameter SSADISK_FORCED_OPEN to the openx subroutine the reservation is broken but the open fails with errno set to ENOCONNECT To break through the fence the SSA logical disk must be opened in SSADISK_FENCEMODE and the SSADISK_ISALCMD ioctl operation used to issue the appropriate hardware command to break the fence condition SSA Target Mode The SSA Target Mode interface TMSSA provides node to node communication through the SSA interface The interface uses two special files that provide a logical connection to another node One of the special files the initiator mode device is used for write operations the other the target mode device is used for read operations Data that is sent to a node is written t
399. st search for example ssa1 The adapter must be known to the searching machine n AdapterUID Specifies the adapter UID for which the program must search The adapter need not be known to the searching machine s SlotNumber Specifies the slot that contains the disk drive as shown in the List Output Optional Flags for Copy Mode You can choose either or both of these flags h Prevents the output of progress messages from the program X Prevents the actions of the compress command and of the tar command The program copies the dump directly to the specified output point o Note You must ensure that the specified output point has enough free space to hold the dump The ssa_getdump command sends all error messages to stderr and the following to stdout e Header messages e List mode output e Copy progress messages The command generates these return codes The command has completed successfully Some parameters are not correct The disk name is not valid or the pdisk is not present The name of the SSA adapter is not correct or not valid The UID or slot number of the SSA adapter is not correct Cannot open the file or directory in the temporary file tmp oOo a fF WO N SO Not enough disk space is available or an error occurred during a write operation to the temporary file 7 Not enough memory is available Note When in Copy mode the command reads data from the disk in blocks of approximately 256 KB 8 An int
400. sted is an adapter This flag has no effect if the device is a disk drive u Forces a disk reservation to be broken if the device the device that is being tested is a disk drive This flag has no effect if the device is an adapter and is not valid for SSA Enhanced RAID Adapters S Requests the output of the hardware status of a disk drive This flag can be used only with a disk drive It cannot be used with the a flag or with the u flag Disk drive status output is 0 Good the adapter has initialized the pdisk 1 Power the pdisk has detected a loss of redundant power or cooling Note If the pdisk is in a 7133 Model D40 or Model T40 this status indicates that the enclosure has detected a degraded environment Such an environment might be caused by a power cooling or temperature problem or by an enclosure hardware failure 2 Failed the adapter cannot initialize the pdisk If an error occurs the ssa_diag command generates an error message for example ssaQ SRN 42500 and sends it to stdout If no error occurs the command sends no message to stdout A non zero return code indicates an error The command sends an error message to stderr 298 Advanced SerialRAID Adapters User and Maintenance Information ssadisk Command Purpose To display the names of disk drives that are connected to an SSA adapter Syntax ssadisk a AdapterName P L Description The ssadisk command lists the names of disk drives that are conne
401. successfully sent to the adapter card this operation returns a value of 0 Otherwise it returns a value of 1 and sets the errno global variable set to one of the following values EIO Either an unrecoverable I O error has occurred or the hardware did not recognize the SCSI command as valid EINVAL Either the u0 scsi cdb_length field in the ssadisk_ioctl_parms structure was set to a length that is not valid or the u0 scsi direction field in the ssadisk_ioct _parms structure was set to a value that is not valid EPERM The caller did not have an effective user ID EUID of 0 ENOMEM The device driver was unable to allocate or pin enough memory to complete the operation If the return code is 0 the result field of the ssadisk_ioctl_parms structure is valid The return code indicates whether the adapter was able to process the command successfully dev pdiskO dev pdisk1 dev pdiskn Provide an interface to allow SSA device drivers to access physical SSA disks dev hdiskO dev hdisk1 dev hdiskn Provide an interface to allow SSA device drivers to access logical SSA disks 236 Advanced SerialRAID Adapters User and Maintenance Information SSADISK_LIST_PDISKS SSA Disk Device Driver ioctl Operation Purpose Description To provide a method of determining which SSA physical disk drives make up a SSA logical disk drive The SSADISK_LIST_PDISKS operation can be issued by any user to an SSA logical disk hdisk The
402. system when particular critical failures are logged Error Logging Summary Hardware errors can be detected by an SSA disk drive an SSA Adapter or the SSA device driver The SSA adapter performs error recovery for disk drive errors the SSA device driver performs error recovery for the SSA adapter When a problem is detected that needs to be logged all the relevant data is sent to the error logging service in the device driver The error logging service then sends the data to the system error logger SSA errors are logged asynchronously that is independently of any system I O activity For example if an SSA cable is unexpectedly disconnected an Open Serial Link error is logged immediately The SSA subsystem does not wait for a read or write command before it logs the error Sometimes on the SSA network the SSA adapter and SSA disk drives detect errors that were possibly caused by activities elsewhere on the network Such activities might be the rebooting of another using system a system upgrade or maintenance These errors do not need any service action and should not cause any problem unless the automatic error log analysis determines that the error is critical Because SSA subsystems are designed for high availability most subsystem errors do not cause I O operations to fail Some errors therefore might not be obvious to the user To ensure that the user knows about such errors a health check is run to the adapter each hour
403. systemname ssa0 A2 systemname ssaQ B1 40 systemname pdisk5 systemname pdisk5 40 systemname pdisk4 systemname pdisk4 40 systemname ssa0 B2 F3 Cancel F1O Exit XN A Eigure 48 gives a physical representation of the configuration that is shown on the screen Disk Disk 57 40 MB s _40MB s_ 40 MB s 4 5 B1 no 40 MB s 4o mess P PSK 40 mB s_ 40 MBVs 0 1 2 3 A1 Figure 48 Configuration with Broken Link Shown by the Service Aid 348 Advanced SerialRAID Adapters User and Maintenance Information Service Aid Service Request Numbers SRNs If the SSA service aids detect an unrecoverable error and are unable to continue one of the following service request numbers SRNs might occur SSAO01 e SSA02 e SSA03 These SRNs are explained in the main SRN table see Using the Service Aids for SSA Link Problem Determination problem with an SSA loop use the Link Verification service aid see ELind The following examples show various loops and the associated information that is displayed by the Link Verification service aid If you have a Chapter 16 SSA Service Aids 349 Example 1 Normal Loops In Figure 49 disk drives 1 through 8 are connected to connectors A1 and A2 of the SSA adapter J Disk drives 9 through 12 are connected to connectors B1 and B2 of the same SSA adapter Disk drives 13 through 16 are connected to connectors A1 and A2 of a different SSA adapte
404. t a count of unreadable blocks be printed 296 Advanced SerialRAID Adapters User and Maintenance Information ssaconn Command Purpose Syntax Description Flags To display the SSA connection details for the physical disk ssaconn 1 PhysicalDiskName a AdapterName The ssaconn command performs a function that is similar to the Link Verification service aid The output from this command is PhysicalDiskName AdapterName hopcount1 hopcount2 hopcount3 hopcount4 The four hop counts represent the number of SSA devices that are between the physical disk and the A1 A2 B1 and B2 ports of the adapter respectively For example if hop count 1 is 0 no devices are between the physical disk and the A1 port of the adapter If hop count 4 is 5 five devices are between the physical disk and the B2 port of the adapter If the disk is not connected to a particular adapter port the hop count is replaced by a dash character I PhysicalDiskName Specifies the physical disk whose connection details are to be listed a AdapterName Specifies the adapter to whose ports the connection details are related Chapter 15 Using the SSA Command Line Utilities 297 ssa_diag Command Purpose Syntax Description Flags Output To run diagnostic tests to a specified device ssa_diag 1 pdiskX ssa_diag 1 ssax The ssa_diag command is in usr lpp diagnostics bin a Causes the adapter to be reset if the device that is being te
405. t the physical disk drive pdisk If a disk drive that has been formatted on a machine of a particular type for example a Personal System 2 is later installed into a using system that is of a different type for example an RS 6000 that disk drive is configured only as a pdisk during the configuration of the using system 20 Advanced SerialRAID Adapters User and Maintenance Information SSA Unique IDs Each SSA device has a specific identifier that is not used by any other SSA device in the whole world This identifier is called the IEEE SSA Unique ID UID of the device It is written into the device during manufacture The full UID consists of 16 characters The label on the side of a disk drive shows the full UID The label on the front of a disk drive shows the serial number of the disk drive The serial number is actually part of the UID Also part of the UID the Connection Address consists of the LUN name and the device type identifier The software uses this information to access the device Full UID OOOOXXXXXXNNNNNN Disk drive serial number XXNNNNNN Connection Address XXXXXXNNNNNNLLD where XXXXXX IEEE Organization Identifier manufacturer NNNNNN Product ID assigned unique number LL LUN always 00 for a LUN device D Device type D for an SSA Physical disk drive E for a fast write logical disk F for a RAID O array K for a RAID 5 array You might need to know the UID of a disk drive if you wa
406. t you have tested or exchanged change the Current Use to Array Candidate Disk g Select Change Member Disks in an SSA RAID Array h Select Swap Members of an SSA RAID Array i Select the degraded hdisk j Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you tested or exchanged in step isi When failed disk drives have been exchanged for new disk drives the data is rebuilt and the array changes its state to the Good state Note The array can be used during the rebuilding operation Inform the user however that while the rebuilding operation is running the data is not protected against another disk drive failure The rebuilding operation runs more slowly if the array is being used 412 Advanced SerialRAID Adapters User and Maintenance Information k When the rebuilding operation is complete ask the user to run diagnostics in System Verification mode to the SSA adapters to ensure that the rebuilding operation has not found any more problems Go to EMAP repair ation on page 420 to verify the 19 from step ia Does the Link Verification service aid indicate an open loop NO Go to step 20 YES from step E9 Does any SSA disk drive have its Check light on NO The disk drive might have been removed from the subsystem a oap p YES oaog Reinstall the removed
407. tatus of Hot Spare Pools c Display the pool status for each installed SSA adapter Are any pools listed with a status of reduced NO Go to step Bil YES The number of hot spare disk drives that are in the pool is less than the number hot spare disk drives that were originally assigned to that pool If you have exchanged a failing disk drive and changed its use to Hot Spare Disk or Array Candidate Disk add that disk drive to the reduced hot spare pool To do this a Type smitty ssaraid and press Enter Select Change Show Delete a Hot Spare Pool Select the adapter and press Enter Select the hot spare pool and press Enter Select Components to Add and press the List key Select a free disk drive or a hot spare disk drive to add to the pool If no free or hot spare disk drives exist in the list review the configuration with the customer or see EChapter 5 Hot Spard for guidance mo aos g Go to step Bil 31 from step Ba You have solved all the problems a Run the repair verification or repair completion procedures that are defined by your using system b If you have previously created a backup reload that data now 32 from steps A kal ba led and ba Has a failed disk drive been exchanged for a new disk drive NO If you have repaired a power or cabling fault that caused the disk drive to be missing from the system the drive might now be in a rejected state You must change that disk drive into a usab
408. ted If the disk drive was rejected from the array because the disk drive itself has failed go to step alan page Gd If the disk drive was rejected from the array because some other part has failed for example a power supply unit or an SSA cable a Correct the problem or call your service representative b Add the disk drive to the array see c Run system diagnostics to verify that the repair is successful Alternatively a Change the use of the original disk drive so that it becomes a hot spare disk drive see b Install a replacement disk drive see c Run system diagnostics to verify that the repair is successful Chapter 6 Using the RAID Array Configurator 91 13 Physically remove the failing disk drive for a new one see the Operator Guide or Service Guide for the unit 14 If you are going to install a replacement disk drive go to Finstalling a Replacemeni 92 Advanced SerialRAID Adapters User and Maintenance Information Installing a Replacement Disk Drive 1 Physically install the replacement disk drive see the Operator Guide or Service Guide for the unit If the failed disk drive has been exchanged for a hot spare disk drive change the drive is working correctly If no hot spare disk drive was available when the original disk drive failed the array is now in the Exposed state or in the Degraded state Change the use of the disk drive to the array For fast path type sm
409. tenance Information SRN Problem Possible Causes 48750 Description An array is in the Offline state because the primary or the secondary half of the array is not present Action Switch on the power to the other half of the array or repair the broken loop that is preventing access to the other disk drives If the other half of the array has become permanently unavailable because an unrecoverable error has occurred you can force access to the available half of the array Attention Do not force access to the available half of the array unless you are sure that no updates to the other unavailable half of the array will be performed See before you perform this operation To force access to the available half of the array change the setting of the Split Array Resolution flag 1 Type smitty ssaraid and press Enter 2 Select Change Show Attributes of an SSA RAID Array 3 Change the setting of the Split Array Resolution flag 4 If possible change the setting of the Split Array Resolution flag on the unavailable half of the array Attention If the unavailable half of the array is reconnected to the available half before the setting of the Split Array Resolution flag has been changed neither SSA adapter can get access to the array The adapter cannot get access the other adapter in the loop because one of the following conditions exists e The SSA adapter can detect the secondary half of the ar
410. ter after all rejected disk drives have been exchanged Select Change Show Use of an SSA Physical Disk and select the RAID manager that you noted earlier Note all the disk drives that are listed as rejected Exchange all failed and rejected disk drives for new disk drives Select Change Show Use of Multiple SSA Physical Disks Change the Current Use parameter of the exchanged disk drives to Hot Spare Disks If the user has a record of how disk drives are assigned to the hot spare pools use that information to assign the hot spare disk drives to the correct pools If the user has no such record see De g g to determine the best hot spare Select Change Show Delete a Hot Spare Pool Add the hot spare disk drives to the correct pool see Adding Disks Select Change Member Disks in an SSA RAID Array Swap the pdisk whose name you noted in step F with a hot spare disk drive that is in the pool that you noted in step aT Disks in an A BAID Array on page Note If the customer chooses not to have the disk drive swapped the only way to clear this error condition is to remove all the member disk drives from this hot spare pool then recreate the pool If you do these actions you change the configuration of the hot spare pool Select Change Show Use of an SSA Physical Disk Change to Hot Spare Disk the Current Use parameter of the disk drive pdisk whose name you noted in step id Select Change Show Delete a H
411. ter special file dev pdisk0O dev pdisk1 dev pdiskn e Provide support for the ioctl subroutine for servicing and diagnostics functions Do not accept read or write subroutine calls for the character special file SSA logical disks have the following properties They e Are configured as hdiskO hdisk1 hdiskn e Provide support for a character special file dev rhdiskO dev rhdisk1 dev rhdiskn e Provide support for a block special file dev hdiskO dev hdisk1 dev hdiskn e Provide support for the ioctl subroutine call for nonservice and diagnostics functions only 218 Advanced SerialRAID Adapters User and Maintenance Information Accept the read and write subroutine call to the special files Can be members of volume groups and have file systems mounted on them Multiple Adapters Some SSA subsystems see g allow a disk drive to be controlled by up to two adapters in a particular using system The disk drive has therefore two paths to each using system and the SSA subsystem can continue to function if an adapter fails If an adapter fails or the disk drive cannot be accessed from the original adapter the SSA disk device driver switches to the alternative adapter without returning an error to any working application When a disk drive has been successfully opened takeover by the alternative adapter does not occur simply because a drive becomes reserved or fenced out However during an open of an SSA l
412. tev writex or writevx system call to start data transmission The kernel mode user issues an fp_write or fp_rwuio service call to start data transmission The SSA target mode device driver then builds a send command to describe the transfer and the data is sent to the device The transfer can be done as a blocking write operation or as a nonblocking write operation When the write entry point returns the calling program can access the transmit buffer When the caller opens the target mode special file a logical path is set up This path allows data to be received The user mode caller issues a read readv readx or readvx system call to start the receiving of data The kernel mode caller issues an fp_read or fp_rwuio service call to start the receiving of data The SSA target mode device driver then returns data that was received for the application program Implementation Specifics The SSA tmssa device driver provides further information about implementation specifics The tmssa special file is part of Base Operating System BOS Runtime This file is in the device ssa tm rte file set which is in the devices ssa tm package 256 Advanced SerialRAID Adapters User and Maintenance Information Related Information The close subroutine open subroutine read or readx subroutine and write or writex IOCINFO Device Information tmssa Device Driver ioctl Operation Purpose To return information about the device in a structure that is define
413. th the protection requirements of EU council directive 89 336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility Neither the provider nor the manufacturer can accept responsibility for any failure to satisfy the protection requirements resulting from a non recommended modification of the product including the fitting of option cards not supplied by the manufacturer Radio Protection for Germany Zulassungsbescheinigung laut Gesetz Uber die elektromagnetische Vertraglichkeit von Ger ten EMVG vom 30 August 1995 Dieses Ger t ist berechtigt in bereinstimmung mit dem deutschen EMVG das EG Konformitatszeichen zu f hren Der Aussteller der Konformitatserklarung ist die IBM Deutschland Informationen in Hinsicht EMVG Paragraph 3 Abs 2 Das Ger t erf llt die Schutzanforderungen nach EN 50082 1 und EN 55022 Klasse A EN55022 Klasse A Ger te bed rfen folgender Hinweise Nach dem EMVG Ger te d rfen an Orten f r die sie nicht ausreichend entst rt sind nur mit besonderer Genehmigung des Bundesministeriums f r Post und Telekommunikation oder des Bundesamtes f r Post und Telekommunikation betrieben werden Die Genehmigung wird erteilt wenn keine elektromagnetischen St rungen zu erwarten sind Auszug aus dem EMVG Para 3 Abs 4 Dieses 432 Advanced SerialRAID Adapters User and Maintenance Information Genehmigungsverfahren ist nach Paragraph 9 EMVG in Verbin
414. the clips the module is not fully home Press the module fully home then close the clips 8 Reinstall the adapter into the using system see the Installation and Service Guide for the using system 282 Advanced SerialRAID Adapters User and Maintenance Information Removing the Fast Write Cache Option Card of an Advanced SerialRAID Adapter Attention The adapter assembly contains parts that are electrostatic discharge ESD sensitive Use the tools and procedures defined by your organization to protect such parts The Fast Write Cache Option card might contain customer data 1 Remove the adapter from the using system see the nstallation and Service Guide for the using system 2 Place the adapter card with its components downward onto a nonconducting surface 3 Refer to Figure 39 a gt Figure 39 Removing the Mounting Screw from the Fast Write Cache Option Card 4 Remove the mounting screw The screw fastens the Fast Write Cache Option card in position Chapter 14 Removal and Replacement Procedures 283 5 Refer to Figure 40 LETTE TEP TEE TT tt ty A E en Figure 40 Removing the Fast Write Cache Option Card
415. the SSA device is installed Chapter 17 SSA Problem Determination Procedures 395 5 from step A Observe the Status column on the screen If the status of any pdisk is Failed that pdisk is failing In the example shown here pdisk2 is failing Link VERIFICATION 802386 N SSA Link Verification for nunu ssa0 00 04 IBM SSA 160 SerialRAID Adapter To Set or Reset Identify move cursor onto selection then press lt Enter gt Physical Serial Adapter Port Al A2 Bl B2 Status TOP nunu pdisk11 AC7AA09A O5 Good nunu pdisk8 AC7AA2D6 1 4 Good nunu pdisk2 AC7AAOBD 2 3 Failed nunu pdisk3 AC7AAQB1 a 2 Good nunu pdisk7 AC7AAOB5 4 1 Good nunu pdisk12 AC7AA052 a 0 Good nunu pdiskO AC7AAOB9 Oe 25 Good nunu pdisk1 AC7AAQB3 1 4 Good nunu pdisk10 AC7AAQB4 23 Good MORE 4 F3 Cancel F1O Exit Is one of the pdisks failing NO Go to step 6 on page 3971 YES a Use the Identify function as instructed on the screen to find the failing disk See EEinding the Ph al Location of a Device on page 358 if you need more information about finding the disk drive b a the disk drive for a new one see c Goto repair 396 Advanced SerialRAID Adapters User and Maintenance Information 6 from step 5 link in one of the loops is broken If two rows of question marks are displayed two links are broken one in each loop In the example shown here pdisk2 is missing en VERIFICATION 802386 D SSA Lin
416. the adapter If an SRN is produced do the SSA adapter card 2 actions for that SRN using system Installation and Service Guide 42510 Description Not enough SDRAM available to run the fast write cache User or service action 364 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 42515 Description A fast write disk is installed but no Fast Write Cache Option The cache card is not Card has been detected installed correctly Action e The Fast Write feature is not ae Verificati installed on this machine but 1 If you have not already done so run diagnostics in System Verification a disk drive that is mode to the adapter If a different SRN is generated solve that configured for fast write problem first operations has been added 2 Do the following actions as appropriate to the subsystem e If the cache card is not installed correctly remove it from the adapter then reinstall it correctly Possible FRUs If the cache card is installed correctly it might have failed ee Cache Option Exchange for new FRUs the FRUs that are shown in the list of Card 90 possible FRUs for this SRN l e Ifthe Fast Write feature is not installed and you want to delete the fast write configuration for one or more disk drives that have been added to this subsystem SSA adapter card 10 using system nstallation and Servic
417. the age of its battery When the battery approaches the age at which it might not be able to maintain the data in the fast write cache for seven days an error is logged This error recommends that the battery be exchanged for a new one At this time the fast write cache continues to work normally If the battery is not exchanged inside approximately three months from the time of the error the fast write cache is disabled and a new error is logged This error indicates that the fast write cache is no longer active Configuring the Fast Write Cache Feature This section describes how to use the system management tool SMIT to configure and install arrays and disks that have the fast write attribute It also gives guidance about the preferred setting for two way fast write operation If you prefer to use the ssaraid command through the command line interface instead of through the menus You can get access to the SMIT panels by using fast path commands or by working through the menus In this chapter the fast path command for a particular option is given at the start of the description of that option Notes 1 Although this book always refers to the smitty commands you can use either the smitty command or the smit command The procedures that you follow remain the same whichever of the two commands you use If you send the smit command from a graphics terminal however the menus are displayed slightly differently from 165 those sho
418. the disk drive should be exchanged for a new one SSA_ARRAY_ERROR B4C00618 A RAID array failure has been detected and the array is not fully operational Usually the data on the array is safe but ensure that you follow the service procedures exactly so that you do not lose any data SSA_CACHE_ERROR BC31DEA7 These errors indicate that the fast write cache has detected a problem Usually the problem has been caused by user or service actions such as moving a Fast Write Cache Option card from one adapter to another or moving a disk drive between adapters before the data in the cache card has been synchronized with the data on the disk drive Take care when moving cache cards or adapters that contain cache cards because they might contain data that needs to be synchronized Always follow the service procedures for the SRN carefully to ensure that you do not lose any data SSA_CACHE_BATTERY 26CA120B This error recommends that the battery of the Fast Write Cache Option card be exchanged for a new one SSA_DEGRADED_ERROR 36E69D82 An error or condition has occurred that might cause some of the SSA functions to be unavailable or to be working with reduced performance SSA_DETECTED_ERROR B8ED86C4 Errors of this type are logged by the adapter when a device failure has been reported via SSA asynchronous messages Because the system name of the device or devices that are sending these message
419. the example screen b If a free disk is selected from the list it is converted to a hot spare disk drive when it is added to the hot spare pool Chapter 6 Using the RAID Array Configurator 83 Adding Disks to or Removing Disks from a Hot Spare Pool This option allows you to exchange the disk drives that are in the hot spare pool or to resynchronize the state of the pool If you are not sure how to configure hot spare pools read before you proceed 1 For fast path type smitty chg_hsm_pool_adap and press Enter Otherwise select Change Show Delete a Hot Spare Pool from the SSA RAID Array menu 2 A list of adapters is displayed in a window a gt SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays List All Supported SSA RAID Arrays List All SSA RAID Arrays Connected to a RAID Manager List Status Of All Defined SSA RAID Arrays List Identify SSA Physical Disks List Delete Old RAID Arrays Recorded in an SSA RAID Manager List Status of Hot Spare Pools List Status of Hot Spare Protection for an SSA RAID Array List Components in a Hot Spare Pool SSA RAID Manager Move cursor to desired item and press Enter ssa0 Available 04 03 IBM SSA 160 SerialRAID Adapter 14109100 ssal Available 04 02 IBM SSA 160 SerialRAID Adapter 14109100 Fl Help F2 Refresh F3 Cancel F8 Image F1lO Exit Enter Do F Find n Find Next N A Select the adapter o
420. the fast write function to continue on a particular disk drive if the partner adapter becomes not accessible set the Bypass Cache in 1 Way Fast Write Network flag to no for that disk drive 172 Advanced SerialRAID Adapters User and Maintenance Information Dealing with Fast Write Problems SRN 42521 This section describes how to recover from problems that might occur during fast write operations The type of problems are those in which data loss might have occurred or customer data recovery procedures need to be performed These problems are indicated by any of the following Service Request Numbers SRNs 42521 42524 42525 If any of these SRNs occurs do the following actions 1 Goto Request Numbe RN J g and find the SRN 2 Do the actions that are given for the SRN and come to this section when the actions tell you to do so Important Do not come to this section until the SRN actions tell you to do so 3 Find the SRN in this section and do the actions given You can use the ssaraid command to list the devices that are affected by this failure The ssaraid command is in usr sbin To list all devices that are affected by this cache failure type ssaraid 1 ssaX Iz a state cache_data_error where X is the number of the adapter that has reported the failure in the error log for example ssa3 The output from the command produces one line of information for each device as follows 2327340C228635K 232
421. tinue operating although one or more of its components have failed e RAID 0O provides data availability equivalent to that of a standard disk drive but with better performance for long data transfer operations e RAID 1 provides good data availability because data is mirrored on two member disk drives as it is with RAID 10 RAID 1 arrays however have only two member disk drives Member disk drives of a RAID 1 array can be configured to be in separate domains Separate domains ensure that data remains available if for example a complete domain fails through loss of power e RAID 5 provides good data availability with good performance for workloads that include many read and write operations 29 e RAID 10 provides good data availability and performance that is better than that provided by RAID 5 especially when a member disk drive has failed For long data transfer operations performance is better than that provided by RAID 1 because data is striped across member disk drives For short data transfer operations performance is better because operations are distributed across the member disk drives and the effect of skew is reduced Member disk drives of a RAID 10 array can be configured to be in separate domains Separate domains ensure that data remains available if for example a complete domain fails through loss of power Disk Drives That Are Not in Arrays Disk drives that are connected to an SSA RAID adapter do not need to be m
422. tion SRNs in this range are not adapter SRNs Not applicable to 2A206_ Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem 2FFFF Description An async code that is not valid has been received Software error Action Go to g 300C0 Description SRNs in this range are not adapter SRNs Not applicable 301C0 Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem 303FE Description A disk drive microcode error has been detected Software error Possible FRUs Device 100 303FF Description An SCSI status that is not valid has been received Possible FRUs Device 100 xchanging D 31000 Description SRNs in this range are not adapter SRNs Not applicable Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem 33PAA Description Excessive link reconfigurations have been detected Possible FRUs Action G External SSA cables ction Go to MA 30 Internal SSA connections 30 enclosure service information Bowes ete Exchanging Disk Drives on page 271 SSA adapter card 10 using system Installation and Service Guide 34000 Description The adapter cannot initialize a device This problem might be Possible FRUs badly affecting the SSA loop If the device was a member of a RAID oe 90 Exchanging array you might not be able to list this disk drive by using the RAID facilities External SSA
423. to be alerted when a single hot has been used see Select Components to Add and press the List key A list of valid hot spare pool candidates is displayed This list contains RAID disk drives hot spare disk drives and free disk drives that are now in pool zero on the selected SSA loop TA Add a Hot Spare Pool Ty MMMMMMMMMMMMMMMM Pr Components to Add Move cursor to desired item and press F7 ONE OR MORE items can be selected Press Enter AFTER making all selections SSA physical disks that are members of an array hdisk4 raid_10 pdisk13 AC7AAB76 04 02 REGY 06 P 18 2GB good pdisk3 AC7AA0B2 04 02 REGY 05 P 9 2GB good pdisk7 AC7AAOBD 04 02 REGY 01 P 9 2GB good SSA physical disks that are hot spare disks pdisk9 AC7AA2D6 04 02 REGY 02 P 9 2GB SSA physical disks that are free Fl Help F2 Refresh F3 Cancel F1 F7 Select F8 Image F10 Exit F5 Enter Do Find n Find Next coal ceca A a SS J Select the disk drives that you want to add to the hot spare pool and press Enter Notes a If all the member disk drives of an hdisk are now in pool zero you can select the hdisk This action adds all the member pdisks of the array to the hot spare pool that you are creating If some of the member pdisks of an hdisk have already been assigned to another hot spare pool the hdisk cannot be selected and is shown with a comment flag in front of it as shown in
424. to keep This is your last chance to stop before continuing Press Enter to continue Press Cancel to return to the application Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next NS J 4 At the prompt press Enter if you want to delete the array Press Cancel if you do not want to delete the array Chapter 6 Using the RAID Array Configurator 69 Creating a Hot Spare Disk Drive 1 For fast path type smitty chgssadisk and press Enter Otherwise select Change Show Use of an SSA Physical Disk from the SSA RAID Array menu A list of disk drives and their usage is displayed in a window a N SSA RAID Arrays Move cursor to desired item and press Enter List All Defined SSA RAID Arrays SSA Physical Disk Move cursor to desired item and press Enter Use arrow keys to scroll SSA physical disks which are members of arrays pdiskO 00022123DFHCOOD member n a 4 5G Physical d pdiskl 0004AC5119EQ00D member n a 1G Physical d pdisk2 0004AC5119EQ00D member n a 1G Physical d pdisk3 Q8005AEA003500D member n a 4 5G Physical d pdisk4 Q8005AEAQ30D00D member n a 2 3G Physical d pdisk5 Q8005AEAQ80100D member n a 4 5G Physical d pdisk7 Q8005AEAQ87A00D member n a 4 5G Physical d SSA physical disks which are hot spares pdisk6 08005AEA080800D spare n a 4 5G Physical d F1l Help F2 Refresh F3 Cance F8 Image F1O Exit Enter Do Find n Find Next Ne y 2 Using the arrow keys
425. to run cfgmgr to restore the device to the system configuration If the original problem was not reported by a device run diagnostics to each SSA adapter in the using system b Go to step 4 4 from step Bh Do you still have the same SRN NO Go to step B YES Go to step zi from step Blin MAP 2010 START and step W in this MAP Do you have any other SRN NO Go to step aan YES Go to from step m Have you have exchanged all the FRUs that were originally reported by the SRN NO Exchange the next FRU that is listed for the SRN YES a Run diagnostics in System Verification mode to all the adapters that are in this SSA loop b Run diagnostics in System Verification mode to all the disk drives that are in this SSA loop c Run the Certify service aid see to all the disk drives that are in this SSA ioi Correct all errors that are reported by the diagnostics d e Go to step Zon page 422 Chapter 17 SSA Problem Determination Procedures 421 7 from steps H in MAP 2010 START and from steps B and H in this MAP Does your subsystem contain RAID arrays If you are not sure whether your subsystem contains RAID arrays a Type smitty ssaraid and press Enter b Select List All Defined SSA RAID Arrays NO Run the repair verification or repair completion procedures that are defined by your using system YES Go to the RAID Checkout at step 22 on page 415 of MAP 2324 SSA BAID 422 Advanced Seria
426. to the adapter 3 If the diagnostics show that the failing device is still in the SSA loop reconnect the device and disconnect the next device in sequence 4 Run the diagnostics again 5 Repeat steps Bl and H until you isolate the failing device 504XX Description The SSA adapter microcode has hung Software error Action Run diagnostics in System Verification mode to the SSA adapter Possible FRUs If the diagnostics fail exchange the Bat for a new FRU If the SSA adapter card 100 diagnostics do not fail go to using system Installation and Service Guide 60000 Description The SSA adapter is missing from the expected configuration Possible FRUs SSA adapter card 100 Action Verify that the SSA adapter card is installed in the expected slot of aaa gabon ale the using system and Service Guide If it is in the expected slot exchange the FRU for a new FRU If it is not in the expected slot give the diag a command and answer the questions that are displayed 60200 Description SRNs in this range are not adapter SRNs Not applicable 60210 Action For SRNs in this range see the documentation for your SSA enclosure or SSA subsystem 384 Advanced SerialRAID Adapters User and Maintenance Information SRN Problem Possible Causes 60240 Description A configuration problem has occurred Software error Action A device cannot be configured for some unknown reason Go to SSA
427. to the Enable Disable Fast Write for Multiple Devices menu a Type smitty ssafastw and press Enter b From the menu displayed select all the logical disk drives for which you are enabling or disabling the fast write function Otherwise a Select Enable Disable Fast Write for Multiple Devices from the SSA Logical Disks menu b From the menu displayed select all the logical disk drives for which you are enabling or disabling the fast write function 2 The Enable Disable Fast Write for Multiple Devices menu appears im D Enable Disable Fast Write for Multiple Devices Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields List of Devices hdisk1 Enable Fast Write no Force Delete no BOTTOM Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1Q Exit Enter Do If you want to enable the fast write function for the selected disk drives set the Enable Fast Write option to yes for those disk drives The state of the Force Delete option is ignored If you want to disable the fast write function for the selected disk drives set the Enable Fast Write option to no and the Force Delete option to no for those disk drives Note The fast write function is disabled only if no data for your selected devices is present in the fast write cache If data for your selected devices is present in the fast write cache and you want to disable the fast write fun
428. to the web pages that are listed here Refer to these pages also if you are upgrading your system hardware or operating system and the system contains SSA devices These web pages provide access to the latest SSA publications and support microcode for the using system SSA adapters and SSA subsystem http www hursley ibm com ssa This web page provides links to SSA publications and other web pages including the other web page in this list http www hursley ibm com ssa rs6k This web page contains a list of the latest levels of SSA support microcode and provides a microcode download capability for the RS 6000 and AIX environments Numbering Convention In this book KB means 1 000 bytes MB means 1 000 000 bytes GB means 1 000 000 000 bytes XV Advanced SerialRAID Adapters User and Maintenance Information Part 1 User Information 2 Advanced SerialRAID Adapters User and Maintenance Information Chapter 1 Introducing SSA and the Advanced SerialRAID Adapters This chapter describes e Serial storage architecture SSA e The Advanced SerialRAID Adapter and the Advanced SerialRAID Plus Adapter Physically the two types of adapter are the same The Advanced SerialRAID Plus Adapter however provides additional functions In this book the name Advanced SerialRAID Adapter is used both for the Advanced SerialRAID Adapter and for the Advanced SerialRAID Plus Adapter unless otherwise stated Serial Storage Architect
429. tructions on how to disable the Fast Write option see 2 Exchange the Fast Write Cache Option Card for a new one Ask the customer to re enable the Fast Write option for the devices that are attached to the new Fast Write Cache Option Card System configuration problem Possible FRUs Fast Write Cache Option Chapter 17 SSA Problem Determination Procedures 367 SRN Problem Possible Causes 42525 Description A fast write logical disk contains unsynchronized data but the The data was not Fast Write Option Card does not contain that data One of the following synchronized on the old conditions occurred adapter before the disk drive i TOE was moved to this adapter Action The failing disk drive is offline j The wrong Fast Write Option e If the disk drive has just been moved from another adapter do either of Card was installed onto this the following actions adapter Return the disk drive to its original adapter The Fast Write Option Card Move the original Fast Write Cache Option Card to this adapter so lost the data because the that the data can be synchronized battery failed e If the wrong Fast Write Cache Option Card has been installed for example if the adapter has been exchanged but the original Possible FRUs Fast Write Cache Option Card is still on the old adapter card install Fast Write Cache Option the original Fast Write Cache O
430. tructure This structure is defined in the usr include sys ssadisk h file 230 Advanced SerialRAID Adapters User and Maintenance Information The SSADISK_ISAL_CMD ioctl uses the following fields of the ssadisk_ioctl_parms structure dsb Contains the directive status byte that is returned for the command The byte contains a value from the usr include ipn ipndef h file A non zero value indicates an error result Contains the Independent Packet Network IPN result word that is returned by IPN for the command The word contains values from the usr include ipn ipntra h file A non zero value indicates an error u0 isal parameter_descriptor Set by the caller to indicate the buffer for parameter data u isal transmit_descriptor Set by the caller to indicate the buffer for transmit data u isal receive_descriptor Set by the caller to indicate the buffer for received data u isal status_descriptor Set by the caller to indicate the buffer for status data u isal minor_function Set by the caller to one of the ISAL commands that is defined in the usr include ipn ipnsal h file and listed at the start of the description of this operation Note Structures that are provided in the usr include ipn ipnsal h file can be used to format the contents of the parameter buffer for the various commands The device driver always overwrites with the correct handle the handle that is located in the first four bytes of the parameter buffer Re
431. ttribute DeviceName The user preferred name of the newly created device InstructType The swap remove or add action that is to be performed on the object See De ON DaAge Chapter 11 Using the SSA Command Line Interface for RAID Configurations 191 Options You can use the following options with the ssaraid command Option Description A C D H I M S Ya Object Types Print a short usage message Perform an action on an object Create an object Delete an object Change an object Report information on an object List all the available SSA RAID managers that are on the system Show the hot spare pool information for an SSA RAID array List all array types List all create types List all objects An attribute and its desired value List the candidates for an object type Create the AIX device for the specified RAID object Print column headers when showing object information in summary format The instruct action to perform The AIX device name to use The name of the SSA RAID manager to use List the member objects for the named object The name of an object for example a RAID array or member disk drive Information is presented in colon separated format List the parent objects for the named object The disk drives that are to become members of the array The type of the object to list or create Remove the AIX device for the specified RAID object List exchange candidate disk
432. ttributes 198 RAID functions 29 read subroutine tmssa device driver 249 readx and writex subroutines disk device driver 226 Rebuilding state RAID 10 37 Rebuilding state RAID 5 34 adapter replacement 34 disk drive replacement 34 initial rebuilding operation 34 redssaraid command 136 reformatting a pdisk as an hdisk 336 relationship of disk drives and adapters 24 one pair of adapter connectors in the loop 24 pairs of adapter connectors in the loop mainly shared data 26 pairs of adapter connectors in the loop some shared data 25 removal and replacement procedures changing pdisk and hdisk numbers 278 exchanging disk drives 271 installing a battery assembly into the fast write cache card 289 installing an SDRAM module 281 installing the fast write cache card 285 removing an SDRAM module 280 removing the battery assembly from the fast write cache card 287 removing the fast write cache card 283 SSA adapter 279 448 Advanced SerialRAID Adapters User and Maintenance Information Remove a Disk from an SSA RAID Array option 136 removing an SDRAM module 280 removing and replacing an SSA adapter 279 removing disks from a hot spare pool 84 removing the battery assembly from the fast write cache card 287 removing the fast write cache card 283 reserving disk drives 27 responsibilities of the SSA adapter device driver 207 responsibilities of the SSA disk device driver 207 return codes command line interface RAID 5 205 return values direct ca
433. turn Values If the command was successfully sent to the adapter card this operation returns a value of 0 Otherwise a value of 1 is returned and the errno global variable set to one of the following values EIO An unrecoverable I O error has occurred EINVAL Either the caller has specified an ISAL command that is not in the list of supported ISAL commands or the caller has attempted to send an FN_ISAL_FENCE command to an SSA physical disk EPERM The caller did not have an effective user ID EUID of 0 ENOMEM The device driver was unable to allocate or pin enough memory to complete the operation If the return code is 0 the result field of the ssadisk_ioctl_parms structure is valid This indicates whether the adapter was able to process the command successfully Chapter 12 Using the Programming Interface 231 Files dev pdiskO dev pdisk1 dev pdiskn Provide an interface to allow SSA device drivers to access SSA physical disk drives dev hdiskO dev hdisk1 dev hdiskn Provide an interface to allow SSA device drivers to access SSA logical disk drives 232 Advanced SerialRAID Adapters User and Maintenance Information SSADISK_ISALMgr_CMD ISAL Manager Command SSA Disk Device Driver ioctl Operation Purpose Description To provide a method of sending Independent Network Storage Access Language ISAL Manager commands to an SSA physical or logical disk drive ISAL consists of a set of commands that a
434. u are creating a RAID 10 array Try to select disk drives of equal sizes Although you can mix disk drives of various sizes all the disk drives in a particular array are logically truncated to the size of the smallest disk drive in that array For example if you create an array from the four disk drives pdisk0 pdisk1 pdisk2 and pdisk3 that are shown on the screen in step all four disk drives are assigned as 1 1 GB disk drives because pdisk3 is a 1 1 GB disk drive If you use disk drives of various sizes therefore you waste some storage size Attention When the array has been created you can use it You might however prefer to wait until the array state changes from Rebuilding to Good because hot spare disk drives are not available until the array is in the Good state If a disk drive fails before the array is in the Good state you might no longer be able to write to the array 7 Change other array attributes as required For more information about each attribute move the cursor to the attribute and press the Help key Chapter 6 Using the RAID Array Configurator 67 Deleting an SSA RAID Array This option allows you to delete arrays that you have created through the Add an SSA RAID Array option The deleted array is broken into its member disk drives You cannot delete arrays that do not have a corresponding hdisk 1 For fast path type smitty rmssaraid and press Enter Otherwise select Delete an SSA RAID Array from the SSA
435. uence Number 640 Machine Id 00400076C400 Node Id identity Class H Type PERM Resource Name ssaQ Resource Class adapter Resource Type ssa Location 04 07 The Type field can have the following flags PEND PERF PERM TEMP UNKN and INFO These flags are described in the using system documentation The PERM flag however is also described here because the SSA definition of the flag is slightly different from the AIX definition The PERM flag is used to log many SSA errors AIX defines the PERM flag as an error from which recovery is not possible For SSA devices the error although possibly permanent is not necessarily obvious to the customer The PERM flag is used here to ensure that when diagnostics are run in Problem Determination mode the SSA error log analysis runs and any problems that need service action are identified Detail Data Formats The Detail Data fields of SSA error logs use two data formats e SCSI Sense Data format SSA Error Code format SCSI Sense Data Format Errors that are logged with the following labels have SCSI sense data in the detail data field in the error log DISK_ERR1 SSA_DISK_ERR2 DISK_ERR4 SSA_DISK_ERR3 SSA_DISK_ERR1 SSA_DISK_ERR4 SCSI sense data consists of 32 bytes of data See find out how this data is used Chapter 10 SSA Error Logs 181 SSA Error Code Format Errors that are logged with the following labels have SSA error code data in the detail data field in the erro
436. ure SSA Serial Storage Architecture SSA is an industry standard interface that provides high performance fault tolerant attachment of I O storage devices In SSA subsystems transmissions to several destinations are multiplexed the effective bandwidth is further increased by spatial reuse of the individual links Commands are forwarded automatically from device to device along a loop until the target device is reached Multiple commands can be travelling around the loop simultaneously SSA retains the SCSI 2 commands queuing model and status and sense bytes The Advanced SerialRAID Adapters type 4 P The Advanced SerialRAID Adapters see Eigure 1 are 40 MB per second Serial Storage Architecture SSA Peripheral Component Interconnect PCI adapters that serve as the interface between systems that use PCI architecture and devices that use SSA These adapters provide support for two SSA loops Each loop can contain a maximum of eight pairs of adapter connectors and a maximum of 48 disk drives See Connector B2 H Green light H Green light O Connector A1 Connector B1 Type number label E Connector A2 i f a 4 P Figure 1 An Advanced SerialRAID Adapter Card Type 4 P BOL F MeV AK AA AA Qi q A 4 Advanced SerialRAID Adapters User and Maintenance Information Note In the SSA service aids this adapter is called IBM SSA 160 SerialRAID Adapter 14109100 The ada
437. ursor to desired item and press Enter List All Defined SSA RAID Arrays SSA Physical Disk Move cursor to desired item and press Enter Use arrow keys to scroll SSA physical disks which are members of arrays pdisk0 00022123DFHCOOD member n a 4 5G Physical d pdisk1 0004AC5119E000D member n a 1 1G Physical d pdisk2 0004AC5119E000D member n a 1 1G Physical d pdisk3 08005AEA003500D member n a 4 5G Physical d pdisk4 08005AEA030D00D member n a 2 3G Physical d pdisk5 08005AEA080100D member n a 4 5G Physical d pdisk7 08005AEA087A00D member n a 4 5G Physical d SSA physical disks which are hot spares pdisk6 08005AEA080800D spare n a 4 5G Physical d Fl Help F2 Refresh F3 Cancel F8 Image F1Q Exit Enter Do Find n Find Next J Using the arrow keys scroll the information until you find the list of SSA physical disks that contains the disk drive that you want to change Chapter 6 Using the RAID Array Configurator 143 4 Select the disk drive that you want to change or show The following screen is displayed for the disk drive that you have chosen C gt Change Show Use of an SSA Physical Disk Type or select values in entry fields Press Enter AFTER making all desired changes Entry Fields SSA RAID Manager ssaQ SSA physical disk pdisk6 CONNECTION address 08005AEAQ80800D Current use Hot Spare Disk Fl Help F2 Refresh F3 Cancel F4 List F5 Reset F6 Command F7 Edit F8 Image F9 Shel1 F1O Exit Enter Do If you are only checking t
438. ut the last write operation Because a nonblocking write operation might still be running you must ensure that the status information applies to a particular write operation The tm_get_stat structure in the usr include sys tmscsi h file is used to indicate the status as follows status_validity Bit O set scsi_status valid scsi_status SC_BUSY_STATUS Write operation in progress SC_GOOD_STATUS Write operation completed successfully SC_CHECK_CONDITION Write operation failed general_card_status Unused Set to zero b_error errno for a failed write operation or zero b_resid Updated uio_resid for the write operation resvd1 Unused Set to zero resvd2 Unused Set to zero Note The tm_get_stat structure works only for the initiator device Chapter 12 Using the Programming Interface 259 TMCHGIMPARM Change Parameters tmssa Device Driver ioctl Operation Purpose Description To allow the caller to change the retry parameter and the time out parameter that are used by the target mode device driver This operation allows the caller to change the default set up of the device It is allowed only for the initiator mode device The arg parameter to the TMCHGIMPARM operation contains the address of the tm_chg_im_parm structure that is defined in the usr include sys tmscsi h file Default values that are used by the device driver for the retry parameter and for the time out parameter usually do not require change For some
439. ute of an object for example to change the new array so that it does not automatically call a hot spare disk drive if one of its member disk drives goes into the Offline state Chapter 11 Using the SSA Command Line Interface for RAID Configurations 195 Type the command gt ssaraid H 1 ssaQ n hdisk5 a spare false where H specifies that this is a change operation n hdisk5 specifies that the object hdisk5 is about to be changed a spare specifies the new value for the spare attribute A list of user changeable attributes are available from FHot Spare Pool Creation and Example 8 To Exchange a Member Disk Drive of an Existing Array This example shows how to exchange a member disk drive of an existing array with a free pdisk for example to exchange pdiskO with pdisk3 Type the command gt ssaraid A 1 ssaQ i exchange n hdisk5 a old_member pdisk0 new_member pdisk3 where A specifies that this is an exchange operation n hdisk5 specifies that the array about to be changed a old_member specifies the name of the existing member disk new_member specifies the name of the new member disk drive If you give a List command in summary format a result similar to that shown here is displayed pdiskO 0004AC506C4000D free n a 4 5GB Physical disk pdiskl 0004AC506D6D00D member n a 4 5GB Physical disk pdisk2 0004AC50A44200D member n a 2 3GB Physical disk pdisk3 0004AC515EA400D member n a 4 5GB Physical disk hdisk5
440. ved if in each building a hot spare pool is created for the disk drives In Figure 18 all the disk drives in building 1 have been made members of pool A1 and all the disk drives in building 2 have been made members of Pool A2 A failure of a member disk drive in Pool A1 now causes pdisk1 to be selected as the hot spare disk drive Building 1 Building 2 Boal Pool A1 paaano POOLA pdisk3 A i A D D A A P P T E E R C A AN EP lt p iit pdisk10 pdisk9 pdisk8 T lt Primary Disks Secondary Disks Figure 18 Primary Disk in Building 1 Secondary Disks in Building 2 Pools Hot spare pools can be configured in other ways as shown in figures fol through bil 46 Advanced SerialRAID Adapters User and Maintenance Information Figure 19 shows how RAID 5 arrays can be protected against the complete failure of an SSA enclosure Each pdisk of each array hdisk is in a different SSA enclosure The hot spare disk drives are also in a different enclosure Pools A1 and A2 each contain an hdisk and a hot spare disk drive The pools ensure that if any one SSA enclosure fails completely three disk drives are always available for each hdisk POOLAT _ Pool A2 _ Enclosure 1 hdisk hdisk a kA JERISEEISE Enclosure 2 CI CA SGRISOEISE Enclosure 3 lt a FA GEEAE Enclosure 4 CORGA Figure 19 Pools and Hdis
441. ves the signal and the current read is returned another read operation can be started or the target can be closed If the read request that the calling program wants to break ends before the signal is generated the read operation ends normally and the signal is ignored The target mode device driver attempts to queue received data in front of requests from the application program A read ahead buffer area is used to store the queued data The length of this read ahead buffer is determined by multiplying the value of the RecvBufferSize attribute by the value of the RecvBuffers attribute These values are in the configuration database While the application program runs read subroutines the queued data is copied to the application data buffer and the read ahead buffer space is again made available for received data If an error occurs while he data is being copied to the caller data buffer the read operation fails and the errno global variable is set to EFAULLT If the read subroutines are not run quickly enough to fill almost all the read ahead buffers for the device data reception is delayed until the application program runs a read subroutine again When enough area is freed data reception capability is restored from the device Data might be delayed but it is not lost or ignored The target mode device driver controls only received data into its read entry point The read entry point can optionally be used with the select entry point to prov
442. witch This flag has support both for SSA logical disk drives and for SSA physical disk drives SSADISK_FORCED_OPEN Forces the open whether another initiator has the device reserved or not If another initiator has the device reserved the reservation is broken Otherwise the open operation runs normally This flag has support only for SSA logical disks You cannot specify this flag and the SSADISK_FENCEMODE flag together SSADISK_RETAIN_RESERVATION Retains the reservation of the device after a close operation by not issuing the release This flag prevents other initiators from using the device unless they break the using system reservation Note This flag does not cause the device to be explicitly reserved during the close if it was not reserved while it was open This flag has support only for SSA logical disk drives You cannot specify this flag and the SSADISK_FENCEMODE together SSADISK_NO_RESERVE Prevents the reservation of a device during an openx subroutine call to that device This operation is provided so a device can be controlled by two processors that synchronize their activity by their own software procedures This flag overrides the setting of the attribute reserve_lock if the value of the attribute is yes This flag has support only for SSA logical disk drives You cannot specify this flag and the SSADISK_FENCEMODE flag together SSADISK_SERVICEMODE Opens an SSA physical disk in service mode This flag wraps t
443. wn in this book If you are not familiar with the selection of items from the graphics versions of the menus use the smitty command The menus will then appear as shown in this book 2 If you use fast path commands you might need to go through intermediate steps that are not shown in this book Also some menus might be displayed slightly differently from those shown in this book 166 Advanced SerialRAID Adapters User and Maintenance Information Getting Access to the Fast Write Menus For fast path access to the Fast Write SMIT menus type smitty ssadlog and press 1 Type smitty and press Enter The System Management menu is displayed Enter Otherwise a b Select Devices The Devices menu is displayed c Select SSA Disks The SSA Disks menu is displayed d Select SSA Logical Disks 2 The SSA Logical Disks menu is displayed a SSA Logical Disks Move cursor to desired item and press Enter List All Defined SSA Logical Disks List All Supported SSA Logical Disks Add an SSA Logical Disk Change Show Characteristics of an SSA Logical Disk Remove an SSA Logical Disk Configure a Defined SSA Logical Disk Generate an Error Report Trace an SSA Logical Disk Show Logical to Physical SSA Disk Relationship List Adapters Connected to an SSA Logical Disk List SSA Logical Disks Connected to an SSA Adapter Identify an SSA Logical Disk Cancel all SSA Disk Identifications Enable Disable Fast Write for Multiple Devices
444. write cache is not empty Data is waiting to be written to another device This message is displayed Cannot be formatted because it is not empty e The adapter card does not provide support for the Fast Write Cache feature This message is displayed This adapter cannot be formatted pdisk Specifies the pdisk that you want to format I SSA_ Adapter Specifies the adapter whose Fast Write Cache Option Card you want to format 306 Advanced SerialRAID Adapters User and Maintenance Information b Specifies that the battery age counter be reset When this flag is used the data on the Fast Write Cache Option Card is not set to zero Important Do not select the b flag unless you have exchanged the battery Otherwise no error message will occur when the battery reaches the end of its life Output The ssa_format command sends all error messages to stderr Chapter 15 Using the SSA Command Line Utilities 307 ssa_getdump Command Purpose Syntax Description To display SSA adapter dump locations and to save the dump to a specified location For the List version of the command ssa_getdump 1 h d pdiskxx a AdapterName n AdapterUID s SlotNumber For the Copy version of the command ssa_getdump c h d pdiskxx a AdapterName n AdapterUID s SlotNumber x o OutputFile The ssa_getdump command has two modes of operation List mode and Copy mode List Mode In List mode the command searche
445. write operations 128 MB Memory Module Feature An optional 128 MB dual inline memory module DIMM feature is available This feature is recommended for two way fast write operations Chapter 1 Introducing SSA and the Advanced SerialRAID Adapters 5 Lights of the Advanced SerialRAID Adapters Each pair of connectors has a green light that indicates the operational status of its related loop Status of Light Meaning Off Both SSA connectors are inactive If disk drives or other SSA adapters are connected to these connectors either those disk drives or adapters are failing or their SSA links are not active Permanently on Both SSA links are active normal operating condition Slow Flash Only one SSA link is active Port Addresses of the Advanced SerialRAID Adapters The port addresses used in some SRNs that relate to these adapters can be numbers 0 through 3 They correspond to the port connectors on the SSA adapter Connector A1 Connector A2 Connector B1 Connector B2 ono nou ot SSA Adapter ID during Bring Up All adapters that can be used on RISC using systems generate a three digit configuration program indicator number During system bring up this indicator number appears on the three digit display of the using system The numbers are 80C Advanced SerialRAID Adapter type 4 P is being identified or configured 6 Advanced SerialRAID Adapters User and Maintenance Information Chapter 2 Introducing SSA Loo
446. xchanged for new disk drives the data is rebuilt and the array changes its state to the Good state Note The array can be used during the rebuilding operation Inform the user however that while the rebuilding operation is running the data is not protected against another disk drive failure The rebuilding operation runs more slowly if the array is being used Chapter 17 SSA Problem Determination Procedures 409 k When the rebuilding operation is complete ask the user to run diagnostics in System Verification mode to the SSA adapters to ensure that the rebuilding operation has not found any more problems Go to MAP repair Q to verify the 15 from step iE Does the Link Verification service aid indicate an open loop NO Go to step 6 YES 16 from step IE Does any SSA disk drive have its Check light on NO The disk drive might have been removed from the subsystem a eo 2095 YES eo a0 5 Reinstall the removed drive or select a new disk drive for addition to the array Type smitty ssaraid and press Enter Select Change Member Disks in an SSA RAID Array Select Swap Members of an SSA RAID Array Select the degraded hdisk Referring to the displayed instructions exchange the failed member for a new disk drive The Disk to Remove is listed as BlankReserved the Disk to Add is the disk drive that you reinstalled or selected in step ked When failed disk drives have been exchanged for
447. y a hot spare disk drive that is in the same pool If the spare_preferred is set to false this member disk drive if it fails can be replaced by a hot spare that is in any pool Hot Spare Pool Creation and Change Attribute You can specify the following attribute with the a option when you are using the ssaraid command with the C or H option to create or change a hot spare pool minimum_spares default 0 This attribute determines the minimum number of hot spare disk drives that must be in this hot spare pool to prevent a hot spare pool error from being logged 202 Advanced SerialRAID Adapters User and Maintenance Information Physical Disk Drive Change Attributes You can specify the following attributes with the a option when you are using the ssaraid command with the H option to change a physical disk drive use system spare free With the attribute set to system The physical disk drive can be used directly by the AIX operating system If you specify also the d option a corresponding AIX hdisk device is created for the physical disk drive With the attribute set to spare The physical disk drive becomes a hot spare disk drive It is therefore available for addition to any arrays on the RAID manager that are in the Exposed state Specify also the u option to ensure that no corresponding AIX hdisk device exists for the physical disk drive With the attribute set to free The physical disk drive has no use assigned to
448. y of the data that is on the primary disk drive If however you use a program that attempts to read data from the array before it has written any data to that array the data that it reads might not be consistent The data can be from either the primary disk drive or from the secondary disk drive which at this time are not mirrored copies of each other If you use such a program use the Initial Rebuild option If you select no for this option any data that your program writes to the array is mirrored Any data that your program reads from the array however might not be consistent because it might not have been written previously by this particular program Chapter 6 Using the RAID Array Configurator 65 If you select yes for this option the array enters the Rebuilding state The data that is on the primary disk drives is copied to the secondary disk drives This operation might take several hours to complete during which time performance is affected Enable Fast Write Switches the fast write cache on or off This facility is not available on adapter cards that do not or cannot have a fast write cache installed 4 Move the cursor to the appropriate disk field that is Member Primary or Secondary and press the List key to display a list of candidate disk drives 5 If candidate disk drives are available a list of those disk drives is displayed in a window Add an SSA RAID Array A Type or select values
449. yed c Select SSA Adapters The SSA Adapters menu is displayed a SSA Adapters D Move cursor to desired item and press Enter List All SSA Adapters Change Show Characteristics of an SSA Adapter Generate Error Report Trace an SSA Adapter Change Show the SSA Node Number for this System List All SSA Adapter Dumps Copy an SSA Adapter Dump F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel 1 F1O Exit Enter Do If you need help with an item move the cursor to that item and press F1 Help 39 Getting Access to the SSA Disks SMIT Menu 1 For fast path access to the SSA RAID Array SMIT menus type smitty ssad and press Enter Otherwise a Type smitty and press Enter The System Management menu is displayed b Select Devices The Devices menu is displayed c Select SSA Disks The SSA Disks menu is displayed a SSA Disks D Move cursor to desired item and press Enter SSA Logical Disks SSA Physical Disks F1 Help F2 Refresh F3 Cancel F8 Image F9 Shel F1O Exit Enter Do XX Select the type of SSA disk on which you want to work e SSA logical disks are configured into the using system as hdisks SSA hdisks can be single disk drives or SSA RAID arrays e SSA physical disks are configured into the using system as pdisks SSA pdisks are used for service and configuration operations 3 If you select SSA Logical Disks go to step 4 on page 411 If you select SSA Physical Disks go to step Bon
450. ysical Serial Adapter Port Al A2 B1 B2 Status TOP systemname pdisk11 AC50AE43 0 Good systemname pdisk8 AC706EA3 1 Good systemname pdisk2 AC1DBE11 Good systemname pdisk3 AC1DBEF4 3 Good systemname pdisk7 AC50AE58 4 Good systemname pdisk12 AC7C6E51 5 Good systemname pdisk0 AC706E9A 6 Good systemname pdisk1l AC1DEEE2 7 Good 22222 MORE 8 F3 Cancel F10 Exit Note that the column for adapter connector A2 shows no connections 354 Advanced SerialRAID Adapters User and Maintenance Information Example 3 Broken Loop Disk Drive Removed In Figure 51 on page 356 disk drives 1 through 8 are connected to connectors A1 and A2 of the SSA adapter fJ but the loop is broken because disk drive number 3 has been removed Disk drives 9 through 12 are connected to connectors B1 and B2 of the same SSA adapter Disk drives 13 through 16 are connected to connectors A1 and A2 of a different SSA adapter H Although the missing disk drive is reported as an error all the remaining disk drives can still communicate with the using system Disk drives 1 and 2 can communicate through connector A1 of the SSA adapter J Disk drives 4 through 8 can communicate through connector A2 of the SSA adapter Disk drives 9 through 12 can communicate through connectors B1 and B2 of the same SSA adapter normal loop disk drives 13 through 16 can communicate through connectors A1 and A2 of the SSA adapter H Chapter 16 SSA Service Aids 355 eel
451. ystem Using the command in this mode you can check the level of microcode on the SSA disk drives that are connected to the system Notes 1 The microcode files that this command can download have names of the pattern ssadisk ros XXXX where XXXX identifies the microcode level also known as the ROS id that the file contains Such microcode files are different from those with names of the pattern ssadisk XXXXXXX YY These files contain a different type of disk microcode and are automatically downloaded by the system configuration software as necessary They cannot work with the ssadload command 2 Microcode can be downloaded to SSA disk drives while the system is using those disk drives You need not vary off any volume groups that contain the disk drives If the microcode is downloaded to a disk drive that AIX is using the system might be delayed slightly while the microcode is downloading 3 The microcode images are stored in the etc microcode directory Attention Usually you can download the microcode to disk drives that are in use By doing so however you might cause a temporary delay in the AIX operating system or in the user s application program Do not download microcode to a disk drive that is in use unless you have the user s permission Always refer to the download instructions that are supplied with the microcode and check for any special restrictions that might be applicable If you are not sure do not download t

User's Guide and Maintenance Information

Contents

Download Pdf Manuals

Related Search

Related Contents