Home

PCI Expansion Unit for Fujitsu M10/SPARC M10 Systems Service

image

Contents

1. BB1 PCI1 PCIE PCIE13 iodoml OCC BB1 PCI2 PCIE PCIE13 iodoml EMP BB1 PCI5 PCIE PCIE14 primary EMP BB1 PCI6 PCIE PCIE14 primary EMP BB1 PCI9 PCIE PCIE15 primary EMP BB1 PCI10 PCIE PCIE15 primary EMP ssSs Omitted lt BB1 CMUL NETO IOVNET PFO PF PCIE8 primary BB1 CMUL NETO IOVNET PFI PF PCIE8 primary BB1 PCIO SLOT1 IOVNET PFO PF PCIE9 iodoml BB1 PCIO SLOT1 IOVNET PF1 PF PCIE9 iodoml BB1 PCIO SLOTI IOVNET PF2 PF PCIE9 iodoml BB1 PCI0 SLOT1 IOVNET PF3 PF PCIE9 iodoml BB1 PCI0 SLOT3 IOVNET PFO PF PCIE9 iodoml BB1 PCI0 SLOT3 IOVNET PF1 PF PCIE9 iodoml BB1 CMUL NET2 IOVNET PFO PF PCIEB12 primary BB1 CMUL NET2 IOVNET PFI PF PCIB12 primary BB1 PCIO SLOT3 IOVNET PFO VFO VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PFO VE VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PFO VF2 VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PFO VF3 VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PFO VF4 VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PF1 VFO VE PCIE sr iodomain BB1 PCIO SLOT3 IOVNET PF1 VE VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PF1 VF2 VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PF1 VF3 VE PCIE9 sr iodomain BB1 PCIO SLOT3 IOVNET PF1 VF4 VE PCIE9 sr iodomain 8 Execute the Idm list io command to check whether the SR IOV function is in use If there is a line on which VF is displayed in TYPE of the above output result the SR IOV function is in use T
2. 1 2 3 18 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Location Component number 1 Power supply unit 2 Link board 3 PCI Express PCle card The link board can be mounted only in its dedicated slot Connecting the link board to the link card Connect the link board mounted in the PCI expansion unit to the link card mounted in the SPARC M10 1 M10 4 M10 45 with the link cables and the management cable Figure 2 3 shows an example of the connection of the link board and the link card Figure 2 3 Example of connection PCI expansion unit r Link board Lt Mounted as standard PCI Express slot PCI Express slot Link cable PCI Express slot PCI Express slot Link card PCI Express slot PCI Express slot Management cable PCI Express slot PCI Express slot PCI Express slot PCI Express slot PCI Express slot PCI Express slot Internal components Note To access internal components remove the PCI tray from the PCI expansion unit For details on the procedure for removing the PCI tray see 14 4 Removing the PCI Tray Chapter 2 Understanding the PCI Expansion Unit Components 19 Figure 2 4 Locations of internal components Location Component number 1 PCI tray 2 T O board 3 PSU backplane 4 Fan backplane 2 2 Checking the Status with the LED This section describes how to identify the state of each component from it
3. 1 Open the rack door 2 Loginto the XSCF shell 3 Execute the showlogs command to identify the fan unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive hot maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the fan unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs Chapter 13 Maintaining the Fan Units 201 For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 13 3 4 Inactive cold mainte
4. XSCF gt showlogs error For details see 3 3 4 Checking log information Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Inactive cold maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information Chapter 7 Maintaining the PCI Express Cards 107 1 3 9 7 3 5 ha g D Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note In the case of a dual power feed record the positions of the power cords before removing them to ensure that they are reinstalled correctly System stopped hot maintenance Open the rack door Log in to the XSCF s
5. 11 2 1 Before Maintaining the Management Cable This section describes the maintenance types and flow for the management cable Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work Types of maintenance Table 11 1 lists the types of maintenance for the management cable For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration 172 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 11 1 Types of maintenance for the management cable Not maintainable Connection Active hot Active cold Inactive hot Inactive cold System System destination stopped hot stopped cold SPARC M10 1 Enabled Enabled Configuration Enabled 1 Enabled 1 Enabled Enabled of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 2 Enabled 2 Enabled Enabled Enabled Enabled 1 Tt is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabl
6. Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity Accessing the link board 1 Remove the two link cables and one management cable connected to the link board requiring maintenance Note Record the positions of the cables before removing them to ensure that they are reinstalled correctly Note Remove the link cable electrical or link cable optical by holding the tab A in the figure of the cable and pulling it straight toward the cable itself At this time do not hold the cable part when pulling out the crossbar cable Pulling the cable part without the connector lock completely released may cause damage Chapter 8 Maintaining the Link Board 131 Figure 8 2 Removing the link cable A 2 Remove the PCle card cassette For details see 7 4 2 Removing a PCI Express card cassette 8 4 2 Removing the link board 1 While holding down the cover stopper lift the cover away 132 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 8 3 Cover stop 2 Remove the screw securing the PCle card cassette and then remove the bracket of the link board Chapter 8 Maintaining the Link Board 133 Figure 8 4 Removing the bracket 3 Remove the link board from the PCle
7. Figure 5 1 Removing the cable clamp 2 Remove the power cord from the power supply unit Figure 5 2 Removing the power cords 5 4 2 Removing the front cover To perform maintenance on a component on the front panel or inside the chassis remove the front cover 1 Release the slide locks on both the left and right sides of the front cover and Chapter5 Understanding the Preparations for Enabling Maintenance 77 then remove the front cover Figure 5 3 Removing the front cover 78 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 6 Understanding the Preparations for Restoring the System This chapter describes the procedures for restoring the system after component maintenance See this chapter as required when performing maintenance on each component described in Chapter 7 onwards Mounting the Link Card on the Server Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Starting the Entire System Restoring the chassis of the PCI expansion unit 6 1 6 1 1 Mounting the Link Card on the Server This section describes the procedure for mounting a link card on the system The link card is mounted on the system using either of the following methods Using PHP and using physical partition dynamic reconfiguration DR Mounting the link card on the server using PHP This section describes
8. review this section 0 ok printenv boot device pci 8000 pci 4 pci 0 pci 0 scsi 0 disk p0 0 boot device 12 Execute the poweroff command of the XSCF firmware to turn off the power to the physical partition XSCF gt poweroff p 0 13 In accordance with the model in use restore the configuration information of the logical domain from the XML file For the SPARC M10 1 When updating from the firmware version XCP2043 or earlier to the firmware version XCP2044 or later in the system with the PCI expansion unit restore the configuration information of the logical domain from the XML file in step 14 and later For details on the firmware update see the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide For the SPARC M10 4 M10 4S When executing the setpciboxdio command to change the enable disable setting for the direct I O function of the PCI expansion unit restore the 12 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 configuration information of the logical domain from the XML file in step 14 and later For details on the setpciboxdio command see the Fujitsu M10 SPARC M10 Systems XSCF Reference Manual 14 Execute the showdomainconfig command of the XSCF firmware to confirm that the configuration information at the next startup of the physical partition is the factory default The following example shows that the configuration information at the next sta
9. Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Log in to the XSCF shell 166 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 10 6 3 10 6 4 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0
10. Close the rack door Inactive cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Moon answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door System stopped hot maintenance Execute the ioxadm command to turn off the CHECK LED of the PCI 208 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 13 6 6 expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4
11. Figure 1 4 Removing power cords 1 7 Important Information about the XCP Firmware This section describes important information that you should know about the XCP firmware version and when connecting the PCI expansion unit 6 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 12 1 1 7 2 Precautions for updating the XCP firmware SPARC M10 1 The logical domain configuration of the physical partition will return to the factory default at the next startup when any of the following conditions are met If the logical domain configuration contains a guest domain the OpenBoot PROM environment variable of the control domain will also be initialized When an update is performed from firmware version XCP2043 or earlier to firmware version XCP2044 or later in a configuration with a PCI expansion unit connected When a PCI expansion unit is installed or removed from a system with a firmware version that is XCP2044 or later Save the logical domain configuration information from Oracle Solaris to XML in advance To save it to XML execute the Idm list constraints x command and to restore it from XML execute the ldm init system i command Also save the setting information for the OpenBoot PROM environment variable of the control domain to the notepad and then reset it To display it execute the printenv command while the ok prompt is displayed For details on these procedures see 1 7 3 How to
12. XSCF gt showlogs error For details see 3 3 4 Checking log information Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Inactive cold maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance 162 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 10 3 5 10 3 6 P a a XSCF gt showlogs error For details see 3 3 4 Checking log information Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped hot maintenance
13. XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 4 Close the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry Chapter 10 Maintaining the Link Cables 167 The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the P
14. Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance Chapter 10 Maintaining the Link Cables 161 10 3 3 10 3 4 XSCF gt showlogs error For details see 3 3 4 Checking log information Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance
15. Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System 9i D Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off mM Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note In the case of a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly 11 4 Removing the Management Cable This section describes the procedure for removing the management cable Enable removal of the management cable before attempting to remove it For details see 11 3 Enabling the Removal of the Management Cable Chapter 11 Maintaining the Management Cable 177 Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity 1 Push the latch lock of the ma
16. Hot Chapter4 Preparing for Maintenance 39 40 System stopped hot maintenance Maintenance is performed while all physical partitions on the system are powered off The power cord of the PCI expansion unit requiring maintenance remains connected The following FRUs of the PCI expansion unit are subject to system stopped hot maintenance PCle card Link board Power supply unit and fan unit Link cable and management cable Figure 4 3 System stopped hot maintenance Single chassis configuration Physical partition stopped SPARC M10 1 M10 4 expansion unit M10 4S Hot Hot PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 System stopped cold maintenance Maintenance is performed while all physical partitions on the system are powered off The power cord of the PCI expansion unit requiring maintenance has been disconnected The following FRUs of the PCI expansion unit are subject to system stopped cold maintenance All FRUs Figure 4 4 System stopped cold maintenance Single chassis configuration Physical partition stopped PCI expansion unit Cold The maintenance types that can be used for each FRU are as follows The maintenance type depends on the type of the server that is a destination of the PCI expansion unit Table 4 4 Whether supported when the connection destination is SPARC M10 1 Not maintainable FRU Active hot System System Reference sto
17. connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Log in to the XSCF shell 138 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 6 3 8 6 4 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 4 Close the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expans
18. ioxadm list PCIBOX Link PCIBOX 1007 PCIBOX 1006 PCIBOX 1005 PCIBOX 1004 BB 00 PCI 10 BB 00 PCL 09 BB 00 PCIL 08 BB 00 PCL 07 XSC PCI PCI PCI PCI POL PCI 264 BOX 2007 BOX 2007 1I0B BOX 2007 PSU 0 BOX 2007 PSU 1 Execute the ioxadm v list command to check the serial number and the firmware version of the PCI expansion unit Location displays the last four digits of the serial number of the PCI expansion unit and FW Ver displays the firmware version of the link card CARD shown on Type and that of the I O board IOBOARD shown on Type The following example shows that 2007 is the last four digits of the serial number of the PCI expansion unit and 1080 is the firmware version of the link card and the I O board F gt ioxadm v list Location Serial Num Part Num PZ21242007 FEJD1212000521 CA01022 0750 D 7060988 FEJD1201000738 CA01022 0750 D 7060988 Type FW Ver PCIBOX PSU z PSU BOX 2007 LINKBD BOX 2007 FANBP BB 00 PCI 10 A firmware version is displayed as a four digit release number in xyyz format Each release number is indicated in xyyz format as follows IOBOARD 1080 BOARD FANBP CARD 1080 PP12470297 PP1244027P PP12470298 PP124401L2 x Major release number yy Minor release number z Micro release number CA20365 B66X CA20365 B60X CA20365 B68xX CA20365 B59X 010AJ 7061033 001AA 7061035 005AD 7061025 001AA 7061040
19. packages pci 8100 pci 4 pci 8100 pci 4 pci d pci 8100 pci 4 pci 0 pcie9 pci 8100 pci 4 pci 0 pci l pci 8100 pci 4 pci 0 pcitd lon DUMM MMM oOoOreNURAOAOCANOGO WOM Chapter 3 Troubleshooting 31 pci 8100 pci 4 pci 0 pci 0 network 0 1 pci 8100 pci 4 pcit 0 pci 0 network 0 pci 8000 pci 4 pci 8000 pci 4 pci d pci 8000 pci 4 pci 0 pcits pci 8000 pci 4 pci 0 pcit2 pci 8000 pci 4 pci 0 pci l pci 8000 pci 4 pci 0 pcitd pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci pci 8000 pci 4 pci 0 pci 8 pci FJSV eulsa 0 pci 8000 pci 4 pci 0 pci 8 pci FISV eulsa 0 tape pci 8000 pci 4 pci 0 pci 8 pci FJSV eulsa 0 disk pci 8000 pci 4 pci 0 pci 2 pci pci 8000 pci 4 pci 0 pci 2 pci pci 8000 pci 4 pci 0 pci 2 pci 0 0 pci 0d 0 pci 0 pci d 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci
20. s 00 0 Chapter 12 Maintaining the Power Supply Units 193 12 6 4 12 6 5 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs XSCF gt ioxadm locator off PCIBOX 12B4 Close the rack door Inactive cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For de
21. see 13 5 1 Installing a fan unit Install the front cover For details see 6 4 2 Installing the front cover Install all the components listed below Power supply unit For details see 12 5 Installing a Power Supply Unit Chapter 15 Maintaining the I O Board 233 PCle card cassette For details see 7 5 2 Installing a PCI Express card cassette 15 6 Restoring the System This section describes the procedure for restoring the system after I O board installation The restoration procedure differs depending on the maintenance type as follows Mounting the link card on the server using PHP Inactive cold maintenance System stopped cold maintenance 15 6 1 Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S Mounting the link card on the server using PHP 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Mount the link card on the server using PH
22. 008AG LINKBOARD Status Normal Serial PP1234026P FRU Part Number CA20365 B60X OO1AA Name_Property ethernet Vendor ID 1077 Device ID 8000 Subsystem _Vendor ID 1077 Subsystem ID 017e Model 6 3 1 Starting the system with the XSCF command 1 Execute the poweron command For the confirmation message enter y XSCF gt poweron a PPAR IDs to power on 00 01 Continue y n ty 00 Powering on 01 Powering on 90 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 6 5 2 Starting the system from the operation panel 1 Press the power switch on the operation panel for 1 second or more less than 4 seconds For details see 2 2 2 Control function of the operation panel in the Fujitsu M10 1 SPARC M10 1 Service Manual or the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual 6 4 Restoring the chassis of the PCI expansion unit This section describes how to restore the chassis of the PCI expansion unit The procedure for restoring a chassis depends on the components that have been maintained 6 4 1 Installing the power cords If the power cords were removed to perform maintenance reinstall the power cords in the PCI expansion unit and then secure them with the cable clamp 1 Install the power cords to the the power supply unit of the PCI expansion unit Figure 6 1 Installing the power cords 2 Clip the power cords with the cable clamp and secure th
23. 1 unless otherwise specified Figure 7 2 Types of PCle card cassette Type 1 Type 2 1 Raise the lever B in the figure while pressing the latch A in the figure of the PCle card cassette 110 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 7 3 Latch and lever of the PCle card cassette 2 Hold the lever and carefully pull the PCle card cassette out of the PCle slot Note Place the removed PCle card cassette on the grounded ESD mat to ground any static electricity Figure 7 4 Removing the PCle card cassette Chapter 7 Maintaining the PCI Express Cards 111 7 4 3 Removing a PCI Express card 1 While pressing the cover stop remove the cover Figure 7 5 Cover stop 2 Remove the screw securing the PCle card cassette and remove the bracket of the PCle card 112 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 7 6 Removal of bracket 3 Remove the PCle card from the PCle card cassette For expansion you do not have to perform this step Remove the filler unit for the PCIe card from the PCIe card cassette Note Do not forcibly remove the PCIe card from the PCIe card cassette If excessive force is used to remove the PCle card it may be damaged Note Place the removed PCle card on a grounded antistatic ESD mat Chapter 7 Maintaining the PCI Express Cards 113 Figure 7 7 PCIe card removal 1 5 15 1 Inst
24. 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry x The following example shows the diagnosis of system board 00 0 lt 1 XSCF gt testsb y s 00 0 Chapter 12 Maintaining the Power Supply Units 195 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Start the entire system For details see 6 3 Starting the Entire System 5 Close the rack door 196 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 13 Maintaining the Fan Units This chapter describes the maintenance procedure for the fan units 13 1 Configuration of the Fan Units Before Maintaining a Fan Unit Enabling the Removal of a Fan Unit Removing a Fan Unit Installing a Fan Unit Restoring the System Configuration of the Fan Units This section describes the configuration and the locations of the fan units A PCI expansion unit has three fan units for cooling the components in the chassis If one fan unit fails while the sys
25. 19 25 After restoring the configuration information execute the Idm add spconfig command to save the configuration information to the XSCF In the following example the configuration information of test1 has been saved to the XSCF ldm add spconfig test1 ldm 1ls spconfig factory default testl current 26 If there are multiple pieces of configuration information to be restored restore all of them Repeat from step 14 to step 25 to restore the configuration information 16 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 2 Understanding the PCI Expansion Unit Components This chapter describes the components of the PCI expansion unit Before starting any maintenance work check and understand the configuration of the components and the LED indications Identifying the Names and Locations of Components m Checking the Status with the LED For the specifications of each component see Appendix B Component Specifications 2 1 Identifying the Names and Locations of Components This section describes the names and locations of each component Components that can be accessed from the front Figure 2 1 Location of components that can be accessed from the front Location Component number 1 Fan unit Components that can be accessed from the rear Figure 2 2 Location of components that can be accessed from the rear
26. 199 13 3 Enabling the Removal of a Fan Unit 200 13 3 1 Active hot maintenance 200 13 3 2 Active cold maintenance 201 13 3 3 Inactive hot maintenance 201 13 3 4 Inactive cold maintenance 202 13 3 5 System stopped hot maintenance 202 13 3 6 System stopped cold maintenance 203 13 4 Removing a Fan Unit 203 13 4 1 Accessing a fan unit 204 13 4 2 Removing a fan unit 204 13 5 Installing a Fan Unit 205 13 5 1 Installing a fan unit 205 13 5 2 Restoring the chassis 206 13 6 Restoring the System 206 13 6 1 Active hot maintenance 206 13 6 2 Active cold maintenance 207 13 6 3 Inactive hot maintenance 207 13 6 4 Inactive cold maintenance 208 13 6 5 System stopped hot maintenance 208 13 6 6 System stopped cold maintenance 209 Chapter 14 Maintaining the PCI Tray 211 14 1 Configuration of the PCI Tray 211 14 2 Before Maintaining the PCI Tray 212 14 2 1 Types of maintenance 212 14 2 2 Maintenance flow 213 14 3 Enabling the Removal of the PCI Tray 213 14 3 1 Active cold maintenance 214 14 3 2 Inactive cold maintenance 214 14 3 3 System stopped cold maintenance 215 14 4 Removing the PCI Tray 216 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 14 4 1 Accessing the PCI tray 216 14 4 2 Removing the PCI tray 216 14 4 3 Removing the components of the PCI tray 218 14 5 Installing the PCI Tray 218 14 5 1 Installing the components of the PCI tray 218 14 5 2 Installing the PCI tray 218 14 5 3 Restoring the chassis 218 14 6 Re
27. Also see the contents of Chapter 1 Before Starting Maintenance Work Types of maintenance Table 10 1 lists the types of maintenance for the link cables For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration 158 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 10 1 Connection destination SPARC M10 1 Configuration of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 2 Active hot Enabled 1 Types of maintenance for the link cables Active cold Inactive hot Enabled 1 Enabled 2 Enabled Inactive cold Enabled System stopped hot Enabled Enabled Enabled Not maintainable System stopped cold Enabled Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 10 2 2 10 2 3 Maintenance flow Table 10 2 lists the sequence of the
28. Enabling Maintenance 59 displayed with the idm list io l command to check the physical location c Suppose that steps a and b indicate that there is a virtual network switch to which the PCle card requiring maintenance is assigned While referring to the PEER section of the virtual network switch indicated in step a check the virtual network device and guest domain that use the service of that virtual network switch The display format is lt virtual network device gt lt guest domain gt For the SAS or FibreChannel card a Execute the Idm list bindings command in the control domain to check the virtual disk backend DEVICE value assigned to the virtual disk service from among virtual disk service VDS information For the types assigned to the virtual disk backend see Virtual Disk Back End in the Oracle VM Server for SPARC Administration Guide The following example specifies rootdom which is the name of the logical domain to which the PCle card is assigned ldm list bindings rootdom VOLUME OPTIONS MPGROUP DEVICE vds0 vol0 export vdisks vdisk img 1 voll dev zvol dsk rpool zvdiskl vol2 dev dsk CxtxxxxxXXXXXXXXXXXXAXSX CLIENT VOLUME vdiskl guestl vol0 2 vdisk2 guest2 voll vdisk3 guest3 1 Virtual disk backend 2 Names of the virtual disk and guest domain to which the vol0 backend is assigned b Log in to the logical domain to which the PCle card is assigned identify the physical disk
29. Execute the Idm list domain command to check the operation status of the logical domain The following example shows that STATE of the control domain two guest domains two root domains one I O domain PCIe and one I O domain SR IOV is displayed as active indicating that the logical domains are operating ldm list domain NAME STATE MEMORY UPTIME primary active 56G 25m guest0 active 16G i 25m guestl active 16G s 25m iodom0 active 64G 25m iodom1 active 64G g 25m sdiodomain active 8G 25m sr iodomain active 8G r 25m 6 Execute the Idm list devices a command to check the resource use status ldm list devices a CORE ID SFREE CPUSET 0 O 1 4 0 8 9 8 0 LG 17 S SS Ss 2 gt S5 S5 Omitted 184 0 368 369 188 100 376 377 512 100 1024 1025 516 100 1032 1033 520 100 1040 1041 524 100 1048 1049 Pease Sse S Omitted VCPU PID SFREE PM 0 0 no 1 0 no 8 0 no 9 0 no SSS S SS5 S 6S SS gt 5 Omitted 369 0 no Chapter 5 Understanding the Preparations for Enabling Maintenance 65 7 Execute the Idm list io command to check the use status of the I O devices Check the domain to which the I O device is assigned The following example shows that PCIEO to PCIE15 in NAME are all displayed as BUS in TYPE indicating the PCIe root complexes Moreover DOMAIN displays primary io
30. For details see Making the link card ready to be released 5 Execute the cfgadm 1M command to cause the locator LED of the link card to blink so that you can locate the card Enter the Ap_ID of the link card that you noted in advance cfgadm x led attn mode blink Ap ID 6 Check the following LEDs to determine whether the PCle card requiring maintenance is actually maintainable The ATTENTION LED amber of the PCI card slot is blinking The POWER LED of the PCI card slot is off 11 3 2 Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 174 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 11 3 3 11 3 4 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the management cable requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server 5 Check the following LEDs to determine whether the PCI expansion unit requiring mainten
31. Fujitsu M10 SPARC M10 Systems Service Manual December 2014 13 3 6 XSCF gt ioxadm locator on PCIBOX 12B4 5 Stop the entire system For details see 5 3 Stopping the Entire System System stopped cold maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the fan unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information PA Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System 9i a Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off N Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 13 4 Removing a Fan Unit This section describes the procedure for removing a fan unit Enable the removal of the fan unit before attempting to remove it For details
32. IOV feature is used Execute the following procedure a Place the root domain to which PF is assigned in delayed reconfiguration mode ldm start reconf lt root domain name gt b Execute the Idm create vf command to create the virtual function ldm create vf lt PF name gt c Execute the Idm add io command to assign the virtual function to the I O domain ldm add io lt VF name gt lt I O domain name gt d Log in to the root domain and then restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y 13 Suppose that you have deleted the virtual device and virtual service in Making the link card ready to be released Based on the information you have written down add a virtual device and virtual service and then reassign them to the guest domain For details on how to add the virtual device and virtual service see the Oracle VM Server for SPARC Administration Guide 14 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the disabled state svcadm disable hotplug 82 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 6 1 2 Mounting the link card on the server using physical partition dynamic reconfiguration DR This section describes the procedure for mounting the chassis containing the link card on the physical partition by using physical partition dynamic reconfiguration DR For details on
33. Idm remove io command to delete the virtual function VF assigned to the I O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCIe card delete all the VFs corresponding to that PF from the I O domain ldm remove io lt device name gt lt I O domain name gt d Place the root domain to which PF is assigned in delayed reconfiguration mode ldm start reconf lt root domain name gt e Execute the ldm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created 62 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 ldm destroy vf lt VF name gt f Log in to the root domain and then restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y Releasing the link card using PHP 1 If the link card and PCle card requiring maintenance belong to the root domain connect to the console of the root domain If they belong to the control domain this step is not necessary since the control domain console is used 2 Display the Oracle Solaris super user prompt Note Execute this as a super user 3 If the hotplug service is disabled execute the svcadm enable hotplug command to enable the hotplug service svcadm enable hotplug 4 Execute the cfgadm a command to check and write down Ap_ID of the PCle card and link card mo
34. PHP 1 Login to the XSCF shell 2 Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 3 Check the hardware and software configurations For details see Confirming the System Configuration in the Fujitsu M10 1 SPARC M10 1 Service Manual or the Fujitsu M10 4 Fujitsu M10 45 SPARC M10 4 SPARC M10 4S Service Manual 4 Execute the idm list io I command to check the logical domain to which the PCle card requiring maintenance is assigned and the logical domain to which the PCle root complex to which that PCle card belongs is assigned ldm list io 1 NAME TYPE BUS DOMAIN STATUS PCIEO BUS PCIEO primary pci 8s8000 PCIE1 BUS PCIE1 primary lt 1 pci 8100 PCIE2 BUS PCIE2 primary IOV lt 2 pci 8200 PCIE3 BUS PCIE3 rootdom lt 3 pci 8300 PCIE4 BUS PCIE4 primary pci 8400 PCIE5 BUS PCIE5 primary IOV pci 8500 PCIE6 BUS PCIE6 rootdom IOV lt 4 pci 8600 PCIE BUS PCIE7 primary IOV pci 8s8700 BBO CMUL NETO PCIE PCIEO primary OCC pci 8000 pcit 4 pci 0 pcie 9 network 0 network 0 1 BBO CMUL SASHBA PCIE PCIEO primary OCC pci 8000 pci 4 pci 0 pci 0 scsi 0 iport f disk w50000393a82368b2 0 scsi 0 iport f smp w500000e0e06d03bf scsi 0 iport f enclosure w500000e0e06d03bd 0 scsi 0 iport v0 BBO PCIO PCIE PCIEL primary OCC lt 5 pci 8100 pci 4 pci 0 pcitd BBO PCI
35. System stopped cold maintenance a Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link board requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information PA Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 i Stop the entire system For details see 5 3 Stopping the Entire System a Check whether the PCI expansion unit requiring maintenance is actually maintainable from the LED status on that unit The LED of the link board is off The LED of the PCI card slot is off oT Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 130 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 4 A 8 4 1 Removing the Link Board This section describes the preparations that must be completed prior to removing the link board Enable removal of the link board before attempting to remove it For details see 8 3 Enabling the Removal of the Link Board
36. Table 16 2 Maintenance flow Details of update process 1 Preparation 2 Fan backplane removal 3 Fan backplane installation 4 Restoring the system Chapter 16 Replacement 16 3 16 4 16 5 16 6 Maintaining the Fan Backplane 241 16 3 16 321 Enabling the Removal of the Fan Backplane This section describes the steps that must be completed prior to removing the fan backplane The preparation procedure differs depending on the maintenance type as follows Active cold maintenance Inactive cold maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method using physical partition dynamic reconfiguration DR can be applied only when the destination has the SPARC M10 4S building block configuration Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the fan backplane requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from th
37. advance cfgadm c configure Ap ID Chapter 7 Maintaining the PCI Express Cards 117 3 Execute the cfgadm 1M command to confirm that the PCle card requiring maintenance has been incorporated into the logical domain In the following example the Receptacle is displayed as connected and the Occupant as configured indicating that the PCle card requiring maintenance is incorporated into the logical domain cfgadm a Ap_Id Type Receptacle Occupant Condition BB 0 PCI 0 pci pci hp connected configured ok 4 If necessary execute the svcadm disable command to disable the hotplug service svcadm disable hotplug g Log in to the XSCF shell 6 Execute the showstatus command to check that the replaced PCle card is operating normally Nothing is displayed if it is normal XSCF gt showstatus 7 Execute the showhardconf command to check the hardware configuration and the status of each component XSCF gt showhardconf 8 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 so Connect to the control domain console of the physical partition p 0 Suppose that the assignment to the I O domain by use of the direct I O function has been deleted in Making the PCle card ready to be released Based on the retained output result of the Idm list io command perform the rea
38. automatically Woo answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Start the entire system For details see 6 3 Starting the Entire System 4 Close the rack door 8 6 6 System stopped cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords 140 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Start the entire system For details see 6 3 Starting the Entire System 5 Close the rack door Chapter8 Main
39. before removing them to ensure that they are reinstalled correctly 226 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 15 4 A 15 4 1 15 4 2 Removing the I O Board This section describes the procedure for removing the I O board Enable the removal of the I O board before attempting to remove it For details see 15 3 Enabling the Removal of the I O Board Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity Accessing the I O board 1 Pull the following components out halfway Power supply unit For details see 12 4 Removing a Power Supply Unit PCle card cassette For details see 7 4 2 Removing a PCI Express card cassette 2 Remove the front cover For details see 5 4 2 Removing the front cover 3 Remove all the fan units For details see 13 4 2 Removing a fan unit 4 Remove the PCI tray For details see 14 4 2 Removing the PCI tray Removing the I O board 1 Remove the six cables connected to the I O board Note Record the positions of the cables before removing them to ensure that they are reinstalled correctly Chapter 15 Maintaining the I O Board 227 Figure 15 2 T O board cables 2 Loosen the two screws securing the I O bo
40. can be recognized from the XSCF The PCI expansion unit is displayed when executing the ioxadm command The control domain to which the PCI expansion unit is connected is started and runs until the OpenBoot PROM state is set Be sure to check the firmware version before replacing a link card or I O board The link card and I O board contain the PCI expansion unit firmware The firmware version cannot be automatically matched to the pre replacement firmware version when the link card or I O board is replaced Therefore matching with the pre replacement firmware version must be done using a firmware version that has been checked in advance After the replacement if the PCI 261 C 1 2 expansion unit cannot be recognized from the XSCF check the firmware version of the components that were not replaced Then match the firmware to the pre replacement firmware version Before replacing a link card together with an T O board be sure to check the firmware version If you replace a link card together with an I O board without checking the firmware version it may not be possible to match the firmware version to the pre replacement firmware version Do not operate the system power supply during firmware update To reflect the applied firmware restart the physical partition or the I O domain to which the PCI expansion unit belongs or turn on the power again Ask the system administrator to do this If multiple PCI expansion units are be
41. connected and the slot location of the link card In the following example BB ID of the server to which PCIBOX 12B4 is connected is BB 01 and the link card is mounted on BB 01 SLOT 05 XSCF gt ioxadm list PCIBOX 12B4 PCIBOX Link PCIBOX 12B4 BB 01 PCI 05 4 Execute the showboards a command to check the PPAR ID of the physical partition using the link card The BB ID of the server to which the PCI expansion unit requiring maintenance is connected is displayed as a system board PSB number In the following example the PPAR ID of PSB 01 0 is 00 XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Normal 5 Connect to the control domain console of the physical partition 6 Execute the Idm list io I command to check the logical domain to which the link card requiring maintenance is assigned If the logical domains to which the PCIe slot and PCIe root complex are assigned are both the control domains primary the link card is assigned to the control 58 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 domain If the logical domains to which the PCIe slot and PCIe root complex are assigned are not the control domains primary the link card is assigned to the root domain 7 Check whether there is a guest domain that is virtually using the PCle card mounted in the PCI expansion unit requiring maintenance F
42. hot maintenance Building block configuration Physical partition active Physical partition active Chapter4 Preparing for Maintenance 45 Active cold maintenance Maintenance is performed while Oracle Solaris is operating in the physical partition The power cord of the PCI expansion unit requiring maintenance has been disconnected The power cord of the PCI expansion unit can be disconnected by releasing the link card mounted on the server from the system The link card is released from the system using either of the following methods Using the PCI hot plug PHP and using physical partition dynamic reconfiguration DR The following FRUs of the PCI expansion unit are subject to active cold maintenance All FRUs Note If the setting of the direct I O function is enabled the link card cannot use PHP Release the link card from the system using the dynamic reconfiguration DR of the physical partition Note To use the physical partition dynamic reconfiguration DR function logical domains must be configured in advance by referring to 2 5 Dynamic Reconfiguration Conditions and Settings in the Fujitsu M10 SPARC M10 Systems Domain Configuration Guide Figure 4 6 Active cold maintenance Single chassis configuration Physical partition active Physical partition active 46 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Inactive hot maintenance Maintenance is performed wh
43. how to import the firmware with the CLI using the USB memory When using the XSCF Web the procedure is the same as that for updating the XSCF Note Perform this task with a user account that has the platadm or fieldeng privilege 1 Log in to the XSCF shell in the master chassis For the SPARC M10 1 M10 4 The chassis is always a master chassis because this is a single chassis configuration For the SPARC M10 45S without the crossbar box The master chassis is the chassis where the MASTER LED green is on on the rear of the chassis of BB ID 00 and 01 For the SPARC M10 4S with the crossbar box The master chassis is the chassis where the MASTER LED green is on on the rear of the chassis of BB ID 80 and 81 2 Connect the USB memory to the USB port of the server Note Connect the USB memory to the USB port shown as MAINTENANCE ONLY w Execute the getflashimage command to import the downloaded firmware into the system Specify the downloaded firmware file tar gz In the following example the PCIBOX1100 tar gz file in the images folder of the USB memory is specified XSCF gt getflashimage file media usb_msd images PCIBOX1100 tar gz If the procedure ends successfully Download successful will be displayed first and then MDS will be displayed e Execute the getflashimage command and confirm that the PCI expansion unit firmware has been imported XSCF gt getflashimage 1 266
44. of the server containing the link card requiring maintenance For details see 5 3 1 Removing the power cords in the Fujitsu M10 1 SPARC M10 1 Service Manual or 5 9 4 Removing the power cord in the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Note In the case of a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly 9 4 Removing the Link Card This section describes the preparations that must be completed prior to removing the link card electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity A Caution Before you handle any components wear a wrist strap to ground any static The procedure for removing a link card is the same as that for removing a PCle card mounted on the SPARC M10 1 or SPARC M10 4 M10 4S For details on the SPARC M10 1 see 12 4 Removing a PCI Express Card in the Fujitsu M10 1 SPARC M10 1 Service Manual 150 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 9 5 9 6 For details on the SPARC M10 4 M10 45 see 8 3 Removing a PCI Express Card in the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Installing the Link Card This section describes the procedure for installing the link card Caution Bef
45. on the operation panel will be turned on The power on self test POST self diagnosis when powering on will be executed Then the system starts up For details see 6 1 Starting the System in the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide Note When Oracle Solaris is configured to start automatically use the sendbreak command of the XSCF shell to display the ok prompt This should be done after the display console banner appears but before the system starts Oracle Solaris Chapter6 Understanding the Preparations for Restoring the System 89 5 Execute the showstatus command to confirm that the FRU is operating normally after the completion of maintenance Nothing is displayed in the normal state XSCF gt showstatus 6 Execute the showhardconf command to check the hardware configuration and the status of each component showhardconf M10 4S Serial 2081229003 Operator Panel Switch Service System _Power On System Phase Cabinet Power On Partition 0 PPAR Status Running Status Normal Role Master Ver 2050h Serial 2081229003 FRU Part Number CA07361 D202 AO Power Supply System Memory Size 320 GB Status Normal Name Property pci Vendor ID 108e Device ID 9020 Subsystem _Vendor ID 0000 Subsystem ID 0000 Model Connection 7001 PCIBOX 7001 Status Normal Ver 1110h Serial 2121237001 FRU Part Number IOB Status Normal Serial PP123403JE FRU Part Number CA20365 B66X
46. or delete the I O device and then restart the domain However for a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later since the dynamic reconfiguration function of the PCle endpoint device is supported placing the domain in delayed reconfiguration mode and restarting the domain are unnecessary Enable the hotplug service before adding or deleting the I O device Checking the operation statuses of the physical partition and logical domain Log in to the XSCF shell 2 Execute the showpparstatus p command to confirm the operating condition of the physical partition In the following example the PPAR Status of PPAR ID 00 is displayed as Running indicating that the physical partition is operating XSCF gt showpparstatus p 0 PPAR ID PPAR Status 00 Running 3 Execute the showdomainstatus p command to check the operation status of the logical domain In the following example the Status of the logical domain with PPAR ID 00 is displayed as Solaris running indicating that Oracle Solaris is operating 64 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 XSCF gt showdomainstatus p 0 Logical Domain Name Status primary Solaris running guest0 Solaris running guestl Solaris running iodom0 Solaris running iodoml Solaris running sdiodomain Solaris running sr iodomain Solaris running Connect to the control domain console of the physical partition
47. performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 13 2 2 13 2 3 Maintenance flow Table 13 2 shows the maintenance procedure for the fan units See the relevant section Table 13 2 Maintenance flow Details of update process Replacement 1 Preparation 13 3 2 Fan unit removal 13 4 3 Installing a fan unit 13 5 4 Restoring the system 13 6 Precautions for replacement Note the following points when replacing a fan unit a When replacing multiple fan units replace no more than one unit at a time If the redundancy of the fan units cannot be secured system stopped maintenance must be executed The fan units have a redundant configuration therefore even if one fan unit fails the system can continue operating Do not however operate the system for an extended period with a failed fan unit Replace the failed fan unit as quickly as possible Chapter 13 Maintaining the Fan Units 199 13 3 Tigi 200 Enabling the Removal of a Fan Unit This section describes the precautions that must be completed prior to removing a fan unit The preparation procedure differs depending on the maintenance type as follows Active hot ma
48. replace the I O board and the link card at the same time check the Chapter 15 Maintaining the I O Board 223 firmware version before the replacement If you replace the I O board and the link card at the same time without checking the firmware version you may not be able to match the version Do not replace the I O board and the fan backplane at the same time When you replace the I O board and the fan backplane at the same time all the serial numbers of the PCI expansion unit are changed to 0 0000000000 If all these serial numbers are changed to 0 0000000000 use the ioxadm command of the XSCF firmware to restore the serial numbers If you replace both the I O board and the fan backplane replace either one and then start the physical partition connected to the PCI expansion unit to determine the error log information on the PCI expansion unit After confirming that no error log information is displayed replace the other Field Replaceable Unit FRU If multiple PCI expansion units are used and they are combined such that their firmware versions match there will be no problem with the operation even if the PCI expansion units are using different firmware versions 15 3 Enabling the Removal of the I O Board This section describes the preparations that must be completed prior to the removal of the I O board The preparation procedure differs depending on the maintenance type as follows m Active cold maintenance Inact
49. requiring Physical partition to which the PCI expansion unit maintenance containing the Field Replaceable Unit FRU requiring maintenance belongs PCI expansion unit requiring Chassis of the PCI expansion unit containing the Field maintenance Replaceable Unit FRU requiring maintenance Maintenance types of the PCI expansion unit The maintenance type of the PCI expansion unit differs depending on whether the SPARC M10 system of the destination of the PCI expansion unit has a single unit configuration or a building block configuration A single unit configuration is that configuration in which one SPARC M10 1 SPARC M10 4 or SPARC M10 4S is used This configuration uses only one physical partition So the status in which the physical partition requiring maintenance stops is equivalent to that in which the entire system stops A building block configuration is that configuration in which two or more SPARC M10 4Ss are used Maintenance types when the destination of the PCI expansion unit has a single unit configuration Suppose that the destination of the PCI expansion unit has a single unit configuration In this case the following four maintenance types can be applied depending on the combinations of the statuses of the physical partition requiring maintenance and the input power statuses of the chassis requiring maintenance 36 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 4 3 sing
50. save restore the logical domain configuration information and the OpenBoot PROM environment variable The processes to be performed when it is necessary to save restore each item of information related to the PCI expansion unit configuration are as follows Table 1 2 Necessary processes related to the PCI expansion unit configuration PCI expansion unit Domain configuration Reconfiguration of Resetting of OpenBoot installation Oracle VM Server for PROM environment SPARC config variable Unsupported factory default Unnecessary Unnecessary Unsupported Contains a guest domain Unnecessary Unnecessary Supported factory default Unnecessary Unnecessary Supported Contains a guest domain Necessary XML Necessary Notes on using the direct I O function SPARC M10 4 M10 45 If the firmware version XCP2044 or later is used on the SPARC M10 4 or a firmware version XCP2050 or later is used on the SPARC M10 4S and one of the following operations is performed with the setpciboxdio command the logical domain configuration of the physical partition will return to the factory default at the next startup If the domain configuration contains a guest domain the OpenBoot PROM environment variable of the control domain will also be initialized Changing the enable disable setting for the direct I O function of the PCI Chapter1 Before Starting Maintenance Work 7 8 expansion unit Installing removing replacing the PCI expansion unit for the PCle sl
51. see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords 188 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 12 3 5 12 3 6 Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the power supply unit requiring maintenance XSCF gt showlogs error ca For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 a SN Stop the entire system For details see 5 3 Stopping the Entire System Remove the power cord from the power supply unit requiring maintenance For details see 5 4 1 Removing the power cords System s
52. shows that the power to PPAR 0 is turned off on XSCF gt poweroff p 0 XSCF gt poweron p 0 4 Execute the Idm Is spconfig command to confirm that the configuration information is set as specified The following example shows that test is set as the current configuration information ldm 1ls spconfig factory default testl current test2 test3 Execute the Idm Is constraints x command to save the current configuration information If necessary backup XML In the following example the current configuration information is saved in test1 xml ldm ls constraints x gt var tmp test1 xml PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 6 Execute the more command to confirm that the configuration information is correct more var tmp test1 xml lt xml version 1 0 gt lt LDM_interface version 1 3 xmlns xsi http www w3 org 2001 XMLSchema instancce 7 If there are multiple pieces of configuration information to be saved save all of them Repeat from step 2 to step 6 to save the configuration information 8 Execute the Idm set spconfig factory default command to set the system to the factory default ldm set spconfig factory default ldm 1ls spconfig factory default next poweron testl current test2 test3 9 Execute the Idm rm spconfig command to delete all the configuration information ldm rm spconfig testl ldm rm spconfig test
53. still operating The input power is turned off Description Indicates that an error has occurred Indicates that the component requires maintenance This function is also referred to as the locator Indicates the normal state Or the breaker is open or the power supply is otherwise off Table 2 5 LEDs and status of link board Name Color Status LINK STATUS Green On PCI Ex oe G left side Pineng Off LINK STATUS Green On Management Sr i right side Blinking Off The blink interval is 1 second 1 Hz Description The link is established with PCI Express Gen3 x8 The link is established with other than PCI Express Gen3 x8 degradation condition The link is down The management link is established The management link is disconnected Indicates that power is not being supplied Chapter 2 Understanding the PCI Expansion Unit Components 23 Table 2 6 LEDs and status of PCIe slot Name Color Status Description OWES Green On Indicates that power is being supplied D Off Indicates that power is not being supplied ATTENTION Amber On Indicates that an error has occurred A Blinking Indicates that the component requires maintenance This function is also referred to as the locator Off Indicates the normal state The blink interval is 1 second 1 Hz 2 2 3 LEDs on link card The link card is mounted in the PCIe slot of the server 24 PCI Expansion Unit for Fujitsu M10 SPARC M10
54. the name of the PCIe root complex to which the PCIe card belongs The name indicated in DOMAIN of the same PCle root complex line where NAME indicates PCIEx indicates the logical domain to which the PCIe root complex to which the PCle card belongs is assigned 1 to 4 in the execution example 1 Assignment of PCIE1 to primary 2 Assignment of PCIE2 to primary 3 Assignment of PCIE3 to rootdom 4 Assignment of PCIE6 to rootdom 5 Based on the check results in step 4 determine whether PHP can be used according to the combination of above two pieces of information Suppose that the logical domains to which the PCIe slot and PCIe root complex are assigned are both the control domains primary Active hot maintenance can be performed using PHP from the control domain See 5 in the execution example of the Idm list io 1 command Suppose that the logical domains to which the PCIe slot and PCIe root complex are assigned are not control domains and are the same logical domains root 54 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 domains Active hot maintenance can be performed using PHP from the root domain See 7 in the execution example of the Idm list io 1 command In other than above for the I O domain PHP cannot be used See 6 and 8 in the execution example of the Idm list io 1 command 4 2 3 Checking whether the SR IOV function is used This section checks whethe
55. the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 6 6 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 7 Close the rack door 154 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 9 6 5 9 6 6 System stopped hot maintenance I Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform
56. the l1dm 1M command to be executed in each step see the reference manuals for Oracle VM Server for SPARC 3 1 and later Mounting the chassis containing the link card on the physical partition 1 Login to the XSCF shell 2 Execute the addboard command with the c configure option specified to mount the target chassis on the physical partition In response to the confirmation message enter y Note In system board mounting using the addboard command the target system board is mounted on the physical partition once the hardware diagnosis of the system board is complete For this reason it may take some time before execution of the command finishes The following example mounts PSB 01 0 on PPAR ID XSCF gt addboard c configure p 0 01 0 PSB 01 0 will be configured into PPAR ID 0 Continue y n Start connecting PSB to PPAR 3600sec Connected PSB to PPAR Start configuring PSB to Logical Domains LDoms Manager 1800sec Configured PSB to Logical Domains LDoms Manager Operation has completed Note If you omit the m option or specify bind resource for the m option upon execution of the addboard command resource assignment may not be restored to the status existing before the execution of the deleteboard command If the amount of the resources of the system board such as CPU and memory before replacement differs from that after replacement you cannot restore the resource assignment to its original status Any re
57. the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Loginto the XSCF shell 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Chapter 7 Maintaining the PCI Express Cards 121 7 6 3 7 6 4 Inactive hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 4 Cl
58. the procedure for mounting the link card on the server Note If you use the PCI Hot Plug PHP to mount the link card on the server remove all the PCIe cards from the PCI expansion unit Mount the link card on the server before installing the PCle cards to the PCI expansion unit Then use PHP to incorporate these cards to the server 1 Remove all PCI Express card cassettes For details see 7 4 2 Removing a PCI Express card cassette 2 Execute the svcadm enable hotplug command to enable the hotplug service 79 svcadm enable hotplug 3 Execute the cfgadm 1M command to mount the link card to which the PCI expansion unit is connected on the logical domain For the Ap_ID enter the Ap_ID of the link card you noted down before the start of maintenance cfgadm c configure Ap ID The locator LED turns off if the link card is successfully mounted on the logical domain Note No locator LED is provided for the link board link cables management cable power supply unit PCI tray or fan backplane 4 Install all the PCI Express card cassettes into the PCI expansion unit For details see 7 5 2 Installing a PCI Express card cassette 5 Execute the cfgadm 1M command to supply power to the PCle card Enter the Ap_ID of the PCle card that you noted in advance cfgadm c connect Ap ID 6 Execute the cfgadm 1M command to incorporate the PCle card into the logical domain Enter the Ap_ID of the PCIe card that you no
59. to each component To provide redundancy two power supply units are mounted in the PCI expansion unit If one power supply unit fails while the system is running the 1 1 redundant configuration allows the system to continue operating 183 Figure 12 1 Location of the power supply units TA FES fir ns NM Hila NUN Mal lars 7 eee eS 1 2 Location number Component 1 Power supply unit PSU 0 2 Power supply unit PSU 1 12 2 12 2 1 Before Maintaining a Power Supply Unit This section describes the types of maintenance for the power supply units the maintenance flow and precautions to observe Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work Types of maintenance Table 12 1 lists the types of maintenance for the power supply units For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration 184 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 12 1 Connection destination SPARC M10 1 Configuration of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 1 Types of maintenance for the power supply unit Active hot Active cold Inactive hot Inactive cold Enabled 1 Enabled 1 Enabled 2 Enabled 3 Enabled Enabled 1 This
60. unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Start the entire system For details see 6 3 Starting the Entire System 5 Close the rack door Chapter 10 Maintaining the Link Cables 169 170 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 11 11 1 Maintaining the Management Cable This chapter describes the maintenance procedure for the management cable Configuration of the Management Cable Connection Port Before Maintaining the Management Cable Enabling the Removal of the Management Cable Removing the Management Cable Installing the Management Cable Restoring the System Configuration of the Management Cable Connection Port This section describes the configuration and location of the management cable connection port The link cards of the SPARC M10 1 or SPARC M10 4 M10 4S are connected to the link board of the PCI expansion unit with the link cables and the management cable 171 Figure 11 1 Location of management cable connection port Location number Component 1 Management cable MGCBL 11 2
61. 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 pci 0 0 usb 4 1 0 usbe4 pci 8000 pci 4 pci 0 pci l network 0 1 pci 8000 pci 4 pci 0 pci l network 0d pci 8000 pci 4 pci 0 pci 0 scsi 0 pci 8000 pci 4 pci 0 pci 0 scsi 0 disk pci 8000 pci 4 pci 0 pci 0 scsi 0 tape 1 1 pci d 1 pci 0 pci ll 1 pci 0 pci l10 1 pci 0 pci s 1 pci 0 pci l 1 pci 0 pci 0 1 pci 0 pci 1l1l pci d 1 pci 0 pci ll pci 0 pci 1 pci 0 pci ll pci 0 pci 1 pci 0 pci ll pci 0 pci 1 pci 0 pci ll pci 0 pci 1 pci 0 pci 10 pci d 1 pci 0 pci 10 pci 0 pci 1 pci 0 pci 1l0 pci 0 pci 1 pci 0 pci 10 pci 0 pci 1 pci 0 pci 10 pci 0 pci 1 pci 0 pci 10 pci 0 pci 1 pci 0 pci 1l0 pci 0 pci 1 pci 0 pci l10 pci 0 pci virtual devices 100 channel devices 200 virtual devices 100 flashprom 0 virtual devices 100 rtc 5 virtual devices 100 console l virtual devices 100 channel devices 200 virtual domain service 0 virtual devices 100 channel devices 200 virtual channel 3 virtual devices 100 channel devices 200 virtual channel client 2 virtual devices 100 channel devices 200 virtual channel client l virtual devices 100 channel devices 200 virtual channel 0 iscsi hba disk ope
62. 10 Systems Service Manual December 2014 Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 5 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 6 6 Start the entire system For details see 6 3 Starting the Entire System 7 Close the rack door Chapter 15 Maintaining the I O Board 237 238 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 16 Maintaining the Fan Ba
63. 2 ldm rm spconfig test3 ldm 1ls config factory default next poweron 10 Stop the logical domain to set it to the OpenBoot PROM state Before turning off the power to the system stop the logical domain with an appropriate procedure and use the Idm unbind command to transfer it to the inactive state shutdown i0 g0 y 11 Check the OpenBoot PROM environment variable with the printenv command 0 ok printenv Variable Name Value Default Value ttya rts dtr off false false ttya ignore cd true true keyboard layout reboot command security mode none No default security password No default Chapter 1 Before Starting Maintenance Work 11 security badlogins 0 o default diag switch false false local mac address true true fcode debug false false scsi initiator id 7 7 oem logo o default oem logo false false oem banner o default oem banner false false ansi terminal true true screen columns 80 80 screen rows 34 34 ttya mode SEOL PE oe N a 9600 85 n L output device input device virtual console virtual console virtual console virtual console auto boot on error false false load base 16384 16384 auto boot false true network boot arguments boot command boot boot boot file boot device pci 8000 pci 4 pci 0 pe disk net multipath boot false false boot device index 0 0 use nvramrc false false nvramrc error reset recovery boot boot If there is any omitted section with
64. 2 5 Installing a Power Supply Unit PCle card cassette For details see 7 5 2 Installing a PCI Express card cassette 16 6 Restoring the System This section describes the procedure for restoring the system after fan backplane 250 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 16 6 1 16 6 2 installation The restoration procedure differs depending on the maintenance type as follows Active cold maintenance Inactive cold maintenance System stopped cold maintenance Active cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method using physical partition dynamic reconfiguration DR can be applied only when the destination has the SPARC M10 4S building block configuration 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion
65. 3 PCIE PCIE2 primary EMP pci 8200 pci 4 pci 0 pcit0 Chapter 4 Preparing for Maintenance 53 BBO PCI4 PCIE PCIE2 iodom1 OCC lt 6 pci 8200 pci 4 pci 0 pci s BBO PCI7 PCIE PCIE3 rootdom EMP pci 8300 pci 4 pci 0 pci d BBO PCI8 PCIE PCIE3 rootdom EMP lt 7 pci 8300 pci 4 pci 0 pci s BBO CMUL NET2 PCIE PCIE4 primary Occ pci 8400 pcit 4 pci 0 pci a network 0 network 0 1 BBO PCI1 PCIE PCIES5 rootdom EMP pci 8500 pcit 4 pci 0 pci s BBO PCI2 PCIE PCIES5 rootdom OCC pci 8500 pcit 4 pci 0 pci 9 BBO PCI5 PCIE PCIE6 iodom2 OCC lt 8 pci 8600 pcit 4 pci 0 pci 9 BBO PCI6 PCIE PCIE6 rootdom OCC pci 8600 pci 4 pci 0 pci l1l BBO PCI9 PCIE PCIE7 primary OCC pci 8700 pci 4 pci 0 pci 9 BBO PCI10 PCIE PCIE7 primary Occ pci 8700 pci 4 pci 0 pci l1l Logical domain to which the PCle card is assigned The name indicated in DOMAIN of the slot line where NAME indicates BBX PCIx of the PCIe card requiring maintenance indicates the logical domain to which that PCIe card is assigned 5 to 8 in the execution example 5 Assignment of both BBO PCIO and PCIE1 to primary 6 Assignment of BBO PCI4 to iodom1 and PCIE2 to primary 7 Assignment of both BBO PCI8 and PCIE3 to rootdom 8 Assignment of BBO PCI5 to iodom2 and PCIE6 to rootdom Logical domain to which the PCle root complex to which the PCle card belongs is assigned Name PCIEx indicated in BUS in the line confirmed above indicates
66. B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 3 Execute the ioxadm list command to check the BB ID of the server that is connected to the PCI expansion unit requiring maintenance The following example shows that the BB ID is BB 01 XSCF gt ioxadm list PCIBOX 12B4 PCIBOX Link PCIBOX 12B4 BB 01 PCI 05 4 Execute the showboards a command to check the PPAR ID of the physical partition using the link card The BB ID of the server to which the PCI expansion unit requiring maintenance is connected is displayed as a system board PSB number In the following example the PPAR ID of PSB 01 0 is 00 XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Normal 5 Execute the showpparstatus p command to confirm the operating condition of the physical partition In the following example the PPAR Status of PPAR ID 00 is displayed as Running indicating that the physical partition is operating 72 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 9 XSCF gt showpparstatus p 0 PPAR ID PPAR Status 00 Running Execute the showdomainstatus p command to confirm the operating condition of the logical domain In the following example the Status of the logical domain with PPAR ID 00 is displayed as Solaris running indicating that Oracle Solaris is operating XSCF gt showdomainstatus p 0 Logical Dom
67. C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to Restoring the logical domain to the status it had before maintenance 4 Close the rack door 9 6 3 Inactive hot maintenance 1 Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically WoW answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 2 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 3 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 4 Chapter9 Maintaining the Link Cards 153 4 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI E
68. CI expansion unit 5 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 2 Releasing the link card using physical partition dynamic reconfiguration DR 9 3 3 Inactive hot maintenance 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expansion unit 5 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 9 3 4 Inactive cold maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expansion unit 5 Turn off the power to the physica
69. CIBOX 12B4 2 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 4 Close the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 180 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Pe g Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically WoW answers y yes in response to
70. ICITE RELATIVE A LA QUALITE MARCHANDE AL APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON Contents Preface xv Chapter1 Before Starting Maintenance Work 1 1 1 Warning Caution Indications 1 1 2 Labels Tags 2 1 3 Safety Precautions 3 1 4 Notes Regarding Static Electricity 4 1 5 Other Precautions 5 1 6 Emergency Power Off 6 1 7 Important Information about the XCP Firmware 6 1 7 1 Precautions for updating the XCP firmware 7 1 7 2 Notes on using the direct I O function 7 1 7 3 How to save restore the logical domain configuration information and the OpenBoot PROM environment variable 9 Chapter 2 Understanding the PCI Expansion Unit Components 17 2 1 Identifying the Names and Locations of Components 17 2 2 Checking the Status with the LED 20 2 2 1 Front LEDs on the PCI expansion unit 21 2 2 2 LEDs on rear of PCI expansion unit 22 2 2 3 LEDs on link card 24 Chapter3 Troubleshooting 27 3 1 Suspected Failure Conditions 27 3 2 Determining the Causes of Individual Failures 27 3 3 Identifying a Failure 28 3 3 1 Checking the LED indications 29 3 3 2 Checking error messages 29 3 3 3 Checking the status 29 3 3 4 Checking log information 33 3 4 Locating the PCI Expansion Unit Requiring Maintenance 34 Chapter4 Preparing for Maintenance 35 4 1 Preparing Tools Required for Maintenance 35 4 2 Understanding Types of Maintenance 35 4 2 1 Maintenance types of the PCI expansion unit 36 4 2 2 Checking whether the PCI hot plug PHP can be
71. Link board Power supply unit and fan unit Link cable and management cable Figure 4 9 System stopped hot maintenance Building block configuration Physical partition stopped PCI expansion unit Hot Physical partition stopped Chapter 4 Preparing for Maintenance 49 50 System stopped cold maintenance Maintenance is performed while all physical partitions on the system are powered off The power cord of the PCI expansion unit requiring maintenance has been disconnected The following FRUs of the PCI expansion unit are subject to system stopped cold maintenance All FRUs Figure 4 10 System stopped cold maintenance Building block configuration Physical partition stopped Physical partition stopped The maintenance types that can be used for each FRU are as follows PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 4 8 When the destination has an SPARC M10 4S building block configuration FRU PCI Express card Link board Link card mounted on server Link cable Management cable Power supply unit Fan unit PCI tray T O board Fan backplane Active hot Enabled 1 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 3 Enabled Active cold Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Inactive hot Enabled Ena
72. M10 4 SPARC M10 4S Service Manual lt text gt Restoring the System This section describes the procedure for restoring the system after link card installation The restoration procedure differs depending on the maintenance type as Chapter9 Maintaining the Link Cards 151 follows Active hot maintenance use of PHP Active hot maintenance use of DR Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance 9 6 1 Active hot maintenance use of PHP Note If you use the PCI Hot Plug PHP to mount the link card on the server remove all the PCle cards from the PCI expansion unit Mount the link card on the server before installing the PCIe cards to the PCI expansion unit Then use PHP to incorporate these cards to the server 1 Mount the PCI expansion unit that uses the link card requiring maintenance on the server a Remove all PCI Express card cassettes For details see 7 4 2 Removing a PCI Express card cassette b Execute the cfgadm 1 command to mount the link card to which the PCI expansion unit is connected on the logical domain For the Ap_ID enter the Ap_ID of the link card you noted down before the start of maintenance cfgadm c configure Ap ID The locator LED turns off if the link card is successfully mounted on the logical domain 2 Check the firmware version of the PCI expansion unit For details see For active maintenance
73. Maintenance Belongs Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the management cable requiring maintenance e XSCF gt showlogs error For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified 5 XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System 176 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 11 3 6 System stopped cold maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the management cable requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information sa
74. N Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb y s 00 0 lt 1 w Pe During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Start the entire system For details see 6 3 Starting the Entire System Close the rack door System stopped cold maintenance J Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance won Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 e oi During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Star
75. O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCle card delete all the VFs corresponding to that PF from the I O domain ldm remove io lt device name gt lt I O domain name gt d Place the root domain to which PF is assigned in delayed reconfiguration mode Chapter 7 Maintaining the PCI Express Cards 103 ldm start reconf lt root domain name gt e Execute the ldm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created ldm destroy vf lt VF name gt f However the VF needs to be discarded in the reverse order to that in which it was created telnet localhost lt port number gt shutdown i6 g0 y 11 Suppose that the PCle card requiring maintenance has been assigned to an I O domain by using the DIO function Execute the Idm 1M command from the control domain to delete the physical I O device from the I O domain and then restore the physical I O device to the root domain In case dynamic reconfiguration of PCle endpoint devices is used Note Dynamic reconfiguration of PCle endpoint devices is supported by a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain svcadm enable ho
76. ONSUMPTION 68 000 000 PCIBOX 2008 PSU 0 F 3936 000 000 PCIBOX 2008 PSU 1 F 3584 000 000 PCIBOX 2008 FAN 0 F 3374 000 000 PCIBOX 2008 FAN 1 F 3374 000 000 PCIBOX 2008 FAN 2 F 3374 000 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 PCIBOX 2008 I 000 B T_INTAKE 26 000 T_PART_NO0 31 500 T_PART_NO1 30 750 T_PART_NO2 31 500 OV 12 069 293 rene 291 300 804 900 O OOOO Oo OC Oo O00 OO 2 OC OO 0 oooo ooo 0000 UUU Ww W e O O O O show devs command Execute the show devs command of OpenBoot PROM to display the path from the host server to the PCIe card on the I O board 30 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 1 Display the ok prompt 2 Execute the show devs command to check the device tree information 0 ok show devs pci performance counters 8100 pci performance counters 8000 pci 8100 pci 8000 cpu 1f cpu le cpu ld cpu lc cpu lb cpu la cpu l19 cpu 18 cpu 17 cpu 16 cpu 15 cpu l14 cpu l3 cpu l1l2 cpu 11 cpu 10 cpu f cpu e cpued cpu c cpu cpu cpu cpu cpu cpu cpu cpu cpu cpu cpu cpu virtual devices 100 iscsi hba virtual memory memory m7e00 60000000 aliases options openprom chosen
77. OX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically WoW answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Start the entire system For details see 6 3 Starting the Entire System 4 Close the rack door System stopped cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Log in to the XSCF shell 3 Execute the testsb command to confirm that the PCI expansion unit requiring Chapter 7 Maintaining the PCI Express Cards 123 maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and th
78. Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance XSCF gt showlogs error e For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 5 Stop the entire system For details see 5 3 Stopping the Entire System System stopped cold maintenance I Open the rack door Chapter 10 Maintaining the Link Cables 163 2 3 Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance XSCF gt showlogs error gt For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified ol a N XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI e
79. P Perform the procedure up to step 2 in6 1 1 Mounting the link card on the server using PHP 3 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 4 Ifthe firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not 234 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 have to perform this step Go to step 3 in 6 1 1 Mounting the link card on the server using PHP 5 If the firmware has been updated the firmware must be applied To do this execute the cfgadm 1M command to release the link card requiring maintenance from the logical domain If the firmware has not yet been updated you do not have to perform this step Go to step 7 cfgadm c disconnect Ap ID 6 If you have updated the firmware again mount the PCI expansion unit requiring maintenance on the server For details see 6 1 1 Mounting the link card on the server using PHP 7 Close the rack door Mounting the link card on the server using physical partition dynamic reconfiguration DR 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Instal
80. PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual fo FUJITSU Manual Code C120 E683 09EN PAN an December 2014 Copyright 2007 2014 Fujitsu Limited All rights reserved Oracle and or its affiliates provided technical input and review on portions of this material Oracle and or its affiliates and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document and such products technology and this document are protected by copyright laws patents and other intellectual property laws and international treaties This document and the product and technology to which it pertains are distributed under licenses restricting their use copying distribution and decompilation No part of such product or technology or of this document may be reproduced in any form by any means without prior written authorization of Oracle and or its affiliates and Fujitsu Limited and their applicable licensors if any The furnishings of this document to you does not give you any rights or licenses express or implied with respect to the product or technology to which it pertains and this document does not contain or represent any commitment of any kind on the part of Oracle or Fujitsu Limited or any affiliate of either of them This document and the product and technology described in this document may incorporate third party intellectual property copyrighted by and or license
81. PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 C l3 C 1 4 Time required for updating The following shows the time required for updating Table C 1 Time required for updating System status Updating time The system is operating with a PCI expansion unit recognized from the About 30 XSCF minutes Flow of update process Table C 2 lists the sequence of the update procedure for the firmware See the relevant sections Table C 2 Flow of update process Task Reference 1 Preparing the firmware C21 2 Importing the firmware into the system C22 3 Updating the firmware C23 C 2 C 2 1 Updating the Firmware This section describes the procedure for updating the firmware Preparing the firmware 1 Download the firmware file from the following website Download the firmware file to an arbitrary folder on a PC or workstation that is connected to the system Note The information on these sites is for customers of Fujitsu Japanese site Customers who subscribe to SupportDesk can download the firmware file from the SupportDesk Web Global site Appendix C Updating the Firmware of the PCI Expansion Unit 265 C 2 2 For the latest firmware file contact your sales representative 2 Check the downloaded firmware version number For the firmware version refer to the four digit number of the firmware file tar gz Importing the firmware into the system This section describes
82. PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 C23 Updating the firmware Note Perform this task with a user account that has the fieldeng privilege 1 Execute the ioxadm command to check the version of the firmware that is currently running XSCF gt ioxadm v list For details see C 1 2 How to check the serial number and firmware version of the PCI expansion unit 2 Execute the ioxadm command to update the firmware In the following example the PCIBOX 2007 firmware is updated to the 1100 version XSCF gt ioxadm c update PCIBOX 2007 s 1100 Firmware update is started version 1100 Firmware update has been completed After Firmware update is started is displayed nothing is displayed for about 30 minutes before Firmware update has been completed is displayed Execute the ioxadm command to check the firmware version Confirm that the firmware version of the updated firmware is correct XSCF gt ioxadm v list For details see C 1 2 How to check the serial number and firmware version of the PCI expansion unit pa Reflect the firmware If the system is started in step 4 of For maintenance with the system stopped in C 1 2 How to check the serial number and firmware version of the PCI expansion unit stop the system after returning the Auto boot setting of the target physical partition to the original one Also after stopping the system return the mode switch on
83. RC M10 4S 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Chapter 14 Maintaining the PCI Tray 219 14 6 3 Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI exp
84. SCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped hot maintenance 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the link board requiring maintenance Chapter8 Maintaining the Link Board 129 XSCF gt showlogs error For details see 3 3 4 Checking log information PA Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 5 Stop the entire system For details see 5 3 Stopping the Entire System 8 3 6
85. Service Manual Fujitsu M10 SPARC M10 Systems PCI Card Installation Guide Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide Fujitsu M10 SPARC M10 Systems Domain Configuration Guide Fujitsu M10 SPARC M10 Systems XSCF Reference Manual Fujitsu M10 SPARC M10 Systems RCIL User Guide 3 Fujitsu M10 SPARC M10 Systems XSCF MIB and Trap Lists Fujitsu M10 SPARC M10 Systems Product Notes Fujitsu M10 SPARC M10 Systems Glossary 1 The listed manuals are subject to change without notice 2 The printed manual comes with the product 3 This document applies specifically to the FUJITSU M10 and FUJITSU ETERNUS storage system xvi PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Text Conventions This manual uses the following fonts and symbols to express specific types of information Font Symbol Meaning Example AaBbCc123 What you type when contrasted with on screen XSCF gt adduser jsmith computer output This font indicates an example of command input AaBbCc123 The names of commands files and directories XSCF gt showuser P on screen computer output User Name jsmith This font indicates an example of command input Privileges useradm in the frame auditadm Italic Indicates the name of a reference manual See the Fujitsu M10 SPARC M10 Systems Installation Guide a Indicates the names of chapters sections items See Chapter 2 Network Connection buttons or menus Command syntax i
86. Systems Service Manual December 2014 Figure 2 7 LEDs of link card SPARC M10 1 SPARC M10 4 M10 4S 1 2 The LEDs on the link card and the statuses indicated by those LEDs are listed below Chapter 2 Understanding the PCI Expansion Unit Components 25 26 Table 2 7 Location Name number 1 LINK STATUS PCI Ex 2 LINK STATUS Management Color Green Green The blink interval is 1 second 1 Hz LEDs and status of link card Status On Blinking Off On Blinking Off Description The link is established with PCI Express Gen3 x8 The link is established with other than PCI Express Gen3 x8 degradation condition The link is down The management link is established The management link is disconnected Indicates that power is not being supplied PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 3 Troubleshooting This chapter describes how to determine and confirm the cause if an error occurs Suspected Failure Conditions Determining the Causes of Individual Failures Identifying a Failure Locating the PCI Expansion Unit Requiring Maintenance 3 1 Suspected Failure Conditions This section explains suspected failure conditions Use the flow to determine the cause of a failure and identify the failure location in the following cases For details on the flow for determining the cause of a failure see 3 2 Dete
87. a Execute the ldm list bindings lt domain name gt command in the control domain and check the physical network interface name NET DEV value assigned to the virtual network switch based on the information for the virtual network switch VSW The following example specifies rootdom which is the name of the logical domain to which the PCle card is assigned ldm list bindings rootdom NET DEV LD DEVICE LINKPROP DEFAULT VLAN ID PVID vsw0 XXIXXIXXIXX XX xx net4 1 switch 0 1 PEER MAC PVID VID vnet0 guestl 2 HKLER IRE KK KK RK 1 1 Physical network interface 2 Virtual network device and guest domain that are receiving the vsw0 services b Log in to the logical domain to which the PCle card is assigned and check the physical location of the above physical network interface to confirm whether that interface corresponds to the PCIe card requiring maintenance For Oracle Solaris 11 execute the dladm show phys L command to determine the LOC physical location of the physical network interface that corresponds to NET DEV in step a dladm show phys L LINK DEVICE LOC neto igbO BBO CMUL netl igbl BBO CMUL 100 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 net2 igb2 BBO CMUU net3 igb3 BBO CMUU net4 ixgbe0 BB 0 PCI 0 lt net5 ixgbel BB 0 PCI 0 For Oracle Solaris 10 check the physical device path from the etc path_to_ inst command and compare that
88. able B 1 Specifications of the PCIe card Item Description Maximum number of PCle 11 cards Location Rear of chassis Active hot maintenance Supported Active cold maintenance Supported with SPARC M10 4 M10 45 connected Inactive hot maintenance Supported Inactive cold maintenance Supported System stopped maintenance Supported For the maintenance procedure see Chapter 7 Maintaining the PCI Express Cards 255 B 2 Link Board The link board is mounted in the slot that is dedicated to the link board for the PCIe card slot The link board is connected to the link card mounted on the SPARC M10 1 M10 4 M10 4S through the link cable and the management cable Table B 2 lists the specifications of the link board Table B 2 Link board specifications Item Description Number of link boards 1 Location Rear of chassis Active hot maintenance Supported with SPARC M10 4 M10 45 connected Active cold maintenance Supported with SPARC M10 4 M10 4S connected Inactive hot maintenance Supported Inactive cold maintenance Supported System stopped maintenance Supported For the maintenance procedure see Chapter 8 Maintaining the Link Board B 3 Power Supply Unit The power supply units take input power and supply it to the system The redundant configuration of the power supply units allows the system to continue operating even if one of the units fails Table B 3 lists the specifications of the power supply units Ta
89. abled state svcadm disable hotplug Releasing the physical partition that uses the link card Log in to the XSCF shell 2 If the server requiring maintenance is operating as the master chassis execute the switchscf command to switch the master XSCF to the standby status In response to the confirmation message enter y If the chassis requiring maintenance is the slave XSCF go to step 4 XSCF gt switchscf t Standby The XSCF unit switch between the Master and Standby states Continue y n ty 70 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Log in to the XSCF again Execute the showboards command to check the status of the server to which the PCI expansion unit requiring maintenance is connected The BB ID of the chassis requiring maintenance is indicated as a system board PSB number The following example shows that Fault of PSB 01 0 is displayed as Degraded indicating that operation is ongoing but that some parts are faulty XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Degraded 5 Execute the deleteboard c disconnect command to release the chassis requiring maintenance from the physical partition The following example releases PSB 01 0 from the physical partition XSCF gt deleteboard c disconnect 01 0 Execute the showresult command to check the end status of the deleteboard comman
90. ain Name Status primary Solaris running 4S 159 D0 GO Solaris running 4S 159 D0 G1 Solaris running 4S 159 D0 G2 Solaris running Execute the poweroff p command to stop all the logical domains on the physical partition to which the PCI expansion unit requiring maintenance belongs In response to the confirmation message enter y In the following example PPAR ID 00 is stopped XSCF gt poweroff p 0 PPAR IDs to power off 00 Continue y n ty 00 Powering off Execute the showpparstatus p command to confirm that the power to the physical partition is turned off In the following example the PPAR Status of PPAR ID 00 is displayed as Powered Off indicating that the physical partition is powered off XSCF gt showpparstatus p 0 PPAR ID PPAR Status 00 Powered Off Change the mode switch on the operation panel to Service mode When the connection destination is a SPARC M10 1 M10 4 Change the mode switch to Service mode When the connection destination is a SPARC M10 45S without the crossbar box Switch the mode switches of BB ID 00 and 01 to Service mode When the connection destination is a SPARC M10 4S with the crossbar box Change the mode switch of BB ID 80 81 to Service mode Chapter 5 Understanding the Preparations for Enabling Maintenance 73 9 3 Stopping the Entire System This section describes the procedure for stopping the entire system The operation for stopping the system is p
91. alling a PCI Express Card This section describes the procedure for installing a PCle card Perform expansion using the same procedure For removal install a filler unit for a PCIe card rather than a PCle card itself Installing a PCI Express card 1 Install the PCle card by inserting it into the connector of the PCle card cassette For removal you do not have to perform this step Mount the filler for a PCIe card in the PCle card cassette Note Confirm that the tab of the PCIe card A in the figure or the tab of the filler for the PCIe card is inserted into the notch B in the figure of the PCIe card cassette 114 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 7 8 Installing a PCIe card 2 Install the bracket for the PCle card and then secure it with the screw Chapter 7 Maintaining the PCI Express Cards 115 Figure 7 9 Installing the bracket 3 Mount the cover on the PCle card cassette 7 02 Installing a PCI Express card cassette Caution When installing a PCIe card cassette confirm that the connectors on both the chassis and PCIe card cassette do not have any bent pins and that the pins are aligned correctly If you attempt to install a PCIe card cassette while any of the connector pins are bent the chassis or the PCIe card cassette may be damaged When performing installation perform the work carefully so as not to bend any pins 1 Hold the lever of the PCle card c
92. an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door 11 6 5 System stopped hot maintenance I Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified N w Pe XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically WoW answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Start the entire system For details see 6 3 Starting the Entire System Close the rack door Chapter11 Maintaining the Management Cable 181 11 6 6 System stopped cold maintenance Connect all the power cords to the power supply unit of t
93. ance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive hot maintenance 1 Open the rack door 2 Loginto the XSCF shell 3 Execute the showlogs command to identify the management cable requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Inactive cold maintenance 1 Open the rack door Chapter11 Maintaining the Management Cable 175 1133 9 2 3 Log in to the XSCF shell Execute the showlogs command to identify the management cable requiring maintenance XSCF gt showlogs error Pe a D For details see 3 3 4 Checking log information Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring
94. ance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error 106 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 1 3 3 7 3 4 For details see 3 3 4 Checking log information Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the connection locations of the power cords before disconnecting them to ensure that they are reinstalled properly Inactive hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the PCle card requiring maintenance
95. ansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door System stopped cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Start the entire system For details see 6 3 Starting the Entire System Close the rack door 220 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 15 Maintaining the I O Board This chapter describes the maintenance procedure for the I O board 15 1 Configuration of the I O Board Before Maintaining the I O Board Enabling the Removal of the I O B
96. ard 228 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 15 3 I O board screws 3 Hold and slide the guide A in the figure of the I O board toward the rear of the chassis and then remove the board Note Do not remove the I O board by holding its connectors Note Place the removed I O board on the grounded ESD mat to eliminate any static electricity Chapter 15 Maintaining the I O Board 229 Figure 15 4 I O board removal 15 5 Installing the I O Board This section describes the procedure for installing the I O board 15 9 1 Installing the I O board 1 Install the I O board adjusting it to align with the six stoppers Hold and slide the guide to the front of the chassis 230 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 15 5 I O board stoppers 2 Tighten the two screws securing the I O board Chapter 15 Maintaining the I O Board 231 Figure 15 6 I O board screws 3 Connect all the six cables to the I O board Note Connect the cables in their original positions by referring to the record that you made before the start of maintenance 232 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 15 7 I O board cables 15 5 2 Restoring the chassis I Install the PCI tray For details see 14 5 2 Installing the PCI tray Install all the fan units For details
97. ase the link card requiring maintenance from the server For details see 5 1 1 Releasing the link card using PHP 6 Execute the cfgadm 1M command to cause the locator LED of the link card to blink so that you can locate the card Enter the Ap_ID of the link card that you noted in advance cfgadm x led attn mode blink Ap ID 7 Check the following LEDs to determine whether the PCle card requiring maintenance is actually maintainable The ATTENTION LED amber of the PCI card slot is blinking The POWER LED of the PCI card slot is off 9 3 2 Active hot maintenance use of DR Note For active hot maintenance that does not use PHP it is necessary to release the server requiring maintenance from the physical partition using physical partition dynamic reconfiguration DR For details on the the versions of XCP and Oracle VM Server for SPARC SRU that support DR see the latest product note Note Active cold maintenance is enabled only for the building block configuration of the SPARC M10 4S 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit Chapter9 Maintaining the Link Cards 147 For details see For active maintenance in How to check the serial number and firmware version of the P
98. assette and carefully insert the cassette into the PC slot Note Slide the PCle card cassette along the rail at the bottom of the PCle slot Note Do not forcibly push the PCle card cassette into the PCI slot Using excessive force may damage the component or the chassis 116 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 2 Lower the lever while pressing the latch of the PCle card cassette to secure it Note Confirm that the PCle card cassette is securely and correctly inserted 75 3 Restoring the chassis 1 Connect all the cables to the PCle card cassette Note Connect the cables in their original positions by referring to the record that you made before the start of maintenance 7 6 Restoring the System This section describes the procedure for restoring the system after a PCIe card is installed or removed The restoration procedure differs depending on the maintenance type as follows m Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance 7 6 1 Active hot maintenance 1 Execute the cfgadm 1M command to supply power to the PCle card requiring maintenance Enter the Ap_ID you noted in advance cfgadm c connect Ap ID 2 Execute the cfgadm 1M command to incorporate the PCle card requiring maintenance into the logical domain Enter the Ap_ID you noted in
99. at the same time Remount the I O board and fan backplane on the replaced PCI tray Table B 5 lists the specifications of the PCI tray Table B 5 Item Number of PCI trays Location Active hot maintenance Active cold maintenance Inactive hot maintenance PCI tray specifications Description 1 Inside the chassis Unsupported Supported with SPARC M10 4 M10 45S connected Unsupported Appendix B Component Specifications 257 Table B 5 PCI tray specifications continued Item Description Inactive cold maintenance Supported System stopped maintenance Supported For the maintenance procedure see Chapter 14 Maintaining the PCI Tray B 6 I O Board Eleven PCle slots and one slot for the link board are provided on the I O board Table B 6 lists the specifications of the I O board Table B 6 1 O board specifications Item Description Number of I O boards 1 Location Rear of chassis Active hot maintenance Unsupported Active cold maintenance Supported with SPARC M10 4 M10 45 connected Inactive hot maintenance Unsupported Inactive cold maintenance Supported System stopped maintenance Supported For the maintenance procedure see Chapter 15 Maintaining the I O Board B 7 Fan Backplane The fan backplane connects the three fan units Table B 7 lists the specifications of the fan backplane Table B 7 Fan backplane specifications Item Description Number of fan backplanes 1 Location Inside the
100. ayed in TYPE of the output result the SR IOV function is in use The original configuration needs to be restored after the PCIe card is maintained So retain the output result of the Idm list io command b Enable the hotplug service of the root domain and I O domain Chapter 5 Understanding the Preparations for Enabling Maintenance 61 svcadm enable hotplug c Execute the Idm remove io command to delete the virtual function VF assigned to the I O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCle card delete all the VFs corresponding to that PF from the I O domain ldm remove io lt VF name gt lt I O domain name gt d Execute the Idm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created ldm destroy vf lt VF name gt In case Static SR IOV feature is used Execute the following procedure a Execute the Idm list io command to check whether the SR IOV function is in use For details see 4 2 3 Checking whether the SR IOV function is used If there is a line on which VF is displayed in TYPE of the output result the SR IOV function is in use The original configuration needs to be restored after the PCIe card is maintained So retain the output result of the Idm list io command b Stop the I O domain ldm stop domain lt I O domain name gt c Execute the
101. be completed prior to the removal of the link board The preparation procedure differs depending on the maintenance type as follows Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link board requiring maintenance XSCF gt showlogs error 4 For details see 3 3 4 Checking log information Release from the server the link card to which the PCI expansion unit Chapter 8 Maintaining the Link Board 127 8 3 2 8 3 3 requiring maintenance is connected For details see 5 1 1 Releasing the link card using PHP Active cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link board requiring maintenance XSCF gt showlogs error For details see 3 3 4 Ch
102. before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 6 6 Start the entire system For details see 6 3 Starting the Entire System 7 Close the rack door 156 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 10 Maintaining the Link Cables This chapter describes the maintenance procedure for the link cables 10 1 Configuration of the Link Cable Connection Ports Before Maintaining a Link Cable Enabling the Removal of a Link Cable Removing a Link Cable Installing a Link Cable Restoring the System Configuration of the Link Cable Connection Ports This section describes the configuration and location of the link cable connection ports The link cards of the SPARC M10 1 or SPARC M10 4 M10 4S are connected to the link board of the PCI expansion unit with the link cables and the management cable 157 Figure 10 1 Location of link cable connection ports Location number Component 1 Link cable LINKCBL 0 2 Link cable LINKCBL 1 10 2 10 2 1 Before Maintaining a Link Cable This section describes the maintenance types flow and points to remember regarding the link cables Note Read and understand the instructions in this chapter before starting the maintenance work
103. ble B 3 Power supply unit specifications Item Description Number of power supply units 2 Redundancy 1 1 redundant configuration Location Rear of chassis Active hot maintenance Supported Active cold maintenance Supported with SPARC M10 4 M10 4S connected Inactive hot maintenance Supported Inactive cold maintenance Supported System stopped maintenance Supported 256 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 For the maintenance procedure see Chapter 12 Maintaining the Power Supply Units B 4 Fan Unit Three fan units are mounted in the chassis to create flow that forces air out of the chassis The redundant configuration of the fan units allows the system to continue running even if a fan unit fails Table B 4 lists the specifications of the fan unit Table B 4 Item Number of fan units Redundancy Location Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped maintenance Specifications of fan units Description 3 2 1 redundant configuration Front of chassis Supported Supported with SPARC M10 4 M10 45S connected Supported Supported Supported For the maintenance procedure see Chapter 13 Maintaining the Fan Units B 5 PCI Tray The PSU backplane I O board and fan backplane are mounted on the PCI tray When the PCI tray is to be replaced replace the PCI tray and PSU backplane
104. bled Enabled Enabled Enabled Enabled Enabled Inactive cold Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled System stopped hot Enabled Enabled Enabled Enabled Enabled Enabled Enabled Not maintainable System stopped cold Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Enabled Reference Chapter 7 Chapter 8 Chapter 9 Chapter 10 Chapter 11 Chapter 12 Chapter 13 Chapter 14 Chapter 15 Chapter 16 1 The maintenance work is performed using the PCI hot plug PHP While referring to 4 2 2 Checking whether the PCI hot plug PHP can be used check whether PHP is usable In combination with the dynamic SR IOV or the dynamic reconfiguration function of the PCIe endpoint device PHP can also enable the SR IOV virtual function or the active maintenance of the PCIe card assigned to an I O domain as a PCIe endpoint For details see Table 4 9 2 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 3 This is supported only for a redundant configuration Chapter4 Preparing for Maintenance 51 Table 4 9 building block config
105. bles 157 10 1 Configuration of the Link Cable Connection Ports 157 10 2 Before Maintaining a Link Cable 158 10 2 1 Types of maintenance 158 10 2 2 Maintenance flow 159 10 2 3 Precautions for replacement 159 10 3 Enabling the Removal of a Link Cable 160 10 3 1 Active hot maintenance 161 Contents vii 10 3 2 10 3 3 10 3 4 10 3 5 10 3 6 Active cold maintenance 161 Inactive hot maintenance 162 Inactive cold maintenance 162 System stopped hot maintenance 163 System stopped cold maintenance 163 10 4 Removing a Link Cable 164 10 5 Installing a Link Cable 165 10 6 Restoring the System 166 10 6 1 10 6 2 10 6 3 10 6 4 10 6 5 10 6 6 Active hot maintenance 166 Active cold maintenance 166 Inactive hot maintenance 167 Inactive cold maintenance 167 System stopped hot maintenance 168 System stopped cold maintenance 168 Chapter 11 Maintaining the Management Cable 171 11 1 Configuration of the Management Cable Connection Port 171 11 2 Before Maintaining the Management Cable 172 11 2 1 11 2 2 Types of maintenance 172 Maintenance flow 173 11 3 Enabling the Removal of the Management Cable 173 11 3 1 11 3 2 11 3 3 11 3 4 11 35 5 11 3 6 Active hot maintenance 174 Active cold maintenance 174 Inactive hot maintenance 175 Inactive cold maintenance 175 System stopped hot maintenance 176 System stopped cold maintenance 177 11 4 Removing the Management Cable 177 11 5 Installing the Management Cable 178 11 6 R
106. bsystem ID 0000 Model Connection 7001 PCIBOX 7001 Status Normal Ver 1110h Serial 2121237001 FRU Part Number IOB Status Normal Serial PP123403JE FRU Part Number CA20365 B66X OO8AG LINKBOARD Status Normal Serial PP1234026P FRU Part Number CA20365 B60X OO1AA Name_Property ethernet Vendor ID 1077 Device ID 8000 Subsystem _Vendor ID 1077 Subsystem ID 017e Model 11 Connect to the control domain console of the physical partition 12 Suppose that the virtual function VF using the SR IOV function has been deleted or discarded in Making the link card ready to be released Based on the retained output result of the Idm list io command re perform the virtual function creation and assignment to the domain In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain Chapter6 Understanding the Preparations for Restoring the System 81 svcadm enable hotplug b Execute the Idm create vf command to create the virtual function ldm create vf lt PF name gt c Execute the Idm add io command to assign the virtual function to the I O domain ldm add io lt VF name gt lt I O domain name gt In case Static SR
107. card cassette Note Do not use excessive force to remove the link board from the PCle card cassette The use of excessive force could damage the link board Note Place the removed link board on the ESD mat to ground any static electricity 134 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 8 5 Link board removal 8 5 Installing the Link Board This section describes the procedure for installing the link board 8 5 1 Installing the link board 1 Install the link board by inserting it into the connector of the PCle card cassette Note Confirm that the tab of the link board A in the figure is inserted into the notch B in the figure of the PCIe card cassette Chapter 8 Maintaining the Link Board 135 Figure 8 6 Link board installation 2 Secure the bracket of the link board with the screw 136 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 5 2 Figure 8 7 Installing the bracket 3 Mount the cover on the PCle card cassette Restoring the chassis 1 Install the PCle card cassette For details see 7 5 2 Installing a PCI Express card cassette 2 Connect the two link cables and one management cable Note Connect the cables in their original positions by referring to the notes that you made before the start of maintenance Note Insert the link cable electrical or link cable optical by holding the connector par
108. cate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 12 3 2 Execute the ioxadm command to stop the power supply unit requiring maintenance In the following example PSU 0 of PCIBOX 12B4 is specified XSCF gt ioxadm poweroff PCIBOX 12B4 PSU 0 Confirm that the LED on the power supply unit requiring maintenance is blinking Remove the power cord from the power supply unit requiring maintenance For details see 5 4 1 Removing the power cords Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the power supply unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually
109. ch the power cord of the PCI expansion unit remains connected Cold Status in which the power cord of the PCI expansion unit has been disconnected Hot Status in which the power cord of the PCI expansion unit remains connected Cold Status in which the power cord of the PCI expansion unit has Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance been disconnected The following details each maintenance type Active hot maintenance Maintenance is performed while Oracle Solaris is operating in the physical partition The power cord of the PCI expansion unit requiring maintenance remains connected The following FRUs of the PCI expansion unit are subject to active hot maintenance Redundant power supply unit Fan unit PCIe card that can use the PCI hot plug PHP The following FRUs of the PCI expansion unit can also be subject to active hot maintenance This can be done after releasing the link card mounted in the server of the destination from the system using the PCI hot plug PHP Link board Link cable and management cable 44 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note If the setting of the direct I O function is enabled the link card cannot use PHP Release the link card from the system using physical partition DR Figure 4 5 Active
110. chassis Active hot maintenance Unsupported Active cold maintenance Supported with SPARC M10 4 M10 4S connected 258 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table B 7 Fan backplane specifications continued Item Description Inactive hot maintenance Unsupported Inactive cold maintenance Supported System stopped maintenance Supported 1 For the maintenance procedure see Chapter 16 Maintaining the Fan Backplane Appendix B Component Specifications 259 260 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Appendix C Updating the Firmware of the PCI Expansion Unit This appendix describes the procedure for updating the firmware of a PCI expansion unit Firmware update is done by the system administrator or a field engineer Before Updating the Firmware Updating the Firmware Problems during Firmware Update C 1 C 1 1 Before Updating the Firmware This section describes the precautions to be observed when updating and the method of checking the firmware version Precautions for updating Note the following points when updating the firmware Always read the latest Product Notes It is not possible to update the firmware on more than one unit at a time Update the firmware one unit at at time The firmware can be updated if any of the following conditions are met when the system is operating and the PCI expansion unit
111. ckplane This chapter describes the maintenance procedure for the fan backplane Location of the Fan Backplane Before Maintaining the Fan Backplane Enabling the Removal of the Fan Backplane Removing the Fan Backplane Installing the Fan Backplane Restoring the System 16 1 Location of the Fan Backplane This section describes the location of the fan backplane The fan backplane connects the individual fan units Caution Do not replace a fan backplane together with an I O board If you replace a fan backplane together with an I O board the PCI expansion unit serial number changes to all 0 s 0000000000 If the serial number changes to all 0 s 0000000000 you need to restore the original serial number by using the ioxadm command of the XSCF firmware To replace both a fan backplane and an I O board replace either of the two start the physical partition connected to the PCI expansion unit and check for error log information related to the PCI expansion unit After confirming that no such error log information is displayed replace the other Field Replaceable Unit FRU 239 Figure 16 1 Location of the fan backplane 1 Location number Component 1 Fan backplane FANBP 16 2 Before Maintaining the Fan Backplane This section describes the maintenance types and flow for the fan backplane Note Read and understand the instructions in this chapter before starting the maintenance work Also
112. components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity AN Caution Before you handle any components wear a wrist strap to ground any static 1 Push the lever of the power supply unit requiring maintenance A in the figure in the direction of the arrow to release the lock and then pull out the unit by grasping the handle B in the figure 190 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 12 2 Removing a power supply unit 2 Using your other hand support the power supply unit from below and carefully remove it from the slot Note Place the removed power supply unit on a grounded antistatic ESD mat 12 5 Installing a Power Supply Unit This section describes the procedure for installing a power supply unit 1 With one hand support the power supply unit from below and then carefully insert it into its slot Note Do not forcibly push the power supply unit into its slot Using excessive force may damage the component or the chassis 2 Push the power supply unit fully home Note Make sure that the power supply unit is firmly inserted and fixed 12 6 Restoring the System This section describes the procedures for restoring the system after installing a power supply unit The restoration procedure differs depending on the maintenance type as Chapter 12 Maintaining the Power Supply Units 191 follows Act
113. d 2 Install the fan backplane on the PCI tray For details see 16 5 1 Installing the fan backplane Installing the PCI tray 1 Hold the PCI tray with both hands and carefully insert it into the chassis Caution Confirm that the PCI tray is inserted and securely fixed 2 Tighten the two screws holding the PCI tray Restoring the chassis 1 Install all the fan units For details see 13 5 1 Installing a fan unit 2 Install the front cover For details see 6 4 2 Installing the front cover 3 Install all the components listed below Power supply unit For details see 12 5 Installing a Power Supply Unit PCle card cassette 218 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 For details see 7 5 2 Installing a PCI Express card cassette 14 6 14 6 1 14 6 2 Restoring the System This section describes the procedure for restoring the system after PCI tray installation The restoration procedure differs depending on the maintenance type as follows Active cold maintenance Inactive cold maintenance System stopped cold maintenance Active cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPA
114. d Chapter 8 Enabled Chapter 9 Enabled Chapter 10 Enabled Chapter 11 Enabled Chapter 12 Enabled Chapter 13 Enabled Chapter 14 Enabled Chapter 15 Enabled Chapter 16 1 The maintenance work is performed using the PCI hot plug PHP While referring to 4 2 2 Checking whether the PCI hot plug PHP can be used check whether PHP is usable In combination with the dynamic SR IOV or the dynamic reconfiguration function of the PCIe endpoint device PHP can also enable the SR IOV virtual function or the active maintenance of the PCIe card assigned to an I O domain as a PCIe endpoint For details see Table 4 6 2 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 3 This is supported only for a redundant configuration Table 4 6 single unit configuration Domain to which the PCI expansion unit belongs Control domain Root domain PCle card requiring maintenance Direct I O 1 Unsupported PHP support Supported SR IOV 2 a upported CG nsupported Maintenance type for the PCIe card of the PCI expansion unit When the destination server has a Not maintainable PCI card maintenance type Unsupported Supported Supported Unsupported Unsupported Unsupported Unsupported S
115. d from the suppliers to Oracle and or its affiliates and Fujitsu Limited including software and font technology Per the terms of the GPL or LGPL a copy of the source code governed by the GPL or LGPL as applicable is available upon request by the End User Please contact Oracle and or its affiliates or Fujitsu Limited This distribution may include materials developed by third parties Parts of the product may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark of The Open Group Oracle and Java are registered trademarks of Oracle and or its affiliates Fujitsu and the Fujitsu logo are registered trademarks of Fujitsu Limited SPARC Enterprise SPARC64 SPARC64 logo and all SPARC trademarks are trademarks or registered trademarks of SPARC International Inc in the United States and other countries and used under license Other names may be trademarks of their respective owners If this is software or related documentation that is delivered to the U S Government or anyone licensing it on behalf of the U S Government the following notice is applicable U S GOVERNMENT END USERS Oracle programs including any operating system integrated software any programs installed on the hardware and or documentation delivered to U S Government end users are commercial computer software pursuant to the applicable Federal Acquisition Regulation and agency specific supplemental regulations As suc
116. d on Oracle Solaris super user prompt to display the list of the configuration information and then confirm the configuration information to be saved The following example shows that test3 is the current configuration information ldm 1ls spconfig factory default testl test2 test3 current If the current configuration is shown as next poweron execute the Idm add spconfig command to save the current configuration information This is because the configuration information stored in the XSCF is different from that stored in the control domain In the following example the current configuration information is saved in test4 because test3 is next poweron ldm 1ls spconfig factory default testl test2 test3 next poweron ldm add spconfig test4 Chapter1 Before Starting Maintenance Work 9 10 ldm 1ls spconfig factory default testl test2 test3 test4 current Execute the Idm set spconfig command to specify the configuration information to be set The following example specifies test1 ldm set spconfig testl ldm 1ls spconfig factory default testl next poweron test2 test3 Execute the poweroff and poweron commands of the XSCF firmware to turn off on the power to the physical partition Before turning off the power to the system stop the logical domain with an appropriate procedure and use the Idm unbind command to transfer it to the inactive state The following example
117. d that was just executed In the following example an end status of 0 is returned indicating normal termination of the deleteboard command XSCF gt showresult 0 Execute the showboards command to check that the server requiring maintenance has been released from the physical partition The following example shows that Pwr Conn and Conf of PSB 01 0 are all displayed as n indicating that PSB 01 0 has been released gy N XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Degraded 8 Execute the Idm list domain command on the control domain console of the physical partition to confirm that the operation status of the logical domain has not changed after the deletion of the system board Chapter 5 Understanding the Preparations for Enabling Maintenance 71 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs This section describes the procedure for turning off the power to a physical partition to which the PCI expansion unit requiring maintenance belongs 1 Log in to the XSCF shell 2 Execute the ioxadm locator command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can locate the unit You do not have to perform this step when performing maintenance on the link card mounted on a server In the following example the CHECK LED of PCIBOX 12
118. d to confirm that the PCI expansion unit requiring maintenance is recognized normally When you enter the y option for the testsb command the system automatically Moo answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Start the entire system For details see 6 3 Starting the Entire System Close the rack door 252 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Appendix A Component List This appendix describes the components of the PCI expansion unit Figure A 1 shows the locations of the components mounted in the chassis Figure A 1 Locations of components 253 Location Component number I O board PCI tray Fan backplane Fan unit PSU backplane Power supply unit PCI Express card cassette Link board PCI Express Card o AN BD oO FF WO N e 254 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Appendix B Component Specifications This appendix describes the specifications of the components B 1 PCI Express Card Link Board Power Supply Unit Fan Unit PCI Tray T O Board Fan Backplane PCI Express Card Up to eleven 11 PCIe cards can be mounted Table B 1 lists the specifications of the PCle card T
119. de to release the physical I O device slot ldm start reconf lt root domain name gt ldm remove io lt I O device name gt lt root domain name gt b Log in to the root domain to restart Oracle Solaris of the root domain telnet localhost lt port number gt shutdown i6 g0 y c Execute the Idm add io command to assign the PCIe slot to the I O domain ldm add io lt I O device name gt lt I O domain name gt 6 Suppose that the virtual function VF using the SR IOV function has been deleted or discarded in Deleting the physical I O device Based on the retained output result of the Idm list io command re perform the virtual function creation and assignment to the domain In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain svcadm enable hotplug b Execute the Idm create vf command to create the virtual function 86 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 ldm create vf lt PF name gt In case Static SR IOV feature is used Execute the following procedure a Execute the ldm start reconf command to place the root domain to which the physical function PF
120. dom0 or iodom1 indicating assignment to the control domain iodom0 or iodom1 XSCF gt ldm list io NAME TYPE BUS DOMAIN STATUS PCIEO BUS PCIEO primary IOV PCIE1 BUS PCIE1 iodom0 IOV PCIE2 BUS PCIE2 primary IOV PCIE3 BUS PCIE3 primary IOV PCIE4 BUS PCIE4 primary IOV PCIE5 BUS PCIE5 iodom0 IOV PCIE6 BUS PCIE6 primary IOV PCIE7 BUS PCIE7 primary IOV PCIE8 BUS PCIE8 primary IOV PCIE9 BUS PCIE9 iodoml IOV PCIE10 BUS PCIE10 primary IOV PCIE11 BUS PCIE11 primary IOV PCIE12 BUS PCIE12 primary IOV PCIE13 BUS PCIE13 iodoml IOV PCIE14 BUS PCIE14 primary IOV PCIE15 BUS PCIELS primary IOV See Omitted BB1 CMUL NETO PCIE PCIE8 primary OCC BB1 CMUL SASHBA PCIE PCIE8 primary OCC BB1 PCI0 SLOT1 PCIE PCIE9 iodoml Occ BB1 PCIO SLOT2 PCIE PCIE9 sdiodomainOCC BB1 PCIO SLOT3 PCIE PCIE9 iodoml Occ BB1 PCIO SLOT4 PCIE PCIE9 sdiodomainOCc BB1 PCIO SLOTS PCIE PCIE9 iodoml EMP BB1 PCI0 SLOT6 PCIE PCIE9 iodoml EMP BB1 PCIO SLOT7 PCIE PCIE9 iodoml EMP BB1 PCI0 SLOT8 PCIE PCIE9 iodoml EMP BB1 PCI0 SLOT9 PCIE PCIE9 iodoml EMP BB1 PCI0 SLOT10 PCIE PCIE9 iodoml EMP BB1 PCI0O SLOT11 PCIE PCIE9 iodoml EMP BB1 PCI3 PCIE PCIELO primary EMP BB1 PCI4 PCIE PCIELO primary EMP BB1 PCI7 PCIE PCIE11 primary EMP BB1 PCI8 PCIE PCIE11 primary EMP BB1 CMUL NET2 PCIE PCIE12 primary OCC 66 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014
121. dure for restoring the system after installing a fan unit The restoration procedure differs depending on the maintenance type as follows m Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance 13 6 1 Active hot maintenance 1 Execute the ioxadm command to supply power to the fan unit In the following example FAN 0 of PCIBOX 12B4 is specified XSCF gt ioxadm poweron PCIBOX 12B4 FAN 0 2 Execute the showstatus command to check that the replaced fan unit is operating normally XSCF gt showstatus 3 Execute the showhardconf command to check the hardware configuration and the status of each component 206 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 13 6 2 13 6 3 XSCF gt showhardconf 4 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 5 Close the rack door Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all th
122. e 1 Mount the PCI expansion unit on the server For details see 6 1 1 Mounting the link card on the server using PHP 2 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 3 Close the rack door Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Chapter11 Maintaining the Management Cable 179 11 6 3 11 6 4 Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Log in to the XSCF shell 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off P
123. e Server 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance 242 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 16 3 2 16 3 3 For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive cold maintenance 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the fan backplane requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the
124. e cable clamp Chapter6 Understanding the Preparations for Restoring the System 91 Lock the latch A in the figure and then push the cable clamp toward the front of the chassis to firmly secure the cable clamp Figure 6 2 Locking the cable clamp 6 4 2 Installing the front cover If the front cover has been removed for maintenance mount the components on the front panel or inside the chassis and then reinstall the front cover 1 Insert the tabs of the front cover A in the figure into the notches located on the lower side of the front panel of the chassis B in the figure to install the front cover 92 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 6 3 Installing the front cover Chapter6 Understanding the Preparations for Restoring the System 93 94 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 7 Maintaining the PCI Express Cards This chapter describes the maintenance procedure for a PCI Express PCIe card PCle cards can be replaced installed or removed 7 1 Configuration of the PCIe Cards Before Maintaining a PCI Express Card Enabling the Removal of a PCI Express Card Removing a PCI Express Card Installing a PCI Express Card Restoring the System Configuration of the PCle Cards This section describes the configuration and location of the PCle cards Up to eleven 11 PCIe cards can be mounted After maintena
125. e et sont des marques d pos es de SPARC International Inc aux Etats Unis et dans d autres pays Tout autre nom mentionn peut correspondre a des marques appartenant a leurs propri taires respectifs Si ce logiciel ou la documentation qui l accompagne est conc d sous licence au Gouvernement des Etats Unis ou toute entit qui d livre la licence de ce logiciel ou l utilise pour le compte du Gouvernement des Etats Unis la notice suivante s applique U S GOVERNMENT END USERS Oracle programs including any operating system integrated software any programs installed on the hardware and or documentation delivered to U S Government end users are commercial computer software pursuant to the applicable Federal Acquisition Regulation and agency specific supplemental regulations As such use duplication disclosure modification and adaptation of the programs including any operating system integrated software any programs installed on the hardware and or documentation shall be subject to license terms and license restrictions applicable to the programs No other rights are granted to the U S Government Avis de non responsabilit les seules garanties octroy es par Oracle et Fujitsu Limited et ou toute soci t affili e de l une ou l autre entit en rapport avec ce document ou tout produit ou toute technologie d crits dans les pr sentes correspondent aux garanties express ment stipul es dans le contrat de licence r gissant le
126. e is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 7 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive cold maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the I O board requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expansion unit 5 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 6 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Chapter 15 Maintaining the I O Board 225 7 Remove all the power cords from the power supply unit of the PCI expansion unit requiring mainte
127. e order of date with the oldest appearing first The following example shows that an Alarm status occurred in PSU 1 and PSU 2 at 12 45 31 on Oct 20 the Alarm status changed to a Warning status at 15 45 31 on the same day and then the Alarm status further expanded to PSU 1 PSU 2 and PSU 3 at 17 45 31 on the same day XSCF gt showlogs error Date Code Status FRU Oct 20 Date Code status FRU Oct 20 Date Code status FRU Oct 20 0011 Alarm PSU Msg ACFAIL occurred 0011 Warning PSU Msg ACFAIL occurred 0011 Alarm PSU Msg ACFAIL occurred 12 45 31 JST 2012 2233 445566778899aabbcc 8899aabbcceeff0011223344 Occurred Oct 20 12 45 31 000 JST 2012 PSU 2 ACS 3 FEP type 15 45 31 JST 2012 2233 445566778899aabbcc 88 99aabbcceeff0011223344 Occurred Oct 20 15 45 31 000 JST 2012 Al PSU 2 ACS 3 FEP type 17 45 31 JST 2012 2233 445566778899aabbcc 88 99aabbcceeff0011223344 Occurred Oct 20 17 45 31 000 JST 2012 Al PSU 2 PSU 3 ACS 3 FEP type Al 3 4 34 Locating the PCI Expansion Unit Requiring Maintenance This section describes the procedure for locating a PCI expansion unit requiring maintenance by causing the CHECK LED locator on the front panel of the chassis to blink Execute the ioxadm command of the XSCF firmware to cause the CHECK LED for the PCI expansion unit requiring maintenance to blink to locate it For details on the loca
128. e power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Loginto the XSCF shell 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 2 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry Chapter 13 Maintaining the Fan Units 207 13 6 4 1326 5 The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs
129. e rack door Log in to the XSCF shell Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information Execute the ioxadm locator command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Execute the ioxadm list command to check the BB ID of the server that is connected to the PCI expansion unit requiring maintenance The following example shows that the BB ID of the server to which PCIBOX 12B4 is connected is BB 01 p ol XSCF gt ioxadm list PCIBOX 12B4 PCIBOX Link PCIBOX 12B4 BB 01 PCI 05 6 Execute the showboards a command to check the PPAR ID of the physical partition using the link card Chapter7 Maintaining the PCI Express Cards 99 The BB ID of the server to which the PCI expansion unit requiring maintenance is connected is displayed as a system board PSB number In the following example the PPAR ID of PSB 01 0 is 00 XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Normal 7 Connect to the control domain console of the physical partition 8 Check whether there is a guest domain that is virtually using the PCle card requiring maintenance For the Ethernet card
130. e result is displayed 4 Start the entire system For details see 6 3 Starting the Entire System 5 Close the rack door 124 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 8 Maintaining the Link Board This chapter describes the maintenance procedure for the link board 8 1 Configuration of the Link Board Before Maintaining the Link Board Enabling the Removal of the Link Board Removing the Link Board Installing the Link Board Restoring the System Configuration of the Link Board This section describes the configuration and location of the link board The link board is mounted in a dedicated slot among the PCI Express PCIe slots Connect the link board to the link card mounted on the SPARC M10 1 M10 4 M10 4S with the link cables and the management cable Figure 8 1 Location of the link board 125 Location number Component 1 Link board LINKBD 8 2 Before Maintaining the Link Board This section describes the maintenance types and flow for the link board Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work 8 2 1 Types of maintenance Table 8 1 lists the types of maintenance for the link board For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configurati
131. eased is assigned and on the root domain 4 Ifthe direct I O is in use delete the physical I O device from the I O domain and then restore the physical I O device to the root domain In case dynamic reconfiguration of PCle endpoint devices is used Note Dynamic reconfiguration of PCle endpoint devices is supported by a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain svcadm enable hotplug b Execute the Idm remove io command to delete the physical I O device from the I O domain ldm remove io lt I O device name gt lt I O domain name gt C Execute the Idm add io command to reassign the deleted physical I O device to the root domain ldm add io lt I O device name gt lt root domain name gt In case dynamic reconfiguration of PCle endpoint devices is not used Delete the physical I O device after stopping the I O domain and then restore the physical I O device to the root domain Execute the following procedure a b Execute the Idm stop domain command to stop the I O domain Execute the Idm remove io command to delete the physical I O device from the I O domain Execute the Idm start reconf command to make the root domain enter delayed reconfiguration mode d Execute the Idm add io command to reassign the delet
132. eassign the deleted physical I O device to the I O domain ldm add io lt I O device name gt lt I O domain name gt 11 Start the stopped I O domain before replacing the PCle card ldm start domain lt I O domain name gt 12 Suppose that the virtual function VF using the SR IOV function has been Chapter 7 Maintaining the PCI Express Cards 119 120 deleted or discarded in Making the PCle card ready to be released Based on the retained output result of the Idm list io command re perform the virtual function creation and assignment to the domain In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain svcadm enable hotplug b Execute the Idm create vf command to create the virtual function ldm create vf lt PF name gt c Execute the Idm add io command to assign the virtual function to the I O domain ldm add io lt VF name gt lt I O domain name gt In case Static SR IOV feature is used Execute the following procedure a Place the root domain to which PF is assigned in delayed reconfiguration mode ldm start reconf lt root domain name gt b Execute the ldm create vf command to create the virtual
133. ecking log information Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link board requiring maintenance 128 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 3 4 8 3 5 XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Inactive cold maintenance 1 Open the rack door 2 Loginto the XSCF shell 3 Execute the showlogs command to identify the link board requiring maintenance X
134. ect the two link cables to the link board mounted in the PCI expansion unit Note Reinstall the link cables in their original positions by referring to the record you made before the start of maintenance Note Confirm that the link cables are connected and firmly secured 2 Connect the two link cables to the link card mounted in the SPARC M10 1 or SPARC M10 4 M10 4S by using the same procedure Note Reinstall the link cables in their original positions by referring to the record that you made before the start of maintenance Note Confirm that the link cables are connected and firmly secured Chapter 10 Maintaining the Link Cables 165 10 6 10 6 1 10 6 2 Restoring the System This section describes the procedure for restoring the system after link cable installation The restoration procedure differs depending on the maintenance type as follows Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Active hot maintenance 1 Mount the PCI expansion unit on the server For details see 6 1 1 Mounting the link card on the server using PHP 2 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 3 Close the rack door Active cold maintenance Note
135. ected 9 2 2 Maintenance precautions Note the following when performing link card maintenance Active hot maintenance and inactive hot maintenance of the link card can only be performed when the server is hot No active addition can be performed for the link card with PCI hot plug PHP In the building block configuration use physical partition dynamic reconfiguration Chapter9 Maintaining the Link Cards 145 or perform inactive addition For the SPARC M10 1 SPARC M10 4 or a configuration of 1 M10 45 perform addition with the system stopped Before replacing the link card check the firmware version The firmware of the PCI expansion unit has been installed on the link card and the I O board When replacing the link card however the firmware version cannot be automatically matched to the one before the replacement For this reason you must use a confirmed firmware version to match it to the firmware version before the replacement If you cannot recognize the PCI expansion unit from the XSCF check the firmware version of a part that has not been replaced after the replacement to match it to the firmware version before the replacement When you replace the I O board and the link card at the same time check the firmware version before the replacement If you replace the I O board and the link card at the same time without checking the firmware version you may not be able to match the version If multiple PCI expansion unit
136. ecute the ioxadm list command to confirm that the maintained PCI expansion unit has been recognized normally The following example shows that PCIBOX 12B4 is connected to BB 01 SLOT 05 XSCF gt ioxadm list PCIBOX Link PCIBOX 12B4 BB 01 PCI 05 9 Ifthe master chassis requiring maintenance has switched to the standby status before maintenance execute the switchscf command to switch to the master XSCF 84 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 XSCF gt switchscf t Standby Restoring the logical domain to the status it had before maintenance Connect to the control domain console of the physical partition N If you have released the I O device assigned to the control domain before maintenance restore the I O device to its original status Execute the Idm start reconf command and then enter delayed reconfiguration mode Then assign the I O device PCIe root complex to the control domain with the Idm add io command After assignment the control domain must be restarted Note Once the control domain is placed in the delayed reconfiguration mode control corresponding to the guest domain cannot be executed When delayed reconfiguration mode has been set restart the control domain quickly 3 Restore the redundancy setting when the I O device of the system volume of the control domain or the network has been released from redundancy 4 Execute the Idm add io command to reassign
137. ed the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 11 2 2 Maintenance flow Table 11 2 lists the sequence of the maintenance procedure for the management cable See the relevant section Table 11 2 Maintenance flow Details of update process Replacement 1 Preparation 11 3 2 Management cable removal 11 4 3 Management cable installation 115 4 Restoring the system 11 6 11 3 Enabling the Removal of the Management Cable This section describes the preparations that must be completed prior to removing the management cable The preparation procedure differs depending on the maintenance type as follows Active hot maintenance Active cold maintenance Inactive hot maintenance Chapter11 Maintaining the Management Cable 173 Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur 11 3 1 Active hot maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the management cable requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the server the link card to which the PCI expansion unit requiring maintenance is connected
138. ed boards of the PCI expansion unit are susceptible to static damage To prevent damage to the printed boards therefore wear a wrist strap and ground it to the chassis prior to starting maintenance When mounting a component in the chassis confirm that the connectors on the chassis and components do not have any bent pins and that the pins are aligned If you attempt to mount a component while any of the connectors have bent pins the chassis or component may be damaged When mounting a component perform the work carefully so as not to bend any pins If you cannot reach the latch lock of the connector when removing the management cable or other cables depress the latch with the tip of a flat bladed screwdriver and then remove the cable If you attempt to remove the cable forcibly the link board and or the PCI Express PCle card may be damaged Do not use a power cord other than the specified type Chapter 1 Before Starting Maintenance Work 5 1 6 Emergency Power Off This section explains the procedure for powering off the system in the case of an emergency Caution Immediately shut down the product in the event of an emergency for example when the chassis emits smoke or flame and then disconnect the input power Prevention of fire must always be your highest priority regardless of the task that you are currently performing 1 Remove all the power cords from the power supply unit installed at the rear of the chassis
139. ed physical I O device PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 to the root domain stop domain lt I O domain name gt remove io lt I O domain name gt lt I O domain name gt start reconf lt root domain name gt add io lt I O device name gt lt root domain name gt e Log in to the root domain to restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y a If the virtual function VF using the SR IOV function has been created and assigned to the domain delete and discard it In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the I O domain and root domain svcadm enable hotplug b Execute the Idm remove io command to delete the virtual function VF assigned to the I O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCle card delete all the VFs corresponding to that PF from the I O domain ldm remove io lt VF name gt lt I O domain name gt c Execute the Idm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created ldm des
140. erated for an extended period with one failed unit When multiple power supply units are to be replaced perform the replacement one by one If redundancy of the power supply units cannot be secured cold maintenance must be executed Do not force a power supply unit into its slot Using excessive force may damage Chapter 12 Maintaining the Power Supply Units 185 12 3 12 3 1 186 the component or the chassis Enabling the Removal of a Power Supply Unit This section describes the preparations that must be completed prior to the removal of a power supply unit The preparation procedure differs depending on the maintenance type as follows Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active hot maintenance Note Active hot maintenance is supported only for a redundant configuration Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the power supply unit requiring maintenance XSCF gt showlogs error gt For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can lo
141. erformed on the server Stop the system in either of the following two ways Stopping the system with the XSCF command Stopping the system from the operation panel 1 Change the mode switch on the operation panel to Service mode For details see 2 2 Confirming the Functions of the Operation Panel in the Fujitsu M10 1 SPARC M10 1 Service Manual or the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Note For a building block configuration switch the mode switches of the master chassis and those chassis whose XSCFs are in the standby state 2 Display the Oracle Solaris super user prompt Note Execute this as a super user 3 Stop all guest domains on all physical partitions For details see 8 6 Shutting Down a Logical Domain in the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide 4 Stop the control domains on all physical partitions to stop the system For details see 5 3 1 Stopping the system with the XSCF command or 5 3 2 Stopping the system from the operation panel 5 Execute the showpparstatus a command to confirm that the power to the physical partition is turned off In the following example the PPAR Status of PPAR ID 00 PPAR ID 01 and PPAR ID 02 is displayed as Powered Off indicating that all the physical partitions are powered off XSCF gt showpparstatus a PPAR Status Powered Off Powered Off Powered Off 6 Execute the showdomainstatus p c
142. estoring the System 179 11 6 1 11 6 2 Active hot maintenance 179 Active cold maintenance 179 viii PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 11 6 3 Inactive hot maintenance 180 11 6 4 Inactive cold maintenance 180 11 6 5 System stopped hot maintenance 181 11 6 6 System stopped cold maintenance 182 Chapter 12 Maintaining the Power Supply Units 183 12 1 Configuration of the Power Supply Units 183 12 2 Before Maintaining a Power Supply Unit 184 12 2 1 Types of maintenance 184 12 2 2 Maintenance flow 185 12 2 3 Precautions for replacement 185 12 3 Enabling the Removal of a Power Supply Unit 12 3 1 Active hot maintenance 186 12 3 2 Active cold maintenance 187 12 3 3 Inactive hot maintenance 188 12 3 4 Inactive cold maintenance 188 12 3 5 System stopped hot maintenance 189 12 3 6 System stopped cold maintenance 189 12 4 Removing a Power Supply Unit 190 12 5 Installing a Power Supply Unit 191 12 6 Restoring the System 191 12 6 1 Active hot maintenance 192 12 6 2 Active cold maintenance 193 12 6 3 Inactive hot maintenance 193 12 6 4 Inactive cold maintenance 194 12 6 5 System stopped hot maintenance 194 12 6 6 System stopped cold maintenance 195 Chapter 13 Maintaining the Fan Units 197 13 1 Configuration of the Fan Units 197 13 2 Before Maintaining a Fan Unit 198 13 2 1 Types of maintenance 198 13 2 2 Maintenance flow 199 186 Contents ix x 13 2 3 Precautions for replacement
143. from the backend and then identify the PCle card in use For details on the step see the documentation for the software that manages the related file system and volume For example if the backend is a file on the ZFS file system execute the zfs list command to check the ZFS storage pool corresponding to the mount point of the directory where the file is placed Moreover execute the zpool status lt zpool name gt to check the physical device path of the PCle card to which the LU or hard disk is connected If MPxIO is used for management display the device path of a physical hard disk corresponding to the LU with the mpathadm command to check the physical device path of the PCle card connected to that path c Suppose that steps a and b indicate that there is a virtual disk service to which 60 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 the PCIe card requiring maintenance is assigned While referring to the CLIENT section of the virtual disk service indicated in step a check the virtual disk and guest domain to which the backend of that virtual disk service is assigned The display format is lt virtual disk gt lt guest domain gt If there is a guest domain that is virtually using the PCle card mounted in the PCI expansion unit requiring maintenance delete the virtual devices vnet vdisk and virtual services vsw vds a Log in to the guest domain to stop the use of the virtual de
144. function ldm create vf lt PF name gt c Execute the Idm add io command to assign the virtual function to the I O domain ldm add io lt VF name gt lt I O domain name gt d Log in to the root domain and then restart Oracle Solaris PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 7 6 2 telnet localhost lt port number gt shutdown i6 g0 y 13 Start the stopped I O domain before replacing the PCle card ldm start domain lt I O domain name gt 14 Suppose that you have deleted the virtual device and virtual service in Making the PCle card ready to be released Based on the information you have written down add a virtual device and virtual service and then reassign them to the guest domain For details on how to add the virtual device and virtual service see the Oracle VM Server for SPARC Administration Guide 15 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the disabled state svcadm disable hotplug 16 Close the rack door Active cold maintenance Note Active cold maintenance is performed using either of the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all the power cords to
145. g Indicates that the PCI expansion unit chassis requires maintenance This function is also referred to as the locator Off Indicates the normal state Or the breaker is open or the power supply is otherwise off The blink interval is 1 second 1 Hz LEDs on rear of PCI expansion unit An LED is mounted on each component If a component experiences an error check the LEDs to see which component requires maintenance Check the LEDs before starting maintenance work The following LEDs are mounted on the rear panel of the PCI expansion unit Power supply unit A in the figure T O board B in the figure Link board C in the figure PCle slot D in the figure Figure 2 6 LEDs on the rear of the chassis The LEDs mounted on each component and the statuses indicated by those LEDs are listed below 22 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 2 3 LEDs and status of power supply unit Name Color Status POWER FAIL Green On Se A Blinking Amber On Blinking Off The blink interval is 1 second 1 Hz Table 2 4 LEDs and status of I O board Name Color Status CHECK Amber On Indicator A Blinking Off The blink interval is 1 second 1 Hz Description The input power is turned on and power is being supplied normally Standby condition Indicates that an error has occurred Warning state an error has occurred but the power unit is
146. g Maintenance Work 9 2 1 Types of maintenance Table 9 1 lists the types of maintenance for the link card For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration The link card maintenance type refers to the status of the server side Table 9 1 Types of maintenance for the link card Not maintainable Mounting location Active hot PHP Active hot DR Inactive hot Inactive cold System System stopped hot stopped cold SPARC M10 1 Enabled Enabled Configuration Enabled 1 Enabled Enabled of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 2 Enabled 3 Enabled Enabled Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 3 Using physical partition dynamic reconfiguration DR it is necessary to release from the physical partition the server to which the PCI expansion unit requiring maintenance is conn
147. g block configuration 212 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 14 1 Types of maintenance for PCI tray Connection destination SPARC M10 1 Configuration of 1 SPARC M10 4 M10 4S SPARC M10 4S Not maintainable Active hot Active cold Inactive hot Inactive cold System System stopped hot stopped cold Enabled Enabled 1 Enabled Enabled 2 Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 14 2 2 Maintenance flow Table 14 2 lists the sequence of the maintenance procedure for the PCI tray See the relevant section Table 14 2 Maintenance flow Details of update process Replacement 1 Preparation 14 3 2 PCI tray removal 14 4 3 PCI Tray installation 14 5 4 Restoring the system 14 6 14 3 Enabling the Removal of the PCI Tray This section describes the preparations that must be completed prior to t
148. h use duplication disclosure modification and adaptation of the programs including any operating system integrated software any programs installed on the hardware and or documentation shall be subject to license terms and license restrictions applicable to the programs No other rights are granted to the U S Government Disclaimer The only warranties granted by Oracle and Fujitsu Limited and or any affiliate in connection with this document or any product or technology described herein are those expressly set forth in the license agreement pursuant to which the product or technology is provided EXCEPT AS EXPRESSLY SET FORTH IN SUCH AGREEMENT ORACLE OR FUJITSU LIMITED AND OR THEIR AFFILIATES MAKE NO REPRESENTATIONS OR WARRANTIE S OF ANY KIND EXPRESS OR IMPLIED REGARDING SUCH PRODUCT OR TECHNOLOGY OR THIS DOCUMENT WHICH ARE ALL PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Unless otherwise expressly set forth in such agreement to the extent allowed by applicable law in no event shall Oracle or Fujitsu Limited and or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits loss of use or data or business interruptions or for any
149. he PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woon answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Start the entire system For details see 6 3 Starting the Entire System Close the rack door 182 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 12 Maintaining the Power Supply Units This chapter describes the maintenance procedure for the power supply units 12 1 Configuration of the Power Supply Units Before Maintaining a Power Supply Unit Enabling the Removal of a Power Supply Unit Removing a Power Supply Unit Installing a Power Supply Unit Restoring the System Configuration of the Power Supply Units This section describes the configuration and the locations of the power supply units The power supply units supply power
150. he chassis is on Execute the setpparparam command and disable the Auto boot function of the physical partition In the following example PPAR ID 0 is set for Auto boot 262 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 If Auto boot is disabled for the physical partition go to step 4 XSCF gt setpparparam p 0 s bootscript setenv auto boot false 4 Execute the poweron command to start the system For a building block configuration specify the physical partition connected to the PCI expansion unit and start the system In the following example PPAR ID 0 is specified XSCF gt poweron p 0 5 If multiple PCI expansion units are connected execute the ioxadm list command to check the combination of the link card and the I O board XSCF gt ioxadm list PCIBOX Link PCIBOX 2007 BB OO PCI 10 PCIBOX 2006 BB OO PCI 09 PCIBOX 2005 BB 00 PCI 08 PCIBOX 2004 BB OO PCI 07 6 Execute the ioxadm v list command to check the serial number and the firmware version of the PCI expansion unit Location displays the last four digits of the serial number of the PCI expansion unit and FW Ver displays the firmware version of the link card CARD shown on Type and that of the I O board IOBOARD shown on Type The following example shows that 2007 is the last four digits of the serial number of the PCI expansion unit and 1080 is the firmware version of the link card and the I O boa
151. he control domain console is being used N Display the Oracle Solaris super user prompt Note Execute this as a super user 3 If the hotplug service is disabled execute the svcadm enable hotplug command to enable the hotplug service svcadm enable hotplug 4 Execute the cfgadm a command to check the Ap_ID of the PCle card and make a note of it cfgadm a Chapter 7 Maintaining the PCI Express Cards 105 5 Execute the cfgadm c command to release the PCle card from the logical domain Enter the Ap_ID you noted in advance cfgadm c unconfigure Ap ID 6 Execute the cfgadm c command to stop the power supply to the PCle card Enter the Ap_ID you noted in advance cfgadm c disconnect Ap ID 7 Execute the cfgadm x command to cause the ATTENTION LED on the PCle slot requiring maintenance to blink so that you can locate the unit For the Ap_ID check the Ap_ID of the PCIe slot by using the cfgadm a command make a note of the Ap_ID and enter it cfgadm x led attn mode blink Ap ID 8 Check the following LEDs to determine whether the PCle card requiring maintenance is actually maintainable The ATTENTION LED amber of the PCI card slot is blinking The POWER LED of the PCI card slot is off 9 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the disabled state svcadm disable hotplug 7 3 2 Active cold maintenance Note Active cold mainten
152. he original configuration must be restored after the PCIe card is maintained So retain the output result of the Idm list io command Deleting the physical I O device 1 If the control domain is made redundant by using the resources of the chassis to be released cancel the redundancy setting 2 If the I O device of the chassis requiring maintenance is assigned to the control domain start the delayed reconfiguration mode with the Idm start reconf command and then delete the I O device root complex with the Idm remove io command After deletion the control domain must be restarted Note Once the control domain is placed in delayed reconfiguration mode control corresponding to the guest domain cannot be executed When the delayed reconfiguration mode has been set restart the control domain quickly 3 If there is a guest domain that is virtually using the PCle card mounted in the Chapter5 Understanding the Preparations for Enabling Maintenance 67 68 PCI expansion unit requiring maintenance make the virtual devices vnet vdisk unused a If the virtual I O is made redundant in the guest domain cancel the redundancy setting and make the target virtual device unused If the virtual I O is not made redundant in the guest domain make it unused by for example deactivating the virtual network or unmounting the virtual disk Perform step 4 and later on the I O domain to which the I O device of the chassis to be rel
153. he removal of the PCI tray The preparation procedure differs depending on the maintenance type as follows Active cold maintenance Inactive cold maintenance System stopped cold maintenance Chapter 14 Maintaining the PCI Tray 213 14 3 1 14 3 2 Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Open the rack door 2 Loginto the XSCF shell 3 Execute the showlogs command to identify the PCI tray requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring main
154. hell Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error Pe For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 5 Stop the entire system For details see 5 3 Stopping the Entire System System stopped cold maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the PCle card requiring maintenance 108 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 XSCF gt showlogs error For details see 3 3 4 Checking log information PA Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System gi D Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off _ Remove all the power cords from the power supply unit of the PCI expansion unit re
155. hysical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Close the rack door 10 6 5 System stopped hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry N The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 3 Start the entire system For details see 6 3 Starting the Entire System 4 Close the rack door 10 6 6 System stopped cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords 168 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion
156. ile the physical partition to which the PCI expansion unit requiring maintenance belongs is powered off The power cord of the PCI expansion unit containing the FRU requiring maintenance remains connected The following FRUs of the PCI expansion unit are subject to inactive hot maintenance PCle card Link board Power supply unit and fan unit Link cable and management cable Figure 4 7 Inactive hot maintenance Building block configuration Physical partition stopped Physical partition active Chapter 4 Preparing for Maintenance 47 Inactive cold maintenance Maintenance is performed while the physical partition to which the PCI expansion unit requiring maintenance belongs is powered off The power cord of the PCI expansion unit requiring maintenance has been disconnected The following FRUs of the PCI expansion unit are subject to inactive cold maintenance All FRUs Figure 4 8 Inactive cold maintenance Building block configuration Physical partition stopped expansion unit Cold Physical partition active 48 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 System stopped hot maintenance Maintenance is performed while all physical partitions on the system are powered off The power cord of the PCI expansion unit requiring maintenance remains connected The following FRUs of the PCI expansion unit are subject to system stopped hot maintenance PCle card
157. in How to check the serial number and firmware version of the PCI expansion unit 3 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 5 4 Ifthe firmware has been updated the firmware must be applied To do this execute the cfgadm 1M command to release the link card requiring maintenance from the logical domain cfgadm c disconnect Ap ID 152 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 5 Mount the PCI expansion unit in the server again For details see 6 1 1 Mounting the link card on the server using PHP 6 Close the rack door 9 6 2 Active hot maintenance use of DR 1 Mount the chassis containing the link card requiring maintenance on the physical partition using physical partition dynamic reconfiguration DR Perform the procedure in Mounting the chassis containing the link card on the physical partition up to step 8 2 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 3 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see
158. in TYPE of the output result the SR IOV function is in use The original configuration needs to be restored after the PCIe card is maintained So retain the output result of the Idm list io command b Enable the hotplug service of the root domain and I O domain svcadm enable hotplug c Execute the Idm remove io command to delete the virtual function VF assigned to the I O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCle card delete all the VFs corresponding to that PF from the I O domain ldm remove io lt VF name gt lt I O domain name gt d Execute the Idm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created ldm destroy vf lt VF name gt In case Static SR IOV feature is use Execute the following procedure a Execute the Idm list io command to check whether the SR IOV function is in use For details see 4 2 3 Checking whether the SR IOV function is used If there is a line on which VF is displayed in TYPE of the output result the SR IOV function is in use The original configuration needs to be restored after the PCIe card is maintained So retain the output result of the Idm list io command b Stop the I O domain ldm stop domain lt I O domain name gt c Execute the Idm remove io command to delete the virtual function VF assigned to the I
159. indirect special incidental or consequential damages even if advised of the possibility of such damages DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2007 2014 Fujitsu Limited Tous droits r serv s Oracle et ou ses affili s ont fourni et v rifi des donn es techniques de certaines parties de ce composant Oracle et ou ses affili s et Fujitsu Limited d tiennent et contr lent chacun des droits de propri t intellectuelle relatifs aux produits et technologies d crits dans ce document De m me ces produits technologies et ce document sont prot g s par des lois sur le droit d auteur des brevets et d autres lois sur la propri t intellectuelle et des trait s internationaux Ce document le produit et les technologies aff rents sont exclusivement distribu s avec des licences qui en restreignent l utilisation la copie la distribution et la d compilation Aucune partie de ce produit de ces technologies ou de ce document ne peut tre reproduite sous quelque forme que ce soit par quelque moyen que ce soit sans l autorisation crite pr alable d Oracle et ou ses affili s et de Fujitsu Limited et de leurs ventuels conc dants de licence Ce document bien qu il vo
160. ing used and are combined in such a way that their firmware versions match there will be no problem with their operation even if some of the PCI expansion units use different firmware versions How to check the serial number and firmware version of the PCI expansion unit The largest firmware version number indicates the latest firmware Check the current firmware version before starting update The procedures will be different for maintenance with the system stopped or for active maintenance For maintenance with the system stopped 1 Switch the mode switches for the master chassis and those chassis whose XSCFs are in the standby state to Service mode For the SPARC M10 1 M10 4 This is always the master chassis since it has a single unit configuration For a building block configuration no crossbar box Change the mode switches of BB ID 00 and 01 to Service mode For a building block configuration with crossbar boxes Change the mode switches of BB ID 80 and 81 to Service mode Log in to the XSCF shell of the master chassis For the SPARC M10 1 M10 4 This is always the master chassis since it has a single unit configuration For the SPARC M10 4S no crossbar box The master chassis is the chassis where the BB ID 00 or 01 MASTER LED green at the rear of the chassis is on For the SPARC M10 4S with crossbar boxes The master chassis is the chassis where the BB ID 80 or 81 MASTER LED green at the rear of t
161. intain a component determine its status from the LEDs and then start the maintenance work LEDs on front of PCI expansion unit The status of the PCI expansion unit or fan unit can be determined by checking the LED or CHECK LED on the respective devices For details see 2 2 1 Front LEDs on the PCI expansion unit LEDs on rear of PCI expansion unit By checking the LEDs mounted on the components that can be maintained the status of each component or the error location can be determined For details see 2 2 2 LEDs on rear of PCI expansion unit LEDs on link card Check the LED on the link card of the server to which the PCI expansion unit is connected For details see 2 2 3 LEDs on link card Checking error messages Display the error messages to check the log information and obtain an error overview You can use either of the following two methods to check the error messages Checking the error log information with the XSCF shell For details see 12 1 Checking a Log Saved by the XSCF in the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide Checking messages with Oracle Solaris For details see 12 2 Checking Warning and Notification Messages in the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide Checking the status Execute the command to check the status of the PCI expansion unit PCI Express PCIe card or the system Table 3 1 lists the commands for checking the sta
162. intenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur I 2 3 Active hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the fan unit requiring maintenance PA XSCF gt showlogs error For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 5 Execute the ioxadm command to stop the fan unit requiring maintenance In the following example FAN 0 of PCIBOX 12B4 is specified XSCF gt ioxadm poweroff PCIBOX 12B4 FAN 0 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 13 3 2 13 3 3 Active cold maintenance Note Active cold maintenance is performed using either of the the following two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S
163. ion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry Chapter8 Maintaining the Link Board 139 The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Close the rack door 8 6 5 System stopped hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system
164. ion dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Log in to the XSCF shell 3 Mount the PCI expansion unit on the server For details see 6 1 Mounting the Link Card on the Server 4 Close the rack door Inactive hot maintenance 1 Connect the power cords to the power supply unit requiring maintenance For details see 6 4 1 Installing the power cords Note Confirm that the LED green on the power supply unit is blinking 2 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woo answers y yes in response to an inquiry w The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y
165. ion unit 5 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance and thus allow you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 6 Stop the entire system For details see 5 3 Stopping the Entire System System stopped cold maintenance 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance Chapter9 Maintaining the Link Cards 149 XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expansion unit 5 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance and thus allow you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System a N Check the following LEDs to determine whether the link card requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off g Remove all the power cords from the power supply unit or the PSU backplane unit
166. irtual device release the target virtual device with the duplication function so that that virtual device is not used b Delete the virtual device and virtual service from the control domain by using the Idm command If you need to restore the configuration to the original status after maintaining the PCle card make a note of the setting information For the virtual network ldm remove vnet lt virtual network gt lt guest domain gt ldm remove vswitch lt virtual network switch gt For the virtual disk ldm remove vdisk lt virtual disk gt lt guest domain gt ldm remove vdiskserver lt virtual disk service gt 10 Suppose that a virtual function VF using the the SR IOV function has been created and assigned to the domain for the PCle card requiring maintenance Delete and discard the virtual function from the control domain with the Idm 1M command In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Execute the ldm list io command to check whether the SR IOV function is in PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 use For details see 4 2 3 Checking whether the SR IOV function is used If there is a line on which VF is displayed
167. is 250 16 6 Restoring the System 250 16 6 1 Active cold maintenance 251 16 6 2 Inactive cold maintenance 251 16 6 3 System stopped cold maintenance 252 Appendix A Component List 253 Appendix B Component Specifications 255 B 1 PCI ExpressCard 255 B 2 Link Board 256 B 3 Power Supply Unit 256 B 4 Fan Unit 257 B 5 PCI Tray 257 B 6 I O Board 258 B 7 Fan Backplane 258 Appendix C Updating the Firmware of the PCI Expansion Unit 261 C 1 Before Updating the Firmware 261 C 1 1 Precautions for updating 261 xii PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 C 1 2 How to check the serial number and firmware version of the PCI expansion unit 262 C 1 3 Time required for updating 265 C 1 4 Flow of update process 265 C 2 Updating the Firmware 265 C 2 1 Preparing the firmware 265 C 2 2 Importing the firmware into the system 266 C 2 3 Updating the firmware 267 C 3 Problems during Firmware Update 268 Index 269 Contents xiii xiv PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Preface This document describes the maintenance procedure for the PCI expansion unit for Oracle or Fujitsu M10 SPARC M10 Systems The maintenance work should be performed by service engineers and or field engineers Fujitsu M10 is sold as SPARC M10 Systems by Fujitsu in Japan Fujitsu M10 and SPARC M10 Systems are identical products The preface includes the following sections Audience Rela
168. is assigned in delayed reconfiguration mode b Execute the ldm create vf command to create the virtual function ldm start reconf lt root domain name gt ldm create vf lt PF name gt c Log in to the root domain to restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y d Execute the Idm add io command to assign the virtual function to the I O domain ldm add io lt VF name gt lt I O domain name gt 7 Execute the Idm start domain command to start the root domain 8 Execute the Idm start domain command to start the I O domain 9 When the virtual device is unused or has been released from redundancy in Deleting the physical I O device restart using the virtual device and set its redundancy again 10 Execute the Idm list io command to check that the physical I O device has the same status as it had before maintenance 11 Execute the Idm list domain command to check that the operation status of the logical domain remains unchanged 12 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the disabled state svcadm disable hotplug Chapter6 Understanding the Preparations for Restoring the System 87 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs This section describes the procedure for turning on the power to a physical partition to which the PCI expansio
169. is supported only for a redundant configuration 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP System stopped hot Enabled Enabled Enabled Not maintainable System stopped cold Enabled Enabled Enabled 3 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting of the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 222 12 2 3 Maintenance flow Table 12 2 lists the sequence of the maintenance procedure for the power supply units See the relevant section Table 12 2 Maintenance flow Details of update process 1 2 3 4 Preparation Removing a power supply unit Installing a power supply unit Restoring the system Precautions for replacement Note the following points when you replace a power supply unit Replacement 123 12 4 12 5 12 6 Active hot maintenance is supported only for a redundant configuration The power supply has a redundant configuration featuring two units Thus the system can continue to function even if one of these units fails The system should not however be op
170. ive cold maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur 15 3 1 Active cold maintenance Note For active cold maintenance that does not use PHP it is necessary to release the server requiring maintenance from the physical partition using physical partition dynamic reconfiguration DR For details on the versions of XCP and Oracle VM Server for SPARC SRU that support DR see the latest product note Note Active cold maintenance is enabled only for the building block of the SPARC M10 4S 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the I O board requiring maintenance 224 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 15 3 2 XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 5 Release from the physical partition the server to which the PCI expansion unit requiring maintenance is connected For details see 5 1 Releasing the Link Card from the Server 6 Check the following LEDs to determine whether the PCI expansion unit requiring maintenanc
171. ive hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance 12 6 1 Active hot maintenance 192 a Connect the power cords to the power supply unit requiring maintenance For details see 6 4 1 Installing the power cords Note Confirm that the LED green on the power supply unit is blinking N Execute the ioxadm command to supply power to the power supply unit In the following example PSU 0 of PCIBOX 12B4 is specified XSCF gt ioxadm poweron PCIBOX 12B4 PSU 0 Execute the ioxadm v list command to check whether Status of the maintained power supply unit is On p9 XSCF gt ioxadm v list gt Execute the showstatus command to check that the reinstalled power supply unit is operating normally XSCF gt showstatus a Execute the showhardconf command to check the hardware configuration and the status of each component XSCF gt showhardconf Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified D XSCF gt ioxadm locator off PCIBOX 12B4 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 12 6 2 12 6 3 7 Close the rack door Active cold maintenance Note Active cold maintenance is performed using either of the two methods Using PHP and using physical partit
172. k from the backend and then identify the PCIe card in use For details on the step see the documentation for the software that manages the related file system and volume For example if the backend is a file on the ZFS file system execute the zfs list command to check the ZFS storage pool corresponding to the mount point of Chapter 7 Maintaining the PCI Express Cards 101 102 the directory where the file is placed Moreover execute the zpool status lt zpool name gt command to check the physical device path of the PCle card to which the LU or hard disk is connected If MPxIO is used for management display the device path of a physical hard disk corresponding to the LU with the mpathadm command to check the physical device path of the PCle card connected to that path c Suppose that steps a and b indicate that there is a virtual disk service to which the PCIe card requiring maintenance is assigned While referring to the CLIENT section of the virtual disk service indicated in step a check the virtual disk and guest domain to which the backend of that virtual disk service is assigned The display format is lt virtual disk gt lt guest domain gt 9 If there is a guest domain that is virtually using the PCle card requiring maintenance delete the virtual devices vnet vdisk and virtual services vsw vds a Log in to the guest domain and stop the use of the virtual device If you are using the duplication function of the v
173. l partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 148 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 9 3 5 9 3 6 6 Check the following LEDs to determine whether the link card requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 7 Remove all the power cords from the power supply unit or the PSU backplane unit of the server containing the link card requiring maintenance For details see 5 3 1 Removing the power cords in the Fujitsu M10 1 SPARC M10 1 Service Manual or 5 9 4 Removing the power cord in the Fujitsu M10 4 Fujitsu M10 45 SPARC M10 4 SPARC M10 45 Service Manual Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped hot maintenance 1 Open the rack door 2 Loginto the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expans
174. le unit configuration Status of the physical partition to which the PCI expansion unit requiring maintenance belongs Active Status in which Oracle Solaris is operating during maintenance Inactive system stopped Status in which all physical partitions stop in addition to the physical partition requiring maintenance Input power status of the PCI expansion unit requiring maintenance Hot Status in which the power cord of the PCI expansion unit remains connected Cold Status in which the power cord of the PCI expansion unit has been disconnected Hot Status in which the power cord of the PCI expansion unit remains connected Cold Status in which the power cord of the PCI expansion unit has been disconnected The following details each maintenance type Maintenance types when the destination of the PCI expansion unit has a Type of maintenance Active hot maintenance Active cold maintenance System stopped hot maintenance System stopped cold maintenance Chapter4 Preparing for Maintenance 37 38 Active hot maintenance Maintenance is performed while Oracle Solaris is in operation in the physical partition The power cord of the PCI expansion unit requiring maintenance remains connected The following FRUs of the PCI expansion unit are subject to active hot maintenance Redundant power supply unit Fan unit PCIe card that can use the PCI hot plug PHP Ina single unit configuration
175. ling the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance 2 Mount the chassis to which the PCI expansion unit requiring maintenance is connected on the physical partition using physical partition dynamic reconfiguration DR Perform the procedure in Mounting the chassis containing the link card on the physical partition up to step 8 3 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 4 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to Restoring the logical domain to the status it had before maintenance 5 Close the rack door Chapter 15 Maintaining the I O Board 235 15 6 2 15 6 3 Inactive cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to
176. mains with dependency start them in the correct order In the following example both root domain and guest domain are bound and started ldm bind root domain ldm start domain root domain ldm bind guest domain ldm start domain guest domain If the binding failed because an overlapping resource exists delete the relevant resource from the logical domain The following example shows that an overlapping resource has been deleted ldm bind root domain No free matching I O device for LDom root domain name PCIE1 ldm start reconf primary ldm remove io PCIE1 primary Notice The primary domain is in the process of a delayed reconfiguration Any changes made to the primary domain will only take effect after it reboots If you deleted a resource restart the control domain shutdown i6 g0 y If you deleted a resource restart the control domain and then bind and start other logical domains For logical domains with dependency start them in the correct order In the following example both root domain and guest domain are bound and Chapter 1 Before Starting Maintenance Work 15 started ldm bind root domain ldm start domain root domain ldm bind guest domain ldm start domain guest domain 24 Execute the Idm Is command to confirm that the logical domain is operating normally ldm 1s NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME primary active n cv UART 8 8G 66 root domain active t 5000 8 4G
177. maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Chapter 12 Maintaining the Power Supply Units 187 12 3 3 Inactive hot maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the power supply unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Remove the power cord from the power supply unit requiring maintenance For details see 5 4 1 Removing the power cords 12 3 4 Inactive cold maintenance 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the power supply unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details
178. maintenance procedure for the link cables See the relevant section Table 10 2 Maintenance flow Details of update process 1 2 3 4 Preparation Link cable removal Link cable installation Restoring the system Precautions for replacement Note the following when performing link cable replacement Do not place any heavy objects on the link cables When performing replacement replace the two link cables as a set Replacement 10 3 10 4 10 5 10 6 Do not bend the link cables unduly Excessive bending could damage the link cables The allowable bending radius for each link cable is shown below Link cable electrical Static dynamic 40 mm 1 6 in or greater Link cable optical Static 35 mm 1 4 in or greater dynamic 58 mm 2 3 in or greater Before use confirm that labels A in the figure are affixed to the connectors at Chapter 10 Maintaining the Link Cables 159 both ends of the link cable For the location of the labels see Figure 10 2 and Figure 10 3 Figure 10 2 Label location on a link cable electrical Khl Figure 10 3 Label location on a link cable optical Q o_o A If there is no label affix one of the labels supplied with the link cable Affix labels with the same number 0 or 1 to the connectors at both ends of the link cable Figure 10 4 State of labels when correctly attached I 10 3 Enabling the Removal of a Link Cable This section describes the
179. model number serial number and version number required for maintenance and management The standard label B in the figure contains notes and the following approved standards Security NRTL C Electromagnetic wave VCCI A FCC A DOC A KCC and C Tick Security and electromagnetic wave CE and GOST R Figure 1 1 Positions of system nameplate label standard label 2 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 The RFID tag contains the Asset ID The RFID tag is attached to the front cover of the chassis Figure 1 2 RFID tag 341 A583DAAAAAAAAAAAAAAAA Asset ID 1 3 Safety Precautions Observe the following precautions to protect yourself when performing maintenance Observe all the precautions warnings and instructions described on the chassis Do not insert foreign objects into the openings in the chassis Any such foreign object could come into contact with high voltage circuitry or could short circuit Chapter 1 Before Starting Maintenance Work 3 the components causing a fire or an electric shock Contact a service engineer and request inspection of the chassis Safety precautions on electricity Confirm that the voltage and frequency of your input power supply match those shown on the electric rating label affixed on the chassis Wear a wrist strap when handling the I O board PCI tray or other print boards Use a grounded po
180. n the text While the XSCF commands have a section number of 8 or 1 it is omitted from the text The Oracle Solaris commands have a section number such as 1M in the text Each command has a section number in a command name to prompt users to refer to it E Notes on Safety Read the following documents thoroughly before using or handling any SPARC M10 Systems Fujitsu M10 SPARC M10 Systems Important Legal and Safety Information Fujitsu M10 SPARC M10 Systems Safety and Compliance Guide Preface xvii Syntax of the Command Line Interface CLI The command syntax is as follows A variable that requires the input of a value must be put in Italics An optional element must be enclosed in A group of options for an optional keyword must be enclosed in and delimited by Document Feedback If you have any comments or requests regarding this document please take a moment to share it with us by indicating the manual code manual title and page and stating your points specifically through the following websites Japanese site http jp fujitsu com platform server sparc manual m Global site http www fujitsu com global services computing server sparc downloads manual xviii PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 1 1 1 gt gt Before Starting Maintenance Work This chapter describes the safety precautions that must be observed before starting a
181. n unit requiring maintenance belongs How the mode switch is changed depends on the connection destination 1 Change the mode switch on the operation panel to Locked mode When the connection destination is a SPARC M10 1 M10 4 Switch the mode switch to Locked mode When the connection destination is a SPARC M10 45S without the crossbar box Switch the mode switches of BB ID 00 and 01 to Locked mode When the connection destination is a SPARC M10 45 with the crossbar box Switch the mode switches of BB ID 80 and 81 to Locked mode Log in to the XSCF shell Execute the poweron command to power on the stopped physical partition In the following example PPAR ID 00 is specified wo N Enter the PPAR ID you previously noted by using the showboards command XSCF gt poweron p 0 4 Execute the showstatus command to confirm that the FRU is operating normally after the completion of maintenance Nothing is displayed in the normal state XSCF gt showstatus 5 Execute the showhardconf command to check the hardware configuration and the status of each component 88 XSCF gt showhardconf SPARC M10 4S Serial 2081229003 Operator Panel Switch Service System Power On System Phase Cabinet Power On Partition 0 PPAR Status Running BB 00 Status Normal Role Master Ver 2050h Serial 2081229003 FRU Part Number CA07361 D202 AO i Power_Supply_System Memory_Size 320 GB PCI 0 Status Normal Name_Proper
182. nabled Enabled Maintenance work is performed using PCI hot plug PHP While referring to 4 2 2 Checking whether the PCI hot plug PHP can be used check whether PHP is usable For the relationship between PHP and the direct I O function see Table 7 2 2 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Table 7 2 Relationship between PHP and direct I O function Main unit side PCI expansion unit side PHP available or not Setting of the direct I O function Use of direct I O Disabled Unused Available Enabled Unused Available Enabled Used Enabled 1 1 Use the dynamic reconfiguration function of the PCIe endpoint device to perform maintenance work The dynamic reconfiguration function of the PCIe endpoint device is supported by a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later Chapter7 Maintaining the PCI Express Cards 97 722 29 7 2 4 Maintenance flow Table 7 3 lists the sequence of the maintenance procedure for PCle cards See the relevant section The procedure for PCIe card expansion is the same as that for installing a PCIe card The procedure for PCIe card removal is the same as that for removing a PCIe card Table 7 3 Maintenance flow Details of update process Replacement Expansion Reduction 1 Preparation Ta VES 7 3 2 Rem
183. nagement cable on the PCI expansion unit and then remove the management cable Note If you cannot not reach the latch lock of the connector depress the latch with a flat head screwdriver and then remove the management cable Do not use excessive force Otherwise the link board could be damaged Figure 11 2 Management cable removal 2 Remove the management cable from the SPARC M10 1 or SPARC M10 4 M10 4S in the same way 11 5 Installing the Management Cable This section describes the procedure for installing the management cable 1 Hold the connector of the management cable and connect the management cable to the link board mounted on the PCI expansion unit Note Confirm that the management cable is securely connected 2 Connect the management cable to the link card mounted in the SPARC M10 1 or SPARC M10 4 M10 4S in the same way 178 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note Confirm that the management cable is securely connected 11 6 11 6 1 11 6 2 Restoring the System This section describes the procedure for restoring the system after management cable installation The restoration procedure differs depending on the maintenance type as follows m Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Active hot maintenanc
184. nance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the fan unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 6 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly 13 3 5 System stopped hot maintenance 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the fan unit requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified 202 PCI Expansion Unit for
185. nance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly 15 3 3 System stopped cold maintenance 1 Open the rack door 2 Log in to the XSCF shell 3 Execute the showlogs command to identify the I O board requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For maintenance with the system stopped in How to check the serial number and firmware version of the PCI expansion unit 5 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance and thus allow you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Stop the entire system For details see 5 3 Stopping the Entire System D Ta Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off pa Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords
186. nce return the PCIe cards to their original mounting locations 95 Figure 7 1 Location of PCIe card 3 5 a 8 iy Vm 9 11 Location number Component PCIe card PCIECS 1 PCle card PCIECS 2 PCle card PCIECS 3 PCIe card PCIECS 4 PCIe card PCIECS 5 PCle card PCIECS 6 PCle card PCIECS 7 PCIe card PCIECS 8 PCle card PCIECS 9 PCIe card PCIECS 10 PCle card PCIECS 11 oO AN DD oO FF QO NY e e pe O 96 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 a2 Before Maintaining a PCI Express Card This section describes the maintenance types flow and points to remember regarding a PCIe card Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work F2 Types of maintenance Table 7 1 lists the types of maintenance for the PCIe cards For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration Table 7 1 PCIe card maintenance types supported Not maintainable Connection Active hot Active cold Inactive hot Inactive cold System System destination stopped hot stopped cold SPARC M10 1 Enabled 1 Enabled Enabled Configuration Enabled 1 Enabled 2 Enabled Enabled of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 1 Enabled 2 Enabled Enabled E
187. nprom client services packages obp tftp packages kbd translator PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Qa 2 Qe Oe packages SUNW asr packages dropins packages terminal emulator packages disk label packages deblocker packages SUNW probe error handler packages SUNW builtin drivers 0 ok prtdiag command Execute the prtdiag 1M command of Oracle Solaris to determine the system configuration and any failed FRUs 1 Display the Oracle Solaris super user prompt 2 Execute the prtdiag 1 command to determine the system configuration and any failed FRUs prtdiag v System Configuration Oracle Corporation sun4v SPARC M10 4 Memory size 64000 Megabytes IO Devices Status L SASHBA scsi pciex1000 87 LSI 2308 2 pci 8000 pci 4 pci 0 pci 0 scsi 0 L N network pciexl4e4 1656 pci 8000 pci 4 pci 0 pci 9 networked L N network pciexl4e4 1656 pci 8000 pci 4 pci 0 pci 9 networke 0 1 L N network pciexl4e4 1656 pci 8000 pci 4 pci 0 pci a networke 0d network pciexl4e4 1656 pci 8000 pci 4 pci 0 pci a network 0 1 2081203001 3 3 4 Checking log information Execute the showlogs command to check the error log information 1 Log in to the XSCF shell Chapter 3 Troubleshooting 33 Execute the showlogs command to determine the error log information The log information is listed in th
188. ny maintenance work and provides important information that you should know Note the meanings of each of the following symbols and labels to ensure that the work is done correctly Warning Caution Indications Labels Tags Safety Precautions Notes Regarding Static Electricity Other Precautions Emergency Power Off Important Information about the XCP Firmware Warning Caution Indications This manual uses the following conventions to indicate warning and alert messages which are intended to prevent injury to the user and others as well as damage to property Warning WARNING indicates a potential hazard that could result in death or serious personal injury if the user does not perform the procedure correctly Caution CAUTION indicates a potential hazard that could result in minor or moderate personal injury if the user does not perform the procedure correctly This also indicates that damage to the unit or other property may occur if the user does not perform the procedure correctly 1 2 Labels Tags This section describes the labels and tags attached to the chassis When performing maintenance always observe the precautions on the standard labels attached to the chassis A Caution Do not remove the labels or tags Note The contents of the labels and tags described here may differ from those actually attached to the chassis The system nameplate label A in the figure provides the product
189. oard Removing the I O Board Installing the I O board Restoring the System Configuration of the I O Board This section describes the configuration and location of the I O board Eleven PCI Express PCIe slots and one slot for the link board are provided on the T O board 221 Figure 15 1 Location of the I O board Location number Component 1 T O board IOB 15 2 Before Maintaining the I O Board This section describes the maintenance types and flow for the I O board Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work 15 2 1 Types of maintenance Table 15 1 lists the types of maintenance for the I O board For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration 222 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 15 1 Types of maintenance for I O board Connection destination SPARC M10 1 Configuration of 1 SPARC M10 4 M10 4S SPARC M10 4S Not maintainable Active hot Active cold Inactive hot Inactive cold System System stopped hot stopped cold Enabled Enabled 1 Enabled Enabled 2 Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the
190. of SPARC M10 4 or M10 4S the following FRUs of the PCI expansion unit can also be subject to active hot maintenance This can be done after releasing the link card mounted in the server of the destination from the system by using the PCI hot plug PHP Link board a Link cable and management cable Note If the setting of the direct I O function is enabled the link card cannot use PHP Perform maintenance with the system stopped Figure 4 1 Active hot maintenance Single chassis configuration Physical partition active SPARC M10 1 M10 4 M10 4S Hot PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Active cold maintenance Maintenance is performed while Oracle Solaris is operating in the physical partition The power cord of the PCI expansion unit requiring maintenance has been disconnected In a single unit configuration of SPARC M10 4 or M10 4S the power cord of the PCI expansion unit can be disconnected by releasing the link card mounted on the server from the system To release the link card from the system use the PCI hot plug PHP The following FRUs of the PCI expansion unit are subject to active cold maintenance All FRUs Note If the setting of the direct I O function is enabled the link card cannot use PHP Perform maintenance with the system stopped Figure 4 2 Active cold maintenance Single chassis configuration Physical partition active M10 4 M10 4S
191. of the virtual function VF of the SR IOV function stop the root domain delete and discard the VF of the SR IOV function and then execute physical partition dynamic reconfiguration DR 7 Stop the I O domain of direct I O stop the root domain delete the I O device and then execute physical partition dynamic reconfiguration DR 8 The PHP function provided when the SR IOV function is used is supported by Oracle VM Server for SPARC 3 1 or later 9 4 2 2 Use the dynamic reconfiguration function of the PCIe endpoint device to return from the I O domain of the direct I O to the control domain or root and then execute PHP The dynamic reconfiguration function of the PCIe endpoint device is supported by Oracle VM Server for SPARC 3 1 1 1 or later Checking whether the PCI hot plug PHP can be used Using PHP maintenance for the PCIe card mounted on the PCI expansion unit or the link card mounted on the server can be performed during Oracle Solaris operation This section enables you to check whether the PCIe card or link card requiring maintenance can use PHP Note Some PCIe cards do not support PHP For details see Appendix A Cards that Support PCI Hot Plug and Dynamic Reconfiguration in the Fujitsu M10 SPARC M10 Systems PCI Card Installation Guide 52 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note If the setting of the direct I O function is enabled the link card cannot use
192. ommand to confirm the operating condition of the logical domain In the following example the Status of the logical domain with PPAR ID 00 is displayed as Solaris powering down indicating that Oracle Solaris has been shut down 74 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 5 2 1 S a XSCF gt showdomainstatus p 0 Logical Domain Name Status primary Solaris powering down 4S 159 D0 G0 Solaris powering down 4S 159 D0 G1 Solaris powering down 4S 159 D0 G2 Solaris powering down Stopping the system with the XSCF command Note Before stopping the system stop all of the guest domains For details see 5 3 Stopping the Entire System Log in to the XSCF shell Execute the poweroff a command In response to the confirmation message enter y In the following example the status of PPAR ID 00 and PPAR ID 01 is displayed as Powering off indicating that the physical partition is powered off XSCF gt poweroff a PPAR IDs to power of f 00 01 Continue y n ty Powering off Powering off The following processes are performed Oracle Solaris is completely shut down The system stops and enters the POWERON READY status the XSCF is running For details see 6 2 2 Stopping the whole system in the Fujitsu M10 SPARC M10 Systems System Operation and Administration Guide Check that the POWER LED on the operation panel is off Note For a building block configu
193. on Table 8 1 Link board maintenance types supported Not maintainable Connection Active hot Active cold Inactive hot Inactive cold System System destination stopped hot stopped cold SPARC M10 1 Enabled Enabled Configuration Enabled 1 Enabled 1 Enabled Enabled of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled 1 Enabled 2 Enabled Enabled Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 8 2 2 Maintenance flow Table 8 2 lists the sequence of the maintenance procedure for the link board See the relevant section 126 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 8 2 Maintenance flow Details of update process Replacement 1 Preparation 8 3 2 Link board removal 8 4 3 Link board installation 8 5 4 Restoring the system 8 6 8 3 8 3 1 Enabling the Removal of the Link Board This section describes the preparations that must
194. or the Ethernet card a Execute the ldm list bindings lt domain name gt command in the control domain and check the physical network interface name NET DEV value assigned to the virtual network switch based on the information of the virtual network switch VSW The following example specifies rootdom which is the name of the logical domain to which the PCle card is assigned ldm list bindings rootdom NET DEV ID DEVICE LINKPROP DEFAULT VLAN ID PVID vsw0 XXIXXIXX IXX XxX xx net4 1 switch 0 1 PEER MAC PVID VID vnetO0 guestl 2 EX ORK RK RE PRK RR I 1 Physical network interface 2 Virtual network device and guest domain that are receiving the vsw0 services b Log in to the logical domain to which the PCIe card is assigned and then check the physical location of the above physical network interface to confirm whether that interface corresponds to the PCIe card requiring maintenance For Oracle Solaris 11 execute the dladm show phys L command to check the LOC physical location of the physical network interface that corresponds to NET DEV in step a dladm show phys L LINK DEVICE LOC neto igb0 BBO CMUL netl igbl BBO CMUL net2 igb2 BBO CMUU net3 igb3 BBO CMUU net4 ixgbe0 BB 0 PCI net5 ixgbel BB 0 PCI For Oracle Solaris 10 check the physical device path from the etc path_to_ inst command and compare that path with the physical device path Chapter 5 Understanding the Preparations for
195. ore you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity Pull out all the PCle cassettes in which the PCle cards of the PCI expansion unit are mounted a Raise the lever while pressing the latch of the PCIe card cassette For details see Figure 7 3 b Hold the lever and carefully pull the PCIe card cassette out of the PCIe slot Install link cards in the PCle cassettes The procedure for installing a link card in a PCIe cassette is the same as that for installing a PCIe card for each server For details on the SPARC M10 1 see 12 5 1 Installing a PCI Express card in the Fujitsu M10 1 SPARC M10 1 Service Manual For details on the SPARC M10 4 M10 4S see 8 4 1 Installing a PCI Express card in the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Connect the link and management cables to the link cards Install the PCIe cassettes with the link cards mounted on the server The procedure for installation is the same as that for installing PCIe cassettes for each server For details on the SPARC M10 1 see 12 5 2 Installing a PCIe riser in the Fujitsu M10 1 SPARC M10 1 Service Manual For details on the SPARC M10 4 M10 4S see 8 4 3 Installing a PCI Express card cassette in the Fujitsu M10 4 Fujitsu M10 4S5 SPARC
196. ose the rack door Inactive cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically Woon answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 122 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 7 6 5 7 6 6 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 5 Close the rack door System stopped hot maintenance 1 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIB
197. ot of the SPARC M10 chassis for which the direct I O function of the PCI expansion unit is enabled Save the logical domain configuration information from Oracle Solaris to XML in advance To save it to XML execute the ldm list constraints x command and to restore it from XML execute the Idm init system i command Also save the setting information for the OpenBoot PROM environment variable of the control domain to the notepad and then reset it To display it execute the printenv command while the ok prompt is displayed For details on these procedures see 1 7 3 How to save restore the logical domain configuration information and the OpenBoot PROM environment variable When executing the setpciboxdio command to change the enable disable setting for the direct I O function of the PCI expansion unit the following operations must be performed to save restore each item of information Table 1 3 Operations to change the enable disable setting with the setpciboxdio command PCl expansion unit Domain configuration Reconfiguration of Resetting of OpenBoot configuration Oracle VM Server for PROM environment SPARC config variable Existence non factory default Unnecessary Necessary existence Existence non Contains a guest domain Necessary XML Necessary existence Suppose that the setpciboxdio command is executed to install remove or replace the PCI expansion unit for the PCIe slot of the SPARC M10 chassis for which the direct I O func
198. oving the filler unit for a PCIe card or 7 4 7 4 7 4 PCIe card 3 Installing the filler unit for a PCIe card or 7 9 7p To PCIe card 4 Restoring the system 7 6 7 6 7 6 Precautions for installation Note the following points when performing PCIe card expansion If you are performing PCIe card expansion remove the filler unit from the PCIe card cassette Keep the removed filler unit because it will be needed if PCIe card reduction is done at a later date Precautions for removal Note the following points when removing PCle cards If you are performing PCIe card removal remove the PCIe card from the PCIe card cassette and then install the filler unit of the PCle card 1 3 Enabling the Removal of a PCI Express Card This section describes the preparations that must be completed prior to the removal of a PCIe card The preparation procedure differs depending on the maintenance type as follows 98 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Making the PCle card ready to be released Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur 7 3 1 Active hot maintenance Making the PCle card ready to be released Open th
199. path with the physical device path displayed with the idm list io 1I command to check the physical location c Suppose that steps a and b indicate that there is a virtual network switch to which the PCle card requiring maintenance is assigned While referring to the PEER section of the virtual network switch indicated in step a check the virtual network device and guest domain that use the service of that virtual network switch The display format is lt virtual network device gt lt guest domain gt For the SAS or FibreChannel card a Execute the ldm list bindings command in the control domain to check the virtual disk backend DEVICE value assigned to the virtual disk service among virtual disk service VDS information For the types assigned to the virtual disk backend see Virtual Disk Back End in the Oracle VM Server for SPARC Administration Guide The following example specifies rootdom which is the name of the logical domain to which the PCle card is assigned ldm list bindings rootdom VOLUME OPTIONS MPGROUP DEVICE vds0 vol0 export vdisks vdisk img 1 voll dev zvol dsk rpool zvdiskl vol2 dev dsk CxtxxxxXxXxXXXXXXXXXXXdUXSX CLIENT VOLUME vdiskl guestl vol0 vdisk2 guest2 voll vdisk3 guest3 1 Virtual disk backend 2 Names of the virtual disk and guest domain to which the vol0 backend is assigned b Log in to the logical domain to which the PCle card is assigned identify the physical dis
200. power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped cold maintenance 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the fan backplane requiring maintenance XSCF gt showlogs error Chapter 16 Maintaining the Fan Backplane 243 For details see 3 3 4 Checking log information 4 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink and thus allow you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 5 Stop the entire system For details see 5 3 Stopping the Entire System 6 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 7 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 16 4 Removing the Fan Backplane This section describes the procedure for removing the fan backplane Enable the removal of the fan backplane befo
201. pped hot stopped cold PCI Express card Enabled 1 Enabled Enabled Chapter 7 Link board Enabled Enabled Chapter 8 Link card mounted on server Enabled Enabled Chapter 9 Link cable Enabled Enabled Chapter 10 Management cable E Enabled Enabled Chapter 11 Power supply unit Enabled 2 Enabled Enabled Chapter 12 Fan unit Enabled Enabled Enabled Chapter 13 PCI tray 7 Enabled Chapter 14 I O board Enabled Chapter 15 Fan backplane 7 Enabled Chapter 16 1 The maintenance work is performed using the PCI hot plug PHP While referring to 4 2 2 Checking whether the PCI hot plug PHP can be used check whether PHP is usable 2 This is supported only for a redundant configuration Chapter4 Preparing for Maintenance 41 Table 4 5 FRU PCI Express card Link board Link card mounted on server Link cable Management cable Power supply unit Fan unit PCI tray I O board Fan backplane Active hot Enabled 1 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 3 Enabled Active cold Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 Enabled 2 System stopped hot Enabled Enabled Enabled Enabled Enabled Enabled Enabled When the destination has a single unit configuration of SPARC M10 4 or M10 4S Not maintainable System stopped Reference cold Enabled Chapter 7 Enable
202. preparations that must be completed prior to the removal of the link cables The preparation procedure differs depending on the maintenance type as follows m Active hot maintenance Active cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance 160 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 10 3 1 10 3 2 Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active hot maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Release from the server the link card to which the PCI expansion unit requiring maintenance is connected For details see 5 1 1 Releasing the link card using PHP 5 Execute the cfgadm 1M command to cause the locator LED of the link card to blink so that you can locate the card Enter the Ap_ID of the link card that you noted in advance cfgadm x led attn mode blink Ap ID 6 Check the following LEDs to determine whether the PCle card requiring maintenance is actually maintainable The ATTENTION LED amber of the PCI card slot is blinking The POWER LED of the PCI card slot is off
203. produit ou la technologie fournis SAUF MENTION CONTRAIRE EXPRESSEMENT STIPULEE AU DIT CONTRAT ORACLE OU FUJITSU LIMITED ET OU LES SOCIETES AFFILIEES A L UNE OU L AUTRE ENTITE DECLINENT TOUT ENGAGEMENT OU GARANTIE QUELLE QU EN SOIT LA NATURE EXPRESSE OU IMPLICITE CONCERNANT CE PRODUIT CETTE TECHNOLOGIE OU CE DOCUMENT LESQUELS SONT FOURNIS EN L ETAT EN OUTRE TOUTES LES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A L APTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON SONT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Sauf mention contraire express ment stipul e dans ce contrat dans la mesure autoris e par la loi applicable en aucun cas Oracle ou Fujitsu Limited et ou l une ou l autre de leurs soci t s affili es ne sauraient tre tenues responsables envers une quelconque partie tierce sous quelque th orie juridique que ce soit de tout manque a gagner ou de perte de profit de probl mes d utilisation ou de perte de donn es ou d interruptions d activit s ou de tout dommage indirect sp cial secondaire ou cons cutif m me si ces entit s ont t pr alablement inform es d une telle ventualit LA DOCUMENTATION EST FOURNIE EN L ETAT ET TOUTE AUTRE CONDITION DECLARATION ET GARANTIE EXPRESSE OU TACITE EST FORMELLEMENT EXCLUE DANS LA MESURE AUTORISEE PAR LA LOI EN VIGUEUR Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPL
204. quiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 1 4 7 4 1 Removing a PCI Express Card This section describes the procedure for removing a PCIe card Perform reduction using the same procedure For expansion remove the PCIe card filler unit rather than a PCIe card itself Enable removal of the PCIe card before attempting to remove it For details see 7 3 Enabling the Removal of a PCI Express Card Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity Accessing a PCI Express card cassette 1 Remove all the cables connected to the PCle cassette requiring maintenance Chapter 7 Maintaining the PCI Express Cards 109 7 4 2 Note Record the positions of the cables before removing them to ensure that they are reinstalled correctly Removing a PCI Express card cassette There are two types of PCIe card cassette These types of PCIe card cassette differ in their latch A in the figure and lever B in the figure but the procedure is the same For the types of PCIe card cassettes see Note that the figures of the explanation show Type
205. r the SR IOV function is used Note For details on the PCIe card supporting the SR IOV function see Appendix B_ Cards that Support SR IOV in the Fujitsu M10 SPARC M10 Systems PCI Card Installation Guide 1 Login to the XSCF shell 2 Execute the showlogs command to identify the PCle card requiring maintenance XSCF gt showlogs error Connect to the control domain console of the physical partition Execute the Idm list io command to determine whether the SR IOV function is being used VF displayed in TYPE indicates that the SR IOV function is being used ldm list io NAME TYPE BUS DOMAIN STATUS PCIEO BUS PCIEO primary IOV PCIE1 BUS PCIE1 primary IOV PCIE2 BUS PCIE2 primary IOV PCIE3 BUS PCIE3 primary IOV PCIE4 BUS PCIE4 primary IOV PCIES BUS PCIE5S primary IOV PCIE6 BUS PCIE6 primary IOV PCIE7 BUS PCIE7 primary IOV BBO CMUL NETO PCIE PCIEO primary OCC BBO CMUL SASHBA PCIE PCIEO primary OCC BBO PCIO PCIE PCIE1 primary OCC BBO PCI3 PCIE PCIE2 primary EMP BBO PCI4 PCIE PCIE2 primary EMP BBO PCI7 PCIE PCIE3 primary EMP BBO PCI8 PCIE PCIE3 primary EMP BBO CMUL NET2 PCIE PCIE4 primary OCC BBO PCI1 PCIE PCIES primary EMP BBO PCI2 PCIE PCIES primary EMP BBO PCI5 PCIE PCIE6 primary EMP BBO PCI6 PCIE PCIE6 primary EMP BBO PCI9 PCIE PCIE7 primary EMP BBO PCI10 PCIE PCIE7 primary EMP Chapter4 Preparing for Maintenance 55 BBO PCIO IOVNET PFO PF PCIE1 p
206. ration check the POWER LEDs on all the chassis constituting the system Stopping the system from the operation panel Note Before stopping the system stop all of the guest domains For details see 5 3 Stopping the Entire System Chapter 5 Understanding the Preparations for Enabling Maintenance 75 1 Press the power switch on the operation panel for 4 seconds or more For details see 2 2 2 Control function of the operation panel in the Fujitsu M10 1 SPARC M10 1 Service Manual or the Fujitsu M10 4 Fujitsu M10 45 SPARC M10 4 SPARC M10 4S Service Manual Note For a building block configuration press the power switch on the master chassis The power switches of the other chassis are disabled 2 Check that the POWER LED on the operation panel is off Note For a building block configuration check the POWER LEDs on all the chassis constituting the system 5 4 5 4 1 Accessing Components This section explains the operations to be performed before accessing the components requiring maintenance The operations to be performed vary depending on the components requiring maintenance Removing the power cords Remove the cable clamp from each power cord and then remove the power cords 1 Release the latch A in the figure of the cable clamp Pulling the cable clamp toward the rear of the chassis facilitates the release of the latch 76 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014
207. rd XSCF gt ioxadm v list Location Type FW Ver Serial Num Part Num PCIBOX 2007 PCIBOX PZ21242007 PCIBOX 2007 PSU 0 PSU FEJD1212000521 CA01022 0750 D 7060988 PCIBOX 2007 PSU 1 PSU FEJD1201000738 CA01022 0750 D 7060988 PCIBOX 2007 I0B IOBOARD 1080 PP12470297 CA20365 B66X 010AJ 7061033 PCIBOX 2007 LINKBD BOARD PP1244027P CA20365 B60X 001AA 7061035 PCIBOX 2007 FANBP FANBP PP12470298 CA20365 B68X 005AD 7061025 BB 00 PCI 10 CARD 1080 PP1244011L2 CA20365 B59X 001AA 7061040 A firmware version is displayed as a four digit release number in xyyz format Each release number is indicated in xyyz format as follows x Major release number yy Minor release number z Micro release number Appendix C Updating the Firmware of the PCI Expansion Unit 263 For active maintenance Log in to the XSCF shell in the master chassis For the SPARC M10 1 M10 4 The chassis is always a master chassis because this is a single chassis configuration For the SPARC M10 4S without the crossbar box The master chassis is the chassis where the MASTER LED green is on on the rear of the chassis of BB ID 00 and 01 For the SPARC M10 45 with the crossbar box The master chassis is the chassis where the MASTER LED green is on on the rear of the chassis of BB ID 80 and 81 If multiple PCI expansion units are connected execute the ioxadm list command to check the combination of the link card and the I O board XSCF gt
208. rding Static Electricity 14 4 1 Accessing the PCI tray 1 Pull out the following components halfway Power supply unit For details see 12 4 Removing a Power Supply Unit PCI Express PCle card cassette For details see 7 4 2 Removing a PCI Express card cassette 2 Remove the front cover For details see 5 4 2 Removing the front cover 3 Remove all the fan units For details see 13 4 2 Removing a fan unit 14 4 2 Removing the PCI tray 1 Loosen the two screws securing the PCI tray and then slightly pull it out 216 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Screw for PCI tray Figure 14 2 Hold the PCI tray with both hands and carefully remove it from the chassis 2s Note Place the removed PCI tray on the grounded ESD mat to ground any static electricity PCI tray removal 3 Figure 14 217 Chapter 14 Maintaining the PCI Tray 14 4 3 14 5 14 5 1 14 5 2 14 5 3 Removing the components of the PCI tray 1 Remove the I O board from the PCI tray For details see 15 4 2 Removing the I O board 2 Remove the fan backplane from the PCI tray For details see 16 4 2 Removing the fan backplane Installing the PCI Tray This section describes the procedure for installing the PCI tray Installing the components of the PCI tray 1 Install the I O board on the replaced PCI tray For details see 15 5 1 Installing the I O boar
209. re attempting to remove it For details see 16 3 Enabling the Removal of the Fan Backplane electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity AN Caution Before you handle any components wear a wrist strap to ground any static 16 4 1 Accessing the fan backplane 1 Pull the following components out halfway Power supply unit For details see 12 4 Removing a Power Supply Unit PCI Express PCIe card cassette For details see 7 4 2 Removing a PCI Express card cassette 244 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 16 4 2 2 Remove the front cover For details see 5 4 2 Removing the front cover 3 Remove all the fan units For details see 13 4 2 Removing a fan unit 4 Remove the PCI tray For details see 14 4 2 Removing the PCI tray Removing the fan backplane 1 Remove the two cables connected to the fan backplane Note Record the positions of the cables before removing them to ensure that they are reinstalled correctly Figure 16 2 Fan backplane cable 2 Remove the screw securing the fan backplane Chapter 16 Maintaining the Fan Backplane 245 Figure 16 3 Fan backplane screw 3 Slide the fan backplane in the direction of the arrow and align the groove of the fan backplane with the guides four places to
210. remove it Note Do not remove the fan backplane by holding one of its connectors Note Place the removed fan backplane on the grounded ESD mat to ground any static electricity 246 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 16 4 Fan backplane removal 16 5 Installing the Fan Backplane This section describes the procedure for installing the fan backplane 16 5 1 Installing the fan backplane 1 Install the fan backplane by aligning it with the guides four places and then sliding it in the direction of the arrow Chapter 16 Maintaining the Fan Backplane 247 Figure 16 5 Fan backplane installation Secure the fan backplane with the screw 248 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 16 6 Fan backplane screw 3 Connect the two cables to the fan backplane Note Connect the cables in their original positions by referring to the record that you made before the start of maintenance Chapter 16 Maintaining the Fan Backplane 249 Figure 16 7 Fan backplane cable 16 5 2 Restoring the chassis 1 Install the PCI tray For details see 14 5 2 Installing the PCI tray 2 Install all the fan units For details see 13 5 1 Installing a fan unit 3 Install the front cover For details see 6 4 2 Installing the front cover 4 Install all the components listed below Power supply unit For details see 1
211. rimary BBO PCIO IOVNET PF1 PF PCIE primary BBO CMUL NETO IOVNET PFO PF PCIEO primary BBO CMUL NETO IOVNET PF1 PF PCIE primary BBO CMUL NET2 IOVNET PF1 PF PCIE4 primary BBO CMUL NET2 IOVNET PFO PF PCIE primary BBO PCIO IOVNET PF0 VFO VF PCIE1 iodom00 lt SR IOV function used BBO PCIO IOVNET PFO VF1 VE PCIE1 iodom01 lt SR IOV function used BBO PCIO IOVNET PFO VF2 VE PCIE1 iodom02 lt SR IOV function used 4 3 Precautions for Maintenance For details on the procedure for installing a PCI expansion unit see 1 4 Workflow when Connecting the PCI Expansion Unit in the Fujitsu M10 SPARC M10 Systems Installation Guide 56 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 5 Understanding the Preparations for Enabling Maintenance This chapter describes the preparations that must be completed before you can physically remove a component See this chapter as required when performing the maintenance work on each component described in Chapter 7 onwards Releasing the Link Card from the Server Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Stopping the Entire System Accessing Components Caution Do not operate a Field Replaceable Unit FRU requiring maintenance while OpenBoot PROM is running the ok prompt is displayed Turn off the power to the physical partition or start Oracle Solaris to relea
212. rmining the Causes of Individual Failures When the CHECK LED is on When an error message is displayed on the console When an error is displayed as a result of executing a command for checking the status When an error is displayed in the error log 32 Determining the Causes of Individual Failures This section explains the flow for determining the causes of failures 27 Figure 3 1 Troubleshooting flow Is the LED on the power supply unit off YES Check the connection of the power supply unit and power cords NO Was e mail sent by the YES XSCF mail function Confirm that an error message is displayed on the OS and XSCF consoles Execute showlogs on XSCF to display failure information Check var adm messages on Oracle Solaris Write down the displayed failure information Contact our service engineer 3 0 Identifying a Failure This section explains the method for identifying a failure Use the flow described in 3 2 Determining the Causes of Individual Failures to determine the appropriate way of checking for a failure 28 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 33 1 3 3 2 3 3 3 Checking the LED indications Identify the component requiring maintenance by checking the LEDs on both the front and rear panels of the PCI expansion unit and the LEDs on the link card of the server to which the PCI expansion unit is connected To ma
213. rtup is the factory default XSCF gt showdomainconfig p 0 PPAR ID 0 Booting config Current factory default Next factory default config name factory default domains zI date _ created The following example shows that the configuration information at the next startup is not the factory default In this case execute the setdomainconfig command to set the configuration information at the next startup of the physical partition to the factory default XSCF gt showdomainconfig p 0 PPAR ID 0 Booting config Current testl Next test2 XSCF gt setdomainconfig p 0 i 1 XSCF gt showdomainconfig p 0 PPAR ID 20 Booting config Current testl factory default config name factory default domains nal date _ created 15 Check auto boot of the OpenBoot PROM environment variable to stop in the OpenBoot PROM state If the value is true change it to false Chapter 1 Before Starting Maintenance Work 13 14 XSCF gt setpparparam p 0 s bootscript setenv auto boot false PPAR ID of PPARs that will be affected 0 OpenBoot PROM variable bootscript will be changed Continue yln ty If you changed the value check the OpenBoot PROM environment variable XSCF gt showpparparam p 0 use nvramrc security mode bootscript setenv auto boot false 16 Execute the poweron command to restart the physical partition XSCF gt poweron p 0 17 Execute the showdomainstatus command
214. s LED indication LEDs are mounted on the front panel of the PCI expansion unit and on each component that can be maintained If an error occurs check the LEDs to see which component requires maintenance 20 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 221 Front LEDs on the PCI expansion unit The following LEDs are mounted on the front panel of the PCI expansion unit to indicate the status Fan unit A in the figure PCI expansion unit B in the figure Figure 2 5 LEDs on front of the chassis The LEDs on each component and the statuses those LEDs indicate are listed below Table 2 1 LEDs and status of fan unit Name Color Status Description CHECK Amber On Indicates that an error has occurred A Blinking Indicates that the component requires maintenance This function is also referred to as the locator Off Indicates the normal state Or the breaker is open or the power supply is otherwise off The blink interval is 1 second 1 Hz Chapter 2 Understanding the PCI Expansion Unit Components 21 222 Table 2 2 LEDs and status of PCI expansion unit Name Color Status Description READY Green On Indicates that the component is operating D Blinking Power is supplied but the system is not running During this time all of the I O boards will be in the standby state Off The system is stopped CHECK Amber On Indicates that an error has occurred A Blinkin
215. s are used and the firmware versions match within the combinations there will be no problem with the operation even if firmware versions differ among PCI expansion units 9 3 9 3 1 Enabling the Removal of the Link Card This section describes the preparations that must be completed prior to the removal of the link card The preparation procedure differs depending on the maintenance type as follows m Active hot maintenance use of PHP Active hot maintenance use of DR Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Caution To stop the system completely all the power cords of the PCI expansion unit must be removed If the power cords are not removed an electrical failure may occur Active hot maintenance use of PHP Note Active hot maintenance using PHP can be performed only when the destination is the SPARC M10 4 or SPARC M10 4S 146 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 1 Open the rack door 2 Log into the XSCF shell 3 Execute the showlogs command to identify the link card requiring maintenance XSCF gt showlogs error For details see 3 3 4 Checking log information 4 Check the serial number and the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 5 Rele
216. se the PCI expansion unit from the server and then operate the FRU requiring maintenance 5 1 Releasing the Link Card from the Server This section describes the procedure for removing a link card mounted on the server from the system The link card is released from the system using either of the following methods Using PHP and using physical partition dynamic reconfiguration DR Note If the setting of the direct I O function is enabled the link card cannot use PHP Note To add or delete an I O device in the control domain enter delayed reconfiguration mode add or delete the I O device and then restart the control domain 57 5 1 1 Releasing the link card using PHP This section describes the procedure for releasing the link card mounted on the server from the system using PHP This allows you to remove a PCI expansion unit requiring maintenance from the system Making the link card ready to be released 1 Log in to the XSCF shell 2 Execute the ioxadm locator command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can locate the unit You do not have to perform this step when performing maintenance on the link card mounted on a server In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 3 Execute the ioxadm list command to check the BB ID of the server to which the PCI expansion unit requiring maintenance is
217. see 13 3 Enabling the Removal of a Fan Unit Chapter 13 Maintaining the Fan Units 203 13 4 1 13 4 2 Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity Accessing a fan unit 1 Remove the front cover For details see 5 4 2 Removing the front cover Removing a fan unit 1 Press the handle A in the figure of the unit requiring maintenance to the left and then remove the fan unit from its slot Note Place the removed fan unit on the grounded ESD mat to ground any static electricity 204 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 13 2 Fan unit removal 13 5 Installing a Fan Unit This section describes the procedure for installing a fan unit 13 5 1 Installing a fan unit 1 Insert the fan unit into its slot Note Do not force the fan unit into the slot Using excessive force may damage the component or the chassis Chapter 13 Maintaining the Fan Units 205 2 Firmly push the fan unit into its mounting location Note Confirm that the fan unit is inserted securely 13 5 2 Restoring the chassis 1 install the front cover For details see 6 4 2 Installing the front cover 13 6 Restoring the System This section describes the proce
218. see the contents of Chapter 1 Before Starting Maintenance Work 240 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 16 2 1 Types of maintenance Table 16 1 lists the types of maintenance for the fan backplane For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration Table 16 1 Types of maintenance for fan backplane Connection destination SPARC M10 1 Configuration of 1 SPARC M10 4 M10 4S SPARC M10 4S Active hot Active cold Inactive hot Inactive cold Enabled 1 Enabled 2 Enabled Not maintainable System System stopped hot stopped cold Enabled 7 Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHP 2 It is necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting of the direct I O function is enabled the link card cannot use PHP Using the physical partition dynamic reconfiguration DR release the link card from the system 16 2 2 Maintenance flow Table 16 2 lists the sequence of the maintenance procedure for the fan backplane See the relevant section
219. setting for the direct I O function is enabled then maintenance with the system stopped must be performed because the link card cannot use PHE 2 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting of the direct T O function is enabled the link card cannot use PHP Using physical partition dynamic reconfiguration DR release the link card from the system 15 2 2 15 2 3 Maintenance flow Table 15 2 lists the sequence of the maintenance procedure for the I O board See the relevant section Table 15 2 Maintenance flow Details of update process Replacement 1 Preparation 15 3 2 T O board removal 15 4 3 T O board installation 15 5 4 Restoring the system 15 6 Precautions for replacement Observe the following when replacing the I O board Before replacing the I O board check the firmware version The firmware of the PCI expansion unit has been installed on the link card and the I O board When replacing the I O board however the firmware version cannot be automatically matched to the one before the replacement For this reason you must use a confirmed firmware version to match it to the firmware version before the replacement If you cannot recognize the PCI expansion unit from the XSCF check the firmware version of a part that has not been replaced after the replacement to match it to the firmware version before the replacement When you
220. sources that cannot be restored to their original assignment status will become free In such cases use the Idm 1M command to assign resources to the logical domain again Chapter6 Understanding the Preparations for Restoring the System 83 3 Execute the showresult command to check the end status of the addboard command that has just been executed In the following example 0 is returned as the end status and it is indicated that the addboard command has ended normally XSCF gt showresult 0 4 Execute the showboards command to check that the server requiring maintenance has been mounted on the physical partition The BB ID of the server requiring maintenance is indicated as a system board PSB number In the following example Fault of PSB 01 0 is displayed as Normal indicating that the component is operating normally XSCF gt showboards a PSB PPAR ID LSB Assignment Pwr Conn Conf Test Fault Assigned Passed Normal Assigned Passed Normal 5 Execute the showstatus command to confirm that the FRU is operating normally after the completion of maintenance Nothing is displayed if it is normal XSCF gt showstatus 6 Check that the LED of the link board mounted on the PCI expansion unit requiring maintenance is lit 7 Execute the showhardconf command to check the hardware configuration and the status of each component Check that an asterisk is not displayed before each component XSCF gt showhardconf 8 Ex
221. ss Cards 95 7 1 Configuration of the PCIe Cards 95 7 2 Before Maintaining a PCI Express Card 97 7 2 1 Types of maintenance 97 7 2 2 Maintenance flow 98 7 2 3 Precautions for installation 98 7 2 4 Precautions for removal 98 7 3 Enabling the Removal of a PCI Express Card 98 7 3 1 Active hot maintenance 99 7 3 2 Active cold maintenance 106 7 3 3 Inactive hot maintenance 107 7 3 4 Inactive cold maintenance 107 7 3 5 System stopped hot maintenance 108 7 3 6 System stopped cold maintenance 108 7 4 Removing a PCI Express Card 109 7 4 1 Accessing a PCI Express card cassette 109 7 4 2 Removing a PCI Express card cassette 110 7 4 3 Removing a PCI Express card 112 7 5 Installing a PCI Express Card 114 7 5 1 Installing a PCI Express card 114 7 5 2 Installing a PCI Express card cassette 116 Contents v 7 5 3 Restoring the chassis 117 7 6 Restoring the System 117 7 6 1 Active hot maintenance 117 7 6 2 Active cold maintenance 121 7 6 3 Inactive hot maintenance 122 7 6 4 Inactive cold maintenance 122 7 6 5 System stopped hot maintenance 123 7 6 6 System stopped cold maintenance 123 Chapter8 Maintaining the Link Board 125 8 1 Configuration of the Link Board 125 8 2 Before Maintaining the Link Board 126 8 2 1 Types of maintenance 126 8 2 2 Maintenance flow 126 8 3 Enabling the Removal of the Link Board 127 8 3 1 Active hot maintenance 127 8 3 2 Active cold maintenance 128 8 3 3 Inactive hot maintenance 128 8 3 4 Inactive cold maintenance 129 8 3 5 Sys
222. ssignment to the I O domain In case dynamic reconfiguration of PCle endpoint devices is used Note Dynamic reconfiguration of PCIe endpoint devices is supported by a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later 118 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the I O domain and root domain svcadm enable hotplug b Execute the Idm remove io command to delete the physical I O device from the root domain ldm remove io lt I O device name gt lt root domain name gt c Execute the Idm add io command to reassign the deleted physical I O device to the I O domain ldm add io lt I O device name gt lt I O domain name gt In case dynamic reconfiguration of PCle endpoint devices is not used Delete the physical I O device after stopping the I O domain and then restore the physical I O device to the root domain Execute the following procedure a Place the root domain in delayed reconfiguration mode ldm start reconf lt root domain name gt b Delete the physical I O device from the root domain ldm remove io lt I O device name gt lt root domain name gt c Log in to the root domain to restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y d Execute the Idm add io command to r
223. storing the System 219 14 6 1 Active cold maintenance 219 14 6 2 Inactive cold maintenance 219 14 6 3 System stopped cold maintenance 220 Chapter15 Maintaining the I O Board 221 15 1 Configuration of the I O Board 221 15 2 Before Maintaining the I O Board 222 15 2 1 Types of maintenance 222 15 2 2 Maintenance flow 223 15 2 3 Precautions for replacement 223 15 3 Enabling the Removal of the I O Board 224 15 3 1 Active cold maintenance 224 15 3 2 Inactive cold maintenance 225 15 3 3 System stopped cold maintenance 226 15 4 Removing the I O Board 227 15 4 1 Accessing the I O board 227 15 4 2 Removing the I O board 227 15 5 Installing the I O Board 230 15 5 1 Installing the I O board 230 15 5 2 Restoring the chassis 233 15 6 Restoring the System 234 15 6 1 Active cold maintenance 234 15 6 2 Inactive cold maintenance 236 15 6 3 System stopped cold maintenance 236 Contents xi Chapter 16 Maintaining the Fan Backplane 239 16 1 Location of the Fan Backplane 239 16 2 Before Maintaining the Fan Backplane 240 16 2 1 Types of maintenance 241 16 2 2 Maintenance flow 241 16 3 Enabling the Removal of the Fan Backplane 242 16 3 1 Active cold maintenance 242 16 3 2 Inactive cold maintenance 243 16 3 3 System stopped cold maintenance 243 16 4 Removing the Fan Backplane 244 16 4 1 Accessing the fan backplane 244 16 4 2 Removing the fan backplane 245 16 5 Installing the Fan Backplane 247 16 5 1 Installing the fan backplane 247 16 5 2 Restoring the chass
224. t of the cable and inserting it straight into the opening Do not hold the cable part when inserting the cable Chapter8 Maintaining the Link Board 137 8 6 8 6 1 8 6 2 Restoring the System This section describes the procedure for restoring the system after link board installation The restoration procedure differs depending on the maintenance type as follows Active hot maintenance Active Cold maintenance Inactive hot maintenance Inactive cold maintenance System stopped hot maintenance System stopped cold maintenance Active hot maintenance 1 Mount the PCI expansion unit on the server For details see 6 1 1 Mounting the link card on the server using PHP 2 Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 3 Close the rack door Active Cold maintenance Note Active cold maintenance is performed using either of two methods Using PHP and using physical partition dynamic reconfiguration DR The latter method of using physical partition dynamic reconfiguration DR is usable only when the destination has the building block configuration of the SPARC M10 4S 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed
225. t the entire system For details see 6 3 Starting the Entire System Close the rack door Chapter 13 Maintaining the Fan Units 209 210 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 14 Maintaining the PCI Tray This chapter describes the maintenance procedure for the PCI tray 14 1 Configuration of the PCI Tray Before Maintaining the PCI Tray Enabling the Removal of the PCI Tray Removing the PCI Tray Installing the PCI tray Restoring the System Configuration of the PCI Tray This section describes the configuration and location of the PCI tray The PSU backplane I O board and fan backplane are mounted on the PCI tray When the PCI tray is to be replaced replace the PCI tray and PSU backplane at the same time The I O board and the fan backplane must be reinstalled on the new PCI tray 211 Figure 14 1 PCI tray location 1 Location number Component 1 PCI tray TRAY 14 2 14 2 1 Before Maintaining the PCI Tray This section describes the maintenance types and flow for the PCI tray Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work Types of maintenance Table 14 1 lists the types of maintenance for the PCI tray For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a buildin
226. tails see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door System stopped hot maintenance Connect the power cords to the power supply unit requiring maintenance For details see 6 4 1 Installing the power cords 194 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 12 6 6 Note Confirm that the LED green on the power supply unit is blinking N Execute the ioxadm command to turn off the CHECK LED of the PCI expansion unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator off PCIBOX 12B4 w Execute the testsb command to confirm that the PCI expansion unit requiring maintenance has been recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 lt 1 XSCF gt testsb y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed e Start the entire system For details see 6 3 Starting the Entire System XSCF gt ioxadm locator off PCIBOX 12B4 5 Close the rack door System stopped cold maintenance 1 Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4
227. taining the Link Board 141 142 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 9 Maintaining the Link Cards This chapter describes the maintenance procedure for the link card Link cards can be replaced expanded and removed Configuration of a Link Card Before Maintaining a Link Card Enabling the Removal of the Link Card Removing the Link Card Installing the Link Card Restoring the System 9 1 Configuration of a Link Card This section describes the configuration and location of the link cards Mount a link card in the PCI Express PCIe slot of the SPARC M10 1 or SPARC M10 4 M10 4S and then for each link card connect one PCI expansion unit to add a PCle slot In the case of the SPARC M10 1 up to three link cards can be mounted up to 11 for the SPARC M10 4 and up to eight for the SPARC M10 4S Figure 9 1 Link card mounting position SPARC M10 1 143 Figure 9 2 Link card mounting position SPARC M10 4 M10 4S SPARC M10 4 SPARC M10 4S 144 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 9 2 Before Maintaining a Link Card This section describes the maintenance types flow and points to remember regarding the link card Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Startin
228. ted Documentation Text Conventions Notes on Safety Syntax of the Command Line Interface CLI Document Feedback Audience This document is intended for service engineers and field engineers who perform maintenance work on the system XV Related Documentation All documents for your server are available online at the following locations Sun Oracle software related documents Oracle Solaris etc http www oracle com documentation Fujitsu documents Japanese site http jp fujitsu com platform server sparc manual Global site http www fujitsu com global services computing server sparc downloads manual The following table lists documents related to SPARC M10 Systems SPARC M10 Systems related documentation 1 Fujitsu M10 SPARC M10 Systems Getting Started Guide 2 Fujitsu M10 SPARC M10 Systems Quick Guide Fujitsu M10 SPARC M10 Systems Important Legal and Safety Information 2 Software License Conditions for Fujitsu M10 SPARC M10 Systems Fujitsu M10 SPARC M10 Systems Safety and Compliance Guide Fujitsu M10 SPARC M10 Systems Security Guide Fujitsu M10 SPARC M10 Systems SPARC Enterprise PRIMEQUEST Common Installation Planning Manual Fujitsu M10 SPARC M10 Systems Installation Guide Fujitsu M10 1 SPARC M10 1 Service Manual Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Crossbar Box for Fujitsu M10 SPARC M10 Systems Service Manual PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems
229. ted in advance cfgadm c configure Ap ID 7 Execute the cfgadm 1M command to confirm that the PCle card requiring maintenance has been incorporated into the logical domain In the following example the Receptacle is displayed as connected and the Occupant as configured indicating that the PCle card requiring maintenance is incorporated into the logical domain cfgadm a Ap_Id Type Receptacle Occupant Condition BB 0 PCI 0 pci pci hp connected configured ok 8 Login to the XSCF shell 9 Execute the showstatus command to check that the Field Replaceable Unit FRU and the link card are operating normally after the completion of maintenance Nothing is displayed if they are normal 80 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 XSCF gt showstatus 10 Execute the showhardconf command to check the hardware configuration and the status of each component In the following example the Status of each component is displayed as Normal indicating that the component is operating normally showhardconf M10 4S Serial 2081229003 Operator Panel Switch Service System _Power On System Phase Cabinet Power On Partition 0 PPAR Status Running Status Normal Role Master Ver 2050h Serial 2081229003 FRU Part Number CA07361 D202 AO Power Supply System Memory Size 320 GB Status Normal Name _Property pci Vendor ID 108e Device ID 9020 Subsystem Vendor ID 0000 Su
230. tem is running the 2 1 redundant configuration allows the system to continue operating 197 Figure 13 1 Fan unit locations Location number Component 1 Fan unit FAN 0 2 Fan unit FAN 1 3 Fan unit FAN 2 13 2 Before Maintaining a Fan Unit This section describes the types of maintenance for the fan units the maintenance flow and some precautions Note Read and understand the instructions in this chapter before starting the maintenance work Also see the contents of Chapter 1 Before Starting Maintenance Work 13 2 1 Types of maintenance Table 13 1 lists the types of maintenance for the fan units For the definition of maintenance see Maintenance type when the destination of the PCI expansion unit has a building block configuration 198 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 13 1 Types of maintenance for fan unit Not maintainable Connection Active hot Active cold Inactive hot Inactive cold System System destination stopped hot stopped cold SPARC M10 1 Enabled Enabled Enabled Configuration Enabled Enabled 1 Enabled Enabled of 1 SPARC M10 4 M10 4S SPARC M10 4S Enabled Enabled 2 Enabled Enabled Enabled Enabled 1 Itis necessary to use the PCI Hot Plug PHP to release the link card mounted on a destination server from the system If the setting for the direct I O function is enabled then maintenance with the system stopped must be
231. tem start entirely 89 system stop entirely 74 system restoring 79 T tags 2 269 270 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014
232. tem stopped hot maintenance 129 8 3 6 System stopped cold maintenance 130 8 4 Removing the Link Board 131 8 4 1 Accessing the link board 131 8 4 2 Removing the link board 132 8 5 Installing the Link Board 135 8 5 1 Installing the link board 135 8 5 2 Restoring the chassis 137 8 6 Restoring the System 138 8 6 1 Active hot maintenance 138 8 6 2 Active Cold maintenance 138 8 6 3 Inactive hot maintenance 139 8 6 4 Inactive cold maintenance 139 vi PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 8 6 5 System stopped hot maintenance 140 8 6 6 System stopped cold maintenance 140 Chapter9 Maintaining the Link Cards 143 9 1 Configuration of a Link Card 143 9 2 Before Maintaining a Link Card 145 9 2 1 Types of maintenance 145 9 2 2 Maintenance precautions 145 9 3 Enabling the Removal of the Link Card 146 9 3 1 Active hot maintenance use of PHP 146 9 3 2 Active hot maintenance use of DR 147 9 3 3 Inactive hot maintenance 148 9 3 4 Inactive cold maintenance 148 9 3 5 System stopped hot maintenance 149 9 3 6 System stopped cold maintenance 149 9 4 Removing the Link Card 150 9 5 Installing the Link Card 151 9 6 Restoring the System 151 9 6 1 Active hot maintenance use of PHP 152 9 6 2 Active hot maintenance use of DR 153 9 6 3 Inactive hot maintenance 153 9 6 4 Inactive cold maintenance 154 9 6 5 System stopped hot maintenance 155 9 6 6 System stopped cold maintenance 155 Chapter10 Maintaining the Link Ca
233. tenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly Inactive cold maintenance 1 Open the rack door 2 Login to the XSCF shell 3 Execute the showlogs command to identify the PCI tray requiring maintenance 214 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 14 3 3 PA a g XSCF gt showlogs error For details see 3 3 4 Checking log information Turn off the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note For a dual power feed make a note of the locations of the power cords before disconnecting them to ensure that they are reinstalled correctly System stopped cold maintenance 1 2 3 Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the PCI tray req
234. the I O device PCle root complex released from the root domain to the root domain Then start the root domain ldm add io lt I O device name gt lt root domain name gt ldm start domain lt root domain name gt 5 If the I O domain is in use reassign the PCle slot to the I O domain The PCle slot is automatically assigned to the root domain So to reassign it to the I O domain first release it from the root domain and then assign it In case dynamic reconfiguration of PCle endpoint devices is used Note Dynamic reconfiguration of PCIe endpoint devices is supported by a combination of XCP 2230 or later and Oracle VM Server for SPARC 3 1 1 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Enable the hotplug service of the root domain and I O domain svcadm enable hotplug b Release the physical I O device slot Chapter6 Understanding the Preparations for Restoring the System 85 ldm remove io lt I O device name gt lt root domain name gt c Execute the Idm add io command to assign the PCIe slot to the I O domain ldm add io lt I O device name gt lt I O domain name gt In case dynamic reconfiguration of PCle endpoint devices is not used Delete the physical I O device after stopping the I O domain and then restore the physical I O device to the root domain Execute the following procedure a Place the root domain in the delayed reconfiguration mo
235. the XSCF shell Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically Woon answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating the Firmware If the firmware version is the same as the one before maintenance you do not have to perform this step Go to step 6 Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door System stopped cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords 236 PCI Expansion Unit for Fujitsu M10 SPARC M
236. the operation panel to Locked mode PA 0 ok setenv auto boot true XSCF gt poweroff p 0 Appendix C Updating the Firmware of the PCI Expansion Unit 267 C 3 Problems during Firmware Update 268 This section explains the problems that may occur during firmware update The following errors may occur A hang up occurs in the XSCF while the firmware is being updated Action Update the firmware again A hang up occurs in the PCI expansion unit while the firmware is being updated Action Either the link card or the I O board has a failure Replace the failed part An error message related to a write failure FROM write error appears If an error occurs during firmware update operation continues using the previous version of the firmware Action Update the firmware again The firmware update may be completed successfully If an error occurs again during the firmware update the I O board has a failure Replace the failed part PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Index C component list 253 component name and location 17 component specifications 255 F failure identifying 28 fan backplane 239 fan unit 197 firmware updating 261 I O board 221 L labels 2 link board 125 link cable 157 link card 143 M maintenance preparing for 35 management cable 171 P PCI Express card 95 PCI tray 211 power supply unit 183 S sys
237. this step Go to step 4 Start the entire system For details see 6 3 Starting the Entire System Close the rack door System stopped cold maintenance 1 Connect all the power cords to the power supply unit or the PSU backplane unit of the server containing the link card requiring maintenance For details see 6 3 6 Installing the power cords in the Fujitsu M10 1 SPARC M10 1 Service Manual or 6 1 1 Installing the power cord in the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 Chapter9 Maintaining the Link Cards 155 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 5 If the firmware version is different from the one
238. tion of the CHECK LED and the procedure for checking it see 2 2 1 Front LEDs on the PCI expansion unit 1 Login to the XSCF shell 2 Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink to locate it In the following example the CHECK LED of PCIBOX 2008 is specified XSCF gt ioxadm locator on PCIBOX 2008 Location Sensor Value Resolution Units PCIBOX 2008 LOCATE Blink LED PCIBOX 2008 FAN 0 SERVICE Blink LED PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Chapter 4 Preparing for Maintenance This chapter describes the preparations that must be completed prior to performing any maintenance as well as the types of maintenance Preparing Tools Required for Maintenance Understanding Types of Maintenance Precautions for Maintenance 4 1 Preparing Tools Required for Maintenance This section explains the tools required for maintenance Table 4 1 lists the tools required for maintenance Table 4 1 Maintenance tools Item Use Phillips screwdriver No 2 Removing or replacing screws Wrist strap For grounding static electricity ESD mat For grounding static electricity 4 2 Understanding Types of Maintenance This section describes the maintenance types for the PCI expansion unit The terms used in this manual are defined as follows 35 4 2 1 Table 4 2 Term definitions Term Definition Physical partition
239. tion of the PCI expansion unit is enabled The following operations must be performed to save restore each item of information Note If you use the PCI Hot Plug PHP function to perform maintenance on the PCI expansion unit the direct I O function is disabled Therefore it is not necessary to save restore each item of information PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 1 7 3 Table 1 4 Operations when installing removing replacing the PCI expansion unit for the PCIe slot of the SPARC M10 chassis for which the direct I O function is enabled Maintenance environment Domain configuration Reconfiguration of Oracle VM Server for SPARC config When stopping PPAR for factory default Unnecessary installation removal Contains a guest Necessary XML domain When stopping PPAR to factory default Unnecessary replace the failed PCI Contains a guest Necessary XML expansion unit 1 domain When stopping PPAR to factory default Unnecessary replace the normal PCI Contains a guest Unnecessary expansion unit 1 domain Resetting of OpenBoot PROM environment variable Unnecessary Necessary Unnecessary Necessary Unnecessary Unnecessary 1 This includes the replacement of the link card link cable management cable or link board How to save restore the logical domain configuration information and the OpenBoot PROM environment variable 1 Execute the Idm Is spconfig comman
240. to check the status of the control domain Confirm that the status of the control domain is displayed as OpenBoot Running indicating that it is in the OpenBoot PROM state XSCF gt showdomainstatus p 0 Logical Domain Name Status primary OpenBoot Running 18 Execute the console command to switch to the control domain console XSCF gt console p 0 y Console contents may be logged Connect to PPAR ID 0 f yln 3y 19 Based on the record in step 11 restore the OpenBoot PROM environment variable In the following example auto boot is restored to true 0 ok setenv auto boot true auto boot true 0 ok printenv auto boot auto boot true 20 Boot Oracle Solaris 0 ok boot 21 With the Oracle Solaris super user prompt confirm that the system has PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 started with the factory default ldm 1ls spconfig factory default current 22 Execute the Idm init system command and the shutdown command to restart the control domain ldm init system i var tmp test1 xml Initiating a delayed reconfiguration operation on the primary domain All configuration changes for other domains are disabled until the primary domain reboots at which time the new configuration for the primary domain will also take effect shutdown y g0 i6 23 After restarting the control domain bind and start other logical domains For logical do
241. topped cold maintenance Open the rack door Log in to the XSCF shell Execute the showlogs command to identify the link cables requiring maintenance XSCF gt showlogs error ca For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink allowing you to locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 Chapter 12 Maintaining the Power Supply Units 189 5 Stop the entire system For details see 5 3 Stopping the Entire System 6 Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off 7 Remove all the power cords from the power supply unit of the PCI expansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 12 4 Removing a Power Supply Unit This section describes the procedure for removing a power supply unit Enable the removal of the power supply unit before attempting to remove it For details see 12 3 Enabling the Removal of a Power Supply Unit electricity If you perform this procedure without a wrist strap individual
242. tplug b Execute the Idm remove io command to delete the physical I O device from the I O domain ldm add io lt I O device name gt lt root domain name gt c Execute the Idm add io command to reassign the deleted physical I O device to the root domain ldm remove io lt I O device name gt lt I O domain name gt In case dynamic reconfiguration of PCle endpoint devices is not used Delete the physical I O device after stopping the I O domain and then restore the physical I O device to the root domain Execute the following procedure 104 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 a Stop the I O domain ldm stop domain lt I O domain gt b Delete the physical I O device from the I O domain ldm remove io lt I O device name gt lt I O domain name gt c Place the root domain in delayed reconfiguration mode ldm start reconf lt root domain name gt d Execute the Idm add io command to reassign the deleted physical I O device to the root domain ldm add io lt I O device name gt lt root domain name gt e Log in to the root domain to restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y Releasing the PCle card requiring maintenance using PHP 1 Ifthe PCle card requiring maintenance belongs to the root domain connect to the console of the root domain If it belongs to the control domain this step is not necessary since t
243. troy vf lt VF name gt In case Static SR IOV feature is used Execute the following procedure a Execute the Idm stop domain command to stop the I O domain b Execute the Idm remove io command to delete the virtual function VF Chapter5 Understanding the Preparations for Enabling Maintenance 69 assigned to the I O domain from the I O domain If multiple VFs are assigned from the physical function PF of a single PCle card delete all the VFs corresponding to that PF from the I O domain c Execute the Idm start reconf command to place the root domain to which PF is assigned in delayed reconfiguration mode d Execute the Idm destroy vf command to discard the virtual function VF However the VF needs to be discarded in the reverse order to that in which it was created ldm stop domain lt I O domain name gt ldm remove io lt VF name gt lt I O domain name gt ldm start reconf lt root domain name gt ldm destroy vf lt VF name gt e Log in to the root domain to restart Oracle Solaris telnet localhost lt port number gt shutdown i6 g0 y Execute the Idm stop domain command to stop the root domain Execute the Idm remove io command to delete the physical I O device PCle root complex from the root domain 8 Execute the Idm list io command again to check the usage status of the I O devices 9 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the dis
244. tus Table 3 1 Status check command Type Command Description XSCF ioxadm Displays information on the PCI expansion unit The system administrator and service engineer can manage the PCI expansion unit by executing the ioxadm command Chapter3 Troubleshooting 29 Table 3 1 Status check command continued Type Command Description OpenBoot PROM show devs Displays device tree information on the PCIe card and other devices connected to the host Execute this command from the ok prompt Oracle Solaris prtdiag Displays the system configuration and all Field Replaceable Units FRUs that have experienced failures Execute this command from the Oracle Solaris super user prompt FRU refers to any component that can be replaced by a field engineer The command execution examples shown here are based on the assumption that PCle cards are inserted into all of the slots ioxadm command Execute the ioxadm command to determine the environmental conditions temperature voltage etc or LED indications of the PCI expansion unit 1 Log in to the XSCF shell 2 Execute the ioxadm command to check the environmental conditions of the specified PCI expansion unit The following example shows the environmental conditions for the PCIBOX 2008 2008 is the last four digits of the serial number of the PCI expansion unit XSCF gt ioxadm env te PCIBOX 2008 Location Sensor Value Resolution PCIBOX 2008 AIRFLOW 180 000 0 000 PCIBOX 2008 P_ C
245. ty pci PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Vendor ID 108e Device ID 9020 Subsystem Vendor ID 0000 Subsystem ID 0000 Model Connection 7001 PCIBOX 7001 Status Normal Ver 1110h Serial 2121237001 FRU Part Number IOB Status Normal Serial PP123403JE FRU Part Number CA20365 B66X OO8AG LINKBOARD Status Normal Serial PP1234026P FRU Part Number CA20365 B60X OO1AA i PCI 1 Name Property ethernet Vendor ID 1077 Device ID 8000 Subsystem _Vendor ID 1077 Subsystem ID 017e Model 6 3 Starting the Entire System This section explains the procedure for starting the system The operation for starting the system is performed on the server Start the system in either of the following two ways Starting the system with the XSCF command Starting the system from the operation panel Check that the XSCF STANDBY LED on the operation panel is on 2 Switch the mode switch on the operation panel to Locked mode For details see 2 2 2 Control function of the operation panel in the Fujitsu M10 1 SPARC M10 1 Service Manual or the Fujitsu M10 4 Fujitsu M10 45 SPARC M10 4 SPARC M10 4S Service Manual Log in to the XSCF shell Start the entire system For details see 6 3 1 Starting the system with the XSCF command or 6 3 2 Starting the system from the operation panel After a short while the following processes are performed The POWER LED
246. uiring maintenance XSCF gt showlogs error Pe For details see 3 3 4 Checking log information Execute the ioxadm command to cause the CHECK LED of the PCI expansion unit requiring maintenance to blink so that you can locate the unit In the following example the CHECK LED of PCIBOX 12B4 is specified XSCF gt ioxadm locator on PCIBOX 12B4 gi Sa N Stop the entire system For details see 5 3 Stopping the Entire System Check the following LEDs to determine whether the PCI expansion unit requiring maintenance is actually maintainable The LED of the link board is off The LED of the PCI card slot is off Remove all the power cords from the power supply unit of the PCI expansion Chapter 14 Maintaining the PCI Tray 215 unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 14 4 Removing the PCI Tray This section describes the procedure for removing the PCI tray Enable the removal of the PCI tray before attempting to remove it For details see 14 3 Enabling the Removal of the PCI Tray Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Rega
247. unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell 3 Execute the testsb command to confirm that the PCI expansion unit requiring maintenance is recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 Chapter 16 Maintaining the Fan Backplane 251 16 6 3 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed Turn on the power to the physical partition to which the PCI expansion unit requiring maintenance belongs For details see 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs Close the rack door System stopped cold maintenance Connect all the power cords to the power supply unit of the PCI expansion unit requiring maintenance For details see 6 4 1 Installing the power cords Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb comman
248. unted in the PCI expansion unit cfgadm a 5 Execute the cfgadm c command to release the link card from the logical domain Enter the Ap_ID of the link card that you noted in advance cfgadm c unconfigure Ap ID 6 Execute the cfgadm c command to stop the power supply to the link card Enter the Ap_ID of the link card that you noted in advance cfgadm c disconnect Ap ID 7 If you have enabled the hotplug service execute the svcadm command to return the hotplug service to the disabled state Chapter5 Understanding the Preparations for Enabling Maintenance 63 Deke svcadm disable hotplug Releasing the link card using physical partition dynamic reconfiguration DR This section describes the procedure for releasing the chassis containing the link card from the physical partition using physical partition dynamic reconfiguration DR This allows you to remove a PCI expansion unit requiring maintenance from the system Physical partition dynamic reconfiguration DR is usable only for the building block configuration For details on the l1dm 1M command to be executed in each step see the reference manuals for Oracle VM Server for SPARC 3 1 and later Note For details on the versions of XCP and Oracle VM Server for SPARC SRU supporting physical partition dynamic reconfiguration DR see the latest product note Note To add or delete an I O device in the control domain enter delayed reconfiguration mode add
249. upported Supported Supported wn U U U U nsupported upported nsupported nsupported nsupported nsupported supported Active hot use pf System stopped PHP Enabled 3 5 Enabled Enabled 2 Enabled Enabled 6 Enabled Enabled 4 Enabled Enabled 4 5 Enabled 42 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Table 4 6 Maintenance type for the PCIe card of the PCI expansion unit When the destination server has a single unit configuration continued Not maintainable Domain to which the PCle card requiring maintenance PCI card maintenance type PCI expansion g 7 a unit belongs Direct I O 1 PHP support SR IOV 2 cha use pf System stopped Unsupported Unsupported Unsupported Enabled supported Supported Unsupported Unsupported Enabled supported Supported Supported Unsupported Enabled 4 6 Enabled al E 3 4 D 6 This refers to a state in which the PCIe card of the PCI expansion unit is assigned to a logical domain through the use of the direct T O For details on whether to use the SR IOV function see 4 2 3 Checking whether the SR IOV function is used Execute PHP from the control domain Execute PHP from the root domain The PHP function provided when the SR IOV function is used is supported by Oracle VM Server for SPARC 3 1 or later Use the dynamic reconfiguration function of the PCIe endpoint device to ret
250. uration Domain to which the PCI expansion PCle card requiring maintenance Maintenance type for the PCIe card of the PCI expansion unit When the destination server has a Not maintainable Maintenance types of the PCle card unit belongs Direct I O 1 PHP support SR IOV function Active hot Use Active hot Use System stopped 2 of PHP of DR Control domain Unsupported Supported Unsupported Enabled 3 Enabled supported 8 Unsupported Unsupported Unsupported Enabled supported Supported Unsupported Unsupported Enabled Supported Supported Unsupported Enabled 9 Enabled Root domain Unsupported Supported Unsupported Enabled 4 Enabled 5 Enabled Unsupported Supported Supported Enabled 4 Enabled 6 Enabled 8 Unsupported Unsupported Unsupported Enabled 5 Enabled Unsupported Unsupported Supported Enabled 6 Enabled Supported Unsupported Unsupported Enabled 7 Enabled Supported Supported Unsupported Enabled 9 Enabled 7 Enabled 1 This refers to a state in which the PCIe card of the PCI expansion unit is assigned to a logical domain through the use of the direct T O 2 For details on whether to use the SR IOV function see 4 2 3 Checking whether the SR IOV function is used 3 Execute PHP from the control domain 4 Execute PHP from the root domain 5 Stop the root domain and execute the dynamic reconfiguration of the physical partition DR 6 Stop the I O domain
251. urn from the I O domain of direct I O to the control domain or root and then execute PHP The dynamic reconfiguration function of the PCIe endpoint device is supported by Oracle VM Server for SPARC 3 1 1 1 or later Maintenance type when the destination of the PCI expansion unit has a building block configuration Suppose that the destination of the PCI expansion unit has a building block configuration In this case the following six maintenance types can be applied depending on the combinations of the statuses of the physical partition requiring maintenance and the input power statuses of the chassis requiring maintenance Chapter4 Preparing for Maintenance 43 Table 4 7 Maintenance type when the destination of the PCI expansion unit has a building block configuration Status of the physical partition to which the PCI expansion unit Input power status of the PCI expansion unit requiring maintenance Type of maintenance requiring maintenance belongs Active Status in which Oracle Solaris is operating during maintenance Inactive Status in which the physical partition requiring maintenance stops during maintenance System stopped Status in which all physical partitions stop as well as the physical partition requiring maintenance Hot Status in which the power cord of the PCI expansion unit remains connected Cold Status in which the power cord of the PCI expansion unit has been disconnected Hot Status in whi
252. us ait t fourni ne vous conf re aucun droit et aucune licence expr s ou tacites concernant le produit ou la technologie auxquels il se rapporte Par ailleurs il ne contient ni ne repr sente aucun engagement de quelque type que ce soit de la part d Oracle ou de Fujitsu Limited ou des soci t s affili es de l une ou l autre entit Ce document ainsi que les produits et technologies qu il d crit peuvent inclure des droits de propri t intellectuelle de parties tierces prot g s par le droit d auteur et ou c d s sous licence par des fournisseurs a Oracle et ou ses soci t s affili es et Fujitsu Limited y compris des logiciels et des technologies relatives aux polices de caract res Conform ment aux conditions de la licence GPL ou LGPL une copie du code source r gi par la licence GPL ou LGPL selon le cas est disponible sur demande par I Utilisateur Final Veuillez contacter Oracle et ou ses affili s ou Fujitsu Limited Cette distribution peut comprendre des composants d velopp s par des parties tierces Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e de The OpenGroup Oracle et Java sont des marques d pos es d Oracle Corporation et ou de ses affili s Fujitsu et le logo Fujitsu sont des marques d pos es de Fujitsu Limited SPARC Enterprise SPARC64 le logo SPARC64 et toutes les marques SPARC sont utilis es sous licenc
253. used 52 4 2 3 Checking whether the SR IOV function is used 55 4 3 Precautions for Maintenance 56 Chapter5 Understanding the Preparations for Enabling Maintenance 57 5 1 Releasing the Link Card from the Server 57 5 1 1 Releasing the link card using PHP 58 5 1 2 Releasing the link card using physical partition dynamic reconfiguration DR 64 5 2 Turning Off the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 72 5 3 Stopping the Entire System 74 5 3 1 Stopping the system with the XSCF command 75 5 3 2 Stopping the system from the operation panel 75 5 4 Accessing Components 76 5 4 1 Removing the power cords 76 5 4 2 Removing the front cover 77 Chapter6 Understanding the Preparations for Restoring the System 79 6 1 Mounting the Link Card on the Server 79 6 1 1 Mounting the link card on the server using PHP 79 iv PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 6 1 2 Mounting the link card on the server using physical partition dynamic reconfiguration DR 83 6 2 Turning On the Power to the Physical Partition to Which the PCI Expansion Unit Requiring Maintenance Belongs 88 6 3 Starting the Entire System 89 6 3 1 Starting the system with the XSCF command 90 6 3 2 Starting the system from the operation panel 91 6 4 Restoring the chassis of the PCI expansion unit 91 6 4 1 Installing the power cords 91 6 4 2 Installing the front cover 92 Chapter 7 Maintaining the PCI Expre
254. vice If you are using the duplication function of the virtual device release the target virtual device with the duplication function so that that virtual device is not used b Delete the virtual device and virtual service from the control domain by using the Idm command If you need to restore the configuration to the original status after maintaining the PCIe card make a note of the setting information For the virtual network ldm remove vnet lt virtual network gt lt guest domain gt ldm remove vswitch lt virtual network switch gt For the virtual disk ldm remove vdisk lt virtual disk gt lt guest domain gt 9 ldm remove vdiskserver lt virtual disk service gt Suppose that a virtual function VF using the the SR IOV function has been created and assigned to the domain for the PCle card mounted on the PCI expansion unit requiring maintenance Delete and discard the virtual function from the control domain with the Idm 1M command In case Dynamic SR IOV feature is used Note Dynamic reconfiguration of the SR IOV virtual function is supported by a combination of XCP 2210 or later and Oracle VM Server for SPARC 3 1 or later Stopping the I O domain or root domain is unnecessary Execute the following procedure a Execute the ldm list io command to check whether the SR IOV function is in use For details see 4 2 3 Checking whether the SR IOV function is used If there is a line on which VF is displ
255. wer outlet Do not make any mechanical or electrical alterations We do not take any responsibility for issues arising from non authorized modifications to the chassis 1 4 Notes Regarding Static Electricity Observe the precautions concerning the electrostatic discharge ESD as described in Table 1 1 to ensure the safety of personnel and the system Table 1 1 ESD precautions Item Note Wrist strap Wear an antistatic wrist strap when handling printed boards ESD mat An approved ESD mat provides protection from static damage when used together with a wrist strap The mat also acts as a cushion to protect the small parts that are attached to printed boards Antistatic bag After removing a printed board or component place it in the ESD safe packaging box antistatic bag or ESD safe packaging box Using a wrist strap Wear a wrist strap in such a way that the inner metal surface A in the figure of the wrist strap band is in contact with your skin Connect the clip B in the figure directly to the chassis strap clip to the chassis the operator and components assume the same electrical AN Caution Do not connect the wrist strap clip to the ESD mat By connecting the wrist potential thus eliminating the danger of damage from static discharge 4 PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Figure 1 3 Wrist strap connection destination 1 5 Other Precautions The print
256. xpansion unit requiring maintenance For details see 5 4 1 Removing the power cords Note When a dual power feed is installed record the positions of the power cords before removing them to ensure that they are reinstalled correctly 10 4 164 A Removing a Link Cable This section describes the procedure for removing a link cable Enable removal of the link cable before attempting to remove it For details see 10 3 Enabling the Removal of a Link Cable Caution Before you handle any components wear a wrist strap to ground any static electricity If you perform this procedure without a wrist strap individual components or the overall system may be damaged For details see 1 4 Notes Regarding Static Electricity 1 Hold the tabs of the link cables on the PCI expansion unit side and then remove the two cables PCI Expansion Unit for Fujitsu M10 SPARC M10 Systems Service Manual December 2014 Note Record the positions of the link cables before removing them to ensure that they are reinstalled correctly Figure 10 5 Removing the link cable 2 Remove the two link cables from the SPARC M10 1 or SPARC M10 4 M10 4S using the same procedure Note Record the positions of the link cables before removing them to ensure that they are reinstalled correctly 10 5 Installing a Link Cable This section describes the procedure for installing the link cables 1 Hold the link cable connectors and conn
257. xpansion Unit Requiring Maintenance Belongs 5 Close the rack door 9 6 4 Inactive cold maintenance 1 Connect all the power cords to the power supply unit or the PSU backplane unit of the server containing the link card requiring maintenance For details see 6 3 6 Installing the power cords in the Fujitsu M10 1 SPARC M10 1 Service Manual or 6 1 1 Installing the power cord in the Fujitsu M10 4 Fujitsu M10 4S SPARC M10 4 SPARC M10 4S Service Manual Note In the case of a dual power feed connect the power cords in their original positions by referring to the record that you made before the start of maintenance Log in to the XSCF shell Execute the testsb command to confirm that the link card and PCI expansion unit requiring maintenance are recognized normally When you enter the y option for the testsb command the system automatically answers y yes in response to an inquiry The following example shows the diagnosis of system board 00 0 XSCF gt testsb v y s 00 0 During the diagnosis processing the show devs command of OpenBoot PROM is executed and the result is displayed 4 Check the firmware version of the PCI expansion unit For details see For active maintenance in How to check the serial number and firmware version of the PCI expansion unit 5 If the firmware version is different from the one before maintenance match it to the firmware version before maintenance For details see C 2 Updating

Download Pdf Manuals

image

Related Search

Related Contents

Kenroy Home 32474DAB Installation Guide  Sony BC-TRA User's Manual  Section syndicale CGT Colas Midi Méditerranée  Pioneer PRO-1150HD User's Manual  S7000 mode emploie  Whirlpool WFW8300SW0 User's Manual  Dri-Eaz Evolution Dehumidifier Manual  Users manual  OnRoad Katalog 2010/2011 - ctr  Kenwood DNX520VBT GPS Receiver User Manual  

Copyright © All rights reserved.
Failed to retrieve file