Home

SuperMicro SERVER RACK|SUPMICRO 6014A

1. Hu 432 J38 J1D1 vss gl DIMM 1 Bank 1 z J1B1 8 DIMN TE Bank T JPS JP11 DIMW ZA Bank2 USBO 1 JP10 M DIMWZE 2 CPU1 I DIMM 3A Bank3 FAN1 1 DIMM 3B Bank3 DIMM 4A Banka ari DIMM 4B Bank4 z FAN2 S E7525 22 CPU2 North Bridge L SXB E Universal Slot ax 8 133 MHz PCI X slot us GLAN1 SMB 12 16 PCI Express slot x4 PCI Express slot gt z GLAN2 IPMI 2 0 I 5 I O E GLAN o JPF 9 Jwon m ICH5R JPASL 1 lt South los 2 5 Bridge AIC 7902 3 8 Rage XL SCSI lt 2 Controller a JBTi 8 JrAN3 CLR CMOS JWD JoHi JPL1 USB2 3 JD2 i JPG1 JDi WOL Notes Jumpers not noted are for test purposes only m indicates the location of Pin 1 5 10 Chapter 5 Advanced Serverboard Setup X6DAR 8G Quick Reference Jumper Description Default Setting J4F4 J4F5 Memory Size Select See Section 5 9 JBT1 CMOS Clear See Section 5 9 JP10 3rd PWR Supply Fail Detect Open Disabled JPA1 SCSI Enable Disable Pins 1 2 Enabled 2 JPA3 SCSI Ch A B Term Enable Disable Open E
2. 5 7 Installing MG MON Coch cet D 5 7 Adding POV GCatds o erret rro qe 5 9 Serverboard Details nitrate nisle ba eR Ud 5 10 X6DAR 8Q LayOUt 5c ae be fet ea edes 5 10 X6DAR 8G Quick Reference seen 5 11 Connector Definitions torret cecinit terret rated ATX Power Connector Processor Power ge aedes 5 12 NIMIEBUTOE eA en cates 5 12 Power BED ecrit eaten aite ated tiere 5 12 HDD WED m 5 13 NIC LEDS X T 5 13 Overheat Fan Fail 5 13 Power Fall LED 3 iiit err tiere re ape e ite e EE Pene 5 13 e H 5 14 Power BUTION me nne nri rie e ida teas 5 14 ChiassissIntt siOR etr to ien aeter obra edes 5 14 GLAN 1 2 Ethernet Ports etie 5 14 Universal Serial BUS re teet era Front Panel USB Headers Fan Serial error penes tee PS 2 Keyboard amp Mouse 5 15 vii SUPERSERVER 6014 8 Manual Power IMED Speaket ote htec ge teri Ate 5 16 Wake E EQ 5 16 Wake sOti BAN ri irr et a n ier 5 16 2 2 etr Inter npe Rente Re 5 17 Overh
3. The control panel LEDs inform you of system status See Chapter 3 System Interface for details on the LEDs and the control panel buttons Details on JF2 can be found in Chapter 5 Advanced Serverboard Setup 6 2 Chapter 6 Advanced Chassis Setup 6 3 System Fans Two 10 cm blower fans provide all the cooling needed for the SuperServer 6014 8 It is very important that the chassis top cover is properly installed and making a good seal in order for the cooling air to circulate properly through the chassis and cool the components See Figure 6 2 Fan speed is controlled by a setting in BIOS see page 7 18 For the 6014A 8 the recommended setting is 3 wire Server System Fan Failure If a fan fails the ambient air temperature in the chassis will rise and acti vate the overheat LED on the control panel Replace any failed fan immedi ately with the same type and model You must power down the system before replacing a cooling fan removing the power cord is also recom mended as a safety precaution Replacing System Fans 1 Removing a fan After turning off the power to the system first remove the chassis cover and unplug the fan cable from the motherboard Unscrew the failed blower fan from the chassis and pull it completely out from the serverboard 2 Installing a new fan Replace the failed fan with an identical 10 cm 12 volt fan available from Supermicro p n FAN 0059 Install the new fan in its pr
4. Select drives for initialization 4 p elected Drives 00 WDC WD360GD OOELX1 34 46 00 WDC WD3606D OOELX1 34 468 01 WDC WD3606D OOELX1 34 468 SUPERSERVER 6014 8 Manual 6 Press Enter 7 Read the warning message as shown on the screen below Warning Initialization will erase all Array information from the selected drives Any Array using any of these drives as members will be affected Do you want to continue Yes No _ 8 Make sure that you have selected the correct disk drives to initialize If correct type Y to continue Rebuilding Arrays Note 1 Rebuilding applies to Fault Tolerant arrays RAID 1 only If an array build process or initialization is interrupted or critical with one member missing you must perform a rebuild to optimized its function ality For a critical array rebuild operation the optimal drive is the source drive Note 2 If no spare array exists and a hard disk drive fails you need to create a spare before you can rebuild an array To Rebuild an array 1 From the Main Menu select Manage Arrays From the list of arrays select the array you want to rebuild 2 Press Ctrl R to rebuild Appendix C Software Installation Using the Disk Utilities The Disk Utilities enable you to format or verify the media of your Serial ATA hard disks To access the disk utilities 1 Turn on your computer and press Ctrl A when prompted to access the A
5. Appendix A BIOS POST Messages During the Power On Self Test POST the BIOS will check for problems If a problem is found the BIOS will activate an alarm or display a message The following is a list of such BIOS messages Failure Fixed Disk Fixed disk is not working or not configured properly Check to see if fixed disk is attached properly Run Setup Find out if the fixed disk type is correctly identified Stuck key Stuck key on keyboard Keyboard error Keyboard not working Keyboard Controller Failed Keyboard controller failed test May require replacing keyboard controller Keyboard locked Unlock key switch Unlock the system to proceed Monitor type does not match CMOS Run SETUP Monitor type not correctly identified in Setup Shadow Ram Failed at offset nnnn Shadow RAM failed at offset nnnn of the 64k block at which the error was detected System RAM Failed at offset nnnn System RAM failed at offset nnnn of in the 64k block at which the error was detected Extended RAM Failed at offset nnnn Extended memory not working or not configured properly at offset nnnn System battery is dead Replace and run SETUP The CMOS clock battery indicator shows the battery is dead Replace the battery and run Setup to reconfigure the system 1 SUPERSERVER 6014 8 Manual System CMOS checksum bad Default configuration used System CMOS has been corrupted or modified incorrectly perhaps by an application
6. 5 Press Esc to return to the previous menu Deleting Arrays Warning Back up the data on an array before you delete it to prevent the loss of data Deleted arrays cannot be restored 1 Turn on your computer and press Ctrl A when prompted to access the ARC utility 2 From the ARC main menu select Array Configuration Utility ACU 3 From the ACU menu select Manage Arrays 4 Select the array you wish to delete and press Delete 5 In the Array Properties dialog box select Delete and press Enter The following prompt is displayed Warning Deleting the array will render array unusable Do you want to delete the array Yes No RAID 1 only the following prompt is also displayed Deleting the partition will result in data loss Do you also want to delete the partition Yes No 6 Press Yes to delete the array or partition or No to return to the previous menu 7 Press Esc to return to the previous menu SUPERSERVER 6014 8 Manual Creating Arrays Before creating arrays make sure the disks for the array are connected and installed in your system that disks with no usable space or disks that are un initialized are shown in gray and cannot be used See Initializing Disk Drives To create an array 1 Turn on your computer and press Ctrl A when prompted to access the ARC utility 2 From the ARC menu select Array Configuration Utility Main Menu ACU as shown on the first s
7. The recommended setting for the 6014A 8 is 3 wire Server 7 18 Chapter 7 BIOS 7 5 Security Choose Security from the Phoenix BIOS Setup Utility main menu with the arrow keys You should see the following display Security setting options are displayed by highlighting the setting using the arrow keys and pressing Enters Security BIOS settings are described in this section Setup Screen Emulation Alt PrtSc Capture To Clipboard F10 Print Main Advanced Security Item Specific Help User Password Is Set Supervisor Password Set User Password Fixed disk boot sector Normal Password on boot Disabled Supervisor Password Is This displays whether a supervisor password has been entered for the system Clear means such a password has not been used and Set means a supervisor password has been entered for the system User Password Is This displays whether a user password has been entered for the system Clear means such a password has not been used and Set means a user password has been entered for the system 7 19 SUPERSERVER 6014 8 Manual Set Supervisor Password When the item Set Supervisor Password is highlighted hit the Enter key When prompted type the Supervisor s password in the dialogue box to set or to change supervisor s password which allows access to BIOS Set User Password When the item Set User Password is highlighted hit the Enter key When p
8. CPU and the heatsink to get rid of the old thermal grease Reapply the proper amount of thermal grease on the surface be fore you re install the heatsink to the CPU Figure 5 2 Installing the Heatsink 1 Screw 4 Screw 3 Screw 2 Screw Do not reuse thermal grease Chapter 5 Advanced Serverboard Setup 5 3 Connecting Cables Now that the processors are installed the next step is to connect the cables to the serverboard These include the data ribbon cables for the peripherals and control panel and the power cables Connecting Data Cables The ribbon cables used to transfer data from the peripheral devices have been carefully routed in preconfigured systems to prevent them from block ing the flow of cooling air that moves through the system from front to back If you need to disconnect any of these cables you should take care to keep them routed as they were originally after reconnecting them make sure the red wires connect to the pin 1 locations If you are configuring the sys tem keep the airflow in mind when routing the cables The following data cables with their motherboard connector locations noted should be con nected See the serverboard layout figure in this chapter for connector location
9. Floppy Drive Installation 6 8 viii Table of Contents 6 5 Power SUpply 6 9 Power Supply reete abre 6 9 Removing Replacing the Power Supply 6 9 Chapter 7 BIOS yn eu 017 a 7 1 7 2 Running Setup annonae eee rri a N E E 7 2 1 3 Main BIOS 7 2 Main BIOS Setup Merula 7 3 T A AdVahicedi Setlpisu nieder 7 7 71 5 SOCULlty i eer mii cemere re er 7 19 7 6 BOON O 7 21 TD ica t bene pee 7 22 Appendices Appendix A BIOS POST Messages eene A 1 Appendix B BIOS POST Codes eer hee ge f dtes B 1 Appendix C Software Installation C 1 Appendix D System Specifications entier D 1 SUPERSERVER 6014 8 Manual Notes Chapter 1 Introduction 1 1 Chapter 1 Introduction Overview The Supermicro SuperServer 6014 8 is a high end dual processor 1U rackmount server that features some of the most advanced technology currently available The SuperServer 6014 8 is comprised of two main subsystems the SC8138 500 10 rackmount chassis and the X6DAR 8G a dual Intel Xeon processor serverboard Please refer to our web site for information on operating systems that have been
10. From the Windows OS Setup screen press the Enter key The OS setup routine will automatically load all device files and continue the Win dows OS installation 13 After the Windows OS installation has completed the system will automatically reboot SUPERSERVER 6014 8 Manual C 3 Installing Other Software Programs and Drivers Installing Other Drivers After you ve installed the Windows Operating System a screen as shown in Figure B 1 will appear You are now ready to install additional software programs and drivers To install these software programs and drivers click the icons to the right of these items Figure C 1 Driver Tool Installation Display Screen SUPERMICRO X6DAR server board Drivers amp Tools Win2000 lt Intel Tumwater chipset INF files SUPERMICR6 al Microsoft Direct 9 0 Drivers amp Tools Intel E7525 lt A Adaptec Storage Manager Browser Edition 5 Chipset lt SUPERMICRO Supero Doctor IIl lt Build driver diskettes and manuals Auto Start Up Next Time Browse CD For more information please visit SUPERMICRO s web site X6DAR series SUPERMICRO Computer Inc Click the icons showing a hand writing on paper to view the readme files for each item Click the computer icons to the right of these items to install each item from top to the bottom one at a time After installing each item you must re boot the system before moving on to the next item on
11. Menu SUPERSERVER 6014 8 Manual Initializing Disk Drives If an installed disk does not appear in the disk selection list for creating a new array or if it appears grayed out you may have to initialize it before you can use it as part of an array Drives attached to the controller must be initialized before they can be used in an array Caution Initializing a disk overwrites the partition table on the disk and makes any data on the disk inaccessible If the drive is used in an array you may not be able to use the array again Do not initialize a disk that is part of a boot array To determine which disks are associated with a particular array please refer to Viewing Array Properties To initialize drives 1 Turn on your computer and press Ctrl A when prompted to access the ARC utility 2 From the ARC menu select Array Configuration Utility ACU as shown on the screen below 4 Adaptec RAID Configuration Utility gt Adaptec Options Array Configuration Utility Disk Utilities 3 Select Initialize Drives 4 Use the up and down arrow keys to highlight the disk you wish to initialize and press Insert as shown on the following screen C 12 Appendix C Software Installation Select drives for initialization Selected Drives 00 WDC WD360GD OOELX1 34 468 01 WDC WD360GD OOGELX1 34 46 5 Repeat Step 4 so that both drives to initialized are selected as shown on the following screen
12. Port Pin Definitions 49 Pin Number Definition 1 Data 2 NC 3 Ground 4 5 Clock 6 NC cations of each SUPERSERVER 6014 8 Manual Power LED Speaker Speaker Connector Pin Definitions JD1 On the JDI header pins 1 3 are Pin for a power LED and pins 4 7 are Number Function Definition 4 Red wire Speaker data for the speaker See the table on 5 Key No connection the right for speaker pin defini Speake dala tions Note The speaker connec tor pins are for use with an exter nal speaker If you wish to use the onboard speaker you should close pins 6 7 with a jumper Wake On Ring Wake on Ring Pin Definitions JWOR The Wake On Ring header is des Pin ignated JWOR This function al Number Definition roun lows your computer to receive 2 Wake up and wake up by an incoming call to the modem when in suspend state See the table on the right for pin definitions You must have a Wake On Ring card and cable to use this feature Wake On LAN Wake On LAN Pin Definitions JWOL The Wake On LAN header is located Pin at JWOL on the motherboard See Number Definition 1 5 Standby the table on the right for pin defini 2 tions You must enable the LAN 3 Wake up Wake Up setting in BIOS to use this function You must also have a LAN card with a Wake On LAN connector and cable to use this feat
13. RAM 2Ch 1 3 4 1 RAM failure on address line xxxx 2Eh 1 3 4 3 RAM failure on data bits xxxx of low byte of memory bus 2Fh Enable cache before system BIOS shadow 32h Test CPU bus clock frequency 33h Initialize Phoenix Dispatch Manager 36h Warm start shut down 38h Shadow system BIOS ROM 3Ah Auto size cache 3Ch Advanced configuration of chipset registers 3Dh Load alternate registers with CMOS values 41h Initialize extended memory for RomPilot 42h Initialize interrupt vectors 45h POST device initialization 46h 2 1 2 3 Check ROM copyright notice 47h Initialize 120 support 48h Check video configuration against CMOS 49h Initialize PCI bus and devices 4Ah Initialize all video adapters in system 4Bh QuietBoot start optional 4Ch Shadow video BIOS ROM 4Eh Display BIOS copyright notice 4Fh Initialize MultiBoot 50h Display CPU type and speed 51h Initialize EISA board 52h Test keyboard 54h Set key click if enabled 55h Enable USB devices 58h 2 2 3 1 Test for unexpected interrupts 59h Initialize POST display service 5Ah Display prompt Press F2 to enter SETUP 5Bh Disable CPU cache 2 Appendix B BIOS POST Codes POSTCode Description 5Ch 60 62 64 66h 67h 68h 69h 6Ah 6Bh 6Ch 6Eh 70h 72h 76h 7Ch 7Dh 7Eh 80h 81h 82h 83h 84h 85h 86h 87h 88h 89h 8Ah 8Bh 8Ch 8Fh 90h 91h 92h 93h 95h 96h 97h 98h Test RAM between 512 and 640 kB Test extended memory Test extended
14. Right LED NN Speed Indicator may be green amber or off to indi LED cate the speed of the connection Color Definition Off No Connection See the table at right for the func Green 10 100 MHz tions associated with the second amber GHz LED 5 21 SUPERSERVER 6014 8 Manual 5 11 Floppy Hard Disk and SCSI Drive Connections Note the following when connecting the floppy and hard disk drive cables The floppy disk drive cable has seven twisted wires A red mark on a wire typically designates the location of pin 1 A single floppy disk drive ribbon cable has 34 wires and two connectors to provide for two floppy disk drives The connector with twisted wires always connects to drive A and the connector that does not have twisted wires always connects to drive B Floppy Connector Pin Definitions Floppy Connector J12 Pin Number Function Pin Number Function 1 GND 2 FDHDIN The floppy connector is 3 GND 4 Reserved 5 Key 6 FDEDIN located on J12 See the gt m x index table below for pin defini 9 GND 10 Motor Enable 11 GND 12 Drive Select B tions 13 GND 14 Drive Select A 15 GND 16 Motor Enable 17 GND 18 DIR 19 GND 20 STEP 21 GND 22 Write Data 23 GND 24 Write Gate 25 GND 26 Track 00 27 GND 28 Write Protect 29 GND 30 Read Data 31 GND 32 Side 1 Select 33 GND 34 Diskette IDE Connector Pin Definitions J5 J6 IDE Connectors Pin Number Function Pin Number Function 1 Reset
15. area around the SuperServer 6014A 8 clean and free of clutter The SuperServer 6014A 8 weighs approximately 38 Ibs 17 3 kg when fully loaded When lifting the system two people at either end should lift slowly with their feet spread out to distribute the weight Always keep your back straight and lift with your legs Place the chassis top cover and any system components that have been removed away from the system or on a table so that they won t accidentally be stepped on While working on the system do not wear loose clothing such as neckties and unbuttoned shirt sleeves which can come into contact with electrical circuits or be pulled into a cooling fan Remove any jewelry or metal objects from your body which are excellent metal conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present 4 2 Chapter 4 System Safety After accessing the inside of the system close the system back up and secure it to the rack unit with the retention screws after ensuring that all connections have been made 4 3 ESD Precautions A Electrostatic discharge ESD is generated by two objects with different electrical charges coming into contact with each other An electrical discharge is created to neutralize this difference which can damage electronic components and printed circuit boards The following measures are generally sufficient to
16. at Leg 5 17 Alari ii rrt Eo erc 5 17 5 9 Jumper Settings o c e teet ie htec eet coepere 5 18 Explanation Of Jumpets ciini re etn nre rete prr 5 18 CMOS VGA Enable Disable GLAN Enable Disable SCSI Controller Enable Disable eene 5 19 SCSI Termination Enable Disable eene 5 19 Watch Dog Enable DiSable rte ete nre 5 20 Third Power Supply Alarm 5 20 Power Force On Enable Disable eem 5 20 Alarm FeSeL nete nine ED ice sii 5 21 Memory Speed Select ne nnt bn ri ers 5 21 5 10 Onboard Indicators 1 ei Ge sere eod 5 21 GLAN LEDs 5 11 Floppy Hard Disk and SCSI Connections 5 22 Floppy GOnhectot ii Fr eic e o i EE nO 5 22 IDE CONNECTIONS 5 22 ultta320 SCSI Connectors nentes 5 23 Chapter 6 Advanced Chassis Setup 6 1 Static Sensitive Devices ed eget 6 1 6 2 Control 6 2 6 3 System 6 3 System Fan Failure 6 3 Replacing System Fans uoi ebrei 6 3 6 4 Drive Bay Installation Removal essent 6 4 Removing the Front 6 4 Accessing the Drive Bays war 6 5 SCSI Drive Installation cscs tt 6 6 CD ROM and
17. certified for use with the SuperServer 6014A 8 www supermicro com In addition to the mainboard and chassis various hardware components may have been included with your SuperServer 6014 8 as listed below Two 2 10 cm system blower fans FAN 0059 One 1 slim floppy drive FPD TEAC S B One 1 slim CD ROM drive CDM TEAC 24 B One 1 PCI Express 16x riser card CSE RR1U E16 One 1 PCI X LP riser card CSE RR1U XLP SCSI Accessories One 1 SCA SAF TE compliant SCSI backplane CSE SCA 813S One 1 internal 68 pin Ultra320 SCSI cable CBL 037 U320 Four 4 SCA 1 inch high SCSI drive carriers CSE PT39 B Rackmount hardware with screws CSE PT51 Two 2 rack rail assemblies Six 6 brackets for mounting the rack rails to a rack telco rack One 1 CD ROM containing drivers and utilities SuperServer 6014 8 User s Manual 1 1 SUPERSERVER 6014 8 Manual 1 2 Serverboard Features At the heart of the SuperServer 6014 8 lies the X6DAR 8G a dual Intel Xeon processor serverboard designed to provide maximum performance Below are the main features of the X6DAR 8G Processors The X6DAR 8G supports single or dual 604 pin Intel Xeon EM64T proces sors at an 800 MHz FSB front side bus speed Please refer to the support section of our web site for a complete listing of supported processors www supermicro com Memory The X6DAR 8G has eight 184 pin DIMM slots that can support up to 16 GB of low pr
18. chassis revolutionary cooling design has been optimized to provide sufficient cooling for dual Xeon configurations The SC813S 500 includes two heavy duty 10 cm blower fans located in the middle of the chassis fan fails the ambient air temperature inside the chassis will rise and activate the Overheat Fan Fail LED The power supply also has a cooling fan All fans operate continuously A setting in BIOS see p 7 18 is used to control the speed of the fans The recommended setting is S wire Server 1 6 Chapter 1 Introduction 1 4 Contacting Supermicro Headquarters Address Tel Fax Email Web Site Europe Address Tel Fax Email Asia Pacific Address Tel Fax Web Site SuperMicro Computer Inc 980 Rock Ave San Jose CA 95131 U S A 1 408 503 8000 1 408 503 8008 marketing supermicro com General Information support supermicro com Technical Support WWW Supermicro com SuperMicro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands 31 0 73 6400390 31 0 73 6416525 sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support SuperMicro Taiwan D5 4F No 16 Chien Ba Road Chung Ho 235 Taipei Hsien Taiwan R O C 886 2 8226 3990 886 2 8226 3991 www supermicro com tw Technical Support Email Tel support supermicro com tw 886 2 8228 1366 ext 132 or
19. for dual channnel Ultra320 onboard SCSI SCSI SCA Backplane Controller QLogic GEM318 controller for SAF TE compliance SCSI Drive Bays Four 4 drive bays to house four 4 standard 1 80 pin SCA SCSI drives Peripheral Drive Bays One 1 slim floppy drive One 1 slim CD ROM drive SUPERSERVER 6014 8 Manual Expansion Slots provided with riser cards CSE RR1U E16 Riser fits into PCI Express x16 slot supports one standard size PCI Express x16 card CSE RR1U XLP Riser fits into PCI X slot supports one low profile half height half length PCI X 133 100 or 66 MHz card Motherboard Model X6DAR 8G Extended ATX form factor Dimensions 12 x 13 in 305 x 330 mm Chassis Model SC813S 500 Form Factor 1U rackmount Dimensions WxHxD 17 2 x 1 7 x 25 6 in 437 x 44 x 650 mm Weight Net Bare Bone 38 165 17 3 kg System Cooling Two 2 10 cm blower fans with fan speed control System Input Requirements AC Input Voltage 100 240V AC auto range Rated Input Current 10A max Rated Input Frequency 50 to 60 Hz Power Supply Rated Output Power 500W Models SP502 1S Part PWS 0048 Rated Output Voltages 3 3V 21A 5 30A 12V 39A 5Vsb 2 0A ALL BTU Rating 2750 BTUs hr for rated output power of 500W Operating Environment Operating Temperature 10 to 35 C 50 to 95 F Non operating Temperature 40 to 70 C 40 to 158 F Operating Relative Humidity 596 to 9096 non condensing No
20. in such a way that they do not block the airflow generated by the fans 5 Supplying power to the system The last thing you must do is to provide input power to the system Plug the power cord from the power supply unit into a high quality power strip that offers protection from electrical noise and power surges is recommended that you use an uninterruptible power supply UPS 2 10 Chapter 3 System Interface Chapter 3 System Interface 3 1 Overview There are several LEDs on the chassis control panel as well as others on the SCSI drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components There are also two buttons on the chassis control panel and an on off switch on the power supply This chapter explains the meanings of all LED indicators and the appropriate response you may need to take 3 2 Control Panel Buttons There are two push button buttons located on the front of the chassis These are in order from left to right a reset button and a power on off button RESET RESET The reset switch reboots the system POWER This is the main power switch which is used to apply turn off the main system power Turning off system power with this button removes the main power but keeps standby power supplied to the system SUPERSERVER 6014 8 Manual 3 3 Control Panel LEDs The control panel located on the front of
21. is off An illuminated green light indicates that the power supply is operating Power Supply Failure If the power supply unit fails the system will shut down and you will need to replace the unit Replacement units can be ordered directly from Supermicro see contact information in the Preface As there is only one power supply unit in the 6014A 8 power must be completely removed from the server before removing and replacing the power supply unit for what ever reason Removing Replacing the Power Supply 1 Removing the power supply First turn the power switch on the control panel off then unplug the power cord from the system Remove the chassis cover by pressing the two release buttons on the top of the chassis near the front and push the chassis top rearward about one inch To remove the failed power unit push the beige colored release tab to the right and then carefully lift the unit up about 1 2 inch only If you lift too high you may damage the power distribution board that the other end of the unit is connected to Then pull the power unit straight back to unplug it from the power distribution board See Figure 6 6 2 Installing a new power supply Replace the failed unit with another unit of the same input voltage output voltage and wattage It is highly recommended to replace it with exactly the same model power supply PWS 0048 Carefully insert the new unit into position to plug it into the power distributio
22. main memory and when reconfiguring the serverboard Chapter 6 Advanced Chassis Setup Refer to Chapter 6 for detailed information on the 1U SC813S 500 rackmount server chassis You should follow the procedures given in this chapter when installing removing or reconfiguring SCSI or peripheral drives and when replacing the system power supply unit and cooling fans Chapter 7 BIOS The BIOS chapter includes an introduction to BIOS and provides detailed information on running the CMOS Setup Utility Appendix A BIOS POST Messages Appendix B BIOS POST Codes Appendix C Software Installation Appendix D System Specifications Notes SUPERSERVER 6014 8 Manual Table of Contents Preface About This Mariali Debe eo ete ee eve iii ACN so o mre rir Aenea ectetuer cann kem teer Dr ene dade iii Chapter 1 Introduction 1 1 Overview es 1 1 1 2 Serverboard Features 1 2 1 3 Server Chassis Features aene nie tente tens 1 5 1 4 Contacting S permlero cetero rre mi reete t e 1 7 Chapter 2 Server Installation 2 OVE EW CI ebrii DI are LIA 2 1 2 2 Unpacking the System imer 2 1 2 8 Preparing for Setup edet eges i tege ep fa i Done echa 2 1 Choosing a Set p Location er tte 2 2 Rack Precautions Server PreCautlONnS cis uidit ee tere
23. not a setting informing you of the event log capacity View DMI Event Log Highlight this item and press Enter to view the contents of the event log Event Logging This setting allows you to Enable or Disable event logging ECC Event Logging This setting allows you to Enable or Disable ECC event logging Mark DMI Events as Read Highlight this item and press Enter to mark the DMI events as read Clear Event Logs Select Yes and press Enter to clear all DMI event logs The default setting is No Chapter 7 BIOS gt Console Redirection Access the submenu to make changes to the following settings COM Port Address Specifies to redirect the console to On board COM A or On board COM B This setting can also be Disabled BAUD Rate Select the BAUD rate for console redirection The options are 300 1200 2400 9600 19 2K 38 4K 57 6K and 115 2K Console Type Choose from the available options to select the console type for console redirection The options are VT100 VT100 8bit PC ANSI 7bit PC ANSI VT100 VT UTF8 Flow Control Choose from the available options to select the flow control for console redirection The options are None XON XOFF and CTS RTS Console Connection Select the console connection either Direct or Via Modem Continue CR after POST Choose whether to continue with console redirection after the POST routine The options are On and Off 7 17 SUPERS
24. only available when using redundant Supermicro power supplies Overheat LED Pin Definitions JOH1 Pin Number Definition 1 5V 2 OH Active Alarm Reset JP11 Jumper Position Definition Open __ Normal default Short Clear Alarm SUPERSERVER 6014 8 Manual 5 9 Jumper Settings Explanation of Jumpers To modify the operation of the serverboard jumpers can be used to choose between optional settings Jumpers create shorts between two pins to change the function of the connector Pin 1 is identified with a square solder pad on the printed circuit board See the serverboard layout pages for jumper locations Note On two pin jumpers Closed means the jumper is on and Open means the jumper is off the pins CMOS Clear JBT1 is used to clear CMOS which will also clear any passwords stead of pins this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS To clear CMOS I1 Connector Pins Jumper Cap Setting 3 Pin 1 2 short 1 First power down the system and unplug the power cord s 2 With the power disconnected short the CMOS pads with a metal object such as a small screwdriver 3 Remove the screwdriver or shorting device 4 Reconnect the power cord s and power on the system Note Do not use the PW ON connector to clear CMOS Enable Disable JPG1 enables or disables
25. program that changes data stored in CMOS The BIOS installed Default Setup Values If you do not want these values enter Setup and enter your own values If the error persists check the system battery or contact your dealer System timer error The timer test failed Requires repair of system board Real time clock error Real Time Clock fails BIOS hardware test May require board repair Check date and time settings BIOS found date or time out of range and reset the Real Time Clock May require setting legal date 1991 2099 Previous boot incomplete Default configuration used Previous POST did not complete successfully POST loads default values and offers to run Setup If the failure was caused by incorrect values and they are not corrected the next boot will likely fail On systems with control of wait states improper Setup settings can also terminate POST and cause this error on the next boot Run Setup and verify that the waitstate configuration is correct This error is cleared the next time the system is booted Memory Size found by POST differed from CMOS Memory size found by POST differed from CMOS Diskette drive A error Diskette drive B error Drive A or B is present but fails the BIOS POST diskette tests Check to see that the drive is defined with the proper diskette type in Setup and that the diskette drive is attached correctly Incorrect Drive A type run SETUP Type of floppy drive A not correctly identified i
26. th SC813S 500 chassis has five LEDs These LEDs provide you with critical information related to different parts of the System This section explains what each LED indicates when illuminated and any corrective action you may need to take n Overheat Fan Fail When this LED flashes it indicates a fan failure When on continuously on and not flashing it indicates an overheat condi tion which may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm Check the routing of the cables and make sure all fans are present and operating normally You should also check to make sure that the chassis covers are installed Fi nally verify that the heatsinks are installed properly see Chapter 5 This LED will remain flashing or on as long as the overheat condition exists ES e NIC2 Indicates network activity on GLAN2 when flashing E e NIC1 Indicates network activity on GLAN1 when flashing HDD Indicates IDE channel activity On the SuperServer 6014 8 this light indicates SCSI and CD ROM drive activity when flashing Chapter 3 System Interface c4 8 gt Power Indicates power is being supplied to the system s power supply units This LED should normally be illuminated when the system is operating 3 4 SCSI Drive Carrier LEDs Each SCSI drive carrier has two LEDs Green When illuminated the green LED on the front of a SCSI drive carrier indicates d
27. the use of one standard size PCI Express x16 card and a CSE RR1U XLP riser card in the SXB E slot which supports one low profile half height half length 133 MHz PCI X card The CSE RR1U ELP riser card may be purchased separately to take the place of the CSE RR1U XLP riser card The CSE RR1U ELP supports the use of one low profile half height half length x8 PCI Express card Riser Card Slot c Add on Card CSE RR1U E16 PCI E x16 PCI Express CSE RR1U XLP SXB E PCI X 133 MHz low profile CSE RR1U ELP SXB E x8 PCI Express low profile 2 PCI card installation Before installing add on card make sure you install it into the riser that supports the speed of the card see step 1 above Begin by removing the screw from the I O backpanel shield that corresponds to the slot you wish to populate Insert the PCI card into the correct riser slot pushing down with your thumbs evenly on both sides of the card Finish by securing the card to the chassis with the same screw you removed from the I O shield Follow this procedure when adding a card to the other riser slot SUPERSERVER 6014 8 Manual 5 7 Serverboard Details Figure 5 6 SUPER X6DAR 8G Layout not drawn to scale
28. you need to understand how to set the options see on next page When you first power on the computer the Phoenix BIOS is immediately activated While the BIOS is in control the Setup program can be activated in one of two Ways 1 By pressing Delete immediately after turning the system on or 2 When the message shown below appears briefly at the bottom of the screen during the POST Power On Self Test press the Delete key to activate the main Setup menu Press the Delete key to enter Setup 7 3 Main BIOS Setup All main Setup options are described in this section The main BIOS Setup screen is displayed below Use the Up Down arrow keys to move among the different settings in each menu Use the Left Right arrow keys to change the options for each setting Press the lt Esc gt key to exit the CMOS Setup Menu The next section describes in detail how to navigate through the menus Items that use submenus are indicated with the icon With the item highlighted press the lt Enter gt key to access the submenu 7 2 Chapter 7 BIOS Main BIOS Setup Menu lain Advanced Security Boot Exit 18 18 42 Item Specific Help System Date 03 16 20041 lt Tab gt XShift Tab5 BIOS Date XEnter selects field Legacy Diskette fi 1 44 1 25 MB 3 7 1 Parallel Both Serial ATA Enabled Native Mode Operation Auto gt IDE Channel Master IDE Channel Slave k IDE Cha
29. 139 SUPERSERVER 6014 8 Manual Notes Chapter 2 Server Installation Chapter 2 Server Installation 2 1 Overview This chapter provides a quick setup checklist to get your SuperServer 6014A 8 up and running Following these steps in the order given should enable you to have the system operational within a minimum amount of time This quick setup assumes that your SuperServer 6014A 8 system has come to you with the processors and memory preinstalled If your system is not already fully inte grated with a serverboard processors system memory etc please turn to the chapter or section noted in each step for details on installing specific compo nents 2 2 Unpacking the System You should inspect the box the SuperServer 6014A 8 was shipped in and note if it was damaged in any way If the server itself shows damage you should file a damage claim with the carrier who delivered it Decide on a suitable location for the rack unit that will hold the SuperServer 6014 8 It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are gener ated You will also need it placed near a grounded power outlet Be sure to read the Rack and Server Precautions in the next section 2 3 Preparing for Setup The box the SuperServer 6014 8 was shipped in should include two sets of rail assemblies two rail mounting brackets and the mounting screws you wi
30. ALL NOT HAVE LIABILITY FOR ANY HARDWARE SOFTWARE OR DATA STORED OR USED WITH THE PRODUCT INCLUDING THE COSTS OF REPAIRING REPLACING INTEGRATING INSTALLING OR RECOVERING SUCH HARDWARE SOFTWARE OR DATA Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California USA The State of California County of Santa Clara shall be the exclusive venue for the resolution of any such disputes Supermicro s total liability for all claims will not exceed the price paid for the hardware product Unless you request and receive written permission from SUPER MICRO COMPUTER you may not copy any part of this document Information in this document is subject to change without notice Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders Copyright 2004 by SUPER MICRO COMPUTER INC All rights reserved Printed in the United States of America Preface Preface About This Manual This manual is written for professional system integrators and PC techni cians It provides information for the installation and use of the Super Server 6014A 8 Installation and maintainance should be performed by ex perienced technicians only The SuperServer 6014A 8 is a high end 1U rackmount server based on the SC8138 500 rackmount server chassis and the X6DAR 8G serverboard which supports single or dual In
31. Definition disable the Power Force On function Open Normal If enabled the power will always stay Closed Force On on automatically If this function dis abled the user needs to press the power button to power on the system 5 20 Chapter 5 Advanced Serverboard Setup Alarm Reset Alarm Reset Jumper Settings The system will notify you in the 2 13 i Jumper event of a power supply failure This Position Definition Open Enabled feature assumes that Supermicro Closed Disabled redundant power supply units are installed in the chassis If you only have a single power supply installed you should disable this the default setting with JP13 to prevent false alarms See the table on the right for jumper settings Memory Speed Select Memory Speed Select Jumper Settings J4F4 J4F5 Use J4F4 and J4F5 to select the speed of the system memory See 052 Memory the table on the right for jumper DDR333 266 2 definitions The default setting is DDR266 closed DDR333 Note if these jumpers are not set correctly you may experience problems with your video display 5 10 Onboard Indicators GLAN LEDs Activity LED B3 oO Speed LED The Gigabit Ethernet LAN ports lo cated beside the VGA port each have two LEDs The left LED indi cates activity while the right LED GLAN
32. ED Vcc Ground Reset gt Reset Button Ground Pwr gt Power Button Chapter 5 Advanced Serverboard Setup 5 4 Ports The ports are color coded in conformance with the PC 99 specification See Figure 5 4 below for the colors and locations of the various ports Figure 5 4 I O Ports Keyboard VGA Port O O ee EH ES a Mouse USB0 1 COM1 GLAN1 2 SCSI Port 5 5 Installing Memory Note Check the Supermicro web site for recommended memory modules http www supermicro com support resources CAUTION Exercise extreme care when installing or removing DIMM modules to prevent any possible damage Also note that the memory is interleaved to improve performance see step 1 DIMM Installation Figures 5 5a and 5 5b 1 Insert the desired number of DIMMs into the memory slots starting with Bank 1A The memory scheme is interleaved so you must install two modules at a time beginning with DIMM 1A then DIMM 1B and so on 2 Insert each DIMM module vertically into its slot Pay attention to the notch along the bottom of the module to prevent inserting the DIMM module incorrectly 3 Gently press down on the DIMM module until it snaps into place in the slot Repeat for all modules see step 1 above Memory Support The X6DAR 8G supports up to 32 16 GB of registered DDR266 333 PC2100 2700 SDRAM recommended by the manufacturer This serverboard was
33. ED for IDE and SCSI Disk Drives connection is located on pins 13 and 14 of JF1 Attach the hard drive LED cable to these pins to dis play disk activity Refer to the table on the right for pin definitions NIC LEDs The NIC Network Interface Con troller LED connections for GLAN porti are located on pins 11 and 12 of JF1 and the NIC LED con nections for GLAN port 2 are lo cated on pins 9 and 10 of JF1 At tach the NIC cables to display net work activity Refer to the table on the right for pin definitions Overheat Fan Fail LED OH Connect an LED to the OH Fan Fail connection on pins 7 and 8 of JF1 to provide warning of system overheating or system fan failure The LED will flash stay on as long as the overheat fan fail condition exists Refer to the table on the right for pin definitions and Chap ter 3 for details Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1 Refer to the table on the right for pin defi nitions 5 13 HDD LED Pin Definitions JF1 Pin Number Definition 18 Vcc 14 HD Active NIC LED Pin Definitions JF1 Pin Number Definition 9 11 Vcc 10 12 GND OH Fan Fail LED Pin Definitions JF1 Pin Number Definition 7 Vcc 8 GND Power Fail LED Pin Definitions JF1 Pin Number Definition 5 6 GND SUPERSERVER 6014 8 Manual Reset Button The R
34. ERVER 6014 8 Manual P Hardware Monitor CPU Temperature Threshold This option allows the user to set a CPU temperature threshold that will activate the alarm system when the CPU temperature reaches this pre set temperature threshold The options are 85 90 95 and 100 Highlight this and hit Enter to see monitor data for the following items CPU1 Temperature This item displays CPU1 Temperature CPU2 Temperature This item displays CPU2 Temperature System Temperature This item displays the system Temperature Fan Speed Control Modes This feature allows the user to decide how the system controls the speeds of the onboard fans If the option is set to 3 wire the fan speed is con trolled based upon the CPU die temperature When the CPU die temperature is higher the fan speed will be higher as well If the option is set to 4 wire the fan speed will be controlled by the Thermal Management Settings pre configured by the user at this feature Select 3 wire if your chassis came with 3 pin fan headers Select 4 wire if your chassis came with 4 pin fan headers Select Workstation if your system is used as a Work station Select Server if your system is used as a Server Select Disable to disable the fan speed control function to allow the onboard fans to run at the full speed 12V at all time The options are Disable 3 wire Server 3 wire Workstation 4 wire Server and 4 wire Workstation
35. G 27 SEL 61 SEL 28 C D 62 C D 29 63 30 64 1 0 31 DB 8 65 DB 8 32 DB 9 66 DB 9 33 DB 10 67 DB 10 34 DB 11 68 DB 11 5 23 SUPERSERVER 6014 8 Manual Notes 5 24 Chapter 6 Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform maintenance on the SC813S 500 chassis For component installation follow the Steps in the order given to eliminate the most common problems encoun tered If some steps are unnecessary skip ahead to the next step Tools Required The only tool you will need to install components and perform maintenance is a Philips screwdriver 6 1 Static Sensitive Devices Electricstatic discharge ESD can damage electronic components To pre vent damage to any printed circuit boards PCBs it is important to handle them very carefully The following measures are generally sufficient to protect your equipment from ESD damage Precautions Use a grounded wrist strap designed to prevent static discharge Touch a grounded metal object before removing any board from its anti static bag Handle a board by its edges only do not touch its components periph eral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their anti static bags w
36. IDE 2 GND 3 Host Data 7 4 Host Data 8 There are no jumpers to 5 Host Data 6 6 Host Data 9 7 Host Data 5 8 Host Data 10 configure the onboard IDE 1 9 Host Data 4 10 Host Data 11 and 2 connectors See the 1 Host Data 3 12 Host Data 12 13 Host Data 2 14 Host Data 13 table on the right for pin 15 Host Data 1 16 Host Data 14 tal 17 Host Data 0 18 Host Data 15 definitions 19 GND 20 Key 2 DRQ3 22 GND 23 Write 24 GND 25 Read 26 GND 27 IOCHRDY 28 BALE 29 DACK3 30 GND 3 IRQ14 32 10 16 33 1 34 GND 35 0 36 Addr 2 37 Chip Select 0 38 Chip Select 1 39 Activity 40 GND 5 22 Chapter 5 Advanced Serverboard Setup Ultra320 SCSI Connectors Refer to the table below for the pin definitions of the Ultra320 SCSI connec tors located at JA1 and JA2 Ultra320 SCSI Connectors JA1 JA2 Connector Connector Contact Contact Number Signal Names Number Signal Names 1 DB 12 35 DB 12 2 DB 13 36 DB 13 3 DB 14 37 DB 14 4 DB 15 38 DB 15 5 DB P1 39 DB P1 6 DB 0 40 DB 0 T DB 1 41 DB 1 8 DB 2 42 DB 2 9 DB 3 43 DB 3 10 DB 4 44 DB 4 11 DB 5 45 DB 5 12 DB 6 46 DB 6 13 DB 7 47 DB 7 14 DB P 48 DB P 15 GROUND 49 GROUND 16 DIFFSENS 50 GROUND 17 TERMPWR 51 TERMPWR 18 TERMPWR 52 TERMPWR 19 RESERVED 53 RESERVED 20 GROUND 54 GROUND 21 ATN 55 ATN 22 GROUND 56 GROUND 23 BSY 57 BSY 24 ACK 58 ACK 25 RST 59 RST 26 MSG 60 MS
37. RC utility 2 From the ARC menu select Disk Utilities 3 Select the desired disk and press Enter as shown below Select SATA Disk and pre Enter SATA Port 0 WDC WD3606D OOELX1 32 06632 SATA Port 1 WDC WD3606D O0ELX1 32 06632 SATA Port 2 No device SATA Port 3 No device SATA Port 4 No device SATA Port 5 No device SATA Port 6 No device SATA Port 7 No device Only drives present at POST are displayed You can choose from the following options 1 Format Disk Simulates a low level format of the hard drive by writing zeros to the entire disk Serial ATA drives are low level formatted at the factory and do not need to be low level formatted again Caution Formatting destroys all data on the drive Be sure to back up your data before performing this operation 2 Verify Disk Media Scans the media of a disk drive for defects 15 SUPERSERVER 6014 8 Manual To Exit Adaptec RAID Configuration Utility 1 Once you have completed RAID array configurations press ESC to exit The following screen will appear 4 Adaptec RAID Configuration Utility gt Arrow keys to move cursor Enter to select option Esc to exit default 2 Press Yes to exit the Utility For more information regarding the Adaptec RAID Utility please refer to Adaptec s User s Guide in the CD included in your ship ping package You can also download a copy of Adaptec User s Guide from our web site at www super
38. SUPERO SUPERSERVER 6014 8 mas 225 Im TEE JC JC JC F JC JC Ls C JC JC JC HI ECC BC Lo C LLL 1 Jum 7 1 1 USER SMANUAL The information in this User s Manual has been carefully reviewed and is believed to be accurate The vendor assumes no responsibility for any inaccuracies that may be contained in this document makes no commitment to update or to keep current the information in this manual or to notify any person or organization of the updates Please Note For the most up to date version of this manual please see our web site at www supermicro com SUPERMICRO COMPUTER reserves the right to make changes to the product described in this manual at any time and without notice This product including software if any and documentation may not in whole or in part be copied photocopied reproduced translated or reduced to any medium or machine without prior written consent IN NO EVENT WILL SUPERMICRO COMPUTER BE LIABLE FOR DIRECT INDIRECT SPECIAL INCIDENTAL SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN PARTICULAR THE VENDOR SH
39. airflow See Chapter 5 for details on cable connec tions Also check the air seals for damage The air seals are located under the blower fan and beneath the frame cross section that sepa rates the drive bay area from the serverboard area of the chassis 2 9 SUPERSERVER 6014 8 Manual 2 6 Checking the Drive Bay Setup Next you should check to make sure the peripheral drives and the SCSI drives and SCSI backplane have been properly installed and all connections have been made 1 Accessing the drive bays All drives are accessable from the front of the server For servicing the CD ROM and floppy drives you will need to remove the top chassis cover The SCSI disk drives can be installed and removed from the front of the chassis without removing the top chassis cover 2 CD ROM and floppy disk drives A slim CD ROM and a floppy drive should be preinstalled in your server Refer to Chapter 6 if you need to reinstall a CD ROM and or floppy disk drive to the system 3 Check the SCSI disk drives Depending upon your system s configuration your system may have one or more drives already installed If you need to install SCSI drives please refer to Chapter 6 4 Check the airflow Airflow is provided by two heavy duty 10 cm blower fans The system component layout was carefully designed to direct sufficient cooling air flow to the components that generate the most heat Note that all power and data cables have been routed
40. al 5 2 Processor and Heatsink Installation When handling the processor package avoid placing direct pressure on the label area of the fan Also do not place the motherboard on a conductive surface which can damage the BIOS battery and prevent the system from booting up IMPORTANT Always connect the power cord last and always remove it before adding removing or changing any hardware components Make sure that you install the processor into the CPU socket before you install the CPU heat sink CPU Installation 1 Lift the lever on the CPU socket Lift the lever completely as shown on the picture on the right otherwise you will damage the CPU socket when power is applied Install CPU1 first 2 Insert the CPU in the socket making sure that pin 1 of the CPU aligns with pin 1 of the socket both corners are marked with a triangle When using only one CPU install it into CPU socket 1 Socket 2 is automatically disabled if only one CPU is used 3 Press the lever down until you hear a click which means the CPU is securely installed in the CPU socket Socket lever in the locking Position Chapter 5 Advanced Serverboard Setup Figure 5 1 604 pin PGA Socket Empty and with Processor Installed installing the CPU If the lever is only partly raised damage to the socket or CPU may result Warning sure you lift the lever completely when Empty socket With process
41. cause of their hotswap capability you do not need to access the inside of the chassis or power down the system to install or replace SCSI drives Proceed to the next step for instructions CD ROM Floppy Disk Drives For installing removing a CD ROM or floppy disk drive you will need to gain access to the inside of the 6014A 8 by removing the top cover of the chassis Proceed to the CD ROM and Floppy Drive Installation section later in this chapter for instructions Note Only a slim CD ROM drive will fit into the 6014A 8 SUPERSERVER 6014 8 Manual SCSI Drive Installation 1 Mounting a SCSI drive in a drive carrier The SCSI drives are mounted in drive carriers to simplify their installation and removal from the chassis These carriers also help promote proper airflow for the SCSI drive bays For this reason even empty carriers without SCSI drives installed must remain in the chassis To add a new SCSI drive install a drive into the carrier with the printed circuit board side toward the carrier so that the mounting holes align with those in the carrier Secure the drive to the carrier with four screws as shown in Figure 6 4 Figure 6 4 Mounting a SCSI Drive in a Carrier Use caution when working around the SCSI backplane Do not touch the backplane with any metal objects and make sure no ribbon cables touch the backplane or obstruct the holes which aid in proper airflow installed all SCSI drive carriers must
42. chassis to release the top cover There is a large rectangular recess in the middle front of the top cover to help you push the cover away from you until it stops You can then lift the top cover from the chassis to gain full access to the inside of the server 2 Check the CPUs processors You should have one or two processors already installed into the serverboard Each processor needs its own heatsink See Chapter 5 for instructions on processor and heatsink installation 3 Verify the proper CPU clock ratio setting If the CPU speed is not automatically detected you will need to set the correct speed with the BIOS Setup utility See the CPU Frequency Ratio settings in BIOS Chapter 7 for setting the proper CPU speed Most processor speeds are automatically detected so this step should be un necessary 4 Check the system memory Your 6014 8 server system may have come with system memory already installed Make sure all DIMMs are fully seated in their slots For details on adding system memory refer to Chapter 5 5 Installing add on cards If desired you can install add on cards to the system See Chapter 5 for details on installing PCI add on cards 2 8 Chapter 2 Server Installation Figure 2 5 Accessing the Inside of the SuperServer 6014 8 with optional front bezel shown 6 Check all cable connections and airflow Make sure all power and data cables are properly connected and not blocking the chassis
43. ck rails Slide the chassis rails into the rack rails keeping the pressure even on both sides you may have to depress the locking tabs when inserting See Figure 2 3 When the server has been pushed completely into the rack you should hear the locking tabs click Finish by inserting and tightening the thumbscrews that hold the front of the server to the rack Figure 2 3 Installing the Server into a Rack 2 6 Chapter 2 Server Installation Installing the Server into a Telco Rack If you are installing the SuperServer 6014 8 into a Telco type rack follow the directions given on the previous pages for rack installation The only difference in the installation procedure will be the positioning of the rack brackets to the rack They should be spaced apart just enough to accommodate the width of the telco rack Figure 2 4 Installing the Server into a Telco Rack 2 7 SUPERSERVER 6014 8 Manual 2 5 Checking the Serverboard Setup After you install the 6014 8 in the rack you will need to open the unit to make sure the serverboard is properly installed and all the connections have been made 1 Accessing the inside of the 6014A 8 see Figure 2 5 First release the retention screws that secure the unit to the rack Grasp the two handles on either side and pull the unit straight out until it locks you will hear a click Next depress the two buttons on the top of the
44. creen on page B 4 3 From the ACU menu select Create Array 4 Select the disks for the new array and press Insert as shown on the the screen below Note To deselect any disk highlight the disk and press Delete Select drives to create Array 00 WDC WD360GD OOELX1 34 468 01 WDC WD360GD OOELX1 34 468 5 Press Enter when both disks for the new array are selected The Array Properties menu displays as the shown on the screen on the next page Appendix C Software Installation Select drives to create firray Selected Drives 00 WDC WD360GD OOELX1 34 4GB 00 WDC WD360GD O0ELX1 34 4GB 91 WDC WD3606D O00ELX1 34 4GB Assigning Array Properties Once you ve create a new array you are ready to assign properties to the array Caution Once the array is created and its properties are assigned you cannot change the array properties using the ACU You will need to use the Adaptec Storage Manager Browser Edition Refer to Adaptec s User s Guide in the enclosed CD To assign properties to the new array 1 In the Array Properties menu as shown on the following screen select an array type and press Enter Note that only the available array types RAID 0 and RAID 1 are dis played on the screen Using RAID 0 or RAID 1 requires two drives 2 Under the item Arrays Label type in a label and press Enter The label cannot be more than 15 characters For RAID 0 select the desired s
45. d on cards All serverboard jumpers and connections are de scribed and a layout and quick reference chart are included in this chapter Remember to close the chassis completely when you have finished working on the serverboard to protect and cool the system sufficiently 5 1 Handling the Serverboard Static electrical discharge can damage electronic components To prevent damage to printed circuit boards it is important to handle them very care fully see Chapter 4 Also note that the size and weight of the serverboard can cause it to bend if handled improperly which may result in damage To prevent the serverboard from bending keep one hand under the center of the board to support it when handling The following measures are gener ally sufficient to protect your equipment from static discharge Precautions Use a grounded wrist strap designed to prevent static discharge Touch a grounded metal object before removing any board from its anti Static bag Handle a board by its edges only do not touch its components periph eral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their anti static bags when not in use Unpacking The serverboard is shipped in antistatic packaging to avoid static damage When unpacking the board make sure the person handling it is static pro tected SUPERSERVER 6014 8 Manu
46. designed to support 2 GB modules in each slot but has only been verified for up to 1 GB modules The memory is an interleaved configuration which 5 7 SUPERSERVER 6014 8 Manual requires modules of the same size and speed to be installed in pairs You should not mix modules of different sizes and or speeds Note if ECC registered DDR333 PC2700 memory modules are used con figurations of four double banked DIMMs or six single banked DIMMs are supported Figure 5 5a Side View of DIMM Installation into Slot Note Notch ios should align with the receptive point on the slot To Install Insert module vertically and press down until it snaps into place Pay attention to the bottom notch To Remove Use your thumbs to gently push each release tab outward to free the DIMM from the slot Figure 5 5b Top View of DIMM Slot Top View of DDR Slot Release Tab Il ll Release Tab 5 8 Chapter 5 Advanced Serverboard Setup 5 6 Adding PCI Cards T PCI slots The X6DAR 8G has two PCI expansion slots consisting of one x16 PCI Express slot and one Universal SXB E slot which supports either one 64 bit PCI X 133 or one x8 PCI Express card depending on the riser card being used see below The SC813S 500 chassis supports the use of two riser cards The standard configuration is with a CSE RR1U E16 riser card in the PCI Express x16 slot which supports
47. eature will allow the data stored in the extended memory area to be cached written into a buffer a storage area in the Static DRM SDROM or written into L1 L2 L3 cache inside the CPU to speed up CPU operations Select Uncached to disable this funciton Select Write Through to allow data to be cached into the buffer and written into the system memory at the same time Select Write Protect to prevent data from being written into the base memory area of Block 0 512K Select Write Back to allow CPU to write data back directly from the buffer without writing data to the System Memory for fast CPU data processing and operation The options are Uncached Write Through Write Protect and Write Back 7 9 SUPERSERVER 6014 8 Manual P PCI Configuration Access the submenu to make changes to the following settings for PCI devices Onboard GLAN Gigabit LAN OPROM Configure Enabling this option provides the capability to boot from GLAN The options ared Disabled and Enabled Onboard SCSI OPROM Configure Enabling this option provides the caability to boot from SCSI HDD The options are Disabled and Enabled Reset Configuration Data If set to Yes this setting clears the Extended System Configuration Data ESCD area The options are Yes and No Frequency for RAID SLOT SCSI This option allows the user to change the bus frequency for the devices installed in the slot indicated The options are Auto PCI 33 MH
48. ect OK to confirm the selection Press the Enter key to load the default settings to the BIOS 3 Use the arrow keys to select the Main Menu in BIOS 4 Scroll down to the item SATA RAID Enable select Enabled and press Enter SUPERSERVER 6014 8 Manual 5 Tap the Esc key and scroll down to Exit Select Save and Exit from the Exit menu Press the Enter key to save the changes and exit the BIOS 6 Once you ve exited the BIOS Utility the system will re boot 7 During system startup press the Ctrl and the A keys simultaneously to run the Adaptec RAID Configuration Utility when prompted by the mes sage Press Ctrl A for Adaptec RAID Configuration Utility Adaptec Embedded SATA with HostRAID Controller Driver Adaptec s Embedded Serial ATA RAID with HostRAID controller adds functionality to the Serial ATA controller by supporting RAID 0 Striping or RAID 1 Mirroring to enhance the industry s pioneer PCI to e host controller products RAID striping RAID 0 can greatly improve hard disk I O performance because of its capability in striping data across multiple drives RAID mirroring RAID 1 allows the data to be simultaneously written to two drives so critical data is always available even if one hard disk fails Due to this built in functionality your Supermicro motherboard is specially designed to keep pace with the increasing performance demands of today s computer systems by improving d
49. eps video configuration error 1 continuous long beep no memory detected Terminal POST Errors If a terminal type of error occurs BIOS will shut down the system Before doing so BIOS will write the error to port 80h attempt to initialize video and write the error in the top left corner of the screen The following is a list of codes that may be written to port 80h POSTCode Description 02h Verify Real Mode 03h Disable Non Maskable Interrupt NMI 04h Get CPU type 06h Initialize system hardware 07h Disable shadow and execute code from the ROM 08h Initialize chipset with initial POST values 09h Set IN POST flag OAh Initialize CPU registers OBh Enable CPU cache OCh Initialize caches to initial POST values Initialize component OFh Initialize the local bus IDE 10h Initialize Power Management 11h Load alternate registers with initial POST values 12h Restore CPU control word during warm boot 13h Initialize PCI Bus Mastering devices 14h Initialize keyboard controller 16h 1 2 2 3 BIOS ROM checksum 17h Initialize cache before memory Auto size B 1 SUPERSERVER 6014 8 Manual POSTCode Description 18h 8254 timer initialization 1Ah 8237 DMA controller initialization 1Ch Reset Programmable Interrupt Controller 20h 1 8 1 1 Test DRAM refresh 22h 1 3 1 3 Test 8742 Keyboard Controller 24h Set ES segment register to 4 GB 28h Auto size DRAM 29h Initialize POST Memory Manager 2Ah Clear 512 kB base
50. eset Button connection is lo cated on pins 3 and 4 of JF1 Attach itto the hardware reset switch on the computer case Refer to the table on the right for pin definitions Power Button The Power Button connection is located on pins 1 and 2 of JF1 Momentarily contacting both pins will power on off the system This button can also be configured to function as a suspend button see setting in BIOS turn off power in suspend mode depress the button for at least 4 seconds Chassis Intrusion A Chassis Intrusion header is lo cated at JL1 Attach the appropri ate cable to inform you of a chas sis intrusion GLAN1 2 Ethernet Ports Two gigabit Ethernet ports are lo cated beside the VGA port These ports accept RJ45 type cables Universal Serial Bus USB0 1 Two USB 2 0 ports are located beside the mouse and COM ports USBO is on the bottom and USB1 is the top See the table on the right for pin definitions 5 14 Reset Pin Definitions JF1 Pin Number Definition 3 4 Reset Ground Power Button Connector Pin Definitions JF1 Pin Number Definition 1 2 PW_ON Ground Chassis Intrusion Pin Definitions JL1 Pin Number Definition 1 Intrusion Input 2 Ground Universal Serial Bus Pin Definitions USBO USB1 Pin Pin Number Definition Number Definition 1 5V 1 5V 2 Po 2 Po 3 PO 3 0 4 Ground 4 G
51. four IDE hard drives or ATAPI devices Backpanel I O ports include one COM port a VGA port two USB ports PS 2 mouse and keyboard ports and an external SCSI port An Intel 82546 Ethernet controller is included to support two Gb LAN ports Other Features Other onboard features are included to promote system health These in clude various voltage monitors two CPU temperature sensors four fan Speed sensors a chassis intrusion header auto switching voltage regula tors chassis and CPU overheat sensors virus protection and BIOS rescue 1 3 SUPERSERVER 6014 8 Manual Figure 1 1 E7525 Chipset Block Diagram 1 PCI X NOCONA CPU 1 NOCONA CPU 2 SLOT J13 SCSI 7902 1 ROLX ste IPCI X 100MH 12 X4 PCI E Xi 1 PCI X B 4DDRII 4 SLOT PCI X 133MH2 DDRII 400 J14 X4 1 PCLEXP MCH Gbit LAN 1PCLE iral DDRII 400 ANVIK SLOT B X8 4DDRII4 PCIE C X8 4 DIMMs 1PCLE SLOT IDE UDMA 100 HUB PRUISC e SATA ICH5 PCI 32 BIT VGA USB PORT USB LPC BUS 0 1 2 3 4 5 LPCS FWH LPCS KB FDD SERA HW PARALL MS SER2 MONITOR PORT 1 4 Chapter 1 Introduction 1 3 Server Chassis Feat
52. g settings Force Compliance Mode Entry This feature allows you to enable the PCI Express Compliance 1 0 Mode The options are Disabled or Enabled 7 11 SUPERSERVER 6014 8 Manual Memory RAS Feature Control Select this option to enable the Memory RAS Feature Control The options are Standard Mirroring and Sparing Clock Spectrum Feature If Enabled BIOS will monitor the level of Electromagnetic Interference caused by the components and will attempt to decrease the interference whenever needed The options are Enabled and Disabled DRAM Data Integrity Mode If enabled this feature allows the data stored in the DRMA memory to be integrated for faster data processing The options are 72 bit ECC 144 bit ECC Auto Algorithms and Disabled ECC Error Type This setting lets you select which type of interrupt to be activated as a result of an ECC error The options are None NMI Non Maskable Interrupt SMI System Management Interrupt and SCI System Control Interrupt SERR Signal Condition This setting specifies the conditions required to be qualified as an ECC error The options are None Single Bit Multiple Bit and Both USB Function This setting allows you to Enable or Disable all functions for the USB devices specified Legacy USB Support This setting allows you to enable support for Legacy USB devices The settings are Enabled and Disabled 7 12 Chapter 7 BIOS gt Advanced Proces
53. he proces sor power connector below See the table on the right for pin definitions Processor Power Connector In addition to the Primary ATX power connector above the 12v 8 pin pro cessor power connector at J1D1 must also be connected to your power supply If an 8 pin cable is not available please use two 4 pin cables See the table on the right for pin definitions NMI Button The non maskable interrupt button header is located on pins 19 and 20 of JF1 Refer to the table on the right for pin definitions Power LED The Power LED connection is lo cated on pins 15 and 16 of JF1 Re fer to the table on the right for pin definitions 5 12 ATX 20 pin Power Connector Pin Definitions J1B1 Pin Definition Pin Definition 11 3 3V 1 3 3V 12 12V 2 3 3V 13 COM 3 COM 14 PS_ON 4 5V 15 COM 5 COM 16 COM 6 5V 17 COM 7 18 5V 8 PW OK 19 5V 9 5VSB 20 5V 10 412V 12V 4 pin Connector J38 Bequired Pins Definition Connection 1 amp 2 Ground 3 amp 4 12V CPU 8 pin PWR Connector J1D1 Required Pins Definition 1 thru 4 Ground Connection 5thru8 12v NMI Button Pin Definitions JF1 Pin Number Definition 19 Control 20 Ground PWR LED Pin Definitions JF1 Pin Number Definition 15 Vcc 16 Control Chapter 5 Advanced Serverboard Setup HDD LED The HDD L
54. hen not in use For grounding purposes make sure your computer chassis provides ex cellent conductivity between the power supply the case the mounting fasteners and the serverboard SUPERSERVER 6014 8 Manual Slim Line CD ROM Drive Floppy Drive System LEDs Control Panel Brace D 1EAD SCSI Drives System Reset Main Power USBO0 1 Ports PCI Expansion Slots VGA Port T ean J Nog Bolo cee SET As 50009 9 U ou Jot 1171 s DUBIO o Mouse Keyboard Ports 1 Port Ethernet LAN Ports SCSI Port Figure 6 1 Chassis Front and Rear Views 6 2 Control Panel The control panel located on the front of the chassis must be connected to the JF2 connector on the serverboard to provide you with system status indications A ribbon cable has bundled these wires together to simplify the connection Connect the cable from JF2 on the serverboard to the appro priate header on the Control Panel PCB printed circuit board Make sure the red wire plugs into pin 1 on both connectors Pull all excess cabling out of the airflow path
55. hese steps to install the left inner rail to the left side of the chassis Figure 2 1 SC813S 500 with Rack Rails Attached with optional front bezel shown 2 4 Chapter 2 Server Installation Installing the Outer Rails Begin by measuring the distance from the front rail to the rear rail of the rack Attach a short bracket to the front side of the right outer rail and a long bracket to the rear side of the right outer rail Adjust both the short and long brackets to the proper distance so that the rail can fit snugly into the rack Secure the short bracket to the front side of the outer rail with two M4 screws and the long bracket to the rear side of the outer rail with three M4 screws Repeat these steps for the left outer rail Locking Tabs Both chassis rails have a locking tab which serves two functions The first is to lock the server into place when installed and pushed fully into the rack which is its normal position Secondly these tabs also lock the server in place when fully extended from the rack This prevents the server from coming completely out of the rack when you pull it out for servicing Figure 2 2 Installing the Rack Rails 2 5 SUPERSERVER 6014 8 Manual Installing the Server into the Rack You should now have rails attached to both the chassis and the rack unit The next step is to install the server into the rack Do this by lining up the rear of the chassis rails with the front of the ra
56. is will make all other existing bootable array non bootable Do you want to make this array bootable A bootable array will then be created An asterisk will appear next to the bootable array Main Menu Deleting a Bootable Array To delete a bootable array 1 From the Main menu select Manage Arrays 2 From the List of Arrays select the bootable array you want to delete and press Ctrl B A bootable array is an array marked with an asterisk 3 Enter Y to delete a bootable array when the following message is dis played The array is already marked bootable Do you want to make this array as not bootable Yes No The bootable array will then be deleted and the asterisk will disappear Note do not use the delete key to delete a bootable array C 10 Appendix C Software Installation Adding Deleting Hotspares Note In order to rebuild a RAID RAID 0 or RAID 1 you need to add a new HDD as a hotspare 1 Turn on your computer and press Cirl A as prompted to access the ARC Utility 2 From the ARC menu select Array Configuration Utility ACU 3 From the ACU menu select Add Delete Hotspares 4 Use the up and down arrow keys to highlight and select the disk you want to designate as a hotspare and press Insert then press Enter 5 Select Yes when the following prompt is displayed Do you want to create spare Yes No The spare you have selected will appear in the Select Drive
57. isk I O throughput and providing data accessibility regardless of a single disk failure By incorporating Adaptec Embedded Serial ATA into the motherboard design Supermicro offers the user the benefits of SATA RAID without the high costs asso ciated with RAID hardware Note For Adaptec s RAID Driver Installation Instructions please refer to the Adaptec RAID Controller User s Guide Emb SA RAID UG pdf which is located in the CD that came with this motherboard You can also download a copy of Adaptec s User s Guide from our website at www supermicro com Appendix C Software Installation Using the Adaptec RAID Configuration Utility ARC The Adaptec Configuration Utility is an embedded BIOS Utility in cluding Array Configuration Utility Use this utility when you want to create configure and manage arrays Disk Utilities Use this option to format or verify disks To run the Adaptec RAID Configuration Utility you will need to enable the RAID function in the system BIOS refer to Chapter 7 for System BIOS Configurations and then press the Ctrl and A keys simultaneously when prompted to do so during the system startup Refer to the previ ous page for detailed instructions Note To select an option use the arrow keys to highlight the item and then press the Enter key to select it To return to the previous menu press the ESC key Using the Array Configuration Utility ACU The Array Configuration Util
58. ity ACU enables you to create manage and delete arrays from the controller s BIOS add and delete spare drives and initialize drives During the system startup press the Ctrl and A keys simultaneously and the main menu will appear SUPERSERVER 6014 8 Manual 4 Adaptec RAID Configuration Utility gt ntrolle Options Array Configuration Utility Disk Utilities RARER OH LIER Managing Arrays Select this option to view array properties and delete arrays The follow ing sections describe the operations Of Managing Arrays To select this option use the arrow keys and the Enter key to select Managing Arrays from the main menu as shown below ites this array is bootable Del Delete ter Display Array properties and mem lt Ctrl S gt Verify Array Ctri R gt Rebuild Array lt Ctrl B gt Mark nmark Bootable Array 11 Moves Cursor Appendix C Software Installation Viewing Array Properties To view the properties of an existing array 1 At the BIOS prompt press 2 From the ARC menu select Array Configuration Utility ACU 3 From the ACU menu select Manage Arrays as shown on the previ OUS Screen 4 From the List of Arrays dialog box select the array you want to view and press Enter The Array Properties dialog box appears showing detailed information on the array The physical disks associated with the array are displayed here
59. lease do not change the default setting set by the manufacturer See the table on the right for jumper settings SUPERSERVER 6014 8 Manual Watch Dog Enable Disable Watch Dog JWD enables the Watch Dog func Jumper Settings JWD tion Watch Dog is a system moni Jumper Position Definition tor that can reboot the system when Pins 1 2 WD to Reset Pins2 3 WD to a software application is hung up Open Disabled Pins 1 2 will cause WD to reset the System if an application is hung up Pins 2 3 will generate a non maskable interrupt signal for the ap plication that is hung up See the table on the right for jumper settings Watch Dog can also be enabled via BIOS Note When enabled the user needs to write their own application soft ware to disable the WD Timer 3rd Power Supply Alarm Enable Disable Power Supply Alarm Enable Disable Jumper Settings JP10 The system can notify you in the Jumper event of a power supply failure This Position Definition Open Disabled feature assumes that three power Closed Enabled supply units are installed in the chassis with one acting as a backup This setting should be disabled on one and two power supply unit systems with JP10 to prevent false alarms See the table on right for pin definitions Power Force On Enable Disable Force Power On JPF Jumper JPF allows you to enable or Jumper Position
60. led you must first configure the Adaptec Embedded Serial ATA RAID Driver before you install the Windows operating system The necessary drivers are all included on the Supermicro bootable CDs that came packaged with your motherboard For Adaptec s SCSI Host RAID Utility please refer to the CDs that came with your motherboard Adaptec Embedded SATA RAID Controller Driver Serial ATA SATA Serial ATA SATA is a physical storage interface lt uses a single cable with a minimum of four wires to create a point to point connection between devices SATA is a serial link which supports transfer rates from 150 MBps Because the serial cables used SATA are thinner than the tradi tional cables used in Parallel ATA PATA SATA systems have better air flow and can be installed in smaller chassis than Parallel ATA In addition the cables used in PATA can only extend to 40cm long while SATA cables can extend up to one meter Overall SATA provides better functionality than PATA Configuring BIOS settings for the SATA RAID Functions 1 Press the Del key during system bootup to enter the BIOS Setup Utility Note If it is the first time to power on the system we recommend that you load the Optimized Default Settings If you have already done so please skip to Step 3 2 Use the arrow keys to select the Exit Menu Once in the Exit Menu scroll down the menu to select the item Load Optimized Default Settings and press the Enter key Sel
61. ll need to install the system into the rack Follow the steps in the order given to complete the installation process in a minimum amount of time Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow 2 1 SUPERSERVER 6014 8 Manual Choosing a Setup Location Leave enough clearance in front of the rack to enable you to open the front door completely 725 inches Leave approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing Warnings and Precautions Rack Precautions Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them In single rack installation stabilizers should be attached to the rack n multiple rack installations the racks should be coupled together Always make sure the rack is stable before extending a component from the rack You should extend only one component at a time extending two or more simultaneously may cause the rack to become unstable Server Precautions Review the electrical and general safety precautions in Chapter 4 Determine the placement of each component in the rack before you install the rails Install the heaviest server components on the bottom of the rack first and then work up Use a regulating uninterruptible power supply UPS to p
62. me push the cover away from you until it stops You can then lift the top cover from the chassis to gain full access to the inside of the server With the chassis cover removed unplug the power and data cables from the drive you want to remove Then locate the locking tab at the rear of the drive It will be on the left side of the drive when viewed from the front of the chassis Pull the tab away from the drive and push the drive unit out the front of the chassis Add a new drive by following this procedure in reverse order You may hear a faint click of the locking tab when the drive is fully inserted Re member to reconnect the data and power cables to the drive before replac ing the chassis cover and restoring power to the system Please be aware of the following The floppy disk drive cable has seven twisted wires A color mark on a cable typically designates the location of pin 1 A single floppy disk drive ribbon cable has 34 wires and two connectors to provide for two floppy disk drives The connector with twisted wires always connects to drive A and the connector that does not have twisted wires always connects to drive B Chapter 6 Advanced Chassis Setup 6 5 Power Supply The SuperServer 6014 8 has a single 500 watt power supply which is auto switching capable This enables it to automatically sense and operate with a 100v 240v input An amber light will be illuminated on the power supply when the power
63. memory address lines Jump to UserPatch1 Configure advanced cache registers Initialize Multi Processor APIC Enable external and CPU caches Setup System Management Mode SMM area Display external L2 cache size Load custom defaults optional Display shadow area message Display possible high address for UMB recovery Display error messages Check for configuration errors Check for keyboard errors Set up hardware interrupt vectors Initialize Intelligent System Monitoring Initialize coprocessor if present Disable onboard Super I O ports and IRQs Late POST device initialization Detect and install external RS232 ports Configure non MCD IDE controllers Detect and install external parallel ports Initialize PC compatible PnP ISA devices Re initialize onboard ports Configure Motherboard Configurable Devices optional Initialize BIOS Data Area Enable Non Maskable Interrupts NMIs Initialize Extended BIOS Data Area Test and initialize PS 2 mouse Initialize floppy controller Determine number of ATA drives optional Initialize hard disk controllers Initialize local bus hard disk controllers Jump to UserPatch2 Build MPTABLE for multi processor boards Install CD ROM for boot Clear huge ES segment register Fix up Multi Processor table 1 2 Search for option ROMs One long two short beeps on checksum failure B 3 SUPERSERVER 6014 8 Manual POSTCode Description 99h Check for SMART Drive optional 9Ah Shad
64. micro com C 16 Appendix C Software Installation C 2 Installing Intel s ICH5R Driver by Adaptec and Windows OS 1 Insert Supermicro s bootable CD that came with the package into the CD Drive during the system reboot The Super Micro Driver Diskette Maker screen will appear 2 Choose Intel ICH5R Driver by 3rd Party Adaptec from the items listed and press Enter 3 From the next screen displayed choose the OS driver you want to install and press Enter 4 Insert a formatted diskette into drive A and press Enter as prompted 5 Exit the program after the process is completed Then reboot the System 6 Insert Microsoft Windows OS Setup CD in the CD Driver The system will boot up from the CD 7 Press the F6 key when the message Press F6 if you need to install a third party SCSI or RAID driver is displayed 8 When the Windows OS Setup screen appears press S to specify additional device s 9 Insert the driver diskette labelled Adaptec Embedded Serial ATA Raid Controller Driver into your floppy drive and press the Enter key 10 Choose Adaptec Embedded Host Serial ATA Raid Controller from the list indicated in the Windows OS Setup Screen and press the Enter key 11 Press the Enter key to continue the installation process If you need to specify any additional devices to be installed do so at this time Once all devices are specified press the Enter key to continue with the instal lation 12
65. n BIOS Screen has two main frames The left frame displays all the options that can be configured Grayed out options cannot be configured The right frame displays the key legend Above the key legend is an area reserved for a text message When an option is selected in the left frame it is highlighted in white Often a text message will accompany it Note BIOS has default text messages built in Supermicro retains the option to include omit or change any of these text messages Options printed in Bold are the default settings The BIOS setup utility uses a key based navigation system called hot keys Most of these hot keys lt F1 gt F10 Enter lt ESC gt Arrow keys etc can be used at any time during the setup navigation process Note fan speed is controlled by the Fan Speed Control Modes setting in BIOS The recommended setting for the 6014 8 is 3 pin Server Loading the BIOS default settings may change this setting Therefore if you do load BIOS defaults you should reenter BIOS setup and change this setting back to 3 wire Server then save and exit see page 7 18 7 1 SUPERSERVER 6014 8 Manual 7 2 Running Setup Default settings are in bold text unless otherwise noted The BIOS setup options described in this section are selected by choos ing the appropriate text from the main BIOS Setup screen All displayed text is described in this section although the screen display is often all
66. n Setup Incorrect Drive B type run SETUP Type of floppy drive B not correctly identified in Setup 2 Appendix A BIOS POST Messages System cache error Cache disabled RAM cache failed and BIOS disabled the cache On older boards check the cache jumpers You may have to replace the cache See your dealer A disabled cache slows system performance considerably CPUID CPU socket number for Multi Processor error EISA CMOS not writeable ServerBIOS2 test error Cannot write to EISA CMOS DMA Test Failed ServerBIOS2 test error Cannot write to extended DMA Direct Memory Access registers Software NMI Failed ServerBIOS2 test error Cannot generate software NMI Non Maskable Interrupt Fail Safe Timer NMI Failed ServerBlOS2 test error Fail Safe Timer takes too long device Address Conflict Address conflict for specified device Allocation Error for device Run ISA or EISA Configuration Utility to resolve resource conflict for the specified device CD ROM Drive CD ROM Drive identified Entering SETUP Starting Setup program Failing Bits nnnn The hex number nnnn is a map of the bits at the RAM address which failed the memory test Each 1 one in the map indicates a failed bit See errors 230 231 or 232 above for offset address of the failure in System Extended or Shadow memory A 3 SUPERSERVER 6014 8 Manual Fixed Disk n Fixed disk n 0 3 identified Invalid System Configura
67. n board making sure you are not holding it at too great an angle which may damage the power distribution board Push it completely into the power distribution board and seat it in the chassis When correctly installed it should be laying flat make sure the end of the power supply is not sitting on the stop in the chassis Reconnect the power cord replace the chassis top cover and reposition the unit back into the rack Finish by depressing the power button on the chassis front control panel 6 9 SUPERSERVER 6014 8 Manual Figure 6 6 Removing Replacing the Power Supply with optional front bezel shown 6 10 Chapter 7 BIOS Chapter 7 BIOS 7 1 Introduction This chapter describes the Phoenix BIOS Setup utility for the X6DAR 8G The Phoenix ROM BIOS is stored in a flash chip and can be easily upgraded using a floppy disk based program Due to periodic changes in the BIOS some settings may have been added or deleted that might not yet be re corded in this manual Please refer to the Manual Download area of the Supermicro web site www supermicro com for any such changes Starting the Setup Utility To enter the BIOS Setup Utility hit the Delete key while the system is booting up In most cases the Delete key is used to invoke the BIOS setup Screen There are a few cases when other keys are used such as F1 F2 and so on Each main BIOS menu option is described in this manual The Mai
68. n operating Relative Humidity 5 to 9596 non condensing Appendix D System Specifications Regulatory Compliance Electromagnetic Emissions Class B EN 55022 Class B EN 61000 3 2 amp EN 61000 3 3 CISPR 22 Class B Electromagnetic Immunity EN 55024 CISPR 24 EN 61000 4 2 EN 61000 4 3 EN 61000 4 4 EN 61000 4 5 EN 61000 4 6 EN 61000 4 8 EN 61000 4 11 Safety EN 60950 IEC 60950 Compliant UL Listed USA CUL Listed Canada TUV Certified Germany CE Marking Europe SUPERSERVER 6014 8 Manual Notes
69. nabled JPF Power Force On Open Disabled JPG1 Enable Disable Pins 1 2 Enabled JPL1 GLAN Enable Disable Pins 1 2 Enabled JWD Watch Dog Pins 1 2 Reset Connector Description COM COM2 1 2 Serial Port Connectors DIMM 1A DIMM 4B Memory RAM Slots FAN 1 5 Onboard CPU Fan Chassis Fan Headers GLAN1 2 Gigabit Ethernet Ports J5 J6 IDE1 2 Hard Disk Drive Connectors J7 VGA Monitor Port J9 IPMI 2 0 Connector J11 System Management Bus Header J12 Floppy Drive Connector J16 Universal Serial 0 1 Ports J32 System Mangement Bus Power Connector J33 J34 PS 2 Keyboard Mouse Ports J38 4 Pin 12V Power Connector required connection J1B1 Primary ATX 20 Pin Power Connector J1D1 8 Pin 12v Processor Power required connection JA1 JA2 SCSI Channel A B Headers JD1 PWR LED pins 1 3 and Speaker pins4 7 Header JD2 Front Panel USB2 3 Headers JF1 Front Control Panel Connector JL1 Chassis Intrusion Header JOH1 Overheat LED JP9 Triple Redundant PS Fail Detect Header JP11 Alarm Rest Header JS1 JS2 Serial ATA SATO SATA1 Connectors JWOL Wake on LAN Header JWOR Wake on Ring Header 5 11 SUPERSERVER 6014 8 Manual 5 8 Connector Definitions ATX Power Connector The serverboard includes a 24 pin main power supply connector J1B1 and a 4 pin CPU PWR con nector J38 These power con nectors meet the SSI EPS 12V specification You must connect power supply cables to both J1B1 and J38 as well as to t
70. nd press Enter to expand the field See details how to change the order and specs of hard drives in the Item Specific Help window 7 21 SUPERSERVER 6014 8 Manual 7 7 Exit Choose Exit from the Phoenix BIOS Setup Utility main menu with the arrow keys You should see the following display All Exit BIOS settings are described in this section Setup Screen Emulation Alt PrtSc Capture To Clipboard 7 F10 Print Main Advanced Security Boot Exit Item Specific Help Exit Discarding Changes Exit System Setup and Load Setup Defaults save your changes to CMOS Discard Changes Save Changes Exit Saving Changes Highlight this item and hit lt Enter gt to save any changes you made and to exit the BIOS Setup utility Exit Discarding Changes Highlight this item and hit lt Enter gt to exit the BIOS Setup utility without saving any changes you may have made Load Setup Defaults Highlight this item and hit lt Enter gt to load the default settings for all items in the BIOS Setup These are the safest settings to use 7 22 Chapter 7 BIOS Discard Changes Highlight this item and hit Enter to discard cancel any changes you made You will remain in the Setup utility Save Changes Highlight this item and hit Enter to save any changes you made You will remain in the Setup utility 7 23 SUPERSERVER 6014 8 Manual Notes 7 24 Appendix A BIOS POST Messages
71. neutralize this difference before contact is made to protect your equipment from ESD Use a grounded wrist strap designed to prevent static discharge Keep all components and printed circuit boards PCBs in their antistatic bags until ready for use Touch a grounded metal object before removing any board from its antistatic bag Do not let components or PCBs come into contact with your clothing which may retain a charge even if you are wearing a wrist strap Handle a board by its edges only do not touch its components peripheral chips memory modules or contacts When handling chips or modules avoid touching their pins Put the serverboard and peripherals back into their antistatic bags when not in use For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 4 3 SUPERSERVER 6014 8 Manual 4 4 Operating Precautions A Care must be taken to assure that the chassis cover is in place when the 6014A 8 is operating to ensure proper cooling Out of warranty damage to the 6014 8 system can occur if this practice is not strictly followed Chapter 5 Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install processors and heatsinks to the X6DAR 8G serverboard connect the data and power cables and install ad
72. nknown interrupt The following are for boot block in Flash ROM POSTCode Description EOh Eth E2h E3h E4h E5h E6h E7h E8h E9h EAh EBh ECh EDh EEh EFh FOh Fih F2h F3h F4h F5h F6h F7h Initialize the chipset Initialize the bridge Initialize the CPU Initialize system timer Initialize system Check force recovery boot Checksum BIOS ROM Go to BIOS Set Huge Segment Initialize Multi Processor Initialize OEM special code Initialize PIC and DMA Initialize Memory type Initialize Memory size Shadow Boot Block System memory test Initialize interrupt vectors Initialize Run Time Clock Initialize video Initialize System Management Manager Output one beep Clear Huge Segment Boot to Mini DOS Boot to Full DOS the BIOS detects error 2C 2E or 30 base 512K RAM error it displays an additional word bitmap xxxx indicating the address line or bits that failed For example 2C 0002 means address line 1 bit one set has failed 2E 1020 means data bits 12 and 5 bits 12 and 5 set have failed in the lower 16 bits The BIOS also sends the bitmap to the port 80 LED display It first displays the checkpoint code followed by a delay the high order byte another delay and then the loworder byte of the error It repeats this sequence continuously B 5 SUPERSERVER 6014 8 Manual Notes Appendix C Software Installation Appendix C Software Installation After all the hardware has been instal
73. nnel 1 Master gt IDE Channel 1 Slave k IDE Channel 2 Master k IDE Channel 3 Master System Memory XXXX KB Extended Memory XXXX KB Fi tL e 9 Esc e gt Enter F10 Main Setup Features System Time To set the system date and time key in the correct information in the appropriate fields System Date Then press the lt Enter gt key to save the data Using the arrow keys highlight the month day and year fields and enter the correct data Press BIOS Date the lt Enter gt key to save the data This feature allows BIOS to automatically display the BIOS date 7 3 SUPERSERVER 6014 8 Manual Legacy Diskette A This setting allows the user to set the type of floppy disk drive installed as diskette A The options are Disabled 360Kb 5 25 in 1 2MB 5 25 in 720Kb 3 5 in 1 44 1 25MB 3 5 in and 2 88MB 3 5 in Parallel ATA This setting allows the user to enable or disable the funciton of Parallel ATA The options are Disabled Channel 0 Channel 1 and Both Serial ATA This setting allows the user to enable or disable the funciton of Serial ATA The options are Disabled and Enabled Serial ATA RAID Feature Select Enable to enable Serial ATA RAID Functions For the Windows OS environment use the RAID driver if this feature is set to Enabled If Disabled use the Non RAID driver Native Mode Operation This option allows the user to select the Native Mode for ATA Some Operating System
74. ofile registered ECC DDR333 or up to 32 GB of low profile regis tered ECC DDR266 SDRAM This serverboard has has been designed to support 4GB DIMM modules for each memory slot but it has only been vali dated with 2GB memory modules Onboard SCSI Onboard SCSI is provided with an Adaptec AIC 7902 SCSI controller chip which supports dual channel Ultra320 SCSI at a burst throughput rate of 320 MB sec The X6DAR 8G provides two SCSI ports A QLogic GEM318 controller is used for the SAF TE compliant SCSI backpanel PCI Expansion Slots The X6DAR 8G has one x16 PCI Express slot one x4 PCI Express slot and one Universal PCI X 133 slot Two riser cards are included with the server One CSE RR1U E16 fits into the PCI Express x16 slot and was designed especially for the SC813S 500 chassis to support the use of one standard size PCI Express x16 card The other riser card CSE RR1U XLP fits into the PCI X slot and supports one low profile half height half length PCI X 133 100 or 66 MHz card Chapter 1 Introduction ATI Graphics Controller The X6DAR 8G features an integrated ATI video controller based on the Rage XL graphics chip Rage XL fully supports sideband addressing and AGP texturing This onboard graphics package can provide a bandwidth of up to 512 MB sec over a 32 bit graphics memory bus Onboard Controllers Ports The X6DAR 8G includes one floppy drive controller and two onboard IDE controllers which support up to
75. oper place in the chassis by positioning it on the two mounting posts Secure the fan to the chassis with the screws you removed previously then attach the fan wires to the same chassis fan header you removed it from Make sure the air seal under the fan is properly installed and creating a good seal Power up the system and check that the fan is working properly and that the LED on the control panel has turned off Finish by replacing the chassis cover SUPERSERVER 6014 8 Manual 10 cm Blower Fans Figure 6 2 System Cooling Fans with optional front bezel shown 6 4 Drive Bay Installation Removal Removing the Front Bezel If your system has a front bezel optional attached to the chassis you must first remove it to gain access to the drive bays To remove the bezel first unlock the front of the chassis then press the release knob see Figure 6 3 Carefully remove the bezel with both hands A filter located within the bezel can be removed for replacement cleaning It is recommended that you keep a maintenance log of filter cleaning replacement since its condition will affect the airflow throughout the whole system Chapter 6 Advanced Chassis Setup Figure 6 3 Removing the Front Bezel y mmm 1 Unlock 2 Press release knob 3 Remove bezel assembly Accessing the Drive Bays SCSI Drives Be
76. or installed Triangle pin 1 Triangle locating pin 1 Heatsink Installation 1 Do not apply any thermal compound to the heatsink or the CPU die the required amount has already been applied 2 Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the retention mechanism 3 Screw in two diagonal screws until snug do not fully tighten the screws to avoid possible damage to the CPU The screw in the other two diagonal screws until snug Refer to Figure 5 2 4 Finish the installation by fully tightening all four screws Note refer to page 7 18 for a BIOS setting that determines fan speed The passive 1U heatsink p n SNK P009 to be used with the 6014 8 is optional item that is sold separately SUPERSERVER 6014 8 Manual Removing the Heatsink CPU IMPORTANT Removal of the heatsink or the CPU is not recom mended However if you do need to remove the heatsink please follow the instructions below to prevent damaging the CPU or the CPU socket 1 Unscrew and remove the heatsink screws from the serverboard in the sequence used when installing diagonal screws 2 Hold the heatsink as show in the picture on the right and gently wriggle the heatsink to loosen it from the CPU Do not use excessive force when wriggling the heatsink 3 Once the heatsink has been loosened from the CPU remove the heatsink from the CPU socket 4 Clean the surface of the
77. ow option ROMs 9Ch Set up Power Management 9Dh Initialize security engine optional 9Eh Enable hardware interrupts 9Fh Determine number of ATA and SCSI drives AOh Set time of day A2h Check key lock A4h Initialize typematic rate A8h Erase F2 prompt AAh Scan for F2 key stroke ACh Enter SETUP AEh Clear Boot flag BOh Check for errors Bih Inform RomPilot about the end of POST B2h POST done prepare to boot operating system B4h 1 One short beep before boot B5h Terminate QuietBoot optional B6h Check password optional B7h Initialize ACPI BIOS B9h Prepare Boot BAh Initialize SMBIOS BBh Initialize PnP Option ROMs BCh Clear parity checkers BDh Display MultiBoot menu BEh Clear screen optional BFh Check virus and backup reminders COh Try to boot with INT 19 Cih Initialize POST Error Manager PEM C2h Initialize error logging C3h Initialize error display function C4h Initialize system error handler C5h PnPnd dual CMOS optional C6h Initialize note dock optional C7h Initialize note dock late C8h Force check optional C9h Extended checksum optional CAh Redirect Int 15h to enable remote keyboard CBh Redirect Int 13h to Memory Technologies Devices such as ROM RAM PCMCIA and serial disk CCh Redirect Int 10h to enable remote serial video B 4 Appendix B BIOS POST Codes POSTCode Description CDh CEh D2h Re map and memory for PCMCIA Initialize digitizer and display message U
78. play The items with a triangle beside them have sub menus that can be accessed by highlighting the item and pressing Enter Options for PIR settings are displayed by highlighting the setting option using the arrow keys and pressing Enter All Advanced BIOS Setup options are described in this section Setup Screen Emulation Alt PrtSc Capture To Clipboard 7 F10 Print Security Boot Exit Item Specific Help Memory Cache PCI Configuration Select Boot features Advanced Chipset Control Advanced Processor Options 1 0 Device Configuration DMI Event Logging Console Redirection Hardware Monitor Oh ib Am 2s 2s am 2 gt Boot Features Access the submenu to make changes to the following settings Quick Boot Mode If enabled this feature will speed up the POST Power On Self Test routine after the computer is turned on The settings are Enabled and Disabled If Disabled the POST routine will run at normal speed Quiet Boot This setting allows you to Enable or Disable the diagnostic screen during boot up 7 7 SUPERSERVER 6014 8 Manual ACPI Mode Use the setting to determine if you want to employ ACPI Advanced Configuration and Power Interface power management on your system The options are Yes and No Power Button Behavior This setting allows you to choose how the system powers down upon pressing the power button The options are Instant Off and 4 sec overide Keyboard on Now F
79. previous Displayed after any recoverable error message Press F1 to start the boot process or F2 to enter Setup and change the settings Press F3 to display the previous screen usually an initialization error of an Option ROM i e an add on card Write down and follow the information shown on the screen Press F2 to enter Setup Optional message displayed during POST Can be turned off in Setup PS 2 Mouse PS 2 mouse identified Run the 120 Configuration Utility One or more unclaimed block storage devices have the Configuration Request bit set in the LCT Run an 120 Configuration Utility e g the SAC utility System BIOS shadowed System BIOS copied to shadow RAM UMB upper limit segment address nnnn Displays the address nnnn of the upper limit of Upper Memory Blocks indicating released segments of the BIOS which can be reclaimed by a virtual memory manager Video BIOS shadowed Video BIOS successfully copied to shadow RAM 5 SUPERSERVER 6014 8 Manual Notes A 6 Appendix B BIOS POST Codes Appendix B BIOS POST Codes This section lists the POST Power On Self Test codes for the PhoenixBIOS POST codes are divided into two categories recoverable and terminal Recoverable POST Errors When recoverable type of error occurs during POST the BIOS will display an POST code that describes the problem BIOS may also issue one of the following beep codes 1 long and two short be
80. r person who is familiar with the power off controls should be nearby to switch off the power if necessary Use only one hand when working with powered on electrical equipment This is to avoid making a complete circuit which will cause electrical shock Use extreme caution when using metal tools which can easily damage any electrical components or circuit boards they come into contact with Do not use mats designed to decrease electrostatic discharge as protection from electrical shock Instead use rubber mats that have been specifically designed as electrical insulators 4 1 SUPERSERVER 6014 8 Manual The power supply power cord must include a grounding plug and must be plugged into grounded electrical outlets Serverboard Battery CAUTION There is a danger of explosion if the onboard battery is installed upside down which will reverse its polarities On the X6DAR 8G the positive side should be facing up This battery must be replaced only with the same or an equivalent type recommended by the manufacturer Dispose of used batteries according to the manufacturer s instructions CD ROM Laser CAUTION this server may have come equipped with a CD ROM drive To prevent direct exposure to the laser beam and hazardous radiation exposure do not open the enclosure or use the unit in any unconventional way 4 2 General Safety Precautions A Follow these rules to ensure general safety Keep the
81. re 2 2 Rack Mounting Considerations iissa citet eee 2 3 2 4 Installing the System into a sse 2 4 Identifying the Sections of the Rack 2 4 Installing the Inner Rails rennen 2 4 Installing the Outer Hails rere teneret gs 2 5 Installing the Server into the Rack 2 6 Installing the Server into a Telco Rack 2 7 2 5 Checking the Serverboard Setup 2 6 Checking the Drive Bay 5 tta Chapter 3 System Interface 3 1 QVeIVIOW cuta ce ea e Pte E ed 3 1 3 2 Control Panel Buttons eine incer i oa e ee care ed erant 3 1 vi Table of Contents Chapter 4 System Safety 4 1 4 2 4 3 4 4 Electrical Safety Precautions General Safety Precautions 22 2 2 ESD Precautions s aee neret ertet ree Operating e IER ER E Chapter 5 Advanced Serverboard Setup 5 1 5 2 5 3 5 4 5 5 5 6 5 7 5 8 Handling the Serverboard iiec notera 5 1 PGA Processor and Heatsink Installation 5 2 Connecting Cables s tete Ra e gate neu Connecting Data Cables sssseeeneeeeneeenenen Connecting Power Cables Connecting the Control Panel re rete 5 6
82. remain in the drive Important Regardless of how many SCSI hard drives are bays for proper airflow Chapter 6 Advanced Chassis Setup 2 Installing removing hot swap SCSI drives The SCSI drive bays are located in the front of the chassis making them easily accessible for installation and removal The SCSI drives are hot swap units meaning that they can be installed and removed while the system is running To remove a SCSI drive first push the colored release button located beside the drive s LEDs then swing the handle fully out and use it to pull the SCSI drive carrier straight out see Figure 6 5 Figure 6 5 Removing SCSI Drives Important of the SCSI drive carriers must remain in the drive bays to maintain proper cooling airflow 6 7 SUPERSERVER 6014 8 Manual CD ROM and Floppy Drive Installation The top cover of the chassis must be opened to gain full access to the CD ROM and floppy drive bays The 6014A 8 accomodates only slim CD ROM drives Side mounting brackets are needed to mount a slim CD ROM drive in the 6014 8 server You must power down the system before installing or removing a floppy or CD ROM drive First release the retention screws that secure the server unit to the rack Grasp the two handles on either side and pull the unit straight out until it locks you will hear a click Next depress the two buttons on the top of the chassis to release the top cover and at the same ti
83. rive CD ROM and ATAPI Removable The option User will allow the user to enter the parameters of the HDD installed at this connection The option Auto will allow BIOS to automatically configure the parameters of the HDD installed at the connection Choose the option 1 39 to select a pre determined HDD type Select CD ROM if a CD ROM drive is installed Select ATAPI if a removable disk drive is installed SUPERSERVER 6014 8 Manual Multi Sector Transfers Select the number of transfer sectors The options are Disabled 2 4 6 8 and 16 Sectors LBA Mode Control This item determines whether Phoenix BIOS will access the IDE Primary Master Device via LBA mode The options are Disabled and Enabled 32 Bit I O Selects 32 Bit I O operation The options are Enabled and Disabled Transfer Mode Selects the transfer mode The options are Standard Fast PIO1 Fast PIO2 Fast PIOS Fast PIO4 FPIO3 DMA1 and FPIO4 DMA2 Ultra DMA Mode Selects Ultra DMA Mode The options are Disabled Mode 0 Mode 1 Mode 2 Mode 3 Mode 4 Mode 5 and Mode 6 System Memory This display informs you how much system memory is recognized as being present in the system Extended Memory This display informs you how much extended memory is recognized as being present in the system Chapter 7 BIOS 7 4 Advanced Setup Choose Advanced from the Phoenix BIOS Setup Utility main menu with the arrow keys You should see the following dis
84. rive activity A connection to the SCSI SCA backplane enables this LED to blink on and off when that particular drive is being accessed Red compliant backplane standard on the 6014 8 activates the red LED which indicates a drive failure If one of the SCSI drives fail you should be notified by your system management software Please refer to Chap ter 6 for instructions on replacing failed SCSI drives SUPERSERVER 6014 8 Manual Notes Chapter 4 System Safety 4 1 Chapter 4 System Safety Electrical Safety Precautions A Basic electrical safety precautions should be followed to protect yourself from harm and the SuperServer 6014A 8 from damage Be aware of the locations of the power on off switch on the chassis as well as the room s emergency power off switch disconnection Switch or electrical outlet If an electrical accident occurs you can then quickly remove power from the system Do not work alone when working with high voltage components Power should always be disconnected from the system when removing or installing main system components such as the serverboard memory modules and the CD ROM and floppy drives not necessary for SCSI drives When disconnecting power you should first power down the system with the operating system and then unplug the power cords of all the power supply units in the system When working around exposed electrical circuits anothe
85. rolled Mode Specify the type of device that will be connected to serial port B The options are Normal IR for an infrared device and ASK IR Base I O Address Select the base I O address for serial port B The options are 3F8 2F8 3E8 and 2E8 Interrupt Select the IRQ interrupt request for serial port B The options are IRQ3 and IRQ4 Chapter 7 BIOS Parallel Port This setting allows you to assign control of the parallel port The options are Enabled user defined Disabled and Auto BIOS controlled Base I O Address Select the base I O address for the parallel port The options are 378 278 and 3BC Interrupt Select the IRQ interrupt request for the parallel port The options are IRQ5 and IRQ7 Mode Specify the parallel port mode The options are Output Only Bi directional EPP ECP DMA Channel Specify the DMA channel The options are DMA1 and DMA3 Floppy Disk Controller This setting allows you to assign control of the floppy disk controller The options are Enabled user defined Disabled and Auto BIOS controlled Base I O Address Select the base I O address for the parallel port The options are Primary and Secondary SUPERSERVER 6014 8 Manual P DMI Event Logging Access the submenu to make changes to the following settings Event Log Validity This is a display not a setting informing you of the event log validity Event Log Capacity This is a display
86. rompted type the user s password in the dialogue box to set or to change the user s password which allows access to the system at boot up Fixed Disk Boot Sector This setting may offer some protection against viruses when set to Write Protect which protects the boot sector on the hard drive from having a virus written to it The other option is Normal Password on Boot This setting allows you to require a password to be entered when the System boots up The options are Enabled password required and Disabled password not required 7 20 Chapter 7 BIOS 7 6 Boot Choose Boot from the Phoenix BIOS Setup Utility main menu with the arrow keys You should see the following display Highlighting a setting with a or will expand or collapse that entry See details on how to change the order and specs of boot devices in the Item Specific Help window All Boot BIOS settings are described in this section Main Advanced Security Removable Devices Item Specific Help CD ROM Drive Hard Drive lt Tab gt lt Shift Tab gt or lt Enter gt selects field Fi tL S F9 Esc gt Enter Removable Devices Highlight and press Enter to expand the field See details how to change the order and specs of devices in the Item Specific Help window CD ROM Drive See details on how to change the order and specs of the CD ROM drive in the Item Specific Help window Hard Drive Highlight a
87. rotect the server from power surges voltage spikes and to keep your System operating in case of a power failure Allow the hot plug SCSI drives and power supply units to cool before touching them Always keep the rack s front door and all panels and components on the servers closed when not servicing to maintain proper cooling 2 2 Chapter 2 Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi unit rack assembly the ambient operating temperature of the rack environment may be greater than the ambient temperature of the room Therefore consideration should be given to installing the equipment in an environment compatible with the manufacturer s maximum rated ambient temperature Tmra Reduced Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading Circuit Overloading Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring Appropriate consid eration of equipment nameplate ratings should be used when addressing this concern Reliable Ground A reliable ground must be maintained at all times To en
88. round 5 N A 5 Key Chapter 5 Advanced Serverboard Setup Front Panel Universal Serial Bus Headers An extra USB header at JD2 USB2 USB3 can be used for front side USB access You will need a USB cable to use these connections Refer to the tables on the right for pin definitions Fan Headers There are five fan headers FAN1 FAN5 on the X6DAR 8G See the table on the right for fan pin defini tions Serial Ports The COM1 port is located beside USBO 1 and the COM2 port is lo cated next to Chassis 1 See the tables on the right for pin defi nitions ATX PS 2 Keyboard and PS 2 Mouse Ports The ATX PS 2 keyboard and PS 2 mouse are located beside USBO 1 See the table at right for pin defini tions See Figure 5 3 for the lo 5 15 Front Panel Universal Serial Bus Pin Definitions USB2 3 402 Pin Number Definition 1 5V 2 PO 3 PO 4 Ground 5 N A Fan Header Pin Definitions FAN 1 5 Pin Definition 1 Ground black 2 412V red 3 Tachometer Caution These fan headers are DC power Serial Port Pin Definitions COM1 Pin Number Definition Pin Number Definition 1 CD 6 DSR 2 RD 7 RTS 3 TD 8 CTS 4 DTR 9 RI 5 Ground Serial Port Pin Definitions 2 Pin Number Definition Pin Number Definition 1 CD 6 DSR 2 RD Fa RTS 3 TD 8 CTS 4 DTR g RI 5 Ground 10 NC PS 2 Keyboard and Mouse
89. s Ultra320 LVD SCSI Cables JA1 Control Panel Cable JF1 see next page CD ROM Cable J6 Floppy Drive Cable J12 Connecting Power Cables The X6DAR 8G has a 20 pin primary ATX power supply connector desig nated J1B1 for connection to the ATX power supply Connect the appro priate connector from the power supply to the J1B1 connector to supply power to the serverboard The 12V 8 pin power connector at J1D1 and the 12V 4 pin power connector at J38 must also both be connected to your power supply See the Connector Definitions section in this chapter for power connector pin definitions SUPERSERVER 6014 8 Manual Connecting the Control Panel JF1 contains header pins for various front control panel connectors See Figure 5 3 for the pin locations of the various front control panel buttons and LED indicators Please note that even and odd numbered pins are on opposite sides of each header All JF1 wires have been bundled into single ribbon cable to simplify their connection Make sure the red wire plugs into pin 1 as marked on the board The other end connects to the Control Panel printed circuit board located just behind the system status LEDs in the chassis See the Connector Definitions section in this chapter for details and pin descriptions of JF1 Figure 5 3 JF1 Header Pins Ground NMI X Power LED Vcc HDD LED Vcc NIC1 LED Vcc NIC2 LED t LED lt Power L
90. s are not supported by the Native Mode The options are Serial ATA Parallel ATA Auto and Both PIDE Channel 0 Master Slave IDE Channel 1 Master Slave IDE Channel 2 Master IDE Channel 3 Master These settings allow the user to set the parameters of IDE Channel 0 Master Slave IDE Channel 1 Master Slave IDE Channel 2 Master IDE Channel 3 Master slots Hit Enter to activate the following sub menu screen for detailed options of these items Set the correct configurations accordingly The items included in the sub menu are 74 Chapter 7 BIOS oa ANNE Item Specific Help CHS Format Cylinders User you antar i parameters of hard dis drive installed at this Heads 11 connection Heads ime ard disk drive actors installed here Sectors 1 39 you select Maximum Capacity pre determined type of Bex em Capac tey LBA Format CD ROM a CD ROM drive Total Sectors i ity emovable Hasim Capan tey removable disk drive is installed here Multi Sector Transfers Disabled LBA Mode Control Disabled 32 Bit 1 0 Disabled Transfer Mode Standard Ultra DMA Mode Disabled Fi tL SAE F9 Esc e gt Enter F10 Type Selects the type of IDE hard drive The options are Auto allows BIOS to automatically determine the hard drive s capacity number of heads Sectors Maximum Capacity LBA Format ect Enter a number from 1 39 to select a predetermined type of hard d
91. sor Options Access the submenu to make changes to the following settings CPU Speed This is a display that indicates the speed of the installed processor Hyper threading This setting allows you to Enable or Disable the function of hyper threading Enabling hyper threading results in increased CPU performance Applicable for the XP systems Machine Checking This setting allows you to Enable or Disable Machine Checking If Enabled the OS will debug the system during system reset after a system crash Adjacent Cache Line Prefetch The CPU fetches the cache line for 64 bytes if Disabled The CPU fetches both cache lines for 128 bytes as comprised if Enabled gt 1 O Device Configuration Access the submenu to make changes to the following settings KBC Clock input This setting allows you to set the clock frequency for the Keyboard Clock The options are 6MHz 8MHz and 12 MHz 7 13 SUPERSERVER 6014 8 Manual On board COM 1 This setting allows you to assign control of serial port A The options are Enabled user defined Disabled and Auto BIOS controlled Base I O Address Select the base I O address for serial port A The options are 3F8 2F8 3E8 and 2E8 Interrupt Select the IRQ interrupt request for serial port A The options are IRQ3 and IRQ4 On board COM 2 This setting allows you to assign control of serial port B The options are Enabled user defined Disabled and Auto BIOS cont
92. sure this the rack itself should be grounded Particular attention should be given to power supply connections other than the direct connections to the branch circuit i e the use of power strips etc 2 3 SUPERSERVER 6014 8 Manual 2 4 Installing the System into a Rack This section provides information on installing the SuperServer 6014 8 into a rack unit with the rack rails provided If the 6014A 8 has already been mounted into a rack you can skip ahead to Sections 2 5 and 2 6 There are a variety of rack units on the market which may mean the assembly proce dure will differ slightly You should also refer to the installation instructions that came with the rack unit you are using Identifying the Sections of the Rack Rails You should have received two rack rail assemblies with the SuperServer 6014 8 Each of these assemblies consists of two sections an inner fixed chassis rail that secures to the 6014A 8 A and an outer fixed rack rail that secures directly to the rack itself B Two pairs of short brackets to be used on the front side of the outer rails are also included Installing the Inner Rails First locate the right inner rail the rail that will be used on the right side of the chassis when you face the front of the chassis Align the four square holes on the right inner rail against the hooks on the right side of the chassis Securely attach the rail to the chassis with two M4 flat head screws Repeat t
93. tel Xeon processors at a Front Side system Bus speed of 800 MHz and up to 16 GB of DDR333 PC2100 or 32 GB of DDR266 PC1600 low profile SDRAM memory Manual Organization Chapter 1 Introduction The first chapter provides a checklist of the main components included with the server system and describes the main features of the SUPER X6DAR 8G serverboard and the SC813S 500 chassis Chapter 2 Server Installation This chapter describes the steps necessary to install the SuperServer 6014A 8 into a rack and check out the server configuration prior to powering up the System If your server was ordered without processor and memory components this chapter will refer you to the appropriate sections of the manual for their installation Chapter 3 System Interface Refer here for details on the system interface which includes the functions and information provided by the control panel on the chassis as well as other LEDs located throughout the system SUPERSERVER 6014 8 Manual Chapter 4 System Safety You should thoroughly familiarize yourself with this chapter for a general overview of safety precautions that should be followed when installing and servicing the SuperServer 6014 8 Chapter 5 Advanced Serverboard Setup Chapter 5 provides detailed information on the X6DAR 8G serverboard including the locations and functions of connectors headers and jumpers Refer to this chapter when adding or removing processors or
94. th Info Performance Remote Control Configuration Administration Sy Remote Control Graceful power control Supero Doctor allows a user to inform the OS to reboot or shut down within a specified time the default is 30 seconds Before the system reboots or shuts down it s allowed to cancel the action Requirements Keep Supero SD3Service Daemon running at all times on this system Provide TCP IP connectivity trol ower contro Note SD III Software Revision 1 0 can be downloaded from our Web site at ftp ftp supermicro com utility Supero Doctor lll You can also download the 011 User s Guide at http www supermicro com PROD UCT Manuals SDIII UserGuide pdf For Linux we recommend using Supero Doctor Il C 20 Appendix D System Specifications Appendix D System Specifications Processors Single or dual Intel Xeon 604 pin EM64T processors at a front side system bus speed of 800 MHz Note Please refer to the support section of our web site for a complete listing of supported processors http www supermicro com Chipset Intel E7525 chipset BIOS 8 Mb Phoenix Flash ROM Memory Capacity Eight 184 pin DIMM sockets supporting up to 16 GB of registered ECC DDR333 or 32 GB of registered ECC DDR266 SDRAM Note Interleaved memory requires memory to be installed two at a time See the memory section in Chapter 5 for details SCSI Controller Adaptec AIC 7902
95. the VGA port See the table on the right for jumper settings the default setting is enabled 5 18 VGA Enable Disable Jumper Settings JPG1 Jumper Position Definition Pins 1 2 Pins 2 3 Enabled Disabled Chapter 5 Advanced Serverboard Setup GLAN Enable Disable GLAN Enable Disable Jumper Settings Change the setting of jumper JPL1 to Jumper enable or disable the onboard GLAN Position Definition Pins 1 2 Enabled ports GLAN1 and GLAN2 on the Pins2 3 Disabled serverboard See the table on the right for jumper settings The default setting is enabled SCSI Controller Enable Disable SCSI Enable Disable Jumper Settings Jumper JPA1 allows you to enable JPA1 or disable the SCSI headers The Jumper MM A Positi Definiti default setting is pins 1 2 to enable Pins 12 Enabled all four headers See the table on Pins 2 3 Disabled the right for jumper settings SCSI Termination Enable Disable SCSI Channel Termination Enable Disable Jumpers JPA2 and allow you Jumper Settings i ci JPA2 JPA3 to enable or disable termination for Jumper the SCSI connectors Jumper JPA2 Position Definition Open Enabled controls SCSI channel A and JPA3 Closed Disabled is for channel B The default set ting is open to enable terminate both SCSI channels Note In order for the SCSI drives to function properly p
96. the list You should install everything here except for the SUPER Doctor utility Intel LDCM the LAN SCSI driver diskettes which are optional The bottom icon with a CD on it allows you to view the entire contents of the CD Note Please refer to the Adaptec User s Guide included in the CD for installing the Adaptec SATA RAID Controller Driver You can also download a copy of the guide from our website C 18 Appendix C Software Installation Supero Doctor 111 The Supero Doctor Ill program is a web based management tool that offers both remote and local management tools The local management application is called SD Client The Supero Doctor program included on the CDROM that came with your motherboard allows you to monitor the environment and operations of your system Supero Doctor dis plays crucial system information such as CPU temperature system volt ages and fan status See Figures B 2 and B 3 for examples of the Supero Doctor Ill interface Figure C 2 Supero Doctor Health Information Display Supero Doctor Microsoft Internet Explorer 51 xl Fie Edit View Favorites Tools a CPUl Chassis CPUZ Chassis C 19 SUPERSERVER 6014 8 Manual Figure C 3 Supero Doctor lll Remote Control Display 2 Supero Doctor Microsoft Internet Explorer File Edt View Favorites Tools Help 7 Remote Management System Info Heal
97. tion Data Problem with NVRAM CMOS data device IRQ conflict device IRQ conflict error PS 2 Mouse Boot Summary Screen PS 2 Mouse installed nnnn kB Extended RAM Passed Where nnnn is the amount of RAM in kilobytes successfully tested nnnn Cache SRAM Passed Where nnnn is the amount of system cache in kilobytes successfully tested nnnn kB Shadow RAM Passed Where nnnn is the amount of shadow RAM in kilobytes successfully tested nnnn kB System RAM Passed Where nnnn is the amount of system RAM in kilobytes successfully tested One or 120 Block Storage Devices were excluded from the Setup Boot Menu There was not enough room in the IPL table to display all installed 120 block storage devices Operating system not found Operating system cannot be located on either drive A or drive C Enter Setup and see if fixed disk and drive A are properly identified Parity Check 1 nnnn Parity error found in the system bus BIOS attempts to locate the address and display it on the screen If it cannot locate the address it displays Parity is a method for checking errors in binary data A parity error indicates that some data has been corrupted 4 Appendix A BIOS POST Messages Parity Check 2 nnnn Parity error found in the bus BIOS attempts to locate the address and display it on the screen If it cannot locate the address it displays Press F1 to resume F2 to Setup F3 for
98. to be cached written into a buffer a storage area in the Static DRM SDROM or written into L1 L2 L3 cache inside the CPU to speed up CPU operations Select Uncached to disable this funciton Select Write Through to allow data to be cached into the buffer and written into the system memory at the same time Select Write Protect to prevent data from being written into the base memory area of Block 0 512K Select Write Back to allow CPU to write data back directly from the buffer without writing data to the System Memory for fast CPU data processing and operation The options are Uncached Write Through Write Protect and Write Back Cache Base 512K 640K If enabled this feature will allow the data stored in the memory area 512K 640K to be cached written into a buffer a storage area in the Static DRM SDROM or written into L1 L2 L3 cache inside the CPU to speed up CPU operations Select Uncached to disable this funciton Select Write Through to allow data to be cached into the buffer and written into the system memory at the same time Select Write Protect to prevent data from being written into the base memory area of Block 0 512K Select Write Back to allow CPU to write data back directly from the buffer without writing data to the System Memory for fast CPU data processing and operation The options are Uncached Write Through Write Protect and Write Back Cache Extended Memory If enabled this f
99. tripe Array Size 68 938 GB Stripe Size 64KB Create RAID via No Init Done Notes 1 Before adding a new drive to an array back up any data contained on the new drive Otherwise all data will be lost 2 If you stop the build or clear process on a RAID 1 from ACU you can restart it by pressing Ctrl R 3 A RAID 1 created using the Quick Init option may return some data mis compares if you later run a consistency check This is normal and is not a cause for concern 4 The ACU allows you to use drives of different sizes in a RAID However during a build operation only the smaller drive can be selected as the Source or first drive 5 When migrating from single volume to RAID 0 migrating from a larger drive to a smaller drive is allowed However the destination drive must be at least half the capacity of the source drive 6 Adaptec does not recommend that you migrate or build an array on Windows dynamic disks volumes as it will result in data loss Warning Do not interrupt the creation of RAID 0 using the Migrate option If you do you will not be able to restart or to recover the data that was on the source drive C 9 SUPERSERVER 6014 8 Manual Adding a Bootable Array 1 From the Main menu select Manage Arrays 2 From the list of arrays select the array you want to make bootable and press Ctrl B 3 Enter Y to create a bootable array when the following message is dis played Th
100. tripe size Available stripe sizes are 16 32 and 64 KB default It is recommended that you do not change the default setting SUPERSERVER 6014 8 Manual frray Properties Array RAID O Stripe RAID 1 Mirror firray Label firray Size Stripe Size Create RAID via 4 The item Create RAID via allows you to select between the differ ent methods of creating RAID 0 and RAID 1 The following table gives examples of when each is appropriate Raid Level Create Via When Appropriate RAID 0 No Init Creating a RAID 0 on new drives RAID 0 Migrate Creating a RAID 0 from one new drive and Note one drive with data you wish to preserve RAID 1 Build1 Any time you wish to create a RAID 1 but especially if you have data on one drive that you wish to preserve RAID 1 Clear Creating a RAID 1 on new drives or when you want to ensure that the array contains no data after creation RAID 1 Quick Fastest way to create a RAID 1 Appropriate when using new drives RAID 1 Init 5 When finished press Done as shown on the following screen Note If you select Migrate for RAID 0 or Build for RAID 1 you will be asked to select the source drive The contents of the source drive will be preserved However the data on the new drive will be lost C 8 Appendix C Software Installation firray Properties Array RAID O Stripe Array Label S
101. unction This option alows you to select how the system may be resumed from the S3 S5 state The options are Space or Password Power Loss Control This setting allows you to choose how the system will react when power returns after an unexpected loss of power The options are Stay On Power Off and Last State Watch Dog This setting is for enabling the Watch Dog feature The options are Enabled and Disabled Summary Screen This setting allows you to Enable or Disable the summary screen P Memory Cache Cache System BIOS Area This setting allows you to designate a reserve area in the system memory to be used as a System BIOS buffer to allow the BIOS write cache its data into this reserved memory area Select Write Protect to enable this function and this area will be reserved for BIOS ROM access only Select Uncached to disable this function and make this area available for other devices Cache Video BIOS Area This setting allows you to designate a reserve area in the system memory to be used as a Video BIOS buffer to allow the BIOS write cache its data into this reserved memory area Select Write Protect to enable the function and this area will be reserved for BIOS ROM access only Select Uncached to disable this function and make this area available for other devices 7 8 Chapter 7 BIOS Cache Base 0 512K If enabled this feature will allow the data stored in the base memory area block 0 512K
102. ure SMB SMB Header Pin Definitions J11 A System Management Bus Pin header is located at J11 Connect Number m the appropriate cable here to uti s pn lize SMB on your system 4 No Connection 5 16 Chapter 5 Advanced Serverboard Setup SMB Power Connector Connect the SMB power connec tor to J32 located near DIMM slot 311A to utilize SMB Power Fault Connect a cable from your power supply to the Power Fail header JP9 to provide warning of power supply failure This warning sig nal is passed through the PWR LED pin to indicate of a power failure on the chassis See the table on the right for pin defini tions Overheat LED JOH1 Connect LED to the JOH1 header to provide warning of chassis overheating See the table on the right for pin defini tions Alarm Reset The system will notify you in the event of a power supply failure This feature assumes that Super micro redundant power supply units are installed in the chassis Connect a microswitch to JP11 to enable you to turn off the alarm that sounds when a power supply module fails See the table on the right for pin definitions 5 17 SMB PWR Pin Definitions J32 Pin Definition Clock Data N A N A N A akwon a Power Fail Pin Definitions JP9 Pin Number Definition 1 P S 1 Fail Signal 2 P S 2 Fail Signal 3 P S 3 Fail Signal 4 Reset from MB Note This feature is
103. ures The SC813S 500 is one of Supermicro s third generation 1U chassis and features four hot swap SCSI hard drive bays a slim CD ROM drive a slim 3 5 floppy drive and a revolutionary cooling design that can keep today s most powerful processors running well below their temperature thresholds The following is a general outline of the main features of the SC813S 500 chassis System Power When configured as a SuperServer 6014A 8 the SC813S 500 chassis in cludes a 500W cold swap power supply SCSI Subsystem The SCSI subsystem supports four 80 pin SCA Ultra320 SCSI hard drives Any standard 1 drives are supported SCA Single Connection Attach ment The SCSI drives are connected to an SCA backplane that provides power bus termination and configuration settings The SCSI drives are also hot swap units Control Panel The SC813S 500 control panel provides important system monitoring and control information LEDs indicate power on network activity hard disk drive activity and system overheat conditions Also present are a power button and a system reset button Backplane The SC813S 500 is a 10 rackmount chassis Its I O backplane provides one full height full length and one half height half length PCI slots one COM port the other is internal two USB ports a VGA port a SCSI port PS 2 mouse and keyboard ports and two Ethernet LAN ports SUPERSERVER 6014 8 Manual Cooling System SC813S 500
104. z PCI 66 MHz PCI X 66 MHz PCI X 100 MHz and PCI X 133 MHz Frequency for PCIX 1 G LAN This option allows the user to change the bus frequency of the devices installed in the slot indicated The options are Auto PCI 33 MHz PCI 66 MHz PCI X 66 MHz PCI X 100 MHz and PCI X 133 MHz Chapter 7 BIOS P PCI X 133MHz Slot 1 PCI Exp x4 Slot 2 PCI Exp x16 Slot 3 Access the submenu for each of the settings above to make changes to the following Option ROM Scan When enabled this setting will initialize the device expansion ROM The options are Enabled and Disabled Enable Master This setting allows you to enable the selected device as the PCI bus master The options are Enabled and Disabled Latency Timer This setting allows you to set the clock rate for Bus Master A high prioity high throughout device may benefit from a greater Clock rate The options are Default 0020h 0040h 0060h 0080h 00A0h 00COh and OOEOh For Unix Novell and other Operating Systems please select the option other If a drive fails after the installation of a new software you might want to change this settiing and try again Different OS requires different Bus Master clock rate Large Disk Access Mode This setting determines how large hard drives are to be accessed The options are DOS or Other for Unix Novellle NetWare and other operating systems gt Advanced Chipset Control Access the submenu to make changes to the followin

SuperMicro SERVER RACK|SUPMICRO 6014A

Contents

Download Pdf Manuals

Related Search

Related Contents