Home
SUPER MICRO Computer 6016T-6RF+ User's Manual
Contents
1. Op D z z AY E LH gt 2 zn EZ EE z S SE amp E Processor Processorto 9 i E ic Ka Ec F Ka Ka F HCH a az PORT1 PORT1 8 a ry a on on e X PORTO PORTO m Gen x16N PORT ONY 7 8 9 10 D E IOH E Gen2 x4 PORT 36D x 12 E E Gen2 x8 ery ul PORT 3 5 6 ESI CLINK D 3 ATMEL E AT25DF321 E oo s Gen2 x8 sPI 5 Lane Reversal Gen1 x4 ESI CLINK PCIE Port 1 4 gt KAWELA ICH10R PORT Gen1x2N KAWELA ILI 8 10 PCIE Port 5 6 RJ45 RJ45 Pci usa Lec saTa use IM E o J45 c g COMA SATA 0 USB 0 1 RJ45 RJ45 BMC SIO TPM SATA 1 USB 2 3 coms Ui SATA 2 USB 4 5 SATA 3 USB 6 SATA 4 USB 7 SATA 5 VGA SWITCH RJ45 PS2 KB MS VGA VGA 1 5 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 1 4 Contacting Supermicro Headquarters Address Super Micro Computer Inc 980 Rock Ave San Jose CA 95131 U S A Tel 1 408 503 8000 Fax 1 408 503 8008 Email marketing supermicro com General Information support supermicro com Technical Support Web Site www supermicro com Europe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Asia Pacific Address S
2. Wa REER NOAA gt RETIRA Ha A EG USE SUS Warnung Die L fter drehen sich u U noch wenn die L fterbaugruppe aus dem Chassis genommen wird Halten Sie Finger Schraubendreher und andere Gegenst nde von den Offnungen des L ftergeh uses entfernt Advertencia Los ventiladores podran dar vuelta cuando usted quite ell montaje del ventilador del chasis Mandtenga los dedos los destornilladores y todos los objetos lejos de las aberturas del ventilador Attention Il est possible que les ventilateurs soient toujours en rotation lorsque vous retirerez le bloc ventilateur du ch ssis Prenez garde ce que doigts tournevis et autres objets soient loign s du logement du bloc ventilateur ITIN U OTA rry OVNI JIN TINA WRIT pon AX Don WR TNA TINA Onn PNV mnay 229 nyaxan nx moa pn pmmn ols casa Jell Cpe As y yall AES A aie gad JAY e del Cl Gaal Ce sE pal lia all As y pall AES Alai e Lisi Lud cya la po y A RE S xd 3E AA up 329145 385p VS E cux dag SAMS PEGA E74 2 LAR ERA HE SAS Waarschuwing Het is mogelijk dat de ventilator nog draait tijdens het verwijderen van het ventilatorsamenstel uit het chassis Houd uw vingers schroevendraaiers en eventuele andere voorwerpen uit de buurt van de openingen in de ventilatorbehuizing 4 17 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Power Cable and AC Adapter A Warning When installing the product use the
3. Hard Drive Installation The hard drives are mounted in drive carriers to simplify their installation and removal from the chassis System power may remain on when removing carriers with drives installed These carriers also help promote proper airflow for the drive bays For this reason even empty carriers without drives installed must remain in the chassis Mounting a Hard Drive in a Drive Carrier 1 Insert a drive into the carrier with the printed circuit board side facing down so that the mounting holes align with those in the carrier 2 Secure the drive to the carrier with six screws as shown in Figure 6 3 Figure 6 3 Mounting a Drive in a Carrier Warning Use caution when working around the hard drive backplane Do not touch the backplane with any metal objects and make sure no ribbon cables touch the backplane or obstruct the holes which aid in proper airflow Warning Regardless of how many hard drives are installed all drive carriers must remain in the drive bays to maintain proper airflow 6 5 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Installing Removing a Hard Drive 1 To remove a carrier push the release button located beside the drive LEDs 2 Swing the colored handle fully out and use it to pull the unit straight out see Figure 6 4 Note Your operating system must have RAID support to enable the hot plug ca pability of the hard drives Release tab Figure 6 4 Removing a Drive
4. Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers Attention Danger d explosion si la pile n est pas remplac e correctement Ne la remplacer que par une pile de type semblable ou quivalent recommand e par le fabricant Jeter les piles usag es conform ment aux instructions du fabricant jAdvertencia Existe peligro de explosi n si la bater a se reemplaza de manera incorrecta Reemplazar la bater a exclusivamente con el mismo tipo o el equivalente recomendado por el fabricante Desechar las bater as gastadas seg n las instrucciones del fabricante ras onam v PPN RY 7792 1920109 572 199105 9w yis n130 np D n JIN 022 ARINI 1102 1199107 NN Ton mimm s yx35 v nwawan ni 2107 pY o dhli Anja A AR plas Ay Aalt Jaial Als lel ga jaa ellis Ay adl lagi Axicaall 4S Al dy Cu y LS Glas Le d gill uiis Jai la 4S ll least Cla All ja anle AN mau Sue 2143 93 329 39 ISE 712 Us 93144 AX IA Add ESA SI sugugeut rer suu AZAS He 4232 ME ES Ale spo Als Waarschuwing Er is ontploffingsgevaar indien de batterij verkeerd vervangen wordt Vervang de batterij slechts met hetzelfde of een equivalent type die door de fabrikant aanbevolen wordt Gebruikte batterijen dienen overeenkomstig fabrieksvoorschriften afgevoerd te
5. gt Hard Disk Drive CD DVD ROM Drive Removable Drive This feature allows the user to specify the boot sequence from all available hard disk drives The settings are Disabled and a list of all hard disk drives that have been detected i e 1st Drive 2nd Drive 3rd Drive etc 1st Drive SATA XXXXXXXXX Retry Boot Devices Select Enabled to enable Retry Boot Devices support to allow the system to attempt to boot from a specific boot device after a boot failure The options are Enabled and Disabled ier SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 7 6 Exit Options Select the Exit tab from the AMI BIOS Setup Utility screen to enter the Exit BIOS Setup screen BIOS SETUP UTILITY Save Changes and Exit Save Changes and Exit When you have completed the system configuration changes select this option to leave the BIOS Setup Utility and reboot the computer so the new system con figuration parameters can take effect Select Save Changes and Exit from the Exit menu and press lt Enter gt Discard Changes and Exit Select this option to quit the BIOS Setup without making any permanent changes to the system configuration and reboot the computer Select Discard Changes and Exit from the Exit menu and press lt Enter gt Discard Changes Select this option and press lt Enter gt to discard all the changes and return to the AMI BIOS Utility Program Load Optimal Defaults To set this feature select Lo
6. BEWAHREN SIE DIESE HINWEISE GUT AUF INSTRUCCIONES IMPORTANTES DE SEGURIDAD Este s mbolo de aviso indica peligro Existe riesgo para su integridad f sica Antes de manipular cualquier equipo considere los riesgos de la corriente el ctrica y familiaricese con los procedimientos est ndar de prevenci n de accidentes Al final de cada advertencia encontrar el n mero que le ayudar a encontrar el texto traducido en el apartado de traducciones que acompa a a este dispositivo GUARDE ESTAS INSTRUCCIONES IMPORTANTES INFORMATIONS DE S CURIT Ce symbole d avertissement indique un danger Vous vous trouvez dans une situation pouvant entrainer des blessures ou des dommages corporels Avant de travailler sur un quipement soyez conscient des dangers li s aux circuits lectriques et familiarisez vous avec les proc dures couramment utilis es pour viter les accidents Pour prendre connaissance des traductions des avertissements figurant dans les consignes de s curit traduites qui accompagnent cet appareil r f rez vous au num ro de l instruction situ la fin de chaque avertissement CONSERVEZ CES INFORMATIONS TIAN nnn mpn Manip VANVAT NR vmm nm YY PWYNT 920 9 99 nvms msan nnn man npn oy Twp 392 w 19099 79922 NPN IN NNW WI TTPA NWN mrs pasan nx n IN Ppns DRVI 3272 05 015 ONIIV 3p 1530 5v Dip 20970 138792 0222997 nan AN MIRAN 2199 18192 MD0IN NN RTP v 4 2 Warning Statements for AC Systems Ayan Abal ve c
7. nun xp YW 11 ony yD INVI CSA 2 1X UL 2 0550155 072392 nc 7292 TIP PIDIO vs DY PIX ROW INN an IW 55 3133 UL CSA AL jg SM GUUS sc Jua gill GUIS lade casa al Cus 2 Ae AA Gell Ml C ssa y ya sh dhe Si gas e cuu us A OY gs y LAS Gi alasin Ol A UL Y CSA OUST aii Esa ASSUM y al ga y A Y J ya Baixa Supermicro J ya Al lil pre al AL es eal GY UL CSA Aale Jor ill ox H E AAS AS ASSAY 444 AA AE AAAS ACHPHS ok Sc 1349 42 ASS OBEY SS THA ES Fae 4910 91g uu AL RA Electrical P and Material Safety aw e THIEN Apta EE SepIuSuEIl4m 1 n gt 4 i OH ba z sj Y ULETE CSAMA AGA AS C8 5 oll ee 241039 ASS A FU Cf uu de Waarschuwing Bij het installeren van het product gebruik de meegeleverde of aangewezen kabels stroomkabels en adapters Het gebruik van andere kabels en adapters kan leiden tot een storing of een brand Elektrisch apparaat en veiligheidsinformatiebladen wet verbiedt het gebruik van UL of CSA gecertificeerde kabels die UL of CSA die op de code voor andere elektrische apparaten dan de producten die door Supermicro alleen 4 19 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes 4 20 Chapter 5 Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install processors and heatsinks to the X8DTU 6TF X8DTU 6F serverboard connect the data and power cables and install add on cards All serverboard jumpers an
8. Only trained and qualified personnel should be allowed to install replace or service this equipment BS tin TEL NUI RQ REENK ARI MTOR EO RL PA ETSY EA Bia iNTOET EpL Ha RABE AACA A DAT RETER RIAR EAE gt Be RA Raa al A RIT ee EAS UA gt Warnung Das Installieren Ersetzen oder Bedienen dieser Ausr stung sollte nur geschultem qualifiziertem Personal gestattet werden jAdvertencia Solamente el personal calificado debe instalar reemplazar o utilizar este equipo Attention Il est vivement recommand de confier l installation le remplacement et la maintenance de ces quipements des personnels qualifi s et exp riment s FIN 937 1199 aw nn JW 3137 DN 99207 PPAT xU 73953 15015 nm Juli Jae Load A lately uf yl al y cula Sall iila gall lii caua C casa 73 11 tae Ya ee eae 9 3819 24 ars ES ALS aa gt AGUA 4 8 Chapter 4 Warning Statements for AC Systems Waarschuwing Deze apparatuur mag alleen worden geinstalleerd vervangen of hersteld door geschoold en gekwalificeerd personeel Restricted Area A Warning This unit is intended for installation in restricted access areas A restricted access area can be accessed only through the use of a special tool lock and key or other means of security This warning does not apply to workstatio
9. 3 Adjust both the short and long brackets to the proper distance so that the rail can fit snugly into the rack 4 Secure the short bracket to the front side of the outer rail with two M4 screws and the long bracket to the rear side of the outer rail with three M4 screws 5 Repeat these steps for the left outer rail Locking Tabs Both chassis rails have a locking tab which serves two functions The first is to lock the server into place when installed and pushed fully into the rack which is its normal position Secondly these tabs also lock the server in place when fully extended from the rack This prevents the server from coming completely out of the rack when you pull it out for servicing Figure 2 2 Installing the Rack Rails 25 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Installing the Server into the Rack Installing the Chassis into a Rack Figure 2 3 1 Confirm that chassis includes the inner rails and rail extensions Also confirm that the outer rails are installed on the rack 2 Line chassis rails with the front of the rack rails 3 Slide the chassis rails into the rack rails keeping the pressure even on both sides you may have to depress the locking tabs when inserting When the server has been pushed completely into the rack you should hear the locking tabs click 4 Optional Insert and tightening the thumbscrews that hold the front of the server to the rack Installing the Server
10. Supero Doctor III allows a user to inform the OS to reboot or shut down the system within 30 seconds On the system console a pop up window will appear with a message telling the local user to save his working files Before the system reboots or shuts down it s allowed to cancel the action either locally or remotely Power control noncancelable Supero Doctor III allows a user to inform the OS to reboot or shut down the system right away The system will reboot or shut down without any warning messages It s not allowed to cancel the action E Note The SuperDoctor III program and User s Manual can be downloaded from the Supermicro web site at http www supermicro com products accessories soft ware SuperDoctorlll cfm For Linux we recommend that you use the SuperDoctor Il application instead 5 13 Onboard Battery Please handle used batteries carefully Do not damage the battery in any way a damaged battery may release hazardous materials into the environment Do not discard a used battery in the garbage or a public landfill Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly Figure 5 8 Installing the Onboard Battery LITHIUM BATTERY SE BATTERY HOLDER Chapter 6 Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform mainte nance on the SC819TQ chassis For
11. 5 short beeps 1 long Memory error system beep Video adapter missing or with faulty memory Display memory read write error Continuous High pitch System OH System Overheat Low pitch siren like 8 beeps A 1 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes Appendix B System Specifications Appendix B System Specifications Processors Single or dual Intel 5500 5600 Series processors in LGA1366 sockets Note Please refer to our web site for a complete listing of supported processors Chipset Intel 5520 ICH10R chipset BIOS 32 Mb AMI SPI Flash ROM Memory Capacity Eighteen DIMM sockets supporting up to 288 GB of registered ECC DDR3 1333 1066 800 or 48 GB of unbuffered ECC non ECC DDR3 1333 1066 800 SDRAM See the memory section in Chapter 5 for details SAS Controller LSI 2108 SAS controller for eight port SAS which supports RAID 0 1 5 6 10 50 and 60 RAID 5 supported with Windows OS only SATA Controller Intel ICH10R on chip controller for six port SATA which supports RAID 0 1 5 and 10 RAID 5 supported with Windows OS only Drive Bays Four hot swap drive bays to house SAS or SATA drives Peripheral Drive Bays One slim DVD ROM drive B 1 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Expansion Slots Left side two PCI E x8 add on cards w RSC R1UU 2E8 riser Right side one PCI E x8 card w RSC R1UU E8R riser Serverboard 6016T
12. Advanced Configuration and Power Interface protocol The options are Disabled and Enabled gt Advanced Chipset Control The items included in the Advanced Settings submenu are listed below gt QPI and IMC Configuration QuickPath Interconnect QPI is the connection between the CPU and the motherboard s I O hub Use this feature to modify speed and power manage ment settings CPU Revision This item displays the CPU revision number Current QPI Frequency This item displays the current QPI frequency Current Memory Frequency This item displays the current CPU memory frequency Chapter 7 BIOS e Memory Reference Code This item displays the memory reference code for the motherboard e QPI Reference Code This item displays the QPI reference code for the moth erboard QPI Quick Path Interconnect Links Speed QuickPath Interconnect QPI is the connection between the CPU and the motherboard s I O hub Use this feature to set data transfer speed for QPI Link connections The options are Slow Mode and Full Speed QPI Frequency Available if the item QPI Link Speed is set to Full Speed This feature allows the user to select the desired QPI frequency The options are Auto 4 800 GT 5 866GT 6 400 GT QPI LOs and L1 This feature allows the user to set the QPI power state to a low setting LOs and L1 are automatically selected by the motherboard The options are Disabled and Enabled Memory Frequency
13. These LEDs provide you with critical information related to different parts of the system This section explains what each LED indicates when illuminated and any corrective action you may need to take U UID Overheat Fan Fail Power Fail Blue This LED turns on when either the front or the rear UID button is pushed Pushing either button a second time will turn this LED off Red When this LED flashes quickly it indicates a fan failure When flashing slowly it indicates a power supply failure When on continuously on and not flashing it indicates an overheat condition which may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm Check the routing of the cables and make sure all fans are present and operating normally You should also check to make sure that the chassis covers are installed Finally verify that the heatsinks are installed properly see Chapter 5 This LED will remain flashing or on as long as the overheat condition exists on NIC2 Indicates network activity on GLAN2 when flashing E NIC1 Indicates network activity on GLAN1 when flashing R HDD Indicates IDE channel activity On the 6016T 6RFT 6016T 6RF this light indicates HDD and or DVD ROM drive activity when flashing 3 2 Chapter 3 System Interface e Da nts Power Indicates power is being supplied to the system s power supply units This LED should normally be illuminated when
14. chassis overheating or fan failure These pins also work with the front UID indicator which will activate as either a solid or flashing blue LED depending on whether the LED was activated via IPMI or the UID button Refer to the tables on the right for pin definitions and status indicators Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1 Refer to the table on the right for pin defini tions Reset Button The Reset Button connection is lo cated on pins 3 and 4 of JF1 Attach it to the hardware reset switch on the computer case Refer to the table on the right for pin definitions Power Button The Power Button connection is located on pins 1 and 2 of JF1 Mo mentarily contacting both pins will power on off the system This button can also be configured to function as a suspend button see the Power Button Mode setting in BIOS To turn off the power when set to suspend mode depress the button for at least 4 seconds Refer to the table on the right for pin definitions 5 17 Chapter 5 Advanced Serverboard Setup OH Fan Fail PWR Fail Blue_UID LED Pin Definitions JF1 Pin Definition 7 Blue LED Cathode UID 8 OH Fan Fail PWR Fail UID LED OH Fan Fail PWR Fail LED Status Red LED Blue LED On OH FF Pwr Fail Off Solid On OH Fast Blinking Fan Fail Slow Blinking Pwr Fail Off System normal On UID LED Off Off Power Fail LED Pin Definitions JF
15. product may expose you to lead a chemical known to the State of California to cause birth defects and other repro ductive harm Manual Revision 1 0 Release Date August 26 2013 Unless you request and receive written permission from Super Micro Computer Inc you may not copy any part of this document Information in this document is subject to change without notice Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders Copyright 2013 by Super Micro Computer Inc All rights reserved Printed in the United States of America Preface Preface About This Manual This manual is written for professional system integrators and PC technicians It provides information for the installation and use of the SuperServer 6016T 6RFT 6016T 6RF Installation and maintenance should be performed by expe rienced technicians only Manual Organization Chapter 1 Introduction The first chapter provides a checklist of the main components included with the server system and describes the main features of the X8DTU 6TF X8DTU 6F serverboard and the SC819TQ R700U chassis which comprise the SuperServer 6016T 6RFT 6016T 6RF Chapter 2 Server Installation This chapter describes the steps necessary to install the SuperServer into a rack and check out the server configuration prior to powering up the system If your server was ordered without processor and
16. 2 7 Checking the Drive Bay Setup Next you should check to make sure the peripheral drives and the hard drives and backplane have been properly installed and all connections have been made Checking the Drives 1 All drives are accessable from the front of the server The hard disk drives can be installed and removed from the front of the chassis without removing the top chassis cover A slim DVD ROM drive should be preinstalled in your server For servicing the DVD ROM drive you will need to remove the top chassis cover Refer to Chapter 6 if you need to reinstall a DVD ROM drive to the system Depending upon your system s configuration your system may have one or more drives already installed If you need to install hard drives please refer to Chapter 6 Checking the Airflow 1 Airflow is provided by five sets of 4 cm fans each set of fans consists of two fans that are mounted back to back The system component layout was carefully designed to direct sufficient cooling airflow to the components that generate the most heat Note that all power and data cables have been routed in such a way that they do not block the airflow generated by the fans Providing Power T The last thing you must do is to provide input power to the system Plug the power cord from the power supply module into a high quality power strip that offers protection from electrical noise and power surges It is recommended that you use an uninte
17. 6RFT X8DTU 6TF Proprietary form factor 6016T 6RF X8DTU 6F Proprietary form factor Dimensions 16 5 x 12 8 in 419 x 325 mm Chassis SC819TQ R700U 1U rackmount Dimensions WxHxD 19 x 1 7 x 27 75 in 483 x 43 x 705 mm Weight Gross Weight 38 5 lbs 17 5 kg System Cooling Five 4 cm counter rotating fans FAN 0086L 4 System Input Requirements AC Input Voltage 100 240 VAC Rated Input Current 10 4A Rated Input Frequency 50 to 60 Hz Power Supply Rated Output Power 700W Part PWS 703P 1R Rated Output Voltages 12V 58A 5Vsb 3A Operating Environment Operating Temperature 10 to 35 C 50 to 95 F Non operating Temperature 40 to 70 C 40 to 158 F Operating Relative Humidity 20 to 95 non condensing Non operating Relative Humidity 5 to 95 non condensing B 2 Appendix B System Specifications Regulatory Compliance Electromagnetic Emissions FCC Class A EN 55022 Class A EN 61000 3 2 3 3 CISPR 22 Class A Electromagnetic Immunity EN 55024 CISPR 24 EN 61000 4 2 EN 61000 4 3 EN 61000 4 4 EN 61000 4 5 EN 61000 4 6 EN 61000 4 8 EN 61000 4 11 Safety CSA EN IEC UL 60950 1 Compliant UL or CSA Listed USA and Canada CE Marking Europe California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warning applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may app
18. JF1 Refer to the table on the right for pin definitions 19 Control Ground Power LED Power LED Pin Definitions JF1 The Power LED connection is located Ping Definition on pins 15 and 16 of JF1 Refer to the 15 VE table on the right for pin definitions i6 Control HDD LED UID Switch The HDD LED UID switch connec tions are located on pins 13 14 of JF1 Attach an LED cable to display HDD HDD UID Switch activity This connection can also be Pin Definitions JF1 used as a front panel UID Unit Identi Pin Definition fier switch The UID LED on pin 7 of 13 UID Signal 3 3V SB JF1 works in conjunction with this UID HD Active switch When the user presses and releases the UID switch the UID LED will be turned on or off to indicate the location of the unit NIC1 LED The NIC1 Network Interface Control ler LED connection is located on pins 11 and 12 of JF1 Attach the NIC1 LED cable to display network activity Refer to the table on the right for pin definitions Pin Definition 11 vec NIC2 LED The NIC2 Network Interface Control NIC2 LED ler LED connection is located on SE pins 9 and 10 of JF1 Attach the NIC2 LED cable to display network activity Refer to the table on the right for pin definitions Pin Definition 9 Vcc 10 Ground 5 16 Overheat OH Fan Fail PWR Fail UID LED Connect an LED to pins 7 and 8 of JF1 to provide advanced warning of
19. LEDs The Ethernet ports located beside the VGA port have two LEDs On each Gigabit LAN port one LED indicates activity when blinking while the other LED may be green amber or off to indicate the speed of the connection See the table on the right for the func tions associated with the connection speed LED Dedicated IPMI LAN LEDs In addition to LAN1 and LAN2 a dedi cated IPMI LAN is located on the I O backpanel The amber LED indicates activity while the Link LED indicates the speed of the connection See the tables at right for more information LE1 An Onboard Power LED is located at LE1 on the serverboard When this LED is lit the system is on Be sure to turn off the system and unplug the power cord before removing or install ing components See the table at right for more information UID LED The rear UID LED is located at the I O backplane This LED is used in conjunction with the rear UID switch to provide easy identification of a system that might be in need of service 5 25 Chapter 5 Advanced Serverboard Setup Activity LED E Link LED LAN LED Connection Speed Indicator LED Color Definition Off No connection or 10 Mb s Green 100 Mb s Amber 1 Gb s Link LED E Activity LED IPMI LAN Activity Indicator Status Defi Flashing Active IPMI LAN Indicator LED Color Definition Off No Connection or 10 Mb s Green 100 Mb s
20. Leif pil bas ll ode jaa SS ai daala sla alii DAS ja hii 5 sane Aii ell gna sll Z OLY 5 pS Alban el d cha y J SE ol FAE duele TAA BARES ARAGUA STET HF dp o 7 EE AH RF PUE SAAT HU steel Salz VST Waarschuwing Dit apparaat is bedoeld voor installatie in gebieden met een beperkte toegang Toegang tot dergelijke gebieden kunnen alleen verkregen worden door gebruik te maken van speciaal gereedschap slot en sleutel of andere veiligheidsmaatregelen Battery Handling A Warning There is the danger of explosion if the battery is replaced incorrectly Replace the battery only with the same or equivalent type recommended by the manufacturer Dispose of used batteries according to the manufacturer s instructions UOMO FEU ASAD EUS TT DNED IEA MRA OSE ES LAS SEIT d FAD MESES 7 3x 7 0 IO 0 Ze Pv BED DEI Bi COPA che 2C UC FEW HU SH LI AAA gt T8 5 FH A FRE Si 28 RR PEECE RJ TRE TH SR FRE E TR SUE FEE gt TAE AN VH BB H FE e SEU TAT EE EUH RYE RS DS SH DEF SOS TS E TH Ie EEES SUE G E DEM H re GES ES TRUE o di 14 Chapter 4 Warning Statements for AC Systems
21. M A R T For Hard disk drives Self Monitoring Analysis and Reporting Technology SMART can help predict impending drive failures Select Auto to allow the AMI BIOS to automatically de tect hard disk drive support Select Disabled to prevent the AMI BIOS from using the S M A R T Select Enabled to allow the AMI BIOS to use the S M A R T to support hard drive disk The options are Disabled Enabled and Auto 32Bit Data Transfer Select Enable to enable the function of 32 bit IDE data transfer The options are Enabled and Disabled gt PCI PnP Configuration Clear NVRAM This feature clears the NVRAM Non Volatile Random Access Memory during system boot The options are No and Yes 7 14 Chapter 7 BIOS Plug amp Play OS Selecting Yes allows the OS to configure Plug amp Play devices This is not required for system boot if Plug amp Play is supported by your OS Select No to allow the AMI BIOS to configure all devices in the system PCI Latency Timer This feature sets the latency Timer of each PCI device installed on a PCI bus Select 64 to set the PCI latency to 64 PCI clock cycles The options are 32 64 96 128 160 192 224 and 248 PCI Cache Line Size This feature sets the cache line size of each PCI device installed on a PCI bus The options are 16 32 64 and 128 MB PCI IDE BusMaster When enabled the BIOS uses PCI bus mastering for reading writing to IDE drives The options are Disabled and Enab
22. Speaker m Ethernet y N Controller S o Battery BS es El JPTLAN C3 x 2 FAN8 CPU1 kd Q m N o X o 3 SAS BBU Y Vy By Vy UV V UV U U menm x nd Bras lena nad o e e CPU1 al 9 9 ole o alas ge So Ez z zzz SH SH S Z S zziz S S e gt Ni NI NI Ol gt O Di gt O w gt S0 3 SAS4 7 wn CH we 1 PM LSI 2108 5 3 SAS LED6 Controller LEDS EX Ja SUPER X8DTU 6TF T m E E LED3 JWD1B e Bc Nig DW JBT1 Intel uixixiu uiu al uu 10H36D NIN YR n n m PY P m E ii SESS sv intel ON z z z 2 Siss CPU2 SI ICH10R BIOS 8585552zss S z Is i hz N c SATAD Ellen p z o ei 3 z 5 SJL LESATAZ i 2 3 213 N g SAID WET Pamm es zz 29 Sy leis Lou USB7 JH ZZ SS Wm f C ESATAS gme pa FANG ESE E FANS E S w e JE lS E j j 8 fey eer N T SGPIO1 02 Notes TLAN1 and TLAN 2 are included on the X8DTU 6TF 6016T 6RFT only Jumpers not indicated are for test purposes only When LED1 the onboard power indic
23. This feature forces a DDR3 module to run at a frequency other than what the sys tem has detected Select Force SPD Serial Presence Detect to force the module to run at a frequency specified on the SPD table The available options are Auto Force DDR 800 Force DDR 1066 Force DDR 1333 and Force SPD Memory Mode If this item is set to Independent all DIMMs are available to the operating system If this item is set to Channel Mirroring the motherboard maintains two identical copies of all data in memory for redundancy If this item is set to Lockstep the motherboard uses two areas of memory to run the same set of operations in parallel The options are Independent Channel Mirroring and Lockstep Demand Scrubbing This is a memory error correction scheme when the Processor writes corrected data back into the memory block from where it was read by the Processor The options are Enabled and Disabled Patrol Scrubbing This is a memory error correction scheme that works in the background looking for and correcting resident errors The options are Enabled and Disabled 7 9 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Channel Interleave This feature allows the user to configure the Memory Interleave settings for an onboard memory channel The options are 1 way 2 way 3 way 4 way and 6 way Bank Interleave This feature allows the user to configure the Memory Interleave settings for an onboard memory bank The options are
24. This submenu displays the status of the processor used in the motherboard and allows the user to configure the Processor and Clock settings e Type of the CPU This item displays the CPU type for the motherboard e Frequency This item displays the CPU frequency for the motherboard e CPUID This item displays the CPUID for the motherboard e Microcode Revision This item displays the CPUID for the motherboard e Cache L1 This item displays the size of Cache L1 of the CPU for the moth erboard 7 5 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual e Cache L2 This item displays the size of Cache L2 of the CPU for the moth erboard e Cache L3 This item displays the size of Cache L3 of the CPU for the moth erboard e Ratio Status This item displays the status of the CPU ratio e Ratio Actual Value This item displays the actual value of the CPU ratio CPU Ratio Select Manual to manually configure the CPU Ratio Select Auto to allow the BIOS to automatically configure the CPU Ratio The options are Auto and Manual Clock Spread Spectrum Select Enable to enable Clock Spectrum support to allow the BIOS to monitor and attempt to reduce the level of Electromagnetic Interference caused by the compo nents whenever needed The options are Disabled and Enabled Hardware Prefetcher Available when supported by the CPU If set to Enabled the hardware prefetcher will prefetch streams of data and instruc tions from the main me
25. a component from the rack You should extend only one component at a time extending two or more si multaneously may cause the rack to become unstable Server Precautions Review the electrical and general safety precautions in Chapter 4 Determine the placement of each component in the rack before you install the rails Install the heaviest server components on the bottom of the rack first and then work up Use a regulating uninterruptible power supply UPS to protect the server from power surges voltage spikes and to keep your system operating in case of a power failure Allow the hot plug SAS SATA drives and power supply modules to cool before touching them Always keep the rack s front door and all panels and components on the servers closed when not servicing to maintain proper cooling 2 2 Chapter 2 Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi unit rack assembly the ambient operating tempera ture of the rack environment may be greater than the ambient temperature of the room Therefore consideration should be given to installing the equipment in an environment compatible with the manufacturer s maximum rated ambient tempera ture Tmra Reduced Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised Mechanical Loading Equipment should be mounted into a ra
26. component installation follow the steps in the order given to eliminate the most common problems encountered If some steps are unnecessary skip ahead to the next step Tools Required The only tool you will need to install components and perform maintenance is a Philips screwdriver 6 1 Static Sensitive Devices Electrostatic Discharge ESD can damage electronic components To prevent damage to any printed circuit boards PCBs it is important to handle them very carefully The following measures are generally sufficient to protect your equipment from ESD damage Precautions Use a grounded wrist strap designed to prevent static discharge e Touch a grounded metal object before removing any board from its antistatic bag Handle a board by its edges only do not touch its components peripheral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their antistatic bags when not in use For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 6 1 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Figure 6 1 Chassis Front and Rear Views Slim DVD ROM Control Panel 2 NTR Re a 7
27. during POST The options are Enabled and Disabled Interrupt 19 Capture Interrupt 19 is the software interrupt that handles boot disk functions When this item is set to Enabled the ROM BIOS of the host adaptors will capture Interrupt 19 at bootup and allow the drives that are attached to these host adaptors to function as bootable disks If this item is set to Disabled the ROM BIOS of the host adap tors will not capture Interrupt 19 and the drives attached to these adaptors will not function as bootable devices The options are Enabled and Disabled Watch Dog Function If enabled the Watch Dog Timer will allow the system to reboot when it is inactive for more than 5 minutes The options are Enabled and Disabled Power Button Function If this feature is set to Instant_Off the system will power off immediately as soon as the user hits the power button If this feature is set to 4 Second Override the system will power off when the user presses the power button for 4 seconds or longer The options are Instant Off and 4 Second Override Restore on AC Power Loss Use this feature to set the power state after a power outage Select Power Off for the system power to remain off after a power outage Select Power On for the system power to turn on after a power outage Select Last State to allow the system to resume its last state before a power outage The options are Power On Power Off and Last State Processor and Clock Options
28. exceed 255 Subnet Mask When IP Address Source is set to Static This item displays the current subnet mask setting for your IPMI connection The value of each three digit number separated by dots should not exceed 255 Gateway Address When IP Address Source is set to Static The BIOS will automatically enter the Gateway address for the system when the IP Address Source is set to Static It can also allow the user to set a Gateway address for the system If the IP Address Source is set to DHCP However the Gateway address may be overwritten The value of each three digit number separated by dots should not exceed 255 MAC Address When IP Address Source is set to Static The BIOS will automatically enter the MAC address for the system when the IP Address Source is set to Static It can also allow the user to set an MAC ad dress for the system If the IP Address Source is set to DHCP However the MAC address may be overwritten Mac addresses are 6 two digit hexadecimal numbers Base 16 0 9 A B C D E F separated by dots i e 00 30 48 DO D4 60 BMC Watch Dog Timer Action Allows the BMC to reset or power down the system if the operating system hangs or crashes The options are Disabled Reset System Power Down Power Cycle If the feature is not set to Disabled the following item will display BMC Watch Dog TimeOut Min Sec This option appears if BMC Watch Dog Timer Action above is enabled This is a ti
29. for pin definitions Fan Headers The board has eight fan headers designated Fan1 through Fan8 FAN1 through FAN6 are for chassis system Pin Definition 1 Ground Black fans while FAN7 and FANS are used 2 12V Red for CPU heatsink fans Their speed is 3 Tachometer controlled via Thermal Management 4 PWM Control with a BIOS setting See the table on the right for pin definitions 5 18 Chassis Intrusion A Chassis Intrusion header is located at JL1 Attach the appropriate cable to inform you of a chassis intrusion ATX PS 2 Keyboard and PS 2 Mouse Ports The ATX PS 2 keyboard and the PS 2 mouse ports are located beside the USB ports See the table on the right for pin definitions Overheat Fan Fail LED Connect an LED to the JOH1 header to provide warning of a chassis overheat ing or fan fail condition See the table on the right for pin definitions SGPIO The two headers labeled T SGPIO 1 and T SGPIO 2 are for SGPIO Se rial General Purpose Input Output SGPIO supports serial link interfaces for onboard SATA and SAS ports Con nect the appropriate cables from the backplane to the SGPIO1 and SGPIO2 headers to utilize SATA SAS manage ment functions on your system 5 19 Chapter 5 Advanced Serverboard Setup Chassis Intrusion Pin Definitions Pin Definition 1 Intrusion Input 2 Ground PS 2 Keyboard and Mouse Ports Pin Definitions Pin Definition
30. from the Server Hard Drive Backplane The hard drives plug into a backplane that provides power and drive ID A RAID controller can be used with the backplane to provide data security The operating system you use must have RAID support to enable the hot swap capability of the drives The backplane is already preconfigured so there are no jumpers or switches present on it 6 6 Chapter 6 Advanced Chassis Setup DVD ROM Drive Installation The top cover of the chassis must be opened to gain full access to the DVD ROM drive bay The 6016T 6RFT 6016T 6RF accomodates only slim DVD ROM drives Side mounting brackets are needed to mount a slim DVD ROM drive in the 6016T 6RFT 6016T 6RF server You must power down the system before installing or removing a DVD ROM drive Removing the Chassis Cover jn Grasp the two handles on either side and pull the unit straight out until it locks you will hear a click Depress the two buttons on the top of the chassis to release the top cover and at the same time push the cover away from you until it stops You can then lift the top cover from the chassis to gain full access to the inside of the server Removing Installing a Drive T With the chassis cover removed unplug the power and data cables from the drive you want to remove Locate the locking tab at the rear of the drive It will be on the left side of the drive when viewed from the front of the chassis Pull the tab a
31. into a rack unit with the rack rails provided If the system has already been mounted into a rack you can skip ahead to Sections 2 5 and 2 6 There are a variety of rack units on the market which may mean the assembly procedure will differ slightly You should also refer to the installation instructions that came with the rack unit you are using Identifying the Sections of the Rack Rails You should have received two rack rail assemblies in the rack mounting kit Each assembly consists of two sections an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself see Figure 2 1 Two pairs of short brackets to be used on the front side of the outer rails are also included Installing the Inner Rails Both the left and right side inner rails have been pre attached to the chassis Pro ceed to the next step Figure 2 1 Identifying the Sections of the Rack Rails left side rail shown Inner Rail Locking Tab Outer Rail Warning do not pick up the server with the front handles They are de signed to pull the system from a rack only 2 4 Chapter 2 Server Installation Installing the Outer Rails Installing the Outer Rails to the Rack 1 Measure the distance from the front rail to the rear rail of the rack 2 Attach a short bracket to the front side of the right outer rail and a long bracket to the rear side of the right outer rail
32. memory components this chapter will refer you to the appropriate sections of the manual for their installation Chapter 3 System Interface Refer here for details on the system interface which includes the functions and information provided by the control panel on the chassis as well as other LEDs located throughout the system Chapter 4 Warning Statements You should thoroughly familiarize yourself with this chapter for a general overview of safety precautions that should be followed when installing and servicing the SuperServer 6016T 6RFT 6016T 6RF SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Chapter 5 Advanced Serverboard Setup Chapter 5 provides detailed information on the X8DTU 6TF X8DTU 6F serverboard including the locations and functions of connections headers and jumpers Refer to this chapter when adding or removing processors or main memory and when reconfiguring the serverboard Chapter 6 Advanced Chassis Setup Refer to Chapter 6 for detailed information on the SC819TQ R700U server chassis You should follow the procedures given in this chapter when installing removing or reconfiguring SATA or peripheral drives and when replacing system power supply modules and cooling fans Chapter 7 BIOS The BIOS chapter includes an introduction to BIOS and provides detailed informa tion on running the CMOS Setup Utility Appendix A BIOS Error Beep Codes Appendix B System Specifications Preface No
33. ports designated LAN1 and LAN2 are located beside the VGA port on the I O backplane A dedicated IPMI LAN port is also located above USB1 These ports accept RJ45 type cables 5 20 UIO Power Connector A Universal I O power connector UIOP is located next to the UID button This is a required connection for the riser cards installed on the serverboard Connect the UIOP con nector to the power supply to provide adequate power to the installed add on cards installed for them to function properly See the table on the right for pin definitions 10Gb TLAN Ports and SFP Devices X8DTU 6TF Two 10Gb Ethernet ports TLAN1 2 with Small_Form Factor Pluggable Device support are located at on the I O backplane on the X8DTU 6TF SAS BBU Connector A SAS Battery Backup Unit BBU connector is located near the SAS ports In the event of a power out age the BBU unit will provide backup power for SAS connection use Part BTR 0018L 0000 LSI 5 21 Chapter 5 Advanced Serverboard Setup Universal I O Power Connector Pin Definitions Pin Definition Pin Definition B1 P5V A1 P3V3 B2 P5V A2 P3V3 B3 P5V A3 P3V3 B4 P5V A4 P3V3 B5 P5V A5 P3V3 B6 P5V A6 P3V3 B7 P5V A7 P3V3 B8 P5V A8 P3V3 B9 P5V A9 P3V3 B10 P5V A10 P3V3 B11 N12V A11 P3V3 B12 P3V3 A12 P3V3 STBY B13 P3V3 A13 P12V STBY B14 Ground A14 P12V B15 Ground A15 P12V B16 Ground A16 P12V B17 Ground A17 P12V B18 Ground A18 Ground SUPERSER
34. provided or designated connection cables power cables and AC adaptors Using any other cables and adaptors could cause a malfunction or a fire Electrical Appliance and Material Safety Law prohibits the use of UL or CSA certified cables that have UL CSA shown on the code for any other electrical devices than products designated by Supermicro only SR FLEACVRTA Be RES DA PEER TAE ENCE T IV EI REACP 27 A ZH Fev MOTD VPP 27 ZL SH ERK oC tin DES WRN MAKES ULE CSABEO7 TIV UL CSEY FMA FICK nt Supermicro RES SALL Ind SC S LCE BE A ESE EP iul ife AA Be AY STE EE BEZE RE AC SS PARC Hampi AY BESS PECK SK gt GR SupermicroPrts eA in HOA RUE REESE ERLE SE IE RE FHARASULERCSAVA TERS ZR gt ERE ES Ed UL ICAL En EAE E a SE E FH AI E e GER J STE ER AAA ERE TERR T aA ae AC AE e SES K SE gt ER l SupermicroHriBaERJ Edna BAA au RA HARE SE LI DI Lt GC A ps gt Sb EE EIURUL CSARTSR Warnung Bei der Installation des Produkts die zur Verf gung gestellten oder benannt Anschlusskabel Stromkabel und Netzteile Verwendu
35. you will need to power off and restart the system for the change to take effect Please refer to Intel s web site for detailed information Execute Disable Bit Capability Available when supported by the OS and the CPU Set to Enabled to enable Execute Disable Bit support which will allow the proces sor to designate areas in the system memory where an application code can be executed and where it cannot thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor or damage the system during an attack The default is Enabled Refer to Intel and Microsoft Web Sites for more information Intel AES NI Available when supported by the OS and the CPU It set to enabled Intel AES NI will add new encryption features to help accelerate AES SW application and provide code authorization and signature verification to improve system performance The default is Enabled Refer to Intel and Microsoft Web Sites for more information Simultaneous Multi Threading Available when supported by the CPU Set to Enabled to use the Simultaneous Multi Threading Technology which will result in increased CPU performance The options are Disabled and Enabled Active Processor Cores Set to Enabled to use a processor s Second Core and beyond Please refer to Intel s web site for more information The options are All 1 and 2 Intel EIST Technology EIST Enhanced Intel SpeedStep Technology allows the system to automatically
36. 00 Hard Drive Bays 4 Power Supplies IPMI LAN USB Ports PCI Expansion Slots w riser cards REIS Bo mg jil ei Es dic 3 lo EOD Go Es Mouse Keyboard Ports COM1 Port VGA Port Ethernet LAN Ports The 6016T 6RF has two 1 Gb Ethernet ports while the 6016T 6RFT has two 1 Gb and two 10 Gb ports 6 2 Control Panel The control panel located on the front of the chassis must be connected to the JF 1 connector on the serverboard to provide you with system status indications These wires have been bundled together as a ribbon cable to simplify the connection Connect the cable from JF1 on the serverboard to the appropriate header on the Control Panel PCB printed circuit board Make sure the red wire plugs into pin 1 on both connectors Pull all excess cabling out of the airflow path The control panel LEDs inform you of system status See Chapter 3 System In terface for details on the LEDs and the control panel buttons Details on JF1 can be found in Chapter 5 Advanced Server
37. 1 Pin Definition 5 Vcc Ground Reset Button Pin Definitions JF1 Pin Definition 3 Reset Ground Power Button Pin Definitions JF1 Pin Definition 1 PW ON Ground SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual ial P Pin Definiti Serial Ports Serial Port Pin Definitions i Pin Definition Pin Definition The COM serial port is located on l 1 DCD 6 DSR the I O backplane COM2 is a header 2 RXD 7 RTS on the serverboard see serverboard 3 TXD a CTS layout for location See the table on 4 DTR 9 RI the right for pin definitions 5 Ground 10 NC Note Pin 10 is included on the header but not on the port NC indicates no connection USB Ports Front Panel USB USBO0 1 6 Pin Definitions Pin Definition m S oe Universal Serial Bus Ports 1 asv dci NM dd 1 5V 1 5V Two Universal Serial Bus ports are 2 PO 5 PO 2 PO located on the I O backplane USBO 3 PO 3 PO 3 PO is the bottom connector and USB1 4 Ground d Ground 4 Ground is the top connector USB4 5 7 are 5 NA 5 Key 5 NC headers provided for front panel ac NC No connection cess cables not included and USB6 Internal USB Pin Definitions USB 7 Pin 4 Defini Pin 4 Defini tion tion 1 PWR 2 Ground 3 USBD 4 Ground 5 USBD 6 Ground 7 Ground 8 Ground 9 NA 10 Ground is a Type A port see board layout for locations See the table on the right
38. 1 Data Nc Ground vec Clock Overheat Fan Fail LED Pin Definitions Pin Definition 1 5V Active OH Fan Fail LED Status State Message Solid Overheat Blinking Fan Fail SGPIO Pin Definitions Pin Definition Pins Definition 1 NC 2 wc Ground 4 Data Load 6 Ground NC NC Note NC indicates no connection SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual IPMB IPMB Pin Definitions Pin Definition A System Management Bus header for IPMI 2 0 is located at IPMB Connect the appropriate cable here to use the IPMB IC connection on your system 1 Data Ground 2 3 4 No Connection DOM Power Connector DOM PWR Pin Definitions A power connector for SATA DOM Disk_On_Module Devices is located at JWF1 Connect the appropriate cable here to provide power support for your DOM devices Pin Definition 1 45V 2 Ground Ground UID Buttons There are two Unit Identification UID buttons on the serverboard The Front Panel UID Switch connects to pin 13 of JF1 The Rear UID Switch SW1 is located next to the last LAN port Pushing the UID switch on the Front Control Panel will illuminate both the Rear UID and the Control Panel UID indicators Push the either switch again to turn off both indicators These UID indicators provide easy identifica tion of a system that may be in need of service LAN Ethernet Ports Two Ethernet
39. 1 way 2 way and 4 way Throttling Closed Loop Throttling improves reliability and reduces power in the processor by automatic voltage control during processor idle states Available options are Disabled and Enabled Intel UOAT The Intel I OAT I O Acceleration Technology significantly reduces CPU overhead by leveraging CPU architectural improvements freeing resources for more other tasks The options are Disabled and Enabled DCA Technology Available when Intel I OAT is enabled Select Enabled to use Intel s DCA Direct Cache Access Technology to enhance data transfer efficiency The options are Enabled and Disabled DCA Prefetch Delay A DCA Prefetch is used with TOE components to prefetch data in order to shorten execution cycles and maximize data processing efficiency Prefetching too frequently can saturate the cache directory and delay necessary cache accesses This feature reduces or increases the frequency the system prefetches data The options are 8 16 24 32 40 48 56 64 72 80 88 96 104 112 120 Intel VT d Select Enabled to enable Intel s Virtualization Technology support for Direct I O VT d by reporting the I O device assignments to VMM through the DMAR ACPI Tables This feature offers fully protected I O resource sharing across the Intel platforms providing the user with greater reliability security and availability in networking and data sharing The options are Enabled
40. 2 will cause WD to reset the system if an applica tion hangs Pins 2 3 will generate a non maskable interrupt signal for the application that has hung See the table on the right for jumper settings Watch Dog must also be enabled in BIOS Note When enabled the user needs to write their own application software to disable the Watch Dog Timer SMB to PCI Express Slots Jumpers JI C1 and JI C2 allow you to connect the System Management Bus 12C to the PCI Express slots Both jumpers must have the same setting to function correctly The default setting is disabled See the table on the right for jumper settings SAS Enable Use JPS1 to enable or disable SAS support on the serverboard See the table on the right for jumper settings 5 24 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual LAN Enable Disable Jumper Settings Jumper Setting Definition Pins 1 2 Enabled Pins 2 3 Disabled 10 Gb TLAN Enable Disable Jumper Settings X8DTU 6TF Jumper Setting Definition Pins 1 2 Enabled Pins 2 3 Disabled Watch Dog Jumper Settings Jumper Setting Definition Pins 1 2 Reset Pins 2 3 NMI Disabled Open SMB to PCI Exp Jumper Settings Jumper Setting Definition Closed Enabled Open Disabled SAS Enable Disable Jumper Settings Jumper Setting Definition Pins 1 2 SAS Enabled Pins 2 3 SAS Disabled 5 10 Onboard Indicators LAN
41. 5 28 Chapter 5 Advanced Serverboard Setup SuperDoctor Ill The SuperDoctor Ill program is a web based management tool that supports remote management capability It includes Remote and Local Management tools The local management is called SD III Client The SuperDoctor III program allows you to monitor the environment and operations of your system SuperDoctor III displays crucial system information such as CPU temperature system voltages and fan status See the figures below for examples of the SuperDoctor III interface Note The default User Name and Password for SuperDoctor III is ADMIN ADMIN Note When SuperDoctor Ill is first installed it adopts the temperature threshold settings that have been set in BIOS Any subsequent changes to these thresholds must be made within SuperDoctor IIl as the SuperDoctor III settings override the BIOS settings To set the BIOS temperature threshold settings again you would first need to uninstall SuperDoctor III Figure 5 6 SuperDoctor Ill Interface Display Screen Health Information SuperDoctor I mote Management a Health Information 5 29 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Figure 5 7 SuperDoctor Ill Interface Display Screen Remote Control SuperDoctor III Remote Management System Info Health Info Performance Remote Control Configuration Administration Systems Manag a Remote Control Graceful power control cancelable
42. AS aak HATE BE e YA E Apart SUCH Waarschuwing Deze eenheid kan meer dan n stroomtoevoeraansluiting bevatten Alle aansluitingen dienen verwijderd te worden om het apparaat stroomloos te maken Backplane Voltage A Warning Hazardous voltage or energy is present on the backplane when the system is operating Use caution when servicing WIIAT UY OIE VAT LOS MIER EEE SAID SV ITI EIT DO TWEET IkPI3 A d EG SKI wes HARRIETT o BIRLA eA EEE TAE GA o REE ETE Er EUH f ERE boer o MEST AEE GA e Warnung Wenn das System in Betrieb ist treten auf der R ckwandplatine gef hrliche Spannungen oder Energien auf Vorsicht bei der Wartung jAdvertencia Cuando el sistema esta en funcionamiento el voltaje del plano trasero es peligroso Tenga cuidado cuando lo revise Attention Lorsque le syst me est en fonctionnement des tensions lectriques circulent sur le fond de panier Prendre des pr cautions lors de la maintenance 4 13 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual nnxa 5153 nn ams T2122 mn v nd wan 21990 para mns 9192 nni n330 no An a dl de baga gall AAN d la fl Ll Gye pbs clus Jal law dead aie s S er lll y S aie 7d a 2480 Xp Se d FAR Backplane AE d i St AHJA epu aq zt WA Su WA asl FSIS Waarschuwing Een g
43. G REPLACING INTEGRATING INSTALLING OR RECOVERING SUCH HARDWARE SOFTWARE OR DATA Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California USA The State of California County of Santa Clara shall be the exclusive venue for the resolution of any such disputes Super Micro s total liability for all claims will not exceed the price paid for the hardware product FCC Statement This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environ ment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case you will be required to correct the interference at your own expense California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warn ing applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may apply See www dtsc ca gov hazardouswaste perchlorate WARNING Handling of lead solder materials used in this
44. Heatsink Installation Warning When handling the processor avoid placing direct pressure on the label area of the fan Also do not place the serverboard on a conductive surface which can damage the BIOS battery and prevent the system from booting up IMPORTANT Always connect the power cord last and remove it first before add ing removing or changing any hardware components Make sure that you install the processor into the CPU socket before you install the heatsink and fan The X8DTU 6TF X8DTU 6F can support either one or two processors If installing one processor only install it into the CPU1 socket Note When purchasing a CPU or when receiving a serverboard with a CPU pre installed make sure that the CPU plastic cap is in place and none of the CPU pins are bent otherwise contact the retailer immediately Installing LGA1366 Processors 1 Starting with CPU1 press the socket clip to release the load plate which covers the CPU socket from its locked position 2 Gently lift the socket clip to open the load plate 3 Hold the plastic cap at its north and south center edges to remove it from the CPU socket Note The photos on this page and succeeding pages are for illustration purposes only They do not necessarily reflect the exact product s described in this manual Chapter 5 Advanced Serverboard Setup 1 After removing the plastic cap use CPU your thumb and the index finger to hold the CPU at the no
45. LAN LED Yellow LED States State Definition Yellow Blinking Gigabit LAN Active Yellow Solid Gigabit LAN Link On GLAN Con nected TLAN LED Green LED States Definition 10 Gb LAN Active 10 Gb LAN Link 10 Gb LAN connected Color State Green Blinking 5 11 SATA Port Connections SATA Ports There are six Serial ATA Ports l SATAO I SATA 5 on the serverboard which are supported by the Intel ICH10R South Bridge See the table on the right for pin definitions for the onboard SATA ports SAS Ports SAS Ports 0 3 and 4 7 provide Serial Attached SCSI connections These SAS ports are supported by the LSI 2108 controller See the table on the right for pin definitions for the onboard SAS ports Chapter 5 Advanced Serverboard Setup SATA Port Pin Definitions Pin Definition Ground TXP TN Ground RXN RXP Ground SAS Port Pin Definitions Pin Definition 1 Ground TXP TN Ground RXN RXP Ground N o Oc fF 0 I 5 27 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 5 12 Installing Software The Supermicro ftp site contains drivers and utilities for your system at ftp ftp supermicro com Some of these must be installed such as the chipset driver After accessing the ftp site go into the CDR_Images directory and locate the ISO file for your motherboard Download this file to create a CD DVD of th
46. MMs will run at 800 MHz BIOS automatic downgrading Note 4 Mixing of 1 35V and 1 5V DIMMs is not recommended 1 35V UDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbuffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank Unb DDR3 ECC 800 1066 1333 SR or DR Unb DDR3 ECC 800 1066 Mixing SR DR Not Available Not Available Not Available Note 1 1333 MHz for two DIMMs per channel is supported when Unbuf ECC DIMMs are used Note 2 Mixing of 1 35V and 1 5V DIMMs is not recommended Possible System Memory Allocation amp Availability System Device Physical Memory Remaining 4 GB Total System Memory Firmware Hub flash memory System BIOS Local APIC Area Reserved for the chipset I O APIC 4 Kbytes PCI Enumeration Area 1 PCI Express 256 MB PCI Enumeration Area 2 if needed Aligned on 256 MB boundary VGA Memory TSEG Memory available to System BIOS amp OS applications SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 5 6 Adding PCI Cards PCI Expansion Slots The X8DTU 6TF X8DTU 6F has one Universal PCI slot Riser cards installed to the system allow you to add PCI expansion cards see below The SC819TQ R700U chassis can support the use of two standard size full height full length expansion cards and one low profile 5 6 length expans
47. Onboard PWR LED Indicator LED Color Definition Off System Off Power cable not connected Green System On UID LED Color State OS Status Blue On Windows Unit Identified Blue Unit Identified Blinking BMC Heartbeat LED A BMC heartbeat LED is located at LED3 on the serverboard When LED3 is blinking the BMC is functioning normally SAS Activity amp SAS Heartbeat LEDs A SAS Activity LED LED 4 and a SAS Heartbeat LED LED 5 are provided on the serverboard When LED 4 is blink ing the SAS connections are active When LED 5 blinks SAS is functioning normally SAS Error LED A SAS Error LED is designated LED6 on the serverboard When LED6 is on a SAS error has occurred See the table at right for more information TLAN LED X8DTU 6TF only A TLAN 10GbLAN LED is located at LED7 When this LED is yellow the LAN port is connected and or active When this LED is green the LAN port is connected and or active Please note that these LAN ports are available on the X8DTU 6TF only See the tables at right for more information 5 26 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual BMC Heartbeat LED State Definition Blink BMC Normal ing SAS Activity amp SAS Heartbeat LEDs LED State Definition LED 4 Blink SAS Active ing LED 5 Blink SAS ing Normal SAS Error LED State Definition On SAS Error Oc curred T
48. P1 2A P1 3A P1 1A P1 1B P1 2A P1 2B P1 3A P1 3B P1 1A P1 1B P1 1C P1 2A P1 2B P1 2C P1 3A P1 3B P1 3C Note Max of 6 UDIMM modules are supported by a CPU P2 DIMMs 3 DIMMs 6 DIMMs 9 DIMMs RDIMMs only Note To Populate P2 DIMMs Branch 0 Branch 1 Branch 2 P2 1A P2 2A P2 3A P2 1A P2 1B P2 2A P2 2B P2 3A P2 3B P2 1A P2 1B P2 1C P2 2A P2 2B P2 2C P2 3A P2 3B P2 3C Memory Population for Optimal Performance With One CPU CPU2 Installed Note Max of 6 UDIMM modules are supported by a CPU Memory Population for Optimal Performance With Two CPUs Installed 6 DIMMs 12 DIMMs 18 DIMMs For RDIMMs only CPU 1 To Populate P1 DIMMs CPU 2 To Populate P2 DIMMs Branch 0 P1 1A P1 1A 1B P1 1A 1B 1C Branch 1 P1 2A P1 2A 2B P1 2A 2B 2C Branch 2 P1 3A P1 3A 3B P1 3A 3B 3C Branch 0 P2 1A P2 1A 1B P2 1A 1B 1C Branch 1 P2 2A P2 2A 2B P2 2A 2B 2C Branch 2 P2 3A P2 3A 3B P2 3A 3B 3C Max of 6 UDIMM modules are supported by a CPU Memory Support for 5500 Processor s DIMM Slots per Channel DIMMs Populated per Channel RDIMM Population w 5500 Processors Installed DIMM Type Reg Registered Speeds in MHz Ranks per DIMM any combination SR Single Rank DR Dual Rank QR Quad Rank DDR3 ECC DDR3 ECC DDR3 ECC 800 1066 1333 SR or DR DDR3 ECC 800 1066 Q
49. PU detected by the BIOS Physical Count This item displays the number of processors installed in your system as detected by the BIOS Logical Count This item displays the number of CPU Cores installed in your system as detected by the BIOS System Memory e Size This displays the size of memory available in the system SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 7 3 Advanced Setup Configurations Use the arrow keys to select Advanced and press lt Enter gt to access the submenu items BIOS SETUP UTILITY gt Boot Feature gt Boot Features Quick Boot If enabled this feature will skip certain tests during POST to reduce the time needed for system boot The options are Enabled and Disabled Quiet Boot Use this feature to modify bootup screen display between POST messages or the OEM logo Select Disabled to display the POST messages Select Enabled to display the OEM logo instead of the normal POST messages The options are Enabled and Disabled AddOn ROM Display Mode This sets the display mode for Option ROM The options are Force BIOS and Keep Current Bootup Num Lock This feature selects the Power on state for the Numlock key The options are Off and On Wait For F1 If Error This forces the system to wait until the F1 key is pressed if an error occurs The options are Disabled and Enabled Chapter 7 BIOS Hit Del Message Display Select Enabled to display Press DEL to run Setup
50. R DDR3 ECC 800 1066 Mixing SR DR 800 Note 800 Note Note 1066 RDIMMs will run at 800 MHz BIOS automatic downgrading Mixing SR DR QR Mixing SR DR SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual UDIMM Population with 5500 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbuffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank Unb DDR3 ECC Non ECC 800 1066 1333 SR or DR Unb DDR3 ECC Non ECC 800 1066 Mixing SR DR Not available Not available Not available Memory Support for 5600 Processor s e 1 5V DIMMs 1 5V RDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Speeds in MHz Ranks per DIMM Slots per Populated Reg Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank DDR3 ECC 800 1066 1333 SR or DR DDR3 ECC 800 1066 Note 1 QR DDR3 ECC 800 1066 1333 Mixing SR DR DDR3 ECC 800 Note 2 Mixing SR DR QR DDR3 ECC 800 Note 2 Mixing SR DR Note 1 1333 MHz RDIMMs will run at 1066 MHz BIOS automatic downgrading Note 2 1333 1066 MHz RDIMMs will run at 800 MHz BIOS automatic downgrading Note 3 Mlxing of 1 35V and 1 5V DIMMs is not recommended 1 5V UDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Unb Speeds in MHz Ranks per DIMM Slots per Populated Unbu
51. SUPERG SUPERSERVER 6016T 6RFT SUPERSERVER 6016T 6RF USER S MANUAL 1 0a The information in this User s Manual has been carefully reviewed and is believed to be accurate The vendor assumes no responsibility for any inaccuracies that may be contained in this document makes no commitment to update or to keep current the information in this manual or to notify any person or organization of the updates Please Note For the most up to date version of this manual please see our web site at www supermicro com Super Micro Computer Inc Supermicro reserves the right to make changes to the product described in this manual at any time and without notice This product including software and docu mentation is the property of Supermicro and or its licensors and is supplied only under a license Any use or reproduction of this product is not allowed except as expressly permitted by the terms of said license IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT INDIRECT SPECIAL INCIDENTAL SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN PARTICULAR SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE SOFTWARE OR DATA STORED OR USED WITH THE PRODUCT INCLUDING THE COSTS OF REPAIRIN
52. Status This feature returns the channel status for the Channel Number selected above Channel Number is OK or Wrong Channel Number IP Address Source This features allows the user to select how an IP address is assigned to a cli ent computer or network device Select DHCP Dynamic Host Configuration Protocol to allow a client computer or device obtains an IP address from a DHCP server that manages a pool of IP addresses and network information on a request and grant basis Upon time out or lease expiration the IP address 7 23 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual assigned to the client can be reassigned to a new client Select Static Static Allocation to allow the host server to allocate an IP address based on a table containing MAC Address IP Address pairs that are manually entered probably by a network administrator Only clients with a MAC address listed in the MAC IP Address Table will be assigned an IP address The IP Address allocated to the client is on a longer term basis than that assigned by the DHCP mentioned in the other option The options are DHCP and Static IP Address The BIOS will automatically enter the IP address for the system when the IP Address Source is set to Static It can also allow the user to set an IP address for the system If the IP Address Source is set to DHCP However the IP ad dress may be overwritten The value of each three digit number separated by dots should not
53. T dx A El AE RBS EESE pa EE AR AT DE IL EE EK eg D Warnung Die Entsorgung dieses Produkts sollte gemaB allen Bestimmungen und Gesetzen des Landes erfolgen SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual jAdvertencia Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales Attention La mise au rebut ou le recyclage de ce produit sont g n ralement soumis a des lois et ou directives de respect de l environnement Renseignez vous aupr s de l organisme comp tent 3757 P19 0 LITTIN Dem PIM 09199 08052 012 27 m 1290 9w 530 p19 0 Aida d ceil gll al sill graal Ub y dea dall Gio Sall Up Gye AA aliil Ae PA dd d HAA ANAA RAA D X RI Co A off A N N 4o Waarschuwing De uiteindelijke verwijdering van dit product dient te geschieden in overeenstemming met alle nationale wetten en reglementen Hot Swap Fan Warning A Warning The fans might still be turning when you remove the fan assembly from the chassis Keep fingers screwdrivers and other objects away from the openings in the fan assembly s housing TIP RY KADY TOS LRM SGT Y Y RIO LEER ien E ERC CUS HY DEE 203 3 Tr Y OPAC Fi FIA BEOTOMOLO SIDI EWC NE ee Ns e EFR NATE TU 4 16 Chapter 4 Warning Statements for AC Systems
54. Tolerance is and not the other way around This results in better CPU thermal management Supermicro has leveraged this feature by assigning a temperature status to certain thermal conditions in the processor Low Medium and High This makes it easier for the user to understand the CPU s temperature status rather than by just simply seeing a temperature reading e 25 C The CPU Temperature feature will display the CPU temperature status as detected by the BIOS Low This level is considered as the normal operating state The CPU temperature is well below the CPU Temperature Tolerance The motherboard fans and CPU will run normally as configured in the BIOS Fan Speed Control User intervention No action required Medium The processor is running warmer This is a precautionary level and generally means that there may be factors contributing to this condition but the CPU is still within its normal operating state and below the CPU Temperature Tolerance The motherboard fans and CPU will run normally as configured in the BIOS The fans may adjust to a faster speed depending on the Fan Speed Control settings User intervention No action is required However consider checking the CPU fans and the chassis ventilation for blockage High The processor is running hot This is a caution level since the CPU s Tem perature Tolerance has been reached or has been exceeded and may activate an
55. U temperature reaches the CPU overheat threshold as predefined by the CPU manufacturer The Default Alarm Select this setting if you want the CPU overheat alarm including the LED and the buzzer to be triggered when the CPU temperature reaches about 5 C above the threshold temperature as predefined by the CPU manufacturer to give the CPU and system fans additional time needed for CPU and system cooling In both the alarms above please take immediate action as shown below 7 17 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual CPU 1 Temperature CPU 2 Temperature System Temperature This feature displays current temperature readings for the CPU and the System The following items will be displayed for your reference only CPU1 Temperature CPU2 Temperature The CPU thermal technology that reports absolute temperatures Celsius Fahr enheit has been upgraded to a more advanced feature by Intel in its newer processors The basic concept is each CPU is embedded by unique temperature information that the motherboard can read This Temperature Threshold or Tem perature Tolerance has been assigned at the factory and is the baseline on which the motherboard takes action during different CPU temperature conditions i e by increasing CPU Fan speed triggering the Overheat Alarm etc Since CPUs can have different Temperature Tolerances the installed CPU can now send informa tion to the motherboard what its Temperature
56. VER 6016T 6RFT 6016T 6RF User s Manual Trusted Platform Module TPM Pin Definitions Definition Pin LPC Clock 2 LPC FRAME 4 LPC Reset 6 LAD3 8 3 3V 10 LADO 12 SCL 14 43V DUAL 16 GND 18 LPCPD 20 Definition GND Key 5V X LAD2 LAD1 GND SDAT SERIRQ CLKRUN X LDRQ X Pin r Trusted Platform Module Header 3 A Trusted Platform Module header 5 JTPM is located next to the COM2 7 connection This header provides 9 TPM support to ensure data integrity 11 and system security Refer to the 13 table on the right for pin definitions 15 17 19 Notes X indicates TPM does not use the signals SCL and SDAT are I C bus clock and data Power SMB PC Connector The Power System Management Bus SC Connector JPI C monitors power supply fan and system tem peratures See the table on the right for pin definitions 5 22 PWR SMB Pin Definitions Pin Definition Clock Data PWR Fail Ground 5 9 Jumper Settings Explanation of Jumpers To modify the operation of the serverboard jumpers can be used to choose between optional settings Jumpers create shorts between two pins to change the function of the connector Pin 1 is identified with a square solder pad on the printed cir cuit board See the diagram at right for an example of jumping pins 1 and 2 Refer to the serverboard layout page for jumper locations Note On two pin jumpers Closed means t
57. ad Optimal Defaults from the Exit menu and press lt Enter gt Then select OK to allow the AMI BIOS to automatically load Optimal De faults to the BIOS Settings The Optimal settings are designed for maximum system performance but may not work best for all computer applications 7 28 Chapter 7 BIOS Load Fail Safe Defaults To set this feature select Load Fail Safe Defaults from the Exit menu and press lt Enter gt The Fail Safe settings are designed for maximum system stability but not for maximum performance 7 29 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes 7 30 Appendix A BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST Power On Self Test routines which are performed each time the system is powered on errors may occur Non fatal errors are those which in most cases allow the system to continue the boot up process The error messages normally appear on the screen Fatal errors will not allow the system to continue the boot up procedure If a fatal error occurs you should consult with your system manufacturer for possible repairs These fatal errors are usually communicated through a series of audible beeps The numbers on the fatal error list correspond to the number of beeps for the corresponding error BIOS Error Beep Codes Beep Code Error Message Description 1 beep Refresh Circuits have been reset Ready to power up No memory detected in the
58. ade Accessing the Inside of the System 1 First grasp the two handles on either side and pull the system straight out until it locks you will hear a click 2 Next press the two buttons on the top of the chassis to release the top cover 3 Push the cover away from you toward the rear of the chassis until it stops You can then lift the top cover from the chassis to gain full access to the inside of the server 4 To remove the system from the rack completely press the locking tabs in the chassis rails push the right side tab down and the left side tab up to continue to pull the system out past the locked position Checking the Components 1 You may have one or two processors already installed in the serverboard Each processor needs its own heatsink See Chapter 5 for instructions on processor and heatsink installation 2 Your server system may have come with system memory already installed Make sure all DIMMs are fully seated in their slots For details on adding system memory refer to Chapter 5 3 If desired you can install an add on card to the system See Chapter 5 for details on installing PCI add on cards 4 Make sure all power and data cables are properly connected and not blocking the chassis airflow See Chapter 5 for details on cable connections 2 8 Chapter 2 Server Installation Figure 2 4 Accessing the Inside of the System 2 9 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual
59. adjust processor voltage and core frequency in an effort to reduce power consump tion and heat dissipation Please refer to Intel s web site for detailed information The options are Disable Disable GV3 and Enable Enable GV3 Intel amp TurboMode Tech Available when Intel EIST Technology is enabled Select Enabled to use the TurboMode Technique to boost system performance The options are Enabled and Disabled 7 7 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual C1E Support Select Enabled to use the feature of Enhanced Halt State C1E significantly reduces the CPU s power consumption by reducing the CPU s clock cycle and voltage during a Halt State The options are Disabled and Enabled Intel C STATE Tech If enabled C State is set by the system automatically to either C2 C3 or C4 state The options are Disabled and Enabled C State Package Limit Setting If set to Auto the AMI BIOS will automatically set the limit on the C State package register The options are Auto C1 C3 C6 and C7 C1 Auto Demotion When enabled the CPU will conditionally demote C3 C6 or C7 requests to C1 based on un core auto demote information The options are Disabled and Enabled C3 Auto Demotion When enabled the CPU will conditionally demote C6 or C7 requests to C3 based on un core auto demote information The options are Disabled and Enabled ACPI T State When this feature is enabled CPU Throttling state will be reported in the ACPI
60. and Disabled Active State Power Management Select Enabled to use the power management for signal transactions between the PCI Express LO and L1 Links Select Enabled to configure PCI Exp LO and L1 Link power states The options are Disabled and Enabled 7 10 Chapter 7 BIOS IOH PCI E Max Payload Size Some add on cards perform faster with the coalesce feature which limits the payload size to 128B while others with a payload size of 256B which inhibits the coalesce feature Please refer to your add on card user guide for the desired setting The options are 256B and 128B ME HECI Support Select Enabled to enable ME HECI Host Embedded Controller Interface support which will allow the Host OS to communicate directly with the Management Engine ME in a standard method for system management effectively replacing the SMbus The options are Enabled and Disabled gt South Bridge Configuration This feature allows the user to configure the settings for the South Bridge chip USB Functions This feature allows the user to decide the number of onboard USB ports to be en abled The Options are Disabled 2 USB ports 4 USB ports 6 USB ports 8 Ports 10 Ports and 12 USB ports USB 2 0 Controller Available when the item USB Functions is disabled This item indicates if the onboard USB 2 0 controller is activated The default set ting is Enabled Legacy USB Support Select Enabled to use Legacy USB devices If this ite
61. and IRQ 4 for the interrupt address The options for Serial Porti are Disabled 3F8 IRQ4 3E8 IRQ4 2E8 IRQ3 and 2F8 IRQ3 The options for Serial Port2 are Disabled 2F8 IRQ3 3E8 IRQ4 3F8 IRQ4 and 2E8 IRQ3 Serial Port 2 Attribute This feature allows the user to set COM 2 as a normal serial port or a virtual COM port used for SOL Serial Over LAN The options are SOL and COM gt Remote Access Configuration Remote Access Select Enabled to enable Remote Access support The options are Disabled and Enabled If Remote Access is set to Enabled the following items will display Serial Port Number This feature allows the user decide which serial port to be used for Console Redi rection The options are COM 1 and COM 2 Base Address IRQ This item displays the based address and IRQ of the serial port specified above Serial Port Mode This feature allows the user to set the serial port mode for Console Redirection The options are 115200 8 n 1 57600 8 n 1 38400 8 n 1 19200 8 n 1 and 9600 8 n 1 Flow Control This feature allows the user to set the flow control for Console Redirection The options are None Hardware and Software Redirection After BIOS POST Select Disabled to turn off Console Redirection after Power On Self Test POST Select Always to keep Console Redirection active all the time after POST Note This setting may not be supported by some operating systems Select Boot Loader 7 16 Chapter 7 BIOS t
62. as System muss von allen Quellen der Energie und vom Netzanschlusskabel getrennt sein das von den Spg Versorgungsteilmodulen entfernt wird bevor es auf den Chassisinnenraum zur ckgreift um Systemsbestandteile anzubringen oder zu entfernen 4 6 Chapter 4 Warning Statements for AC Systems Advertencia El sistema debe ser disconnected de todas las fuentes de energ a y del cable el ctrico quitado de los m dulos de fuente de alimentaci n antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema Attention Le systeme doit tre d branch de toutes les sources de puissance ainsi que de son cordon d alimentation secteur avant d acc der a l int rieur du chassis pour installer ou enlever des composants de syst me LOIN paon rvnn DID nx von un Dawn nop 99m no3yin nx PNI v 022299 non IN NPAT Tv TRAT VW 355 pon nu 12 Aal das y ya el jg SII IL All 3 y AURI jols aren Ca sall Jai cass J da gall cia So AN i y cad Kal lala Ai Al ja gi AI NARA PEES FAAA AAN ARAE ap ARAN AE ael WEA Ad DARA daselgz SE As ANTEE oo sh Waarschuwing Voordat u toegang neemt tot het binnenwerk van de behuizing voor het installeren of verwijderen van systeem onderdelen dient u alle spanningsbronnen en alle stroomkabels aangesloten op de voeding en van de behuizing te verwijderen 4 7 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Equipment Installation A Warning
63. ator is on system power is on Unplug the power cable before installing or removing any components SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual X8DTU 6TF X8DTU 6F Quick Reference Jumper Description Default Setting JBT1 Clear CMOS See Section 5 9 JI C1 JI C2 SMB to PCI E Slots Open Disabled JPG1 VGA Enable Pins 1 2 Enabled JPL1 LAN1 LAN2 Enable Disable Pins 1 2 Enabled JPS1 SAS Enable Disable Pins 1 2 Enabled JPTLAN TLAN1 2 Enable Disable Pins 1 2 Enabled JWD1 Watch Dog Pins 1 2 Reset Connector Description COM1 COM2 COM1 COM2 Serial Port Header FAN 1 8 CPU System Fan Headers Fans 7 amp 8 CPU Fans IPMB 4 pin External BMC IC Header for IPMI Card IPMI LAN Dedicated IPMI LAN I SATA 0 5 Intel SB SATA Connectors 0 5 JF1 Control Panel Header JL1 Chassis Intrusion JOH1 Overheat Fan Fail LED JPI C Power Supply SMBbus 1 C Header JPTM1 Trusted Platform Support Header JPW1 ATX 24 Pin Power Connector JPW2 JPW3 12V 8 Pin Power Connectors JWF1 SATA DOM Disk On Module Power Header LAN1 2 Gigabit Ethernet Ports 1 2 SAS0 3 4 7 SAS Ports SAS BBU SAS Battery Backup Unit p n BTR 0018L 0000 LSI TLAN1 TLAN2 10 Gb Ethernet Ports X8DTU 6TF only T SGPIO 1 2 Serial_Link General Purpose I O Headers USB 0 1 Back Panel USB 0 1 Ports USB4 5 6 7 Front Panel Accessible USB Headers USB6 Type A port UID UID Unit Identifier Button UIOP Universal I O Add on Card Power Connection Quick Reference table con
64. aus f Say Alle el A a eist Ae Al Nae is il gall ge haa lll ly ale de Silaa gl ule dei gl J 4th eS Saal ga gl E As al Aa Sl GLa Lally 2d ja ule US eis A Ae vie US A ef Ue paill all ad exsul o GL az dat FIA AI ol AI 7SE AA Yes YA 94 2849 AAA SAS op Y 91x SAA JA Bu SE Ayo det 24948 FAH de 471339 Hae HARASS Hols D AA AWS YAS YES xc agp EPA FA 7 BU BELANGRIJKE VEILIGHEIDSINSTRUCTIES Dit waarschuwings symbool betekent gevaar U verkeert in een situatie die lichamelijk letsel kan veroorzaken Voordat u aan enige apparatuur gaat werken dient u zich bewust te zijn van de bij een elektrische installatie betrokken risico s en dient u op de hoogte te zijn van de standaard procedures om ongelukken te voorkomen Gebruik de nummers aan het eind van elke waarschuwing om deze te herleiden naar de desbetreffende locatie BEWAAR DEZE INSTRUCTIES 4 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Installation Instructions A Warning Read the installation instructions before connecting the system to the power source iie TI VAT AC EI BCT Zon Ze FIA Fi EE REHAB HSFCA Bx ZEE gt BA o E REL Ea En aa TCR AA gt Warnung Vor dem AnschlieBen des Systems an die Stromquelle die Installationsanweisungen lesen jAdvertencia Lea las instrucciones de instalaci n antes de conectar el sistema a la red de alimen
65. board Setup 6 2 Chapter 6 Advanced Chassis Setup 6 3 System Fans Five 4 cm heavy duty counter rotating fans provide the cooling for the 6016T 6RFT 6016T 6RF Each fan unit is actually made up of two fans joined back to back which rotate in opposite directions This counter rotating action generates exceptional airflow and works to dampen vibration levels It is very important that the chassis top cover is properly installed and making a good seal in order for the cooling air to circulate properly through the chassis and cool the components See Figure 6 2 System Fan Failure Fan speed is controlled by system temperature via a BIOS setting If a fan fails the remaining fan will ramp up to full soeed and the overheat fan fail LED on the control panel will turn on Replace any failed fan at your earliest convenience with the same type and model the system can continue to run with a failed fan Remove the top chassis cover while the system is still running to determine which of the fans has failed Then power down the system before replacing a fan Removing the power cord s is also recommended as a safety precaution Replacing System Fans 1 After determining which fan has failed turn off the power to the system 2 Unplug the fan cable from the serverboard and remove the failed fan from the chassis 3 Replace the failed fan with an identical 4 cm 12 volt fan available from Supermicro p n FAN 0086L4 4 Push
66. ck so that a hazardous condition does not arise due to uneven mechanical loading Circuit Overloading Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring Appropriate consideration of equipment nameplate ratings should be used when addressing this concern Reliable Ground A reliable ground must be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connec tions other than the direct connections to the branch circuit i e the use of power strips etc Warning To prevent bodily injury when mounting or servicing this unit in a rack you must take special precautions to ensure that the system remains stable The following guidelines are provided to ensure your safety This unit should be mounted at the bottom of the rack if it is the only unit in the rack e When mounting this unit in a partially filled rack load the rack from the bottom to the top with the heaviest component at the bottom of the rack e f the rack is provided with stabilizing devices install the stabilizers before mounting or servicing the unit in the rack 2 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 2 5 Installing the System into a Rack This section provides information on installing the 6016T 6RFT 6016T 6RF
67. d connections are described and a layout and quick reference chart are included in this chapter Remember to close the chassis completely when you have finished working on the serverboard to protect and cool the system sufficiently 5 1 Handling the Serverboard Static electrical discharge can damage electronic components To prevent damage to printed circuit boards it is important to handle them very carefully see Chapter 4 Also note that the size and weight of the serverboard can cause it to bend if handled improperly which may result in damage To prevent the serverboard from bending keep one hand under the center of the board to support it when handling The following measures are generally sufficient to protect your equipment from static discharge Precautions Use a grounded wrist strap designed to prevent static discharge e Touch a grounded metal object before removing any board from its antistatic bag Handle a board by its edges only do not touch its components peripheral chips memory modules or gold contacts When handling chips or modules avoid touching their pins Put the serverboard add on cards and peripherals back into their antistatic bags when not in use Unpacking The serverboard is shipped in antistatic packaging to avoid static damage When unpacking the board make sure the person handling it is static protected 5 1 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 5 2 Processor and
68. d to allow the processor to load an authenticated code AC module in an internal memory partition to ensure that the CPU chipset and all other related components are launched in the same protected environment for trusted platform computing The options are Disabled and Enabled BIOS AC SCHECK Available when Intel TXT LT Initialization is enabled Select Enabled to allow the authenticated code AC module to check that hardware the memory protection mechanism and the domain manager are configured properly to ensure safe computing in the Trusted Computing Platform Module The options are Disabled and Enabled Load DPR Available when Intel TXT LT Initialization is enabled Select Enabled to load a DPR which is a powerful lightweight and compact module used to track and record vital data in running electric powered radio controlled com ponents for trusted platform computing The options are Disabled and Enabled Reset TPM Establishment Flag Available when Intel TXT LT Initialization is enabled Select Enabled to reset Trusted Platform Module Establishment Flag for safe com puting The options are Disabled and Enabled gt Trusted Computing Optional TCG TPM Support Select Yes on this item and enable the TPM jumper on the motherboard to enable TCG TPM 1 1 1 2 TPM support to improve data integrity and network security The options are No and Yes If this feature is set to Yes the following items will display Indicate Phys
69. e drivers and utilities it contains You may also use a utility to extract the ISO file if preferred Another option is to go to the Supermicro Website at http www supermicro com products Find the product page for your motherboard here where you may down load individual drivers and utilities After creating a CD DVD with the ISO files insert the disk into the CD DVD drive on your system and the display shown in Figure 5 5 should appear SUPERMICRO x8DTU 6 Motherboard Drivers amp Tools wine E xj ei 2 Intel 5500 5520 Chipset INF files S U PERM I C Re 2 Matrox G200e Graphics Driver Drivers amp Tools Intel 5520 Chipset X8DTU 6F X8DTU 6TF LSI MegaRAID Storage Manager Intel Rapid Storage Technology Adaptec Storage Manager Intel PRO Network Connections Drivers Mellanox InfiniBand Driver SUPERMICRO Supero Doctor III SUPERMICRO Computer Inc Build driver diskettes and manuals Browse CD Auto Start Up Next Time For more information please visit SUPERMICRO s web site Figure 5 5 Driver Tool Installation Display Screen Note Click the icons showing a hand writing on paper to view the readme files for each item Click the computer icons to the right of these items to install each item from top to the bottom one at a time After installing each item you must re boot the system before moving on to the next item on the list The bottom icon with a CD on it allows you to view the entire contents
70. e system In no event shall Supermicro be liable for direct indirect special incidental or consequential dam ages arising from a BIOS update If you have to update the BIOS do not shut down or reset the system while the BIOS is updating This is to avoid possible boot failure 7 2 Main Setup When you first enter the AMI BIOS Setup Utility you will enter the Main setup screen You can always return to the Main setup screen by selecting the Main tab on the top of the screen The Main BIOS Setup screen is shown below BIOS SETUP UTILITY System Time Chapter 7 BIOS System Overview The following BIOS information will display System Time System Date Use this option to change the system time and date Highlight System Time or Sys tem Date using the arrow keys Key in new values through the keyboard and press lt Enter gt Press the lt Tab gt key to move between fields The date must be entered in Day MM DD YY format The time is entered in HH MM SS format Note The time is in the 24 hour format For example 5 30 P M appears as 17 30 00 SuperMicro X8DTU 6TF Version This item displays the BIOS revision used in your system Build Date This item displays the date when this BIOS was complete Processor The AMI BIOS will automatically display the status of the processor used in your system e CPU Type This item displays the type of CPU used in the motherboard Speed This item displays the speed of the C
71. ecautions in the next section 2 3 Preparing for Setup The box the 6016T 6RFT 6016T 6RF was shipped in should include two sets of rail assemblies two rail mounting brackets and the mounting screws you will need to install the system into the rack Follow the steps in the order given to complete the installation process in a minimum amount of time Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow Choosing a Setup Location Leave enough clearance in front of the rack to enable you to open the front door completely 25 inches and approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing This product is for 2 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual installation only in a Restricted Access Location dedicated equipment rooms service closets and the like This product is not suitable for use with visual display work place devices acccording to 2 of the the German Ordinance for Work with Visual Display Units Warnings and Precautions Rack Precautions Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them In single rack installation stabilizers should be attached to the rack In multiple rack installations the racks should be coupled together Always make sure the rack is stable before extending
72. ess Level Available when Supervisor Password is set as above Available options are Full Access grants full User read and write access to the Setup Utility View Only allows access to the Setup Utility but the fields cannot be changed Limited allows only limited fields to be changed such as Date and Time No Access prevents User access to the Setup Utility Change User Password Select this feature and press Enter to access the submenu and then type in a new User Password Clear User Password Available only when User Password has been set This item allows you to clear a user password after it has been entered Password Check Select Setup for the system to check for a password at Setup Select Always for the system to check for a password at bootup The options are Setup and Always Boot Sector Virus Protection When Enabled the AMI BIOS displays a warning when any program or virus is sues a Disk Format command or attempts to write to the boot sector of the hard disk drive The options are Enabled and Disabled 7 26 Chapter 7 BIOS 7 5 Boot Configuration Use this feature to configure boot settings BIOS SETUP UTILITY gt Boot Device Priority gt Boot Device Priority This feature allows the user to specify the sequence of priority for the Boot Device The settings are 1st boot device 2nd boot device 3rd boot device 4th boot device 5th boot device and Disabled 1st Boot Device SATA XXXXXXXXX
73. evaarlijke spanning of energie is aanwezig op de backplane wanneer het Systeem in gebruik is Voorzichtigheid is geboden tijdens het onderhoud Comply with Local and National Electrical Codes Warning Installation of the equipment must comply with local and national electrical codes MT 354 O Bd ORR CAE Bids OBRUO STU 7 0175353 O MOEA BUILT E750 Ed Eu ES LI RDA AAT AS E VAR gt E H iSc DE BE BD A a AS KB E ROAR gt Warnung Die Installation der Gerate muss den Sicherheitsstandards entsprechen jAdvertencia La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales Chapter 4 Warning Statements for AC Systems Attention L quipement doit tre install conform ment aux normes lectriques nationales et locales Nn DOWN PIN aen TIN JOINT Opa DAWN pin NARIN nv D nen Tex nipnn Aaleial Aida lly Gill ul sill Bai of cas A ES lar Gus ji el SL AI ad xe us 471 139 94 40 AAN 407 Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften Product Disposal A Warning Ultimate disposal of this product should be handled according to all national laws and regulations BO BE RE COR ine ELIT TIA HOBART SA TORA PMC HE VUES EZ HOES DE ng Ar tira e A EE ARE ATA BIR EAE
74. ffered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank Unb DDR3 ECC Non ECC 800 1066 1333 SR or DR Unb DDR3 ECC Non ECC 800 1066 1333 Mixing SR DR Not Available Not Available Not Available Note 1 1333 MHz for two DIMMs per channel is supported when Unbuf ECC DIMMs are used Note 2 Mlxing of 1 35V and 1 5V DIMMs is not recommended Notes Due to OS limitations some operating systems may not show more than 4 GB of memory Due to memory allocation to system devices memory remain ing available for operational use will be reduced when 4 GB of RAM is used The reduction in memory availability is disproportional Refer to the Memory Availability Table on the following page for details Chapter 5 Advanced Serverboard Setup e 1 35V DIMMs 1 35V RDIMM Population with 5600 Processors Installed DIMM DIMMs DIMM Type Speeds in MHz Ranks per DIMM Slots per Populated Reg Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank Reg DDR3 ECC 800 1066 1333 Reg DDR3 ECC 800 Note 1 QR Reg DDR3 ECC 800 1066 Note 2 Mixing SR DR Reg DDR3 ECC 800 Note 3 Mixing SR DR QR Not Available Not Available Not Available Note 1 1333 1066 MHz QR RDIMMs will run at 800 MHz BIOS automatic downgrading Note 2 1333 MHz SR DR RDIMMs will run at 800 MHz BIOS automatic downgrading Note 3 1333 1066 MHz SR DR QR RDI
75. h Precision Event Timer Select Enabled to activate the High Precision Event Timer HPET that produces periodic interrupts at a much higher frequency than a Real time Clock RTC does in synchronizing multimedia streams providing smooth playback and reducing the dependency on other timestamp calculation devices such as an x86 RDTSC Instruction embedded in the CPU The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer The options are Enabled and Disabled NUMA Support Select Enabled to use the feature of Non Uniform Memory Access to improve CPU performance The options are Disabled Enabled and NUMA for SLES 11 SUSE Linux Enterprise Server 11 WHEA Support Select Enabled to enable Windows Hardware Error Architecture WHEA support which will provide a common infrastructure for the system to handle hardware errors on Windows platforms in order to reduce system crashes due to hardware errors and to enhance system recovery and health monitoring The default setting is Enabled Intel TXT LT Configuration Intel TXT Initialization Select Enabled to initialize Intel Trusted Execution Technology TXT to provide the building blocks and create trusted platforms for safe computing The options are Dis abled and Enabled If this item is set to Enabled the following items will display 7 20 Chapter 7 BIOS BIOS AC SCLEAN Available when Intel TXT LT Initialization is enabled Select Enable
76. he jumper is on and Open means the jumper is off the pins CMOS Clear Chapter 5 Advanced Serverboard Setup 3 2 1 Pins Lg Jumper JBT1 is used to clear CMOS and will also clear any passwords Instead of pins this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS To clear CMOS 1 First power down the system and unplug the power cord s 2 With the power disconnected short the CMOS pads with a metal object such as a small screwdriver 3 Remove the screwdriver or shorting device 4 Reconnect the power cord s and power on the system Note Do not use the PW ON connector to clear CMOS VGA Enable Disable JPG1 allows you to enable or disable the onboard VGA port The default position is on pins 1 and 2 to enable VGA See the table on the right for jumper settings The default setting is enabled 5 23 VGA Enable Disable Jumper Settings Jumper Setting Definition Pins 1 2 Enabled Pins 2 3 Disabled LAN TLAN Enable Disable Change the setting of jumper JPL1 to enable or disable the LAN1 and LAN2 onboard Ethernet RJ45 ports and JPTLAN to enable the 10 Gb LAN ports on the X8DTU 6TF See the table on the right for jumper settings The default setting is enabled Watch Dog Enable Disable JWD1 controls the Watch Dog function Watch Dog is a system monitor that can reboot the system when a software application hangs Pins 1
77. ical Available when TCG TPM Support Yes Select Yes for the BIOS to detect the presence of TPM devices at system boot Select No to hide the presence of TPM devices at system boot The options are Yes and No TPM Deactivated Available when TCG TPM Support Yes Select Set to disable TPM support at bootup Select Clear to activate the TPM devices to at bootup Select Don t Change to keep the current TPM support status The options are Set Clear and Don t Change TPM Owner Available when TCG TPM Support Yes This feature allows the user to configure TPM Owner settings The options are Don t Change Enable Install Disable Install and Clear 7 21 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Execute TPM Command Available when TCG TPM Support Yes Select Enabled to execute TPM commands you ve selected Select Don t Change to keep the current TPM commands without making any changes Select Dis abled to abandon the changes you have made on TPM commands The options are Enabled Disabled and Don t Change TPM Enable Disable Status This item displays the status of TPM Support to indicate if TPM is currently enabled or disabled TPM Owner Status This item displays the status of TPM Ownership IPMI Configuration Intelligent Platform Management Interface IPMI is a set of common interfaces that IT administrators can use to monitor system health and to manage the system as a whole For more information
78. ii 5 15 5 9 Jumper Settings RES 5 23 5 10 Onboard ee 5 25 5 11 SATA Port Connections eseti aenea as arae ra nennen ternera ise nnne 5 27 5 12 Installing e 5 28 SuperDoctor Minis CE 5 29 E deele le WEEN E 5 30 Chapter 6 Advanced Chassis Setup a DEN o c 6 1 lee te EE 6 1 62 Control Panel diese arena deed Cegedel Reger iR us 6 2 A NE Pee Pere nner LIMES Li petes eee EE 6 3 System E 6 3 Hard Drive Installation iii 6 5 Hard Drive Ee 6 6 DVD ROM Drive Installation sess 6 7 6 4 Power SUpply ecrire tmi en na cua ee ERE Ph Ee ERU RE cess EESE NEEE SEN NS REI OTEA 6 8 Power Supply Failure cccceccccccceeeececeeceeeeeeeeececeeeaeeeeeeessenenaeeeeeeeeeseeeeaees 6 8 Chapter 7 BIOS 7 1 Introducir r 7 1 Starting BIOS Setup Dll E 7 1 How To Change the Configuration Data sica ata 7 1 icisgeguEc 35 7 2 22 Mal UN c ep 7 2 7 3 Advanced Setup Reg UE E 7 4 7 4 SOCUMY SONINGS ems 7 25 7 5 ROOM COMMON ANON E 7 27 7 6 eei ac MEE RE 7 28 Appendix A BIOS Error Beep Codes Appendix B System Specifications viii Chapter 1 Introduction Chapter 1 Introduction 1 1 Overview The SuperServer 6016T 6RFT 6016T 6RF is a comprised of two main subsys tems the SC819TQ R700U 1U server chassis and the X8DTU 6TF X8DTU 6F dual processor serverboard Please refer to our web site for information on operating systems that have been certified for use with the system www supermicro com In addition t
79. in 1 of JF1 Connect the other end of the cable to the Control Panel printed circuit board located just behind the system status LEDs in the chassis See the Connector Definitions section in this chapter for details and pin descrip tions of JF1 5 6 Chapter 5 Advanced Serverboard Setup Figure 5 1 Front Control Panel Header Pins JF1 Power LED 3 3V UID Switch Vcc NIC1 Active LED NIC2 Active LED Red Blue LED Cathode 3 3V Reset Button Power Button HDD LED NIC1 Link LED NIC2 Link LED Blue OH Fan Fail Power Fail UID LED Power Fail LED Ground Ground 2 1 5 4 I O Ports The I O ports are color coded in conformance with the PC 99 specification See Figure 5 2 below for the colors and locations of the various l O ports Figure 5 2 Rear Panel I O Ports eii Q o 000 DO Rear UO Ports el o O o 1 Keyboard 7 VGA Port 2 PS 2 Mouse 8 LAN1 1 Gb 3 USBO 9 LAN2 1 Gb 4 USB1 10 T LAN1 10 Gb 5 Dedicated IPMI LAN 11 T LAN2 10 Gb 6 COM1 12 UID Button Note only two LAN ports 8 and 9 as shown are included on the 6016T 6RF The 6016T 6RFT also includes the 10 Gb T LAN ports 5 7 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 5 5 Installing Memory Note Check the Supermicro web site for recommended memory modules CAUTION Exercise extreme care when installing or rem
80. in a situation that could cause bodily injury Before you work on any equipment be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents ROEA OTTO ZA REEKLET prelio WHEE HOE TOC OPNO COMES Sl Vc BATEN CAR VS fi OE CHE RS UC ERHERS BBG EDR ICAU PE PT Poft GEI EE DAVIE A LEE ER TIETE o REN EUH OS e IEE TS Fie ebe e KRENI n Be Er He AT RE E SAGA TE TREE o ERE EA ZA gt BE A FRAY robe gt ESAS ER EY RE EE RIE ESR REA SEI EE Our SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr Sie befinden sich in einer Situation die zu Verletzungen f hren kann Machen Sie sich vor der Arbeit mit Ger ten mit den Gefahren elektrischer Schaltungen und den blichen Verfahren zur Vorbeugung vor Unf llen vertraut Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen bersetzung in den bersetzten Sicherheitshinweisen die zusammen mit diesem Ger t ausgeliefert wurden
81. ined Select SWDMAO to allow the BIOS to use Single Word DMA mode 0 It has a data transfer rate of 2 1 MB s Select SWDMA1 to allow the BIOS to use Single Word DMA mode 1 It has a data transfer rate of 4 2 MB s 7 13 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Select SWDMA2 to allow the BIOS to use Single Word DMA mode 2 It has a data transfer rate of 8 3 MB s Select MWDMAO to allow the BIOS to use Multi Word DMA mode O It has a data transfer rate of 4 2 MB s Select MWDMA1 to allow the BIOS to use Multi Word DMA mode 1 lt has a data transfer rate of 13 3 MB s Select MWDMA2 to allow the BIOS to use Multi Word DMA mode 2 It has a data transfer rate of 16 6 MB s Select UDMAO to allow the BIOS to use Ultra DMA mode 0 It has a data transfer rate of 16 6 MB s It has the same transfer rate as PIO mode 4 and Multi Word DMA mode 2 Select UDMA1 to allow the BIOS to use Ultra DMA mode 1 It has a data transfer rate of 25 MB s Select UDMA to allow the BIOS to use Ultra DMA mode 2 It has a data transfer rate of 33 3 MB s Select UDMAS to allow the BIOS to use Ultra DMA mode 3 It has a data transfer rate of 44 4 MB s Select UDMAA to allow the BIOS to use Ultra DMA mode 4 It has a data transfer rate of 66 6 MB s Select UDMAS5 to allow the BIOS to use Ultra DMA mode 4 It has a data transfer rate of 100 MB s Select UDMA6 to allow the BIOS to use Ultra DMA mode 4 It has a data transfer rate of 133 MB s S
82. ing air that moves through the system from front to back If you need to disconnect any of these cables you should take care to reroute them as they were originally after reconnecting them make sure the red wires connect to the pin 1 locations If you are configuring the system keep the airflow in mind when routing the cables The following data cables with their connector locations noted should be connect ed See the serverboard layout diagram in this chapter for connector locations e DVD ROM drive cable SATAO e SAS cables SASO SAS3 e Control Panel cable JF1 see next page Connecting Power Cables The X8DTU 6TF X8DTU 6F has a 24 pin primary power supply connector des ignated JPW1 for connection to the ATX power supply Connect the appropriate connector from the power supply to JPW1 to supply power to the serverboard See the Connector Definitions section in this chapter for power connector pin definitions In addition your power supply must be connected to the 8 pin Proces sor Power connectors at JPW2 and JPW3 Connecting the Control Panel JF1 contains header pins for various front control panel connectors See Figure 5 1 for the pin locations of the front control panel buttons and LED indicators Please note that even and odd numbered pins are on opposite sides of each header All JF1 wires have been bundled into single keyed ribbon cable to simplify their connection The red wire in the ribbon cable plugs into p
83. into a Telco Rack To install the 6016T 6RFT 6016T 6RF into a Telco type rack use two L shaped brackets on either side of the chassis four total 1 First determine how far follow the server will extend out the front of the rack Larger chassis should be positioned to balance the weight between front and back If a bezel is included on your server remove it 2 Then attach the two front brackets to each side of the chassis then the two rear brackets positioned with just enough space to accommodate the width of the telco rack 3 Finish by sliding the chassis into the rack and tightening the brackets to the rack Note Figure is for illustrative purposes only Always install servers to the bottom of a rack first Stability hazard The rack stabilizing mechanism must be in place or the A rack must be bolted to the floor before you slide the unit out for servicing Failure to stabilize the rack can cause the rack to tip over 2 6 Chapter 2 Server Installation Figure 2 3 Installing the Server into a Rack 2 7 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 2 6 Checking the Serverboard Setup After you install the system in the rack you will need to open the top cover to make sure the serverboard is properly installed and all the connections have been m
84. ion card with pre installed riser cards PCI Card Installation Before installing a PCI add on card make sure you power off the system first Begin by removing the top chassis cover Two riser cards should be pre installed into the system Remove the screws that secure the riser cards to the rear of the chassis then lift the riser card assembly from the chassis Insert the PCI card into the riser card slot pushing down with your thumbs evenly on both sides of the card note that the add on card attaches to the riser card with a single screw After the card has been installed reinsert the riser card back into the expansion slot on the board then secure it with the same screws you removed previously Finish by replacing the chassis cover PCI Slot Card Configurations Riser Card Expansion Card Supported RSC R1UU 2E8 left side 1x UIO card and 1x PCI E x16 card RSC R1UU E8R right side 2x low profile PCI E x8 cards Chapter 5 Advanced Serverboard Setup 5 7 Serverboard Details Figure 5 4 SUPER X8DTU 6TF Layout UID EER n Ea Se San eleng ai Lana LAN o VGA COM1 Kb e Vd nA l ol o Mse e Sa lS w o2 loom PPAR erro IPMI LAN Sols pei dmn Gamm Zem 3 Intel 82576 m Ethernet 3 Intel 82599 JPL18 Controller C
85. ircuits surtension ce produit d pend de l installation lectrique du local V rifiez que le courant nominal du dispositif de protection n est pas sup rieur 250 V 20 A xm v san xp nye 012752 DIPNTAN mnn PY TANDA m x15 60VDC 20A 2 IND X NIT san IPA 155 an usn A Vois a Al By sual isl sll ee Uylacd dora se dales S Gel Ide Aide 20A 250VDC 0e JS ugl d s Sled saat Ol Oe ado 4 5 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual AI la 2 35 tea so AAA AAL Ass wa 2H o VEY us39 YA WEN 250V E 20A AHH ZAI Jus spo gh Waarschuwing Dit product is afhankelijk van de kortsluitbeveiliging overspanning van uw electrische installatie Controleer of het beveiligde aparaat niet groter gedimensioneerd is dan 220V 20A Power Disconnection Warning A Warning The system must be disconnected from all sources of power and the power cord removed from the power supply module s before accessing the chassis interior to install or remove system components FDR UY OO EE VAFLI Ze OWDI E RUBRO ALORDI Vrv ABICV IRA TAWI VAT LO BIN ATO YARD HEPA FRERES NPD INAS PED DO ES qx ZE E TETRTTJF AS ER VN SERIOUS E UUT TS Pris gu 5 E A E ETA RAS RA TER gt AIG ARSC EEE gt MRE Warnung T D
86. isting of supported processors Memory The X8DTU 6TF X8DTU 6F features 18 DIMM sockets that can support up to 288 GB of registered ECC DDR3 1333 1066 800 or 48 GB of unbuffered ECC non ECC DDR3 1333 1066 800 SDRAM Please refer to Chapter 5 for installing memory UIO The X8DTU 6TF X8DTU 6F is a specially designed serverboard that features Supermicro s UIO Universal I O technology UIO serverboards have a PCI Ex press 2 0 x8 slot that can support any one of several types of UIO card types to add SAS ports SATA ports additional LAN ports or other additional functions to the serverboard This allows the user to tailor the serverboard to their own needs Note the server does not come with a UIO card installed Onboard SAS An onboard LSI 2108 SAS controller in integrated into the X8DTU 6TF X8DTU 6F The hot swap SAS drives are connected to a backplane that provides power bus termination and configuration settings Note The operating system you use must have RAID support to enable the hot swap capability and RAID function of the SAS drives RAID 0 1 5 6 10 50 and 60 is supported Refer to the following ftp site for setup guidelines lt ftp ftp supermicro com driver SAS LSI LSI_SAS_EmbMRAID_SWUG pdf gt Onboard Serial ATA An on chip ICH10R SATA controller is integrated into the X8DTU 6TF X8DTU 6F to provide a six port 3 Gb sec SATA subsystem which is RAID 0 1 5 and 1 2 Chapter 1 Introduction 10 su
87. ith another identical power supply unit 2 Push the new power supply unit into the power bay until you hear a click 3 Secure the locking tab on the unit 4 Finish by plugging the AC power cord back into the unit 6 8 Chapter 6 Advanced Chassis Setup Figure 6 5 Removing Replacing the Power Supply 6 9 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes 6 10 Chapter 7 BIOS 7 1 Chapter 7 BIOS Introduction This chapter describes the AMI BIOS Setup Utility for the X8DTU 6F X8DTU 6TF The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens Starting BIOS Setup Utility To enter the AMI BIOS Setup Utility screens press the lt Delete gt key while the system is booting up Note In most cases the Delete key is used to invoke the AMI BIOS setup screen There are a few cases when other keys are used such as F1 F2 etc Each main BIOS menu option is described in this manual The Main BIOS setup menu screen has two main frames The left frame displays all the options that can be configured Grayed out options cannot be configured Options in blue can be configured by the user The right frame displays the key legend Above the key legend is an area reserved for a text message When an option is selected in the left frame it is highlighted in white Often a text message will accompa
88. lable when the option AHCI is selected Use this feature to select the AHCI Codebase for the ICH South Bridge The options are BIOS Native Module and Intel AHCI ROM SATA 2 Configuration Available when the option IDE is selected Selecting Enhanced will set SATA 2 to native SATA mode The options are Disabled and Enhanced IDE Detect Timeout sec Use this feature to set the time out value for the BIOS to detect the ATA ATAPI devices installed in the system The options are O sec 5 10 15 20 25 30 and 35 Primary IDE Master Slave Secondary IDE Master Slave Third IDE Master and Fourth IDE Master These settings allow the user to set the parameters the slots indicated above Press Enter to activate the following submenu screen for detailed options of these items Set the correct configurations accordingly The items included in the submenu are listed below Type Select the type of device connected to the system The options are Not Installed Auto CD DVD and ARMD Chapter 7 BIOS LBA Large Mode LBA Logical Block Addressing is a method of addressing data on a disk drive In the LBA mode the maximum drive capacity is 137 GB For drive capacities over 137 GB your system must be equipped with a 48 bit LBA mode addressing If not contact your manufacturer or install an ATA 133 IDE controller card that supports 48 bit LBA mode The options are Disabled and Auto Block Multi Sector Transfer Block Mode boo
89. led SXB1 PCI E 2 0 x16 x8 Option ROM SXB3 PCI E 2 0 x8 Option ROM SXB2 PCI E 2 0 x8 x4 Option ROM SXB2 PCI E 2 0 x4 Option ROM Select Enabled to enable PCI E slots indicated above It can also enable Option ROMs specified to boot computer using a network interface from these slots The options are Enabled and Disabled Onboard LAN Option ROM Select Select iSCSI to use iSCSI Option ROMs to boot the computing using a network device Select iSCSI to use PXE Option ROMs to boot the computing using a network device The options are iSCSI and PXE Load Onboard LAN1 LAN4 Option ROM Select Enabled to enable the onboard LAN1 LANZ LAN3 or LAN4 Option ROM This is to boot computer using a network interface The options are Enabled and Disabled Boot Graphics Adapter Priority This feature allows the user to specify which graphics controller to be used as the primary boot graphics controller The options are Onboard VGA SXB1 PCI E 2 0 x16 and Offboard VGA SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual gt Super IO Device Configuration Serial Port1 Address Serial Port2 Address This option specifies the base I O port address and the Interrupt Request address of Serial Port 1 and Serial Port 2 Select Disabled to prevent the serial port from accessing any system resources When this option is set to Disabled the serial port physically becomes unavailable Select 3F8 IRQA to allow the serial port to use 3F8 as its I O port address
90. ly See www dtsc ca gov hazardouswaste perchlorate B 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes continued from front The products sold by Supermicro are not intended for and will not be used in life support systems medical equipment nuclear facilities or systems aircraft aircraft devices aircraft emergency com munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage Accordingly Supermicro dis claims any and all liability and should buyer use or sell such products for use in such ultra hazardous applications it does so entirely at its own risk Furthermore buyer agrees to fully indemnify defend and hold Supermicro harmless for and against any and all claims demands actions litigation and proceedings of any kind arising out of or related to such ultra hazardous use or sale B 4
91. m is set to Auto Legacy USB support will be automatically enabled if a legacy USB device is installed on the motherboard and vise versa The settings are Disabled Enabled and Auto Port60h 64h Emulation Select Enabled to enable 60h 64h emulation for complete USB keyboard support for operating systems that are not compatible with USB devices The options are Enabled and Disabled IDE SATA Configuration When this submenu is selected the AMI BIOS automatically detects the presence of the IDE and SATA devices and displays the following items SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual SATA 1 Configuration If Compatible is selected it sets SATA 1 to legacy compatibility mode while se lecting Enhanced sets SATA 1 to native SATA mode The options are Disabled Compatible and Enhanced Configure SATA 1 as Not available when SATA 1 Configuration is disabled This feature allows the user to select the drive type for SATA 1 The options are IDE RAID and AHCI When the option RAID is selected the item ICH RAID Code Base will appear When the option AHCI is selected the item ICH AHCI Codebase will be available ICH RAID Code Base Available when the option RAID is selected Select Intel to enable Intel s SATA RAID firmware to configure Intel s SATA RAID settings Select Adaptec to enable Adaptec s SATA RAID firmware to configure Adaptec s SATA RAID settings The options are Intel and Adaptec ICH AHCI Codebase Avai
92. med delay in minutes or seconds before a system power down or reset 7 24 Chapter 7 BIOS after an operating system failure is detected The options are 5 Min 1 Min 30 Sec and 10 Sec gt DMI Event Log Configuration View Event Log Use this option to view the System Event Log Mark All Events as Read This option marks all events as read The options are OK and Cancel Clear Event Log This option clears the Event Log memory of all messages The options are OK and Cancel PCIE Event Log Select Yes to activate and display the PCI Express slot event log The options are Yes and No Memory ECC Error Log Select Yes to activate and display ECC Memory Error event log The options are Yes and No 7 4 Security Settings The AMI BIOS provides a Supervisor and a User password If you use both pass words the Supervisor password must be set first BIOS SETUP UTILITY Change Supervisor Password 7 25 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Supervisor Password This item indicates if a Supervisor password has been entered for the system Not Installed means a Supervisor password has not been used User Password This item indicates if a user password has been entered for the system Not In stalled means that a user password has not been used Change Supervisor Password Select this feature and press lt Enter gt to access the submenu and then type ina new Supervisor Password User Acc
93. mory to L2 cache in the forward or backward manner to improve CPU performance The options are Disabled and Enabled Adjacent Cache Line Prefetch Available when supported by the CPU The CPU prefetches the cache line for 64 bytes if this option is set to Disabled If this feature is set to Enabled the CPU prefetches both cache lines for 128 bytes as comprised The options are Disabled and Enabled MPS and ACPI MADT Ordering This feature allows the user to configure the MPS Multi Processor Specifica tions and ACPI Advanced Configuration and Power Interface settings for your motherboard Select Modern Ordering if XP or a newer version of Windows OS is used in the motherboard Select Legacy Ordering if 2000 or an earlier version is used The options are Modern Ordering and Legacy Ordering Machine Checking Feature Available when supported by the CPU Select Enabled to use this feature which will allow the CPU to detect and report hardware machine errors via a set of model specific registers MSRs The options are Disabled and Enabled Chapter 7 BIOS Intel Virtualization Technology Available when supported by the CPU Select Enabled to use the feature of Virtualization Technology to allow one platform to run multiple operating systems and applications in independent partitions creat ing multiple virtual systems in one physical computer The options are Enabled and Disabled Note If there is any change to this setting
94. ng anderer Kabel und Adapter kann zu einer Fehlfunktion oder ein Brand entstehen Elektrische Ger te und Material Safety Law verbietet die Verwendung von UL oder CSA zertifizierte Kabel UL oder CSA auf der Code f r alle anderen elektrischen Ger te als Produkte von Supermicro nur bezeichnet gezeigt haben jAdvertencia Al instalar el producto utilice los cables de conexi n previstos o designados los cables y adaptadores de CA La utilizaci n de otros cables y adaptadores podr a ocasionar un mal funcionamiento o un incendio Aparatos El ctricos y la Ley de Seguridad del Material proh be el uso de UL o CSA cables certificados que tienen UL o CSA se muestra en el c digo de otros dispositivos el ctricos que los productos designados por Supermicro solamente 4 18 Chapter 4 Warning Statements for AC Systems Attention Lors de l installation du produit utilisez les bables de connection fournis ou d sign L utilisation d autres cables et adaptateurs peut provoquer un dysfonctionnement ou un incendie Appareils lectrom nagers et de loi sur la s curit Mat riel interdit l utilisation de UL ou CSA cables certifi s qui ont UL ou CSA indiqu sur le code pour tous les autres appareils lectriques que les produits d sign s par Supermicro seulement AC nxn an onun FTN UN AC DARNA Depp 0272353 vnum w WIAA nx DPPN UN IX lan 01749 535 358 ARNA IN 225 992 sg 15 OW pat 1391 DOR OP mrmoa pim YAWN v05223 vvv Pin s Dy
95. ns TAXAN CO ALY MS PICA MKT ENS TER BCL CL Ed 772 AIRE RA FETE IV SEE GER TOMO CAV 4 O FB MOTO AIAD DURECH Ap Oo VE aR MI ER a ELS Ait D Hiec e HUC LEFF gt wll an ERAS R RAE PALA gt PURI HAZ EL eS EE HY tl cda ae Hr e i AERE RE LIRR LAL gt SHEER MC S Etude AT BEXE A BIER EX gt Warnung Diese Einheit ist zur Installation in Bereichen mit beschr nktem Zutritt vorgesehen Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug Schloss und Schl ssel oder einer sonstigen Sicherheitsvorkehrung m glich jAdvertencia Esta unidad ha sido dise ada para instalaci n en reas de acceso restringido S lo puede obtenerse acceso a una de estas reas mediante la utilizaci n de una herramienta especial cerradura con llave u otro medio de seguridad Attention Cet appareil doit tre install e dans des zones d acc s r serv s L acc s une zone d acc s r serv n est possible qu en utilisant un outil sp cial un m canisme de verrouillage et une cl ou tout autre moyen de s curit 4 9 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Paan nv 3 OY IN ITIN nya nm nu n nmun a23n 092 ww amma mma ns penn v 7121 50332 nm 33523 nnoaN gt gt gt 3 glans la u
96. ny it Note the AMI BIOS has default text messages built in Supermicro retains the option to include omit or change any of these text messages The AMI BIOS Setup Utility uses a key based navigation system called hot keys Most of the AMI BIOS setup utility hot keys can be used at any time during the setup navigation process These keys include F1 lt F10 gt Enter ESC ar row keys etc Note Options printed in Bold are default settings How To Change the Configuration Data The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility This Setup utility can be accessed by pressing Del at the appropriate time during system boot SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Note For AMI BIOS Recovery please refer to the AMI BIOS Recovery Instructions posted on our website at http www supermicro com support manuals Starting the Setup Utility Normally the only visible Power On Self Test POST routine is the memory test As the memory is being tested press the Delete key to enter the main menu of the AMI BIOS Setup Utility From the main menu you can access the other setup screens An AMI BIOS identification string is displayed at the left bottom corner of the screen below the copyright message Warning Do not upgrade the BIOS unless your system has a BlOS related issue Flashing the wrong BIOS can cause irreparable damage to th
97. o keep Console Redirection active during POST and Boot Loader The options are Disabled Boot Loader and Always Terminal Type This feature allows the user to select the target terminal type for Console Redirec tion The options are ANSI VT100 and VT UTF8 VT UTF8 Combo Key Support Aterminal keyboard definition that provides a way to send commands from a remote console Available options are Enabled and Disabled Sredir Memory Display Delay This feature defines the length of time in seconds to display memory information The options are No Delay Delay 1 Sec Delay 2 Sec and Delay 4 Sec gt Hardware Health Monitor This feature allows the user to monitor system health and review the status of each item as displayed CPU Overheat Alarm This option allows the user to select the CPU Overheat Alarm setting which de termines when the CPU OH alarm will be activated to provide warning of possible CPU overheat Warning 1 Any temperature that exceeds the CPU threshold temperature predefined by the CPU manufacturer may result in CPU overheat or system instability When the CPU temperature reaches this predefined threshold the CPU and system cooling fans will run at full speed 2 To avoid possible system overheating please be sure to provide adequate airflow to your system The options are e The Early Alarm Select this setting if you want the CPU overheat alarm includ ing the LED and the buzzer to be triggered as soon as the CP
98. o the serverboard and chassis various hardware components have been included with the 6016T 6RFT 6016T 6RF as listed below e One slim DVD ROM drive DVM TEAC DVD SBT Five sets of 4 cm counter rotating fans FAN 0086L4 One air shroud MCP 310 81901 0B e Two passive CPU heatsinks SNK P0037P e Riser Cards see Section 5 6 for details One RSC R1UU 2bE8 One RSC R1UU E8R e SATA Accessories One SATA backplane BPN SAS 815TQ One SAS cable CBL 00288L Four drive carriers MCP 220 00075 0B e One rackmount kit MCP 290 00062 0N e One SuperServer 6016T 6RFT 6016T 6RF User s Manual Note For your system to work properly please follow the links below to download all necessary drivers utilities for your server e Product drivers and utilities ftp ftp supermicro com e Product safety info http super dev about policies safety_information cfm e f you have any questions please contact our support team at support supermicro com dai SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 1 2 Serverboard Features At the heart of the SuperServer 6016T 6RFT 6016T 6RF lies the X8DTU 6TF X8DTU 6F a dual processor serverboard based on the Intel 5520 chipset Below are the main features of the serverboard See Figure 1 1 for a block diagram of the chipset Processors The X8DTU 6TF X8DTU 6F supports single or dual Intel 5500 5600 Series processors in LGA1366 sockets Please refer to our web site for a complete l
99. on the IPMI specifications please visit Intel s website at www intel com IPMI Firmware Version This item displays the current IPMI Firmware Version Status of BMC The Baseboard Management Controller BMC manages the interface between system management software and platform hardware This item displays the status of the current BMC controller gt View BMC System Event Log This feature displays the BMC System Event Log SEL It shows the total number of entries of BMC System Events To view an event select an Entry Number and pressing lt Enter gt to display the information as shown in the screen e Total Number of Entries e SEL Entry Number e SEL Record ID 7 22 Chapter 7 BIOS e SEL Record Type Event Timestamp e Generator ID e Event Message Format Ver Event Sensor Type e Event Sensor Number Event Dir Type e Event Data Clear BMC System Event Log Clear BMC System Log now Select OK and press the Enter key to clear the BMC system log immediately Select Cancel to keep the BMC System log The options are OK and Cancel Caution Any cleared information is unrecoverable Make absolutely sure that you no longer need any data stored in the log before clearing the BMC Event Log Set LAN Configuration Set this feature to configure the IPMI LAN adapter with a network address as shown in the following graphics Channel Number This feature displays the channel number Channel Number
100. overheat alarm User intervention If the system buzzer and Overheat LED has activated take action immediately by checking the system fans chassis ventilation and room temperature to correct any problems Notes 1 The system may shut down if it continues for a long period to prevent damage to the CPU 7 18 Chapter 7 BIOS 2 The information provided above is for your reference only For more information on thermal management please refer to Intel s Web site at www Intel com System Temperature The system temperature will be displayed in degrees in Celsius and Fahrenheit as it is detected by the BIOS Fan 1 Fan 8 Reading This feature displays the fan speed readings from fan interfaces Fan 1 through Fan 8 Fan Speed Control Modes This feature allows the user to decide how the system controls the speeds of the onboard fans The CPU temperature and the fan speed are correlative When the CPU on die temperature increases the fan speed will also increase for effective system cooling Select Full Speed FS to allow the onboard fans to run at full speed for maximum cooling The FS setting is recommended for special system configuration or debugging Select Performance PF for better system cooling The PF setting is recommended for high power consuming and high density systems Select Balanced BL for the onboard fans to run at a speed that will balance the needs between system cooling and power saving The BL setting is
101. oving DIMM modules to prevent any possible damage Installing DIMMs 1 Insert the desired number of DIMMs into the memory slots starting with slot P1 DIMM1A For best performance install memory modules of the same type and same speed in the slots as indicated in the tables below 2 Insert each DIMM vertically into its slot Pay attention to the notch along the bottom of the module to prevent inserting the DIMM module incorrectly see Figure 5 5 3 Gently press down on the DIMM module until it snaps into place in the slot Repeat for all modules Memory Support The X8DTU 6TF X8DTU 6F supports up to 288 GB of registered ECC or 48 GB of unbuffered ECC non ECC DDR3 1333 1066 800 SDRAM in 18 slots Note Memory speed support depends on the type of CPU used Figure 5 3 Installing DIMM into Slot Notch Notch To Install Insert module vertically and press down until it snaps into place Pay attention to the alignment notch at Y Front View the bottom To Remove Use your thumbs to Note Notch should align d hib l with the receptive key gently pus e release Release Tab point on the slot Release Tab tabs near both ends of the module This should Y y release it from the slot 5 8 Chapter 5 Advanced Serverboard Setup Memory Population for Optimal Performance With One CPU CPU1 Installed P1 DIMMs 3 DIMMs 6 DIMMs 9 DIMMs RDIMMs only Note To Populate P1 DIMMs Branch 0 Branch 1 Branch 2 P1 1A
102. pported RAID 5 is supported with Windows OS only The SATA drives are hot swappable units Note You must have RAID set up to enable the hot swap capability of the SATA drives Documentation on RAID setup guidelines can be found on our web site Rear I O Ports The color coded UO ports include one COM port a VGA monitor port two USB 2 0 ports PS 2 mouse and keyboard ports one dedicated IPMI LAN port and two gigabit Ethernet ports The 6016T 6RFT X8DTU 6TF includes two additional Ethernet ports Graphics Controller The X8DTU 6TF X8DTU 6F features an integrated Matrox G200eW graphics chip Other Features Other onboard features that promote system health include onboard voltage moni tors auto switching voltage regulators chassis and CPU overheat sensors virus protection and BIOS rescue 1 3 Server Chassis Features The 6016T 6RFT 6016T 6RF is built upon the SC819TQ R700U chassis Details on the chassis and on servicing procedures can be found in Chapter 6 The following is a general outline of the main features of the chassis System Power The SC819TQ R700U features a redundant 700W power supply consisting of two power modules The system does not need to be shut down when replacing or removing a single power supply module Hard Drives The SC819TQ R700U chassis was designed to support four hot swap SAS or SATA hard drives 1 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual PCI Expansion Slots T
103. recommended for regular systems with normal hardware configurations Select Energy Saving ES for best power efficiency and maximum quietness The Options are Full Speed FS Performance PF Balanced BL and Energy Saving ES Voltage Monitoring CPU1 Vcore CPU2 Vcore CPU1 DIMM CPU2 DIMM 1 1V 3 3V 1 5V 5V 12V 3 3VSB 5VSB and Vbat gt ACPI Configuration Use this feature to configure Advanced Configuration and Power Interface ACPI power management settings for your system ACPI Aware O S Select Yes to enable ACPI support for an operating system that supports ACPI Select No to disable ACPI support for an OS that does not support ACPI The op tions are Yes and No ACPI Version Features Available ACPI Aware O S Yes The options are ACPI v1 0 ACPI v2 0 and ACPI v3 0 Please refer to ACPI s website for further explanation http www acpi info SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual ACPI APIC Support Available ACPI Aware O S Yes Select Enabled to include the ACPI APIC Table Pointer in the RSDT Root System Description Table pointer list The options are Enabled and Disabled APIC ACPI SCI IRQ When this item is set to Enabled APIC ACPI SCI IRQ is supported by the system The options are Enabled and Disabled Headless Mode Available ACPI Aware O Sz Yes This feature is used to enable system to function without a keyboard monitor or mouse attached The options are Enabled and Disabled Hig
104. rruptible power supply UPS source 2 10 Chapter 3 System Interface Chapter 3 System Interface 3 1 Overview There are several LEDs on the control panel as well as others on the hard drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components There are also two buttons on the chassis control panel and an on off switch on the power supply This chapter explains the meanings of all LED indicators and the appropriate response you may need to take 3 2 Control Panel Buttons There are three push buttons located on the front of the chassis These are in order from left to right A UID button a reset button and a power on off button UID Depressing the UID unit identifier button illuminates an LED on both the front and rear of the chassis for easy system location in large stack configurations The LED will remain on until the button is pushed a second time Another UID button on the rear of the chassis serves the same function Reset The reset button reboots the system The main power switch is used to apply or remove power from the power supply to the server system Turning off system power with this button removes the main power but keeps standby power supplied to the system 3 1 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 3 3 Control Panel LEDs The control panel located on the front of the SC819TQ chassis has five LEDs
105. rth and south center edges 2 Align the CPU key the semi circle cutout with the socket key the notch below the gold color dot on the side of the socket 3 Once the CPU and the socket are aligned carefully lower the CPU straight down into the socket Do not rub the CPU against the surface of the socket or its pins to avoid damaging the CPU or the socket 4 With the CPU in the socket in spect the four corners of the CPU ait to make sure that it sits level and i SEA is properly installed 5 Once the CPU is securely seated in the socket lower the CPU load plate to the socket 6 Use your thumb to gently push the Socket clip down to the clip lock 7 Repeat for the CPU2 socket for a dual processor configuration Important Please save the plastic cap The serverboard must be shipped with the plastic cap properly installed to protect the CPU socket pins Shipment without the plastic cap properly installed may cause damage to the socket pins SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Installing the Heatsink 1 Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the retention mechanism Thermal Grease 2 Remove the thin layer of protective film from the copper core of the heatsink Warning The CPU may overheat if the protective film is not removed from the heatsink CPU 3 Apply the proper amount of ther mal grease on the CPU If your heat
106. sink came with a thermal pad please ignore this step 4 Screw in two diagonal screws i e the 1 and the 2 screws until just snug do not over tighten the screws which may damage the CPU aer Screw 1 Screw 3 Screw 2 5 Finish the installation by fully tight ening all four screws Chapter 5 Advanced Serverboard Setup Removing the Heatsink Warning We do not recommend removing the CPU or the heatsink If you do need to remove the heatsink please follow the instructions below to prevent damage to the CPU or other components 1 Unplug the power cord from the power supply 1 Unscrew and remove the heatsink screws in the sequence shown in the picture below 2 Hold the heatsink and gently wiggle it to loosen it from the CPU Do not use excessive force when doing this 3 Once the heatsink is loosened remove it from the CPU 4 Clean the surface of the CPU and the heatsink to get rid of the old thermal grease Reapply the proper amount of thermal grease before you re install the heatsink Screw Em Pho RT d Screw 1 Screw 3 Screw 2 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 5 3 Connecting Cables Now that the processors are installed the next step is to connect the cables to the serverboard Connecting Data Cables The cables used to transfer data from the peripheral devices have been carefully routed in preconfigured systems to prevent them from blocking the flow of cool
107. sts the IDE drive performance by increasing the amount of data transferred Only 512 bytes of data can be transferred per interrupt if Block Mode is not used Block Mode allows transfers of up to 64 KB per interrupt Select Disabled to allow data to be transferred from and to the device one sector at a time Select Auto to allow data transfer from and to the device occur multiple sectors at a time if the device supports it The options are Auto and Disabled PIO Mode The IDE PIO Programmable I O Mode programs timing cycles between the IDE drive and the programmable IDE controller As the PIO mode increases the cycle time decreases The options are Auto 0 1 2 3 and 4 Select Auto to allow the AMI BIOS to automatically detect the PIO mode Use this value if the IDE disk drive support cannot be determined Select 0 to allow the AMI BIOS to use PIO mode O It has a data transfer rate of 3 3 MB s Select 1 to allow the AMI BIOS to use PIO mode 1 It has a data transfer rate of 5 2 MB s Select 2 to allow the AMI BIOS to use PIO mode 2 It has a data transfer rate of 8 3 MB s Select 3 to allow the AMI BIOS to use PIO mode 3 It has a data transfer rate of 11 1 MB s Select 4 to allow the AMI BIOS to use PIO mode 4 It has a data transfer band width of 32 Bits Select Enabled to enable 32 Bit data transfer DMA Mode Select Auto to allow the BIOS to automatically detect IDE DMA mode when the IDE disk drive support cannot be determ
108. taci n Attention Avant de brancher le syst me sur la source d alimentation consulter les directives d installation Ana mp nana wn nmn DINA OX NIP v AGUA jas ell sl Jue gi Sd ca ill Galt l NAAS AAA AAS dep AA MUS MIF AA Waarschuwing Raadpleeg de installatie instructies voordat u het systeem op de voedingsbron aansluit 4 4 Chapter 4 Warning Statements for AC Systems Circuit Breaker A Warning This product relies on the building s installation for short circuit overcurrent protection Ensure that the protective device is rated not greater than 250 V 20 A PET LI TORNA BREA QI READ RIOTS EEN use TE OFERSD250 V 20 ARREBATO C EZ ES Pv WE a AER EEGENEN VET 250V 20A gt ERE HEE Ar OAR EB Sit HE EH SE SREY CES ALEA EUROS DRE csc HJ AE ES FeRAM 250V 20A gt Warnung Dieses Produkt ist darauf angewiesen dass im Geb ude ein Kurzschluss bzw berstromschutz installiert ist Stellen Sie sicher dass der Nennwert der Schutzvorrichtung nicht mehr als 250 V 20 A betr gt jAdvertencia Este equipo utiliza el sistema de protecci n contra cortocircuitos o sobrecorrientes del edificio Aseg rese de que el dispositivo de protecci n no sea superior a 250 V 20 A Attention Pour ce qui est de la protection contre les courts c
109. tes SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Table of Contents Chapter 1 Introduction 1 1 EI geegent Eier 1 1 1 2 Serverboard Features A A 1 2 EOS OS de x 1 2 Mn een 1 2 A HEC 1 2 eebe ee cm 1 2 Onboard Serial ATA ascii i ie ees ae ia 1 2 A AA 1 3 Graphics Controller en s 1 3 TT 1 3 1 3 Server Chassis 21 0 cm 1 3 System POWO Kec eee 1 3 Hard DIVES rsss EE 1 3 PCI EE E 1 4 PS 1 4 Cooling SY E 1 4 1 4 eet ee Een E 1 6 Chapter 2 Server Installation 2 1 gg c 2 1 222 Unpacking th System quias eire S5 apes ee ceases b Mere p teenage clea 2 1 2 3 o os o AAA A 2 1 Choosing a Setup Local inside eden 2 1 2 4 Warnings and Precautons een 2 2 o A 2 2 caucdiui icio iaa 2 2 Rack Mounting ee Ee E TEE 2 3 Ambient Operating Temperature extirpar sia dect 2 3 EP e 2 3 Mechanical Loading imitar 2 3 Circuit Overloading VE 2 3 FUG IA El E 2 3 2 5 Installing the System into a Rack eebessgeegeeiegeeg sender ti 2 4 Identifying the Sections of the Rack RallS esgseeegpebreeggseuegespegrueeeegegrgeenggeg 2 4 installing ne inet Ralls Mee 2 4 Installing the Outer EE 2 5 vi Table of Contents Installing the Server Into a Telco Back ottenere tae 2 6 Checking the Serverboard Setup icono Chapter 3 S
110. the new fan into the vacant space in the housing while making sure the arrows on the top of the fan indicating air direction point in the same direc tion as the arrows on the other fans 5 Reposition the fan housing back over the two mounting posts in the chassis then reconnect the fan wires to the same chassis fan headers you removed them from 6 Power up the system and check that the fan is working properly and that the LED on the control panel has turned off 7 Finish by replacing the chassis cover 6 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Figure 6 2 System Cooling Fans Accessing the Drive Bays Hard Drives Because of their hotswap capability you do not need to access the inside of the chassis or power down the system to install or replace the SAS SATA drives Proceed to the next section for instructions DVD ROM Drive For installing removing a DVD ROM drive you will need to gain access to the inside of the 6016T 6RFT 6016T 6RF by removing the top cover of the chassis Proceed to the DVD ROM Drive Installation section later in this chapter for instructions Note Only a slim DVD ROM drive will fit into the 6016T 6RFT 6016T 6RF Warning Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers For information on recommended HDDs visit the Supermicro Web site at http Awww supermicro com products nfo storage cfm 6 4 Chapter 6 Advanced Chassis Setup
111. the system is operating 3 4 Drive Carrier LEDs Green Each SAS SATA drive carrier has a green LED When illuminated this green LED indicates drive activity A connection to the SAS SATA back plane enables this LED to blink on and off when that particular drive is being accessed Please refer to Chapter 6 for instructions on replacing failed SAS SATA drives e Red The red LED to indicate a SAS SATA drive failure If one of the drives fail you should be notified by your system management software Please refer to Chapter 6 for instructions on replacing failed SAS SATA drives 3 3 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Notes 3 4 Chapter 4 Warning Statements for AC Systems Chapter 4 Standardized Warning Statements for AC Systems 4 1 About Standardized Warning Statements The following statements are industry standard warnings provided to warn the user of situations which have the potential for bodily injury Should you have questions or experience difficulty contact Supermicro s Technical Support department for assistance Only certified technicians should attempt to install or configure components Read this appendix in its entirety before installing or configuring components in the Supermicro chassis These warnings may also be found on our web site at http www supermicro com about policies safety_information cfm Warning Definition A Warning This warning symbol means danger You are
112. tinued on next page Chapter 5 Advanced Serverboard Setup LED Description LED1 Power LED LED2 UID LED LED3 BMC Heartbeat LED LED4 SAS Activity LED LED5 SAS Heartbeat LED LED6 SAS Error LED LED UID LED 5 8 Connector Definitions ATX Power 24 pin Connector Pin Definitions ATX Power Connector The primary ATX power supply con nector meets the SSI EPS 12V speci fication Make sure that the orientation of the connector is correct See the table on the right for pin definitions Processor Power Connectors JPW2 and JPW3 must also be con nected to the power supply to provide power for the processor s See the table on the right for pin definitions Pin Definition Pin Definition 3 3V 3 3V COM 5V 2 3 4 5 6 if 8 9 ak o Processor Power Pin Definitions JPW2 JPW3 Pins Definition 1 through 4 Ground 5 through 8 Warning To prevent damage to your power supply or serverboard please use a power supply that contains a 24 pin and two 8 pin power connectors Be sure to connect these power connectors to the 20 pin and the two 8 pin power connectors on your serverboard for adequate power supply to your system Failure to do so will void the manufacturer warranty on your power supply and serverboard 5 15 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual NMI Button NMI Button Pin Definitions JF1 The non maskable interrupt button SEM header is located on pins 19 and 20 dal e of
113. uper Micro Computer Inc SF No 150 Jian 1st Rd Zhonghe Dist New Taipei City 23511 Taiwan R O C Tel 886 2 8226 3990 Fax 886 2 8226 3992 Web Site www supermicro com tw Technical Support Email support supermicro com tw Tel 886 2 8226 3990 1 6 Chapter 2 Server Installation Chapter 2 Server Installation 2 1 Overview This chapter provides a quick setup checklist to get your 6016T 6RFT 6016T 6RF up and running Following these steps in the order given should enable you to have the system operational within a minimum amount of time This quick setup assumes that your system has come to you with the processors and memory pre installed If your system is not already fully integrated with a serverboard processors system memory etc please turn to the chapter or section noted in each step for details on installing specific components 2 2 Unpacking the System You should inspect the box the 6016T 6RFT 6016T 6RF was shipped in and note if it was damaged in any way If the server itself shows damage you should file a damage claim with the carrier who delivered it Decide on a suitable location for the rack unit that will hold the 6016T 6RFT 6016T 6RF It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated You will also need it placed near a grounded power outlet Be sure to read the Rack and Server Pr
114. way from the drive and push the drive unit out the front of the chassis Add a new drive by following this procedure in reverse order You may hear a faint click of the locking tab when the drive is fully inserted Remember to reconnect the data and power cables to the drive before replac ing the chassis cover and restoring power to the system 6 7 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual 6 4 Power Supply The SuperServer 6016T 6RFT 6016T 6RF has a 700 watt redundant power supply consisting of two power modules Each power supply module has an auto switching capability which enables it to automatically sense and operate at a 100V 240V input voltage Power Supply Failure If either of the two power supply modules fail the other module will take the full load and allow the system to continue operation without interruption The PWR Fail LED will illuminate and remain on until the failed unit has been replaced Replacement units can be ordered directly from Supermicro part number PWS 703 P 1R The power supply units have a hot swap capability meaning you can replace the failed unit without powering down the system Removing the Power Supply First unplug the AC power cord from the failed power supply module 1 Depress the locking tab on the power supply module 2 Use the handle to pull it straight out with the rounded handle see Fig 6 5 Installing a New Power Supply 1 Replace the failed hot swap unit w
115. wo riser cards are included The RSC R1UU E8R is located on the right side of the chassis and supports one low profile PCI E x4 card in a x8 slot The RSC R1UU 2E8 is located on the left side of the chassis and supports two PCI E x8 add on cards See our web site for details http www supermicro com products nfo UIO cfm See section 5 6 of this manual for details Front Control Panel The chassis control panel provides you with system monitoring and control LEDs indicate system power HDD activity network activity 2 overheat fan power failure and UID Unit Identifier A main power button and a UID button is also included Cooling System The SC819TQ R700U has an innovative cooling design that features five sets of 4 cm counter rotating fans located in the middle section of the chassis There is a Fan Speed Control Mode setting in BIOS that allows chassis fan speed to be determined by system temperature The power supply module also includes a cooling fan 1 4 Chapter 1 Introduction Figure 1 1 Intel 5520 IOH 36D ICH10R Chipset System Block Diagram Note This is a general block diagram Please see Chapter 5 for details
116. worden 4 11 SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual Redundant Power Supplies A Warning This unit might have more than one power supply connection All connections must be removed to de energize the unit USE AT COLI MEMO TMD RENTOA ADDES Ay KOA STE DICE FN TOBE NO NET USTED ECA ee EA ER BE ALEA EE E EIERE ERC ze VES ERA A Re RS RA TA SCIAT Re IL KBE e Warnung Dieses Ger t kann mehr als eine Stromzufuhr haben Um sicherzustellen dass der Einheit kein trom zugef hrt wird m ssen alle Verbindungen entfernt werden jAdvertencia Puede que esta unidad tenga m s de una conexi n para fuentes de alimentaci n Para cortar por completo el suministro de energ a deben desconectarse todas las conexiones Attention Cette unit peut avoir plus d une connexion d alimentation Pour supprimer toute tension et tout courant lectrique de l unit toutes les connexions d alimentation doivent tre d branch es THY pD0 n ap ON bit po n35 og amar 99 ng PON v pp 90 ns TNA 307 w mmo ATA DN Chapter 4 Warning Statements for AC Systems ASLAN Aal Calan yy Yi Sae ileal Dal cy 9S a ela w l ye Sam dl el YLT ARIS AN Gay E oy o 4e ra rie o i ATE AAO AL Shed el FA A
117. ystem Interface 3 1 eu M Cr 3 27 Gontrol Panel BUllOls orte Tig eet a cu uo SERRE TEN Canvass 3 3 Control Panel EDS irse doors nen exea e Edge era EEEE 3 4 Drive Carrier LED Chapter 4 Standardized Warning Statements for AC Systems 4 1 X About Standardized Warning Statements essesesesssse Warring BP STD iii is Installation Mie Eil Level Eege Power Disconnection Warning sssini iina NEEN Equipment Installation cere rete eret pen Seege geeedeeg there ENEE SEET ne EE Redundant Power Supplies eege Backplane VOS a Sori Comply with Local and National Electrical Codes ssssssssss geeiert Hot Swap Fat WN AMMA E Power Cable and AC Adapter visi n EE Chapter 5 Advanced Serverboard Setup 5 1 Handling the Serverboard DE xii qq i ee ee ita aa Biver Le alle BEE 5 2 Processor and Heatsink Installaton ec eeeeeeeeeeeeeeeneneeeeeeeeeeeenaeeeeeeeens installing LGATSE6 Proc es SONS C Installing the FeatslrK eiii a Removing the Heatsllk cedi it re Ei nere Enn 5 37 GOMECUNO DADOS ist Connecting Data Cables DRE Connecting Power e Connecting the Control Panelluacnionn alii cis O A S E UI a teeth tete inerenti 56 Adding POl Gafmds ee ee ee ene eee E Ee Me vii SUPERSERVER 6016T 6RFT 6016T 6RF User s Manual X8DTU 6TF X8DTU 6F Quick Heterence Are 5 14 5 B Connector Leben i
Download Pdf Manuals
Related Search
Related Contents
Hampton Bay 14790 Instructions / Assembly Manual Pratic - Ulfer Purificadores de Água 2,24MB - fujitsu general Copyright © All rights reserved.
Failed to retrieve file