Home

Supermicro Superserver 6016XT-TF

Contents

1. System Cooling Four sets of 4 cm counter rotating cooling fans fan speed controlled by BIOS setting and two sets of 4 cm counter rotating cooling fans for GPUs 6016GT series only System Input Requirements AC Input Voltage 180 240 VAC Rated Input Current 7 2A 180V to 9 5 240V Rated Input Frequency 50 60 Hz Power Supply Rated Output Power 1400W w PFC Part PWS 1K41F 1R Rated Output Voltages 12V 117A 5Vsb 6A Operating Environment Operating Temperature 10 to 35 C 50 to 95 F Non Operating Temperature 40 to 70 C 40 to 158 F Operating Relative Humidity 8 to 90 non condensing Non Operating Relative Humidity 5 to 95 non condensing Regulatory Compliance Electromagnetic Emissions FCC Class A EN 55022 Class A EN 61000 3 2 3 3 CISPR 22 Class A Electromagnetic Immunity EN 55024 CISPR 24 EN 61000 4 2 EN 61000 4 3 EN 61000 4 4 EN 61000 4 5 EN 61000 4 6 EN 61000 4 8 EN 61000 4 11 C 2 Appendix C System Specifications Safety CSA EN IEC UL 60950 1 Compliant UL or CSA Listed USA and Canada CE Marking Europe California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warning applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may apply See www dtsc ca gov hazardouswaste perchlorate C 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual
2. Temperature Threshold or Tem perature Tolerance has been assigned at the factory and is the baseline on which the motherboard takes action during different CPU temperature conditions i e by increasing CPU Fan speed triggering the Overheat Alarm etc Since CPUs can have different Temperature Tolerances the installed CPU can now send informa tion to the motherboard what its Temperature Tolerance is and not the other way round This results in r CPU thermal management 1 16 Chapter 7 BIOS Supermicro has leveraged this feature by assigning a temperature status to certain thermal conditions in the processor Low Medium and High This makes it easier for the user to understand the CPU s temperature status rather than by just simply seeing a temperature reading i e 25 C The CPU Temperature feature will display the CPU temperature status as detected by the BIOS Low This level is considered as the normal operating state The CPU temperature is well below the CPU Temperature Tolerance The motherboard fans and CPU will run normally as configured in the BIOS Fan Speed Control User intervention No action required Medium The processor is running warmer This is a precautionary level and generally means that there may be factors contributing to this condition but the CPU is still within its normal operating state and below the CPU Temperature Tolerance The motherboard
3. continued from front The products sold by Supermicro are not intended for and will not be used in life support systems medical equipment nuclear facilities or systems aircraft aircraft devices aircraft emergency com munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage Accordingly Supermicro dis claims any and all liability and should buyer use or sell such products for use in such ultra hazardous applications it does so entirely at its own risk Furthermore buyer agrees to fully indemnify defend and hold Supermicro harmless for and against any and all claims demands actions litigation and proceedings of any kind arising out of or related to such ultra hazardous use or sale C 4
4. SUPER SUPERSERVER 6016XT TF SUPERSERVER 6016GT TF SUPERSERVER 6016GT TF TM2 SUPERSERVER 6016GT TF TC2 cami Sains eens Ajres oG IT av 5 5 i o I lt IU See SE FP E amp JU USER S MANUAL Revision 1 0 The information in this User s Manual has been carefully reviewed and is believed to be accurate The vendor assumes no responsibility for any inaccuracies that may be contained in this document makes no commitment to update or to keep current the information in this manual or to notify any person or organization of the updates Please Note For the most up to date version of this manual please see our web site at www supermicro com Super Micro Computer Inc Supermicro reserves the right to make changes to the product described in this manual at any time and without notice This product including software if any and documentation may not in whole or in part be copied photocopied reproduced translated
5. Each fan unit is actually made up of two fans joined back to back which rotate in opposite directions This counter rotating action generates exceptional airflow and works to dampen vibration levels The SC818GTQ chassis provides two additional open fan housings where an additional system fan may be added for optimal cooling It is very important that the chassis top cover is properly installed and making a good seal in order for the cooling air to circulate properly through the chassis and cool the components See Figure 6 2 6 2 Chapter 6 Advanced Chassis Setup System Fan Failure Fan speed is controlled by system temperature via a BIOS setting If a fan fails the remaining fans will ramp up to full soeed Replace any failed fan at your earli est convenience with the same type and model the system can continue to run with a failed fan Replacing a System Fan Figure 6 2 1 If the BIOS is not being utilized to determine which fan has failed open the top cover of the chassis while the system is running to locate the position of the failed fan Never run the server for an extended period of time with the top cover open 2 Turn off the power to the system and unplug the AC power cord 3 Remove the failed fan s wiring from the backplane 4 Remove the four pins securing the fan to the fan tray 5 Lift the failed fan from the fan tray and out of the chassis 6 Place the new fan into the vacant space in the fan tray whi
6. The options are All 1 and 2 Intel EIST Technology EIST Enhanced Intel SpeedStep Technology allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consump 7 6 Chapter 7 BIOS tion and heat dissipation Please refer to Intel s web site for detailed information The options are Disable Disable GV3 and Enable Enable GV3 Intel TurboMode Technology Select Enabled to use the Turbo Mode to boost system performance The options are Enabled and Disabled Intel C STATE Tech If enabled C State is set by the system automatically to either C2 C3 or C4 state The options are Disabled and Enabled C State package limit setting If set to Auto the AMI BIOS will automatically set the limit on the C State package register The options are Auto C1 C3 C6 and C7 C1 Auto Demotion When enabled the CPU will conditionally demote C3 C6 or C7 requests to C1 based on un core auto demote information The options are Disabled and Enabled C3 Auto Demotion When enabled the CPU will conditionally demote C6 or C7 requests to C3 based on un core auto demote information The options are Disabled and Enabled Clock Spread Spectrum Select Enable to use the feature of Clock Spectrum which will allow the BIOS to monitor and attempt to reduce the level of Electromagnetic Interference caused by the components whenever needed The options are Disabled and Enabled gt Advanced Chipse
7. amp other applications 3 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Populating DIMMs for Optimal Performance For One CPU CPU71 Installed Brancno Branch Branch Populating DIMMs for Optimal P For One CPU CPU2 Inst erformance alled Branch Branch Branch2 3 DIMMs P2 DIMM1A P2 DIMM2A P2 DIMM3A Populating DIMMs for Optimal Performance For Two CPUs Installed ed eee e e e ea 6 DIMMs P1 DIMM1A P1 DIMM2A P1 DIMM3A P2 DIMM1A P2 DIMM2A P2 DIMM3A 5 6 Adding PCI Add On Cards The 6016XT TF without GPUs installed can support four full size PCI E x8 cards in the x16 slots and with a riser card one low profile PCI E x4 card in a x16 slot The 6016GT series servers can in addition to two NVIDIA Tesla GPU cards sup port one low profile PCI Express 2 0 x4 card via a riser card installed in the PCI E x16 slot Installing an Add on Card 1 Begin by removing the PCI slot shield for the slot you wish to populate 2 Fully seat the card into the riser card pushing down with your thumbs evenly on both sides of the card 3 Finish by using a screw to secure the top of the card shield to the chassis The PCI slot shields protect the serverboard and its components from EMI and aid in proper ventilation so make sure there is always a shield covering each unused slot 5 10 Chapter 5 Advanced Serverboard Setup 5 7 Serverboard Details Figure 5 5 X8DTG DF Layout not drawn to
8. condition which may be caused by cables obstructing the airflow in the system or the ambient room temperature being too warm Check the routing of the cables and make sure all fans are present and operating normally You should also check to make sure that the chassis covers are installed Finally verify that the heatsinks are installed properly see Chapter 5 This LED will remain flashing or on as long as the indicated condition exists See the table below for descriptions of the LED states Figure 3 1 Universal Information LED States Universal Information LED States State Indication Fast Blinking Red 1x sec Fan Fail Solid Red CPU Overheat Solid Blue Local UID Button Depressed Blinking Blue IPMI Activated UID Note deactivating the UID LED must be performed in the same way it was activated If the UID LED was activated via IPMI you can only turn the LED off via IPMI and not with the UID button eel NIC2 Indicates network activity on GLAN2 when flashing 3 2 Chapter 3 System Interface eel NIC1 Indicates network activity on GLAN1 when flashing u HDD This light indicates SATA and or DVD ROM drive activity when flashing Indicates power is being supplied to the system s power supply units This LED should normally be illuminated when the system is operating 3 4 SATA Drive Carrier LEDs e Green Each Serial ATA drive carrier has a green LED When illuminated this green LED on the
9. 4 4 Chapter 5 Advanced Serverboard Setup 5 1 Handling the Serverboard sicicciinescnnoteteanncetattuanctabananstouanmecdhabenbectansdexstathaneatdatnenns 5 1 POCION oe E see ego ie 5 1 BDAC lt 1 9 aee E E E E E E E O EA E E ee 5 2 5 2 Serverboard Installation ec cseczesrexionissesitics onavan iactamststvisendznbasicn oust vance sense onadetiedanatet ences 5 2 5 3 Connecing 216 2 gt teen ne nnn nner enn ence e aeia 5 3 Co nn ting Data Cables eee eee eee 5 3 Connecting Power Cables ic ccsccccnceatonsecesorsnapatanacnystettuasedded tamsatdbesmertebtmeeneeatenses 5 3 Connecting the Control Ml aecl a eee ee eee en nee enn ener Omer ene i 5 3 Da TOFO e A ee E E EEE nn ee eee eee 5 4 5 5 Installing the Processor and Heatsink cccecccceeeceeeeseeeeeeeeseeeseeeeseeeeneeees 5 5 Installing an LGA1366 Processor nannnannnennnannnnnnnennnnnnnnnnnnnnnennnnrersnrrsnenne 5 5 stalling a CPU Feats 9 cee ee ee ee eee 5 7 Memory SUPPO cusses aaa a e a anaiai 5 8 56 Adding POLAE On AS rs a seeee a eee eee ee 5 10 5 7 OeWeboard ID gt eee nee ee ee 5 11 X8DTG DF Quick Reference ccccceeeecceeeeeeeeeeeeeseceeeaeeseceeeaeeeeesaeneeeeeaenses 5 12 58 Connector WSUS aca stinceteteterncpstaneanavetsnisretetsensinns casa a 5 13 SS A C11 9 2 are U 6 coe arr re ete ee ee eee 5 18 vii SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 510 ONDOA MACIOS teeter nee eee ete eee earn nee eee eee
10. BMC Baseboard Management CTRL Enable Pins 1 2 Enabled JBT1 CMOS Clear See Section 5 9 JPG1 VGA Enable Pins 1 2 Enabled JPL1 LAN1 2 Enable Pins 1 2 Enabled J UID OW Red LED OW Pins 7 8 of JF1 Off Overwrites JWD1 Watch Dog Pins 1 2 Reset Connector Description COM1 COM1 Serial Port FAN 1 8 System CPU Fan Headers IPMB IPMB Header for an IPMI Card IPMI LAN Dedicated IPMI LAN RJ45 Port IPMI 2 0 JF1 Front Panel Connector JL1 Chassis Intrusion JLPC80 JLPC80 Connector JNMI1 NMI Non Maskable Interrupt Header JPI C Power SMB I C1 JPSK1 Internal Speaker Buzzer Header JPW1 12V 20 pin Power Connector See Chpt 2 JPW2 JPW3 GPU Card Power Connectors LAN1 2 Gigabit Ethernet RJ45 Ports PWR 2C Power System Management Bus C Header SATA1 SATA6 SBX1B SBX2B SW1 T SGPIO 0 T SGPIO 1 USBO 1 USB 2 3 VGA LED LE1 LE2 LE4 Intel South Bridge SATA Ports GPU Graphic Processing Unit Slots Unit Identifier Button Serial General Purpose Input Output Headers Universal Serial Bus USB Ports 0 1 2 3 Video Port Description Onboard Standby PWR warning LED Indicator BMC LED Indicator Rear Unit Identifier UID LED Indicator 5 12 Chapter 5 Advanced Serverboard Setup 5 8 Connector Definitions 20 pin Main Power Connector Pin Definitions Pin Definition Pin Definition Main ATX Power Supply Connector PS On Ground The primary power supply connector 5VSB 2 Ground JPW1 is a proprie
11. LED located on pin 8 of the Front Control Panel JF1 will take precedence over the Blue UID LED located on pin 7 ada eine of JF1 That is when the red LED is on Jumper Definition the blue LED will be turned off When the OPe ec Fall LED overwiites the Blue UID LED red LED is off the blue UID LED can be Red LED On Blue LED Off Red LED Off Blue LED On or Off on or off In other words the red LED Closed Red LED does not overwrite and has signal overwrites the blue UID LED signal no effect on the Blue UID LED Red LED On Blue LED On Off if J_UID OW is set to off When the jumper Red LED Off Blue LED On Off J UID OW is Closed the red LED and the Blue_UID_LED work independently of each other and the red LED will have no effect on the blue LED See the table below for jumper settings I 19 BMC Enable Disable Use jumper JPBMC1 to enable or disable the Winbond WPCM450 BMC Baseboard Management Controller which supports IPMI 2 0 See the table on the right for jumper settings 5 10 Onboard Indicators LAN1 2 LEDs The Ethernet ports have two LEDs On each port one LED indicates activity while the other LED may be green amber or off to indicate the speed of the connec tion See the table on the right for the functions associated with the connection speed LED Note the dedicated IPMI LAN does not operate at 1 Gb s Onboard Power LED LE1 An Onboard Power LED is located at LE1 This L
12. This feature defines how many meters above or below sea level the system is located The options are Sea Level or Below 1 300 301 600 601 900 901 1200 1201 1500 1501 1800 1801 2100 2101 2400 2401 2700 2701 3000 DIMM Pitch This is the physical space between each DIMM module Each step is in 1 1000 of an inch The default is 400 Press or on your keyboard to change this value gt North Bridge Configuration This feature allows the user to configure the settings for the Intel IOH 36D chip Crystal Beach DMA Direct Memory Access This feature works with the Intel I O AT Acceleration Technology to accelerate the performance of TOE devices Note A TOE device is a specialized dedicated processor that is installed on an add on card or a network card to handle some or all packet processing of this add on card When this feature is set to Enabled it will enhance overall system performance by providing direct memory access for data transferring The options are Enabled and Disabled 7 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Intel VT d Select Enabled to enable Intel s Virtualization Technology support for Direct I O VT d by reporting the I O device assignments to VMM through the DMAR ACPI Tables This feature offers fully protected I O resource sharing across the Intel platforms providing the user with greater reliability security and availability in networking and data sharing The sett
13. an appropriate cable from the chassis to inform you of a chassis intrusion when the chassis is opened 3 19 HDD UID LED Pin Definitions JF1 Pin Definition 13 UID Signal 3 3V HDD Active Pin Definition 15 3 3V Stby Pin Definition Ground Black 12V Red Tachometer PWM Control Chassis Intrusion Pin Definitions Pin Definition 1 Intrusion Input Ground SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual LAN1 2 Ethernet Ports Two Ethernet ports designated LAN1 and LAN2 are located beside the VGA port on the I O backplane These ports accept RJ45 type cables Universal Serial Bus USB Universal Serial Bus Pin Definitions There are two Universal Serial Bus ports USBO 1 USB2 3 located on the I O panel and two additional Pin Definition Pin Definition USB headers located on the serverboard 1 5V The headers can be used to provide front i PO side USB access cables not included See the table on the right for pin defini tions Pin Definition Pin Definition Serial Ports DCD DSR A serial port is included on the I O back panel See the table on the right for pin definitions RXD RTS TXD CTS DTR RI Ground NC SGPIO Headers The SGPIO Serial General Purpose i Definition Input Output headers support serial link Ne Ne interfaces for the onboard SATA connec Ground DATA Out tors See the table on the right for pin EF E definitio
14. and operations of your system Supero Doctor III displays crucial system information such as CPU temperature system voltages and fan status See the Figure below for a display of the Supero Doctor Ill interface Note The default User Name and Password for SuperDoctor III is ADMIN AD MIN Note When SuperDocior Ill is first installed it adopts the temperature threshold settings that have been set in BIOS Any subsequent changes to these thresholds must be made within Super Doctor as the Super Doctor settings override the BIOS settings To set the BIOS temperature threshold settings again you would first need to uninstall SuperDoctor Ill Supero Doctor Ill Interface Display Screen Health Information EE Supero Doctor IMI Microsoft Internet Explorer Intrusion CPUL Chassis CUZ Chassis 129 57 EI 3 3Vsb 5 23 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Supero Doctor Ill Interface Display Screen Remote Control E Supero Doctor III Microsoft Internet Explorer File Edt view Favorites Tools Help Se ER Super _ Doctor M Remote Manag ement l System Info He alth Info Performance Remote Cantral k configuration a dministratio in Systems Managem ent Report apo rt Help E Remote Control Graceful power control eupero Docter II allows a user to inform the OS to reboot or shut down within a specified time the default is 50 seconds Betore the system rebo
15. ene eee te ee ee eet a 5 20 A AA TON een ee ee E E A EE eee 5 21 5 12 Installing SOWA Gansussa ni aada aaa 5 22 1018 21 fon Doctor Ulser EES E E a E 5 23 Chapter 6 Advanced Chassis Setup 6 1 Static Sensitive Devices scesaissrirnnaien n a a n E 6 1 Fe FS CANTO LIS aaee oE EE E E E R 6 1 C2 794100 Wl a2 9 ae E A E ee eee ee 6 2 Siro SYSE OOO 19 6 enema eee E ee eee eee 6 2 System Fan PNAS inentaaicisseciesiat ciseerism aa aai aA 6 3 6 4 Drive Bay Installation Removal cccccecccseeceseceseeceeeeceeeceesesseeseeseneeeeneeess 6 4 Accessing the Drive Bays rca cerca onwtaaeemntpvunoeek inci strat onsbeenctensneiaventanuteen tive 6 4 Peripheral Drive Installation ccccscccseccsseeceeeceeeceeeceeeecseeceueeseeesueesseesaas 6 7 65 IfnSt ling the Air OIG i cetsecte ce sents sseesercsse se teietieiesa cena ara EA 6 8 ai e ale MEA F ION Gee ee ee A eee 6 8 66 POW UDI eases ersecistine pa aE aa n aa 6 9 POWwer SUDPIV Falo suya a 6 9 Chapter 7 BIOS 7 1 ATOduU CUO a E E E E A EA 7 1 Starting BIOS Setup WY sa ccenecersensesstcdernensatherawestehiuanctntisionsatanswesentspecatanedens 7 1 How To Change the Configuration Data ccceucen seseresaccumeanemernnensraantaanngorensdeuen 7 1 Stanno the Setup Utt Aeeeeeee eee eee eee ee ree ee 7 2 T2 Man SEUD ee a net ee oe ee ere eee eee 7 2 7 3 Advanced Setup Configurations ccccccccccssececceeeeeceeeecesaeecesseeeesseeeeeeseeeeeeas 7 4 74A CUNY OU Sores cpa vectra c
16. for Work with Visual Display Units A N Warnings and Precautions Rack Precautions e Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them e In single rack installation stabilizers should be attached to the rack In multiple rack installations the racks should be coupled together e Always make sure the rack is stable before extending a component from the rack e You should extend only one component at a time extending two or more si multaneously may cause the rack to become unstable e Rack mounted equipment should not be used as a shelf or work space Server Precautions e Review the electrical and general safety precautions in Chapter 4 e Determine the placement of each component in the rack before you install the rails e Install the heaviest server components on the bottom of the rack first and then work up e Use a regulating uninterruptible power supply UPS to protect the server from power surges voltage spikes and to keep your system operating in case of a power failure e Allow the hot plug SATA drives and power supply modules to cool before touch ing them 2 2 Chapter 2 Server Installation e Always keep the rack s front door and all panels and components on the servers closed when not servicing to maintain proper cooling Rack Mounting Considerations Ambient Operating Temperature If installed in
17. or reduced to any medium or machine without prior written consent INNO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT INDIRECT SPECIAL INCIDENTAL SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES IN PARTICULAR SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE SOFTWARE OR DATA STORED OR USED WITH THE PRODUCT INCLUDING THE COSTS OF REPAIRING REPLACING INTEGRATING INSTALLING OR RECOVERING SUCH HARDWARE SOFTWARE OR DATA Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California USA The State of California County of Santa Clara shall be the exclusive venue for the resolution of any such disputes Super Micro s total liability for all claims will not exceed the price paid for the hardware product FCC Statement This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the manufacturer s instruction manual may cause harmful interference with radio communications Operation of this equipment in a residential area is lik
18. system back up and secure it to the rack unit with the retention screws after ensuring that all connections have been made ESD Precautions A Electrostatic Discharge ESD is generated by two objects with different electrical charges coming into contact with each other An electrical discharge is created to neutralize this difference which can damage electronic components and printed circuit boards The following measures are generally sufficient to neutralize this difference before contact is made to protect your equipment from ESD Use a grounded wrist strap designed to prevent static discharge Keep all components and printed circuit boards PCBs in their antistatic bags until ready for use Touch a grounded metal object before removing the board from the antistatic bag Do not let components or PCBs come into contact with your clothing which may retain a charge even if you are wearing a wrist strap Handle a board by its edges only do not touch its components peripheral chips memory modules or contacts When handling chips or modules avoid touching their pins Put the serverboard and peripherals back into their antistatic bags when not in use For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 4 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 4 4 Operating Precautions
19. that exceeds the CPU threshold tempera N ture predefined by the CPU manufacturer may result in CPU overheat or system instability When the CPU temperature reaches this predefined threshold the CPU and system cooling fans will run at full speed 2 To avoid possible system overheating please be sure to provide adequate airflow to your system The options are e The Early Alarm Select this setting if you want the CPU overheat alarm includ ing the LED and the buzzer to be triggered as soon as the CPU temperature reaches the CPU overheat threshold as predefined by the CPU manufacturer e The Default Alarm Select this setting if you want the CPU overheat alarm including the LED and the buzzer to be triggered when the CPU temperature reaches about 5 C above the threshold temperature as predefined by the CPU manufacturer to give the CPU and system fans additional time needed for CPU and system cooling In both the alarms above please take immediate action as shown below CPU Temperature System Temperature This feature displays current temperature readings for the CPU and the System The following items will be displayed for your reference only CPU Temperature The CPU thermal technology that reports absolute temperatures Celsius Fahr enheit has been upgraded to a more advanced feature by Intel in its newer processors The basic concept is each CPU is embedded by unique temperature information that the motherboard can read This
20. the driver diskette Intel AA RAID XP 2003 2008 Vista Driver for ICH10R into the floppy drive and press the lt Enter gt key Choose the Intel R ICH10R SATA RAID Controller from the list indicated in the Windows setup screen and press the lt Enter gt key Press the lt Enter gt key to continue the installation process If you need to specify any additional devices to be installed do so at this time Once all devices are specified press the lt Enter gt key to continue with the installation From the Windows setup screen press the lt Enter gt key The program will automatically load all device files and then continue the Windows installation After the installation is complete the system will automatically reboot B 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual B 2 l Installing Windows for a Non RAID System Insert Microsoft s Windows XP Windows 2003 setup CD in the CD drive and the system will start booting up from the CD Continue with the OS installation The Windows OS Setup screen will display From the Windows setup screen press the lt Enter gt key The XP 2003 Setup will automatically load all device files and then continue with the installation After the installation is complete the system will automatically reboot Insert the Supermicro Setup CD that came with your system into the CD drive during the system boot and the main screen will display B 2 Appendix C System Spec
21. various I O ports Figure 5 2 I O Ports 3 gt Q USB Port 0 LAN Port 2 USB Port 1 COM Port IPMI Dedicated LAN VGA Port LAN Port 1 UID Button Chapter 5 Advanced Serverboard Setup 5 5 Installing the Processor and Heatsink remove the power cord first before adding removing or changing any Avoid placing direct pressure to the top of the processor package Always hardware components Notes e Always connect the power cord last and always remove it before adding re moving or changing any hardware components Make sure that you install the processor into the CPU socket before you install the CPU heatsink e f you buy a CPU separately make sure that you use an Intel certified multi directional heatsink only e Make sure to install the serverboard into the chassis before you install the CPU heatsinks e When receiving a serverboard without a processor pre installed make sure that the plastic CPU socket cap is in place and none of the socket pins are bent otherwise contact your retailer immediately e Refer to the Supermicro web site for updates on CPU support Installing an LGA1366 Processor 1 Press the socket clip to release the load plate which covers the CPU socket from its locked posi tion 2 Genily lift the socket clip to open the load plate 3 Hold the plastic cap at its north and south center edges to remove it from the CPU socket Not
22. 03 8000 Fax 1 408 503 8008 Email marketing supermicro com General Information support supermicro com Technical Support Web Site www supermicro com Europe Address Super Micro Computer B V Het Sterrenbeeld 28 5215 ML s Hertogenbosch The Netherlands Tel 31 0 73 6400390 Fax 31 0 73 6416525 Email sales supermicro nl General Information support supermicro nl Technical Support rma supermicro nl Customer Support Asia Pacific Address Super Micro Taiwan 4F No 232 1 Liancheng Rd Chung Ho 235 Taipei County Taiwan R O C Tel 886 2 8226 3990 Fax 886 2 8226 3991 Web Site www supermicro com tw Technical Support Email Support supermicro com tw Tel 886 2 8228 1366 ext 132 or 139 1 6 Chapter 2 Server Installation Chapter 2 Server Installation 2 1 Overview This chapter provides a quick setup checklist to get your SuperServer up and running Following these steps in the order given should enable you to have the system operational within a minimum amount of time This quick setup assumes that your system has come to you with the processors and memory preinstalled If your system is not already fully integrated with a serverboard processors system memory etc please turn to the chapter or section noted in each step for details on installing specific components 2 2 Unpacking the System You should inspect the box the system was shipped in and note if it was damaged
23. 6016GT TF TC2 and the 6016GT TF if GPUs are installed can accommodate one low profile PCI E x4 card with a riser card in a x16 slot The 6016XT TF without GPUs installed can support four full size PCI E x8 cards in the x16 slots and with a riser card one low profile PCI E x4 card in a x16 slot Onboard Controllers Ports The color coded O ports include one COM port an additional COM header is located on the serverboard a VGA monitor port two USB 2 0 ports PS 2 mouse and keyboard ports and two Gb Ethernet ports 1 2 Chapter 1 Introduction IPMI IPMI Intelligent Platform Management Interface is a hardware level interface speci fication that provides remote access monitoring and administration for Supermicro server platforms IPMI allows server administrators to view a server s hardware status remotely receive an alarm automatically if a failure occurs and power cycle a system that is non responsive Other Features Other onboard features that promote system health include onboard voltage moni tors a chassis intrusion header auto switching voltage regulators chassis and CPU overheat sensors virus protection and BIOS rescue 1 3 Server Chassis Features System Power The SC818GTQ 1400B features a Gold Level 1400W high efficiency power supply The AC power cord should be removed from the system before servicing or replac ing the power supply See Chapter 6 for details SATA Subsystem The SC818GTQ 1400B ch
24. A Care must be taken to assure that the chassis cover is in place when the system is operating to ensure proper cooling Out of warranty damage to the system can occur if this practice is not strictly followed Figure 4 1 Installing the Onboard Battery LITHIUM BATTERY OR BATTERY HOLDER BATTERY HOLDER LITHIUM BATTERY 4 4 Chapter 5 Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install the X8DTG DF serverboard into the chassis connect the data and power cables and install add on cards All serverboard jumpers and connections are also described A layout and quick reference chart are included in this chapter for your reference Remember to completely close the chassis when you have finished working with the serverboard to better cool and protect the system 5 1 Handling the Serverboard Electrostatic Discharge ESD can damage electronic components To prevent dam age to any printed circuit boards PCBs it is important to handle them very carefully see previous chapter To prevent the serverboard from bending keep one hand under the center of the board to support it when handling The following measures are generally sufficient to protect your equipment from electric static discharge Precautions e Use a grounded wrist strap designed to prevent Electrostatic Discharge ESD e Touch a grounded metal object before removing any board from its antista
25. C2 is based on the SC818GTQ 1400B 1U rackmount server chassis and the Super X8DTG DF serverboard Please refer to our web site for an up to date list of sup ported operating systems processors and memory Manual Organization Chapter 1 Introduction The first chapter provides a checklist of the main components included with the server system and describes the main features of the Super X8DTG DF serverboard and the SC818GTQ 1400B chassis Chapter 2 Server Installation This chapter describes the steps necessary to install the system into a rack and check out the server configuration prior to powering up the system If your server was ordered without the processor and memory components this chapter will refer you to the appropriate sections of the manual for their installation Chapter 3 System Interface Refer to this chapter for details on the system interface which includes the functions and information provided by the control panel on the chassis as well as other LEDs located throughout the system Chapter 4 System Safety You should thoroughly familiarize yourself with this chapter for a general overview of safety precautions that should be followed when installing and servicing the system SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Chapter 5 Advanced Serverboard Setup Chapter 5 provides detailed information on the X8DTG DF serverboard including the locations and functions of connectors headers and
26. D LED Red OH Fan Fail LED Status Red LED State Definition Off Normal On Overheat Flashing Fan Fail NIC2 LED Pin Definitions JF1 Pin Definition Vcc Pin Definition 11 Vice Chapter 5 Advanced Serverboard Setup HDD FP UID Button The HDD UID button connections are located on pins 13 14 of JF1 Attach a hard drive LED cable to display HDD or SATA activity This connection can also be used for the front panel UID Unit Identi fier button The UID LED on pin 7 of JF1 works in conjunction with the UID button When the user presses and releases the UID button the UID LED will be turned on or off to indicate the location of the unit in a stack or rackmounted servers Power On LED The Power On LED connector is located on pins 15 and 16 of JF1 This connection is used to provide LED indication of power being supplied to the system See the table on the right for pin definitions Fan Headers The X8DTG DF has eight chassis system fan headers Fani to Fan8 All these 4 pin fans headers are backward compatible with the traditional 3 pin fans Fan speed control is available for 4 pin fans but not supported by 3 pin fans The fan speeds are controlled by Thermal Management via Hardware Monitoring in the Advanced Setting in the BIOS The Default setting is disabled See the table on the right for pin definitions Chassis Intrusion The Chassis Intrusion header is desig nated JL1 Attach
27. Data Clear BMC System Event Log Clear BMC System Log Select OK and press the lt Enter gt key to clear the BMC system log Select Cancel to keep the BMC System log The options are OK and Cancel A Caution Any cleared information is unrecoverable Make absolutely sure that you no longer need any data stored in the log before clearing the BMC Event Log gt Set LAN Configuration Set this feature to configure the IPMI LAN adapter with a network address as shown in the following graphics 7 20 Chapter 7 BIOS BIOS SETUP UTILITY Channel Number Enter the channel number for the SET LAN Config com mand This is initially set to 1 Press or on your keyboard to change the Channel Number Channel Number Status This feature returns the channel status for the Channel Number selected above Channel Number is OK or Wrong Channel Number gt IP Address Configuration Enter the IP address for this machine This should be in decimal and in dotted quad form i e 192 168 10 253 The value of each three digit number separated by dots should not exceed 255 as shown in the screen below _ oS SETUP iil IP Address 192 166 001 173 1 21 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Parameter Selector Use this feature to select the parameter of your IP Address configuration IP Address The BIOS will automatically enter the IP address of this machine however it may be over r
28. E 1 3 SATA CUDO V SIO 1 Cee E eee ee ee ee eee ere 1 3 Font Contool gare La serere a E EN E A eee 1 3 ONIN SySleM aseeseen aiee aiaeei iaki 1 3 tA OPU SUDY 2 1 a ETE 1 4 t3 GContac ng SUPEI O seismoa oa mee ee R ee area 1 6 Chapter 2 Server Installation 2 1 DVS E EAA AEE eae 2 1 Bae Unpacking ihe System seui a T EEE 2 1 23 Prepanng Tor Selu erce E a a E ee 2 1 Choosing a Setup LOCAU ON vepincexcpatessecasosannecdanccweatehiucnastetsansctondsesusatapeeseteteines 2 1 PCK TOC UUNO oera 2 2 Seier Preca on S assa E E E R E EON 2 2 Rack Mounting Considerations ccccccccecseeceeeeeceeeeeeceeeeeeeesseeeesseeeeeeseeeeeeas 2 3 Ambient Operating Temperature cccccccseccccseeeeceeeeceeeeseeseseuseeseneesaaees 2 3 Reduced AION aspect aeceectoeet sc tras Gene atten get ae oe ewes eee 2 3 Mechanical Loading sas scceseenacnsatatincessiiub namnatdnndematsh ana eap aaia 2 3 rout OV CHO ING eee E O 2 3 Relable Ground eee eee eee eee a EE 2 3 2 4 Installing the System into a Rack aaannnannnnennnsnnnnnnnnnnnnnnsnnrnnnrrnnnrnsennresnennne 2 4 Identifying the Sections of the Rack Rails cccccceeccscsseeeseeeeeeeeeeeeeeeeeeeas 2 4 Installing the Inner Rail Extensions wsiiiesenwsavesandstearcunguiiinunteievbunvevsswneweuiesnnaues 2 5 Assembling the Outer Rails c ccccccccsecceceseceeseceeceeeseeseeeeesseeeesseeeeessaaeees 2 6 Installing the Outer Rails onto the Rack cccccccccsecce
29. ED Indicator is on when the system is on Be sure to unplug the AC power cable before removing or adding any components See the table on the right for more details BMC Activity LED LE2 A BMC Heartbeat LED is located at LE2 When LE2 is on BMC Baseboard Man agement Controller is active Rear UID LED LED4 The UID LED is used to help locate the server for servicing See the description of SW1 in Section 5 9 for more details 5 20 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual BMC Enable Disable Jumper Settings Both Jumpers Definition Pins 1 2 Enabled Pins 2 3 Disabled LAN1 2 LED Connection Speed Indicator LED Color Definition Off No connection or 10 Mb s Green 100 Mb s Amber 1 Gb s Onboard PWR LED Indicator LED Color Definition Off System Off power cable not connected Green System On Green ACPI S1 State Flashing Quickly Chapter 5 Advanced Serverboard Setup 5 11 SATA Ports SATA Port Pin Definitions Definition SATA Ports TEE roun There are no jumpers to configure the TXP onboard SATA connectors See the table TXN on the right for pin definitions Ground RXN RXP Ground 5 21 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 5 12 Installing Software After the hardware has been installed you should first install the operating system and then the drivers The necessary drivers are all included on the Su
30. Flow 1 Make sure there are no wires or other objects obstructing the airflow in and out of the server Pull all excess cabling out of the airflow path Do not operate the server without all drive carriers installed in the drive bays Use only recommended server parts The control panel LEDs inform you of the overall system status See Chapter 3 System Interface for details on the LEDs and the control panel buttons Figure 6 6 Installing the Air Shroud 6 8 Chapter 6 Advanced Chassis Setup 6 6 Power Supply The system includes a single 1400 watt power supply which is auto switching capa ble Power must be removed from the system when replacing the power supply Power Supply Failure If the power supply module fails the system will shut down and you will need to replace the module Replacements can be ordered directly from Supermicro see contact information in the Preface As there is only one power supply module in the system power must be com pletely removed from the server before removing and replacing the power supply for whatever reason Removing Replacing the Power Supply Figure 6 6 1 Power down the server and unplug the AC power cord 2 Push the release tab on the front of the power supply 3 Pull the power supply out using the attached handle 4 Replace the failed power module with the same model See Appendix C 5 Push the new power supply module into the power bay until you hear a cli
31. Hard disk drives Self Monitoring Analysis and Reporting Technology SMART can help predict impending drive failures Select Auto to allow the AMI BIOS to automatically de tect hard disk drive support Select Disabled to prevent the AMI BIOS from using 7 13 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual the S M A R T Select Enabled to allow the AMI BIOS to use the S M A R T to support hard drive disk The options are Disabled Enabled and Auto 32Bit Data Transfer Select Enable to enable the function of 32 bit IDE data transfer The options are Enabled and Disabled IDE Detect Timeout sec Use this feature to set the time out value for the BIOS to detect the ATA ATAPI devices installed in the system The options are O sec 5 10 15 20 25 30 and 35 gt PCI PnP Configuration Clear NVRAM This feature clears the NVRAM during system boot The options are No and Yes Plug amp Play OS Selecting Yes allows the OS to configure Plug amp Play devices This is not required for system boot if your system has an OS that supports Plug amp Play Select No to allow the AMI BIOS to configure all devices in the system PCI Latency Timer This feature sets the latency Timer of each PCI device installed on a PCI bus Select 64 to set the PCI latency to 64 PCI clock cycles The options are 32 64 96 128 160 192 224 and 248 PCI IDE BusMaster When enabled the BIOS uses PCI bus mastering for reading writ
32. Us GPU Specifications Server Model GPU Subsystem 6016XT TF Riser cards included for PCI expansion see note below 6016GT TF TM2 2x Nvidia Tesla M1060 GPUs preinstalled 6016GT TF 2x Gen 2 0 PCI E x16 slots for double width GPUs GPUs not included 6016GT TF TC2 2x Nvidia Tesla C1060 GPUs preinstalled Notes The GPUs process complex image calculations and then route the data out through the VGA port on the serverboard The 6016XT TF can support a single standard size single width GPU only The C1060 GPU model includes an active heatsink Its fans work independently of the system fans and cooling parameters The M1060 model comes with a passive heatsink Cooling the GPU is a function of overall system cooling 1 4 Chapter 1 Introduction Figure 1 1 Intel 5520 Chipset System Block Diagram Note This is a general block diagram Please see Chapter 5 for details DDR3 DIMM t lo lp 1b DDR3 DIMM T DDR3 DIMM DDR3 DIMM Link1 LinkO Ports 3 6 PCI E x16 PCI E x16 NPorts Intel 5520 7 10 IOH36D PCI E x16 PCI E X Ports O x lt a O A DMI CLINK ICH10R SATA 6 Winbond LPCIO W83527 BMC VGA ACPI KBC IL f ERM VGA CONN RTL8201N PHY Dedicated LAN 1 5 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 1 5 Contacting Supermicro Headquarters Address Super Micro Computer Inc 980 Rock Ave San Jose CA 95131 U S A Tel 1 408 5
33. a closed or multi unit rack assembly the ambient operating tempera ture of the rack environment may be greater than the ambient temperature of the room Therefore consideration should be given to installing the equipment in an environment compatible with the manufacturer s maximum rated ambient tempera ture Tmra Reduced Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading Circuit Overloading Consideration should be given to the connection of the equipment to the power Supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring Appropriate consideration of equipment nameplate ratings should be used when addressing this concern Reliable Ground A reliable ground must be maintained at all times To ensure this the rack itself should be grounded Particular attention should be given to power supply connec tions other than the direct connections to the branch circuit i e the use of power Strips etc 2 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 2 4 Installing the System into a Rack This section provides information on installing the SC818G chassis into a rack unit with the rails provided There are a variety of rac
34. able on the right for pin definitions PWRI2C Pin Definitions Pin Definition 1 Clock 2 Data 3 PWR Fail Ground IPMB Header Pin Definitions Pin Definition 1 Data Ground 2 3 4 No Connection UID Button Pin Definition Ground Ground Button In Ground Internal Speaker Pin Definitions Pin Definitions Pin 1 Pos Beep In Alarm Speaker SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 5 9 Jumper Settings Explanation of Jumpers To modify the operation of the serverboard jumpers can be used to choose between optional settings Jumpers create shorts between two pins to change the function of the con nector Pin 1 is identified with a square solder pad on the printed circuit board See the serverboard layout pages for jumper locations Pins Jumper Note On a two pin jumper Closed means the jumper is on both pins and Open means the jumper is either on only one pin or completely removed Cie CMOS Clear JBT1 is used to clear CMOS which will also clear any passwords Instead of pins this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS To clear CMOS 1 First power down the system and unplug the power cord s 2 With the power disconnected short the CMOS pads with a metal object such as a small screwdriver 3 Remove the screwdriver or shorting device 4 Reconnect
35. ack and tightening the brackets to the rack Figure 2 6 Installing the Server into a Telco Rack 2 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 2 5 Checking the Serverboard Setup After you install the server in the rack you will need to open the unit to make sure the serverboard is properly installed and all the connections have been made Removing the Chassis Cover Figure 2 7 T Remove the three screws securing the top cover to the chassis Press both of the release tabs at the same time to release the cover Slide the cover toward the rear of the chassis Lift the cover up and off of the chassis Warning Except for short periods of time do NOT operate the server without the cover in place The chassis cover must be in place to allow proper airflow and prevent overheating Figure 2 7 Removing the Chassis Cover 2 10 Chapter 2 Server Installation Checking the Components ty 2 6 You may have processors already installed to the serverboard Each proces sor needs its own heatsink See Chapter 5 for instructions on processor and heatsink installation Your server system may have come with system memory already installed Make sure all DIMMs are fully seated in their slots For details on adding system memory refer to Chapter 5 If desired you can install add on cards to the system See Chapter 5 for details on installing PCI add on cards Make sure all power and data cable
36. am and hazardous radiation exposure do not open the enclosure or use the unit in any uncon ventional way e Mainboard replaceable soldered in fuses Self resetting PTC Positive Tempera ture Coefficient fuses on the mainboard must be replaced by trained service technicians only The new fuse must be the same or equivalent as the one replaced Contact technical support for details and support 4 2 General Safety Precautions A Follow these rules to ensure general safety e Keep the area around the server clean and free of clutter e The server weighs approximately 47 Ibs 21 4 kg when fully loaded When lifting the system two people at either end should lift slowly with their feet soread out to distribute the weight Always keep your back straight and lift with your legs e Place the chassis top cover and any system components that have been re moved away from the system or on a table so that they won t accidentally be stepped on e While working on the system do not wear loose clothing such as neckties and unbuttoned shirt sleeves which can come into contact with electrical circuits or be pulled into a cooling fan 4 2 Chapter 4 System Safety 4 3 Remove any jewelry or metal objects from your body which are excellent metal conductors that can create short circuits and harm you if they come into contact with printed circuit boards or areas where power is present After accessing the inside of the system close the
37. an C 2 C YG JQ JK Y E ie i Ti Nd ra ra f l J 1 Ok O eeey YAN LAN PCI Slot LAN Ports COM Port VGA Port 6 2 Control Panel The control panel located on the front of the chassis must be connected to the JF1 connector on the serverboard to provide you with system status indications A ribbon cable has bundled these wires together to simplify the connection Connect the cable from JF1 on the serverboard to the appropriate header on the Control Panel PCB printed circuit board Make sure the red wire plugs into pin 1 on both connectors Pull all excess cabling out of the airflow path The control panel LEDs inform you of system status See Chapter 3 System In terface for details on the LEDs and the control panel buttons Details on JF1 can be found in Chapter 5 Advanced Serverboard Installation 6 3 System Cooling Eight 4 cm counter rotating fans provide the cooling for the system
38. and 9600 8 n 1 Flow Control This feature allows the user to set the flow control for Console Redirection The options are None Hardware and Software Redirection After BIOS POST Select Disabled to turn off Console Redirection after Power On Self Test POST Select Always to keep Console Redirection active all the time after POST Note This setting may not be supported by some operating systems Select Boot Loader to keep Console Redirection active during POST and Boot Loader The options are Disabled Boot Loader and Always Terminal Type This feature allows the user to select the target terminal type for Console Redirec tion The options are ANSI VT100 and VT UTF8 VT UTF8 Combo Key Support A terminal keyboard definition that provides a way to send commands from a remote console Available options are Enabled and Disabled Sredir Memory Display Delay This feature defines the length of time in seconds to display memory information The options are No Delay Delay 1 Sec Delay 2 Sec and Delay 4 Sec 7 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual gt Hardware Health Monitor This feature allows the user to monitor system health and review the status of each item as displayed CPU Overheat Alarm This option allows the user to select the CPU Overheat Alarm setting which de termines when the CPU OH alarm will be activated to provide warning of possible CPU overheat Warning 1 Any temperature
39. anges to the system configuration and reboot the computer Select Discard Changes and Exit from the Exit menu and press lt Enter gt Discard Changes Select this option and press lt Enter gt to discard all the changes and return to the AMI BIOS Utility Program Load Optimal Defaults To set this feature select Load Optimal Defaults from the Exit menu and press lt Enter gt Then select OK to allow the AMI BIOS to automatically load Optimal De faults to the BIOS Settings The Optimal settings are designed for maximum system performance but may not work best for all computer applications Load Fail Safe Defaults To set this feature select Load Fail Safe Defaults from the Exit menu and press lt Enter gt The Fail Safe settings are designed for maximum system stability but not for maximum performance 7 28 Appendix A BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST Power On Self Test routines which are performed each time the system is powered on errors may occur Non fatal errors are those which in most cases allow the system to continue the boot up process The error messages normally appear on the screen Fatal errors are those which will not allow the system to continue the boot up procedure If a fatal error occurs you should consult with your system manufac turer for possible repairs A 1 BIOS Error Beep Codes BIOS Error Beep Codes Error Message Refresh Beep C
40. assis includes three 3 5 drive bays which may be used to house hot swappable SATA drives RAID 0 1 5 and 10 are supported RAID 5 is not supported with Linux OS Front Control Panel The control panel provides a system monitoring and control interface LEDs indicate system power HDD activity network activity system overheat UID and power sup ply failure A main power button and a system reset button are also included Cooling System The SC818GTQ 1400B has an innovative cooling design that includes four 4 cm counter rotating PWM Pulse Width Modulated fans located in the middle section of the chassis Two additional fans are included to cool each GPU in the 6016GT series servers The power supply module also includes a cooling fan All chassis and power supply fans operate continuously An air shroud channels the airflow from the system fans to efficiently cool the processors and memory See note on the following page regarding fan control 1 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 1 4 GPU Subsystem The 6016GT family of servers represents Supermicro s line of massively parallel processing dual GPU servers Two NVIDIA Tesla GPUs with multiple x16 non blocking native Gen2 PCI Express connectivity place these systems at the forefront of today s GPU computing solutions See the table below for the GPU specifications of each server Refer to the NVIDIA web site www nvidia com for details on Tesla GP
41. ceeeeeseeeseeseeeeeeseeeeeeas 2 7 Installing the Server into a Telco Rack cccccceeecceceeeeeeeeeeseeeseeseeeeeeseeeeeeas 2 9 vi Table of Contents 2 5 Checking the Serverboard Setup cccccccccseececceeeceeceseeesseeeeseeeeeseeeseeseaees 2 10 26 Checking the Drive Bay SQUID srs cacnevcsccssncosavescencucosnwesancicnsaracdeieanaetemepvicuacew secs 2 11 Chapter 3 System Interface 3 1 DVS WW EE AAN EAE ANEA AA A EE 3 1 32 COOL Panel i ONS ache eres eee cectneahsaeaet aracic oa antes aan 3 1 FSS Se ater E ids eae a vines pe nso eds wan oan dean oe ee eens es 3 1 EON Ce ce sere ss sess elas A E E E 3 1 SG COMO PEL LEDS oreraa eee ee ene ee eer eT mere 3 2 Universal INiornmaton LED scocacaunamtrnaneroedsaqaiGeasiacsatemeavarentevasnomaunnanmavoaaconnwan 3 2 MIC E oE E A E E E E E noes 3 2 MG T E Reamer Ree ae meee er eee eee a ene eres 3 3 ADD tt te acters le testis cen E pees cron og eeoentouaeua yee 3 3 FO Ce erae isnt E rsa te we need tae EA EE E E tase eee sucess 3 3 34 SAIA DEVE ale LEDS ae eaereeee ta nioran R eeu 3 3 Chapter 4 System Safety 4 1 Electrical Safety Precautions crsssicteco sacs ssncnvaceoustpiacdemasvacsonnnesacestnteactensuvactsenseese 4 1 4 2 General Safety Precautions cccccccccceeceeceececseeeeeseeeeeseeeeesseeeesseeeeeseeeeeeeas 4 2 PCA ONS seers tered sense tute nesta eceie tana A 4 3 4 4 Operating Precautions co sosicxem tec tesstenesemcntesesinseecietemssanesvadssisevnndeesebenstauesteesiese
42. ck 6 Reconnect the AC power cord and depress the power button on the control panel to restart the system Figure 6 7 Removing Replacing the Power Supply 6 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Notes 6 10 Chapter 7 BIOS 7 1 Chapter 7 BIOS Introduction This chapter describes the AMI BIOS Setup Utility for the X8DTG DF The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens Starting BIOS Setup Utility To enter the AMI BIOS Setup Utility screens press the lt Delete gt key while the system is booting up Note In most cases the lt Delete gt key is used to invoke the AMI BIOS f setup screen There are a few cases when other keys are used such as lt F1 gt lt F2 gt etc Each main BIOS menu option is described in this manual The Main BIOS setup menu screen has two main frames The left frame displays all the options that can be configured Grayed out options cannot be configured Options in blue can be configured by the user The right frame displays the key legend Above the key legend is an area reserved for a text message When an option is selected in the left frame it is highlighted in white Often a text message will accompany it Note the AMI BIOS has default text messages built in Supermicro retains the option to include omit or change any of these text mes
43. cket pins 5 6 Chapter 5 Advanced Serverboard Setup Installing a CPU Heatsink 1 Remove power from the system and unplug the AC power cord from the power supply 2 Do not apply any thermal grease to the heatsink or the CPU die the required amount has already been applied 3 Place the heatsink on top of the CPU so that the four mounting NO 1 SCREW NO 4 SCREW holes are aligned with those on ie w the preinstalled heatsink reten tion mechanism 4 Screw in two diagonal screws i e the 1 and the 2 screws until just snug Do not fully tighten the screws or you may damage the CPU be A NO 3 SCREW NO 2 SCREW 5 Add the two remaining screws then finish the installation by fully tightening all four screws Removing the Heatsink 1 Unscrew and remove the heatsink screws from the serverboard in the sequence as show in the picture above 2 Hold the heatsink and gently wriggle the heatsink to loosen it from the CPU Do not use excessive force when wriggling the heatsink 3 Once the heatsink is loose remove it from the CPU socket 4 Clean the surface of the CPU and the heatsink to get rid of the old thermal grease Reapply the proper amount of the
44. d possible boot failure 7 2 Main Setup When you first enter the AMI BIOS Setup Utility you will enter the Main setup screen You can always return to the Main setup screen by selecting the Main tab on the top of the screen The Main BIOS Setup screen is shown below BIOS SETUP UTILITY tee A Af IOU L LAL se ENTER TABI 16 to system Time 57 46 select a field system Date Ise or to ARAN pt ee ee OM ee en IT beeen contigure system Time 1985 2006 American Megatrends System Overview The following BIOS information will be displayed System Time System Date Use this option to change the system time and date Highlight System Time or Sys tem Date using the arrow keys Key in new values through the keyboard and press lt Enter gt Press the lt Tab gt key to move between fields The date must be entered in Day MM DD YY format The time is entered in HH MM SS format Note The time is in the 24 hour format For example 5 30 P M appears as 17 30 00 1 2 Chapter 7 BIOS Supermicro X8DTG DF e BIOS Build Version This item displays the BIOS revision used in your sys tem e BIOS Build Date This item displays the date when this BIOS was completed e AMI BIOS Core Version This item displays the revision number of the AMI BIOS Core upon which your BIOS was built Processor The AMI BIOS will automatically display the status of the processor used in your system e CPU Type This item
45. determined Select SWDMAO to allow the BIOS to use Single Word DMA mode 0 It has a data transfer rate of 2 1 MBs Select SWDMA T1 to allow the BIOS to use Single Word DMA mode 1 It has a data transfer rate of 4 2 MBs Select SWDMA2Z to allow the BIOS to use Single Word DMA mode 2 It has a data transfer rate of 8 3 MBs Select MWDMADO to allow the BIOS to use Multi Word DMA mode 0 It has a data transfer rate of 4 2 MBs Select MWDMAT1 to allow the BIOS to use Multi Word DMA mode 1 It has a data transfer rate of 13 3 MBs Select MWDMA2 to allow the BIOS to use Multi Word DMA mode 2 It has a data transfer rate of 16 6 MBs Select UDMAQ to allow the BIOS to use Ultra DMA mode 0 It has a data transfer rate of 16 6 MBs It has the same transfer rate as PIO mode 4 and Multi Word DMA mode 2 Select UDMA1 to allow the BIOS to use Ultra DMA mode 1 It has a data transfer rate of 25 MBs Select UDMAZ2 to allow the BIOS to use Ultra DMA mode 2 It has a data transfer rate of 33 3 MBs Select UDMAS to allow the BIOS to use Ultra DMA mode 3 It has a data transfer rate of 66 6 MBs Select UDMA4 to allow the BIOS to use Ultra DMA mode 4 It has a data transfer rate of 100 MBs Select UDMAS to allow the BIOS to use Ultra DMA mode 5 It has a data transfer rate of 133 MBs Select UDMA6 to allow the BIOS to use Ultra DMA mode 6 It has a data transfer rate of 133 MBs The options are Auto SWDMAn MWDMAn and UDMAn S M A R T For
46. displays the type of CPU used in the motherboard Speed This item displays the speed of the CPU detected by the BIOS e Physical Count This item displays the number of processors installed in your system as detected by the BIOS e Logical Count This item displays the number of CPU Cores installed in your system as detected by the BIOS e Micro _code Revision This item displays the revision number of the BIOS Micro_code used in your system System Memory This displays the size of memory available in the system e Size This item displays the memory size detected by the BIOS SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 7 3 Advanced Setup Configurations Use the arrow keys to select Boot Setup and hit lt Enter gt to access the submenu items BIOS SETUP UTILITY H Boot Features gt BOOT Features Quick Boot If Enabled this option will skip certain tests during POST to reduce the time needed for system boot The options are Enabled and Disabled Quiet Boot This option allows the bootup screen options to be modified between POST mes sages or the OEM logo Select Disabled to display the POST messages Select Enabled to display the OEM logo instead of the normal POST messages The op tions are Enabled and Disabled AddOn ROM Display Mode This sets the display mode for Option ROM The options are Force BIOS and Keep Current Bootup Num Lock This feature selects the Power on state for Numlock k
47. e The photos on this page and succeeding pages are for illustration purposes only They do not necessarily reflect the exact product s described in this manual Holding the north amp south edges 9 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 1 After removing the plastic cap use CPU your thumb and the index finger to hold the CPU at the north and south center edges 2 Align the CPU key the semi circle cutout with the socket key the notch below the gold color dot on the side of the socket 3 Once the CPU and the socket are aligned carefully lower the CPU Straight down into the socket Do not rub the CPU against the surface of the socket or its pins to avoid damaging the CPU or the socket 4 With the CPU in the socket in spect the four corners of the CPU tb a ee to make sure that it sits level and HHS nhiem ehpeadda das ete pia A is properly installed ERRHEH EEn Bap ih e A te i i Td fen io fie Te tm 5 Once the CPU is securely seated in the socket lower the CPU load plate to the socket a ee ee IEE J E LE Pht he Prrhrtrhheeee aa tp fe Me Ra a A Mat a eee rr a 6 Use your thumb to gently push the socket clip down to the clip lock Important Please save the plastic cap The serverboard must be shipped with the plastic cap properly installed to protect the CPU socket pins Shipment without the plastic cap properly installed may cause damage to the so
48. e Outer Rails to the Rack 2 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Installing the Chassis into a Rack Figure 2 5 1 Confirm that chassis includes the inner rails and rail extensions Also confirm that the outer rails are installed on the rack Line chassis rails with the front of the rack rails Slide the chassis rails into the rack rails keeping the pressure even on both sides you may have to depress the locking tabs when inserting When the server has been pushed completely into the rack you should hear the locking tabs click Optional Insert and tightening the thumbscrews that hold the front of the server to the rack Figure 2 5 Installing the Server into a Rack 2 8 Chapter 2 Server Installation Installing the Server into a Telco Rack Optional brackets p n MCP 290 00016 0ON are needed to install the server to a telco open type rack To install the server into a Telco type rack use the two L shaped brackets on either side of the chassis four total First determine how far follow the server will extend out the front of the rack Larger chassis should be positioned to balance the weight between front and back If a bezel is included on your server remove it Then at tach the two front brackets to each side of the chassis then the two rear brackets positioned with just enough space to accommodate the width of the telco rack Finish by sliding the chassis into the r
49. e support to provide a workaround solution for an operating system that does not have EHCI 7 10 Chapter 7 BIOS Hand Off support When enabled the EHCI Interface will be changed from the BIOS controlled to the OS controlled The options are Disabled and Enabled gt IDE SATA Floppy Configuration When this submenu is selected the AMI BIOS automatically detects the presence of the IDE devices and displays the following items SATA 1 Configuration lf Compatible is selected it sets SATA 1 to legacy compatibility mode while se lecting Enhanced sets SATA 1 to native SATA mode The options are Disabled Compatible and Enhanced Configure SATA 1 as This feature allows the user to select the drive type for SATA 1 The options are IDE RAID and AHCI When the option RAID is selected the item ICH RAID Code Base will appear When the option AHCI is selected the item SATA AHCI will be available ICH RAID Code Base This feature is available when the option RAID is selected Select Intel to enable Intel s SATA RAID firmware to configure Intel s SATA RAID settings Select Adaptec to enable Adaptec s SATA RAID firmware to configure Adaptec s SATA RAID settings The options are Intel and Adaptec SATA AHCI This feature is available when the option AHCI is selected Select Enable to enable the function of Serial ATA Advanced Host Interface Take caution when using this function This feature is for advanced programmers only T
50. ely to cause harmful interference in which case you will be required to correct the interference at your own expense California Best Management Practices Regulations for Perchlorate Materials This Perchlorate warning applies only to products containing CR Manganese Dioxide Lithium coin cells Perchlorate Material special handling may apply See www dtsc ca gov hazardouswaste perchlorate WARNING Handling of lead solder materials used in this product may expose you to lead a chemical known to the State of California to cause birth defects and other reproductive harm Manual Revision 1 0 Release Date July 17 2009 Unless you request and receive written permission from Super Micro Computer Inc you may not copy any part of this document Information in this document is subject to change without notice Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders Copyright 2009 by Super Micro Computer Inc All rights reserved Printed in the United States of America Preface Preface About This Manual This manual is written for professional system integrators and PC technicians It provides information for the installation and use of the SuperServer 6016XT TF 6016GT TF 6016GT TF TM2 6016GT TF TC2 Installation and maintenance should be performed by experienced technicians only The SuperServer 6016XT TF 6016GT TF 6016GT TF TM2 6016GT TF T
51. ension holes Make sure the extension faces outward just like the inner rail 2 Slide the extension toward the front of the chassis 3 Secure the chassis with screws as illustrated 4 Repeat steps 1 3 for the other inner rail extension Figure 2 2 Installing the Inner Rails 2 9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Assembling the Outer Rails Each outer rail is in two sections that must be assembled before mounting on to the rack Assembling the Outer Rails 1 Identify the left and right outer rails by examining the ends which bend outward 2 Slide the front section of the outer rail A into the rear section of the outer rail B Figure 2 3 Assembling the Outer Rails Secure to the rear of the rack Slide outer rails together Secure to the front of the rack Assembling the sections of the outer rail Outer rail assembled 2 6 Chapter 2 Server Installation Installing the Outer Rails onto the Rack Outer Rail Installation 1 Adjust the outer rails to the proper length so that the outer rail fits snugly within the rack 2 Align the holes on the front of the outer rail with the holes on the front of the rack C and secure with the screws provided 3 Align the holes on the rear of the outer rail to the holes on the rack D and secure with the screws provided 4 Repeat the procedure with the second outer rail assembly Figure 2 4 Installing th
52. ent EE Ea a E O saad a a 7 25 75 Bool COMMOQULAUOR sesceccanonexcocnsacncctatennt audheneodecsnmeen aaaea 7 26 TO EI ODO e E E E E A ae E E E EE 7 27 Appendix A BIOS Error Beep Codes Appendix B Installing Windows Appendix C System Specifications vill Chapter 1 Introduction Chapter 1 Introduction 1 1 Overview The SuperServer 6016XT TF 6016GT TF 6016GT TF TM2 6016GT TF TC2 is a GPU optimized supercomputing server comprised of two main subsystems the SC818GTQ 1400B 1U server chassis and the X8DTG DF Intel Xeon processor 5500 series serverboard Please refer to our web site for information on operating systems that have been certified for use with the system www supermicro com e Six 4cm hot swap counter rotating fans FAN 0102L4 e Two 4 cm hot swap counter rotating fans FAN 0087L4 e One air shroud MCP 310 81802 0B e Two passive CPU heatsinks SNK P0037P e Riser Cards 6016XT TF One RSC R1UG 2E8 for two PCI Express x8 cards left side One RSC R1UG 2E8R for two PCI Express x8 cards right side One RSC R1U E16R for PCI Express x16 card right side e Riser Cards 6016GT Series One RSC R1UG E16 for PCI Express x16 card left side One RSC R1UG E16R for PCI Express x16 card right side One RSC R1U E16R for PCI Express x16 card right side e Two power cables for GPU cards 6016GT series only CBL 0333L e SATA Accessories One SATA backplane BPN SAS 818TQ Three 35 cm SATA cables CBL 0315L Three hot swap dr
53. erface Chapter 3 System Interface 3 1 Overview There are several LEDs on the control panel as well as others on the drive car riers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components There are also two buttons on the chassis control panel and an on off switch on the power supply This chapter explains the meanings of all LED indicators and the appropriate response you may need to take 3 2 Control Panel Buttons There are two push buttons located on the front of the chassis a reset button and a power on off button RESET Reset Use the reset button to reboot the system Power The main power button is used to apply or remove power from the power supply to the server system Turning off system power with this button removes the main power but keeps standby power supplied to the system 3 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 3 3 Control Panel LEDs The control panel located on the front of the SC818GTQ chassis has five LEDs These LEDs provide you with critical information related to different parts of the system This section explains what each LED indicates when illuminated and any corrective action you may need to take Universal Information LED When this LED blinks red quickly it indicates a fan failure This LED will be blue when used for UID Unit Identifier When on continuously it indicates an overheat
54. es if this option is set to Disabled The CPU fetches both cache lines for 128 bytes as comprised if Enabled Intel Virtualization Technology Available when supported by the CPU Select Enabled to use the feature of Virtualization Technology to allow one platform to run multiple operating systems and applications in independent partitions creat ing multiple virtual systems in one physical computer The options are Enabled and Disabled Note If there is any change to this setting you will need to power off and restart the system for the change to take effect Please refer to Intel s web site for detailed information Execute Disable Bit Capability Available when supported by the OS and the CPU Set to Enabled to enable the Execute Disable Bit which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor or damage the system during an attack The default is Enabled Refer to Intel and Microsoft Web Sites for more information Simultaneous Multi Threading Available when supported by the CPU Set to Enabled to use the Simultaneous Multi Threading Technology which will result in increased CPU performance The options are Disabled and Enabled Active Processor Cores Set to Enabled to use a processor s Second Core and beyond Please refer to Intel s web site for more information
55. ey The options are Off and On Wait For F1 If Error This forces the system to wait until the F1 key is pressed if an error occurs The options are Disabled and Enabled Chapter 7 BIOS Hit Del Message Display This feature displays Press DEL to run Setup during POST The options are Enabled and Disabled Interrupt 19 Capture Interrupt 19 is the software interrupt that handles the boot disk function When this item is set to Enabled the ROM BIOS of the host adaptors will capture Interrupt 19 at boot and allow the drives that are attached to these host adaptors to function as bootable disks If this item is set to Disabled the ROM BIOS of the host adap tors will not capture Interrupt 19 and the drives attached to these adaptors will not function as bootable devices The options are Enabled and Disabled Power Configuration Power Button Function If set to Instant_Off the system will power off immediately as soon as the user hits the power button If set to 4 Second Override the system will power off when the user presses the power button for 4 seconds or longer The options are Instant_Off and 4 Second Override Restore on AC Power Loss Use this feature to set the power state after a power outage Select Power Off for the system power to remain off after a power loss Select Power On for the system power to be turned on after a power loss Select Last State to allow the system to resume its last state before a p
56. fans and CPU will run normally as configured in the BIOS The fans may adjust to a faster soeed depending on the Fan Speed Control settings User intervention No action is required However consider checking the CPU fans and the chassis ventilation for blockage High The processor is running hot This is a caution level since the CPU s Tem perature Tolerance has been reached or has been exceeded and may activate an overheat alarm User intervention If the system buzzer and Overheat LED has activated take action immediately by checking the system fans chassis ventilation and room temperature to correct any problems Notes 1 The system may shut down if it continues for a long period to f prevent damage to the CPU 2 The information provided above is for your reference only For more information on thermal management please refer to Intels Web site at www Intel com System Temperature The system temperature will be displayed in degrees in Celsius and Fahrenheit as it is detected by the BIOS Fan Speed Control Monitor This feature allows the user to decide how the system controls the speeds of the onboard fans The CPU temperature and the fan speed are correlative When the CPU on die temperature increases the fan speed will also increase and vice versa Select Workstation if your system is used as a Workstation Select Server if your system is used as a Server Select Disabled Full Soeed 12V to d
57. front of the SATA drive carrier indicates drive activity A connection to the SATA backplane enables this LED to blink on and off when that particular drive is being accessed Please refer to Chapter 6 for instructions on replacing failed SATA drives e Red The red LED to indicate an SATA drive failure If one of the SATA drives fail you should be notified by your system management software Please refer to Chapter 6 for instructions on replacing failed SATA drives SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Notes Chapter 4 System Safety 4 1 Chapter 4 System Safety Electrical Safety Precautions Note power should always be disconnected before perform ing any service on the system Basic electrical safety precautions shall be followed to protect yourself from harm and the server from damage Be aware of the locations of the power on off switch on the chassis as well as the room s emergency power off switch disconnection switch or electrical outlet If an electrical accident occurs you can then quickly remove power from the system Do not work alone when working with high voltage components Power should always be disconnected from the system when removing or in Stalling main system components such as the serverboard memory modules and floppy drive When disconnecting power you should first power down the system with the operating system first and then unplug the power cords of all the power
58. he options are Enabled and Disabled If the option Enabled is selected the following item will display Hot Plug This feature is available when the option Enabled is selected Select Enable to enable the hot plug function for the SATA devices The options are Enabled and Disabled SATA 2 Configuration Selecting Enhanced will set SATA 2 to native SATA mode The options are Disabled and Enhanced rel SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Primary IDE Master Slave Secondary IDE Master Slave Third IDE Master and Fourth IDE Master These settings allow the user to set the parameters of Primary IDE Master Slave Secondary IDE Master Slave Third and Fourth IDE Master slots Hit lt Enter gt to activate the following submenu screen for detailed options of these items Set the correct configurations accordingly The items included in the submenu are Type Select the type of device connected to the system The options are Not Installed Auto CD DVD and ARMD LBA Large Mode LBA Logical Block Addressing is a method of addressing data on a disk drive In the LBA mode the maximum drive capacity is 137 GB For drive capacities over 137 GB your system must be equipped with a 48 bit LBA mode addressing lf not contact your manufacturer or install an ATA 133 IDE controller card that supports 48 bit LBA mode The options are Disabled and Auto Block Multi Sector Transfer Block Mode boosts the IDE drive pe
59. idden IP addresses are 6 two digit hexadecimal numbers Base 16 0 9 A B C D E F separated by dots i e 00 30 48 D0 D4 60 Current IP Address in BMC This ttem displays the current IP address used for your IPMI connection gt MAC Address Configuration Enter the Mac address for this machine This should be in decimal and in dotted quad form i e 192 168 10 253 The value of each three digit number separated by dots should not exceed 255 as shown in the screen below Parameter Selector Use this feature to select the parameter of your Mac Address configuration Mac Address The BIOS will automatically enter the Mac address of this machine however it may be over ridden Mac addresses are 6 two digit hexadecimal numbers Base 16 0 9 A B C D E F separated by dots i e 00 30 48 D0 D4 60 Current Mac Address in BMC This ttem displays the current Mac address used for your IPMI connection gt Subnet Mask Configuration Subnet masks tell the network which subnet this machine belongs to The value of each three digit number separated by dots should not exceed 255 Parameter Selector Use this feature to select the parameter of your Subnet Masks configuration Subnet Mask This item displays the current subnet mask setting for your IPMI connection 1 22 Chapter 7 BIOS gt SEL PEF Configuration BIOS SETUP UTILITY PEF SUPPORT Disabled Set PEF Configuration Set this feature to co
60. ification for more informa tion at www intel com The options are Disabled and Enabled BMC Watch Dog Timer Action Allows the BMC to reset or power down the system if the operating system hangs or crashes The options are Disabled Reset System Power Down Power Cycle BMC Watch Dog TimeOut Min Sec This option appears if BMC Watch Dog Timer Action above is enabled This is a timed delay in minutes or seconds before a system power down or reset after an operating system failure is detected The options are 5 Min 1 Min 30 Sec and 10 Sec gt DMI Event Log View Event Log Use this option to view the System Event Log Mark all events as read This option marks all events as read The options are OK and Cancel Clear event log This option clears the Event Log memory of all messages The options are OK and Cancel 7 24 Chapter 7 BIOS 7 4 Security Settings The AMI BIOS provides a Supervisor and a User password If you use both pass words the Supervisor password must be set first BIOS SETUP UTILITY Change Supervisor Password Supervisor Password This item indicates if a Supervisor password has been entered for the system Not Installed means a Supervisor password has not been used User Password This item indicates if a user password has been entered for the system Not In stalled means that a user password has not been used Change Supervisor Password Select this feat
61. ifications Appendix C System Specifications Processors Two Intel Xeon 5500 series processors Note Please refer to our web site for a complete listing of supported processors Chipset Intel 5520 ICH10R BIOS 32 Mb AMIBIOS SPI Flash ROM Memory Capacity Twelve DIMM sockets supporting up to 96 GB of registered ECC DDR3 1333 1066 800 SDRAM or up to 24 GB of unbuffered ECC non ECC DDR3 1333 1066 800 MHz SDRAM Note See the memory section in Chapter 5 for details GPUs Graphics Processing Units 6016XT TF 6016GT TF GPU ready no GPUs installed 6016GT TF TM2 two NVIDIA Tesla M1060 GPU cards 6016GT TF TC2 two NVIDIA Tesla C1060 GPU cards SATA Controller Intel on chip controller for 3 Gb s SATA RAID 0 1 10 and 5 support Drive Bays Three 3 hot swap drive bays to house three 3 standard SATA drives Expansion Slots 6016XT TF four standard size PCI E x8 cards in x16 slots one low profile PCI E x4 card in x16 slot 6016GT TF two standard size PCI E x16 cards one low profile PCI E x4 card in x16 slot 6016GT TF TM2 one low profile PCI E x4 card 6016GT TF TC2 one low profile PCI E x4 card C 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Serverboard X8DTG DF proprietary ATX form factor Dimensions 16 64 x 7 74 423 x 197 mm Chassis SC818GTQ 1400B 1U rackmount Dimensions WxHxD 17 2 x 1 7 x 28 2 in 437 x 43 x 716 mm Weight Gross Bare Bone 47 lbs 21 4 kg
62. in any way If the server itself shows damage you should file a damage claim with the carrier who delivered it Decide on a suitable location for the rack unit that will hold the server It should be situated in a clean dust free area that is well ventilated Avoid areas where heat electrical noise and electromagnetic fields are generated You will also need it placed near a grounded power outlet Read the Rack and Server Precautions in the next section 2 3 Preparing for Setup The box the server was shipped in should include two sets of rail assemblies two rail mounting brackets and the mounting screws you will need to install the system into the rack Follow the steps in the order given to complete the installation process in a minimum amount of time Please read this section in its entirety before you begin the installation procedure outlined in the sections that follow Choosing a Setup Location e Leave enough clearance in front of the rack to enable you to open the front door completely 25 inches and approximately 30 inches of clearance in the back of the rack to allow for sufficient airflow and ease in servicing This product is for installation only in a Restricted Access Location dedicated equipment rooms service closets and the like 2 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual e This product is not suitable for use with visual display work place devices acccording to 2 of the the German Ordinance
63. ing to IDE drives The options are Disabled and Enabled Load Onboard LAN1 Option ROM Load Onboard LAN2 Option ROM Select Enabled to enable the onboard LAN1 or LAN2 Option ROM This is to boot computer using a network interface The options are Enabled and Disabled gt Super IO Device Configuration Serial Port1 Address Serial Port2 Address This option specifies the base I O port address and the Interrupt Request address of Serial Port 1 and Serial Port 2 Select Disabled to prevent the serial port from accessing any system resources When this option is set to Disabled the serial port physically becomes unavailable Select 3F8 IRQ4 to allow the serial port to use 3F8 7 14 Chapter 7 BIOS as its I O port address and IRQ 4 for the interrupt address The options for Serial Port are Disabled 3F8 IRQ4 3E8 IRQ4 2E8 IRQ3 The options for Serial Port2 are Disabled 2F8 IRQ3 3E8 IRQ4 and 2E8 IRQ3 gt Remote Access Configuration Remote Access This allows the user to enable the Remote Access feature The options are Disabled and Enabled lf Remote Access is set to Enabled the following items will display Serial Port Number This feature allows the user decide which serial port to be used for Console Redi rection The options are COM 1 and COM 2 Serial Port Mode This feature allows the user to set the serial port mode for Console Redirection The options are 115200 8 n 1 57600 8 n 1 38400 8 n 1 19200 8 n 1
64. ings are Enabled and Disabled IOH PCIE Port1 Bifurcation This feature allows the user to set IOH Bifurcation configuration for the PCI E Port 1 The options are X4X4X4X4 X4X4X8 X8X4X4 X8X8 and X16 IOH PCIE Max Payload Size Some add on cards perform faster with the coalesce feature which limits the pay load size to 128 MB while others with a payload size of 256 MB which inhibits the coalesce feature Please refer to your add on card user guide for the desired setting The options are 256 MB and 128MB gt SouthBridge Configuration This feature allows the user to configure the settings for the Intel ICH South Bridge chipset USB Functions This feature allows the user to decide the number of onboard USB ports to be en abled The Options are Disabled 2 USB ports 4 USB ports 6 USB ports 8 Ports 10 Ports and 12 USB ports Legacy USB Support Select Enabled to use Legacy USB devices If this item is set to Auto Legacy USB support will be automatically enabled if a legacy USB device is installed on the motherboard and vise versa The settings are Disabled Enabled and Auto USB 2 0 Controller Select Enabled to activate the onboard USB 2 0 controller The options are Enabled and Disabled USB 2 0 Controller Mode This setting allows you to select the USB 2 0 Controller mode The options are Hi Speed 480 Mbps and Full Speed 12 Mbps BIOS EHCI Hand Off Select Enabled to enable BIOS Enhanced Host Controller Interfac
65. isable the fan speed control function and allow the onboard fans to constantly run at the full soeed 12V The Options are 1 Disabled Full Speed 2 Server Mode 3 Workstation Mode SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Fan1 Fan 4 Reading This feature displays the fan speed readings from fan interfaces Fani through Fanb CPU1 Vcore CPU2 Vcore 5Vin 12Vcc V VP1 DIMM VP2 DIMM 3 3Vcc V and Battery Voltage gt ACPI Configuration Use this feature to configure Advanced Configuration and Power Interface ACPI power management settings for your system ACPI Version Features The options are ACPI v1 0 ACPI v2 0 and ACPI v3 0 Please refer to ACPI s website for further explanation http www acpi info ACPI APIC Support Select Enabled to include the ACPI APIC Table Pointer in the RSDT Root System Description Table pointer list The options are Enabled and Disabled APIC ACPI SCI IRQ When this item is set to Enabled APIC ACPI SCI IRQ is supported by the system The options are Enabled and Disabled Headless Mode This feature is used to enable system to function without a keyboard monitor or mouse attached The options are Enabled and Disabled High Performance Event Timer Select Enabled to activate the High Performance Event Timer HPET that produces periodic interrupts at a much higher frequency than a Real time Clock RTC does in synchronizing multimedia streams providing s
66. ive carriers MCP 220 00001 01 One SGPIO cable CBL 0157L e One rail set MCP 290 00020 N One Super Server 6016XT TF 6016GT Series User s Manual i SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 1 2 Serverboard Features At the heart of the SuperServer 6016XT TF 6016GT TF 6016GT TF TM2 6016GT TF TC2 lies the X8DTG DF a dual processor serverboard based on the Intel 5520 chipset Below are the main features of the X8DTG DF See Figure 1 1 for a block diagram of the chipset Processors The X8DTG DF supports two Intel Xeon processor 5500 series Please refer to the serverboard description pages on our web site for a complete listing of supported processors www supermicro com Memory The X8DTG DF has 12 DIMM slots that can support up to 96 GB of registered ECC DDR8 1333 1066 800 SDRAM or up to 24 GB of unbuffered ECC non ECC DDR3 1333 1066 800 MHz SDRAM Modules of the same size and speed are recommended See Chapter 5 for details Serial ATA A SATA controller is integrated into the South Bridge ICHR10 section of the chipset to provide a six port 3 Gbs SATA subsystem which is RAID 0 1 5 and 10 sup ported The SATA drives are hot swappable units Note The operating system you use must have RAID support to enable the hot swap capability and RAID function of the SATA drives PCI Expansion Slots The X8DTG DF has two PCI Express 2 0 x16 slots and one PCI Express 2 0 x4 slot The 6016GT TF TM2 and
67. jumpers Refer to this chap ter when adding or removing processors or main memory and when reconfiguring the serverboard Chapter 6 Advanced Chassis Setup Refer to Chapter 6 for detailed information on the SC818GTQ 1400B 1U rackmount server chassis You should follow the procedures given in this chapter when install ing removing or reconfiguring Serial ATA or peripheral drives and when replacing system power supply units and cooling fans Chapter 7 BIOS The BIOS chapter includes an introduction to BIOS and provides detailed informa tion on running the CMOS Setup Utility Appendix A BIOS Eror Beep Codes Appendix B Installing Windows Appendix C System Specifications Preface Notes SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Table of Contents Chapter 1 Introduction 1 1 IVE EW air aaa gece presse craw oe eesti E E otg ae dates eene 1 1 1 2 Serverboard Feature cccccccssscccsscecensceceneeteneetaseeeneecesseeceseueeseneetaneetsneees 1 2 OCC SOUS sacer r ET EE OTE 1 2 MOMON ooann E E E E E E EE E EE 1 2 LL Pa A E A EEE AEE ET 1 2 POLEA ON 51 ONS aesa E EEEE E A ES 1 2 Onboard Conrollers POS sereen e e EE EE aa 1 2 a a PA EA EA EE E EEE 1 3 ONE FENIE O ea erecece eieaelenan oem leeneuaie ansandnustae sets ataanatnues 1 3 t3 Gemer CASSIS Features cases tersc cere acerocsse pecan vataae ante sacteseuuoseseeeGuaidassuaneseneua oad 1 3 System FOV T oorsese se ae names atset select OaE EAE
68. k units on the market which may mean that the assembly procedure will differ slightly You should also refer to the installation instructions that came with the rack unit you are using Note This rail will fit a rack between 26 and 33 5 deep Identifying the Sections of the Rack Rails The chassis package includes two rack rail assemblies in the rack mounting kit Each assembly consists of two sections an inner fixed chassis rail that secures directly to the server chassis and an outer fixed rack rail that secures directly to the rack itself Figure 2 1 Identifying the Sections of the Rack Rails l Inner Rail Outer Rails Inner Rail preattached Extension slide together then to the chassis attach to the attach to the front chassis and rear brackets Front and Rear Brackets attach to the rack 2 4 Chapter 2 Server Installation Installing the Inner Rail Extensions The SC818G chassis includes a set of inner rack rails in two sections inner rails A and inner rail extensions B The inner rails are preattached and do not interfere with normal use of the chassis if you decide not to install to a server rack Attaching the inner rail extensions to to the inner rails stabilizes the chassis within the rack Installing the Inner Rail Extensions 1 Place the inner rail extensions B over the preattached inner rails A which are attached to the side of the chassis Align the hooks of the inner rail with the rail ext
69. le making sure the arrows on the top of the fan indicating air direction point in the same direc tion as the arrows on the other fans in the same fan tray 7 Reconnect the fan wires to the exact same chassis fan headers as the previ ous fan 8 Reconnect the AC power cord power up the system and check that the fan is working properly before replacing the chassis cover 6 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Figure 6 2 Removing a Fan from the Fan Tray 6 4 Drive Bay Installation Removal Accessing the Drive Bays Hard Drives Because of their hotswap capability you do not need to access the inside of the chassis or power down the system to install or replace hard drives Proceed to the next section for instructions Peripheral Drives The SC818GTQ chassis includes space for a variety of peripheral drive options including a 2 5 hard disk drive DVD ROM or floppy drive For a complete listing of peripheral drive options visit the Supermicro web site at http www supermicro com products chassis 1 U 818 SC818G 1400 cfm Hard Drive Installation The hard drives are mounted in drive carriers to simplify their installation and removal from the chassis These carriers also help promote proper airflow for the drive bays For this reason even empty carriers without drives installed must remain in the chassis Removing Hard Drive Carriers from the Chassis 1 Press the release button on the drive car
70. led Patrol Scrubbing A memory error correction scheme that works in the background looking for and correcting resident errors The options are Enabled and Disabled Throttling Closed Loop Throttling Open Loop Throttling improves reliability and reduces power in the processor by automatic voltage control during processor idle states Available options are Disabled and Enabled If Enabled the following items will appear Hysteresis Temperature Temperature Hysteresis is the temperature lag in degrees Celsius after the set DIMM temperature threshold is reached before Closed Loop Throttling begins The options are Disabled 1 59C 3 0 C and 6 0 C 7 8 Chapter 7 BIOS Guardband Temperature This is the temperature which applies to the DIMM temperature threshold Each step is in 0 5 C increment The default is 006 Press or on your keyboard to change this value Inlet Temperature This is the temperature detected at the chassis inlet Each step is in 0 5 C increment The default is 070 Press or on your keyboard to change this value Temperature Rise This is the temperature rise to the DIMM thermal zone Each step is in 0 5 C increment The default is 020 Press or on your keyboard to change this value Air Flow This is the air flow speed to the DIMM modules Each step is one mm sec The default is 1500 Press or on your keyboard to change this value Altitude
71. located on pins 3 and 4 of JF1 and attaches to the reset switch on the computer chassis See the table on the right for pin definitions Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1 Refer to the table on the right for pin definitions Overheat Fan Fail UID LED Connect an LED cable to pins 7 and 8 of JF1 for the Overheat Fan Fail and UID LED connections The red LED pin 8 provides warning of an overheat or fan failure The blue LED pin 7 works as the UID LED indicator for the front panel UID button located on pins 13 14 of JF1 When Jumper J_ UID OW is set to off default the red LED takes precedence over the blue LED See Page 3 2 for details Refer to the table on the right for pin definitions NIC2 JLAN2 LED The LED connections for JLAN2 are on pins 9 and 10 of JF1 Attach an LED cable to display network activity See the table on the right for pin definitions NIC1 JLAN1 LED The LED connections for JLAN1 are on pins 11 and 12 of JF1 Attach an LED cable to display network activity See the table on the right for pin definitions 5 14 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Reset Button Pin Definitions JF1 Pin Definition 3 Reset Ground PWR Fail LED Pin Definitions JF1 Pin Definition 5 3 3V PWR Fail LED OH Fan Fail Blue_UID LED Pin Definitions JF1 Pin Definition 7 Blue_LED Cathode UID 5 5V SB OH Fan Fail UI
72. ly do not touch its components peripheral chips memory modules or gold contacts e When handling chips or modules avoid touching their pins e Put the serverboard add on cards and peripherals back into their antistatic bags when not in use e For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 6 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Figure 6 1 Chassis Front and Rear Views Power Supply Control Panel Ma o J N Ro e aa aceon SOSSSSs j 229550 p were 2 use ge Hot Swap Drive Bays 3 USB Ports Dedicated IPMI LAN Port E Z Z m
73. mooth playback and reducing the de pendency on other timestamp calculation devices such as an x86 RDTSC Instruc tion embedded in the CPU The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer The options are Enabled and Disabled gt IPMI Configuration X8DTG DF IBXF IBQF Only Intelligent Platform Management Interface IPMI is a set of common interfaces that IT administrators can use to monitor system health and to manage the system as a whole For more information on the IPMI specifications please visit Intel s website at www intel com 1 18 Chapter 7 BIOS BIDS SETUP UTILITY Status of BMC Baseboard Management Controller BMC manages the interface between system management software and platform hardware This is an informational feature which returns the status code of the BMC micro controller gt View BMC System Event Log This feature displays the BMC System Event Log SEL It shows the total number of entries of BMC System Events To view an event select an Entry Number and pressing lt Enter gt to display the information as shown in the screen BIOS SETUP UTILITY SEL Entry Number 7 19 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual e Total Number of Entries e SEL Entry Number e SEL Record ID e SEL Record Type e Timestamp Generator ID e Event Message Format User e Event Sensor Type e Event Sensor Number e Event Dir Type Event
74. nfigure the Platform Event Filter PEF PEF interprets BMC events and performs actions based on pre determined settings or traps under IPMI 1 5 specifications For example powering the system down or sending an alert when a triggering event is detected The following will appear if PEF Support is set to Enabled The default is Dis abled PEF Action Global Control These are the different actions based on BMC events The options are Alert Power Down Reset System Power Cycle OEM Action Diagnostic Interface Alert Startup Delay This feature inserts a delay during startup for PEF alerts The options are Enabled and Disabled PEF Alert Startup Delay This sets the pre determined time to delay PEF alerts after system power ups and resets Refer to Table 24 6 of the IPMI 1 5 Specification for more information at www intel com The options are No Delay 30 sec 60 sec 1 5 min 2 0 min Startup Delay This feature enables or disables startup delay The options are Enabled and Disabled PEF Startup Delay This sets the pre determined time to delay PEF after system power ups and resets Refer to Table 24 6 of the IPMI 1 5 Specification for more information at www intel com The options are No Delay 30 sec 60 sec 1 5 min 2 0 min 1 23 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Event Message for PEF Action This enables of disables Event Messages for PEF action Refer to Table 24 6 of the IPMI 1 5 Spec
75. ns NC No Connection NMI Button Use this header to issue a non maskable Pin Definition interrupt Refer to the table on the right for 1 Control pin definitions Ground 5 16 Chapter 5 Advanced Serverboard Setup PWR I C Connector This System Management Bus lC con nector is used to monitor the status of the power supply See the table on the right for pin definitions IPMB C SMB A System Management Bus header for the IPMI is located at IPMB Connect the ap propriate cable here to use the IPMB C connection on your system Unit Identifier Button SW1 There are two Unit Identifier UID buttons and LED indicators on the serverboard The Front Panel UID button connects to pin 13 on the JF1 header and its LED connects to pin 7 of JF1 The Rear UID button SW1 is located next to the VGA port and the Rear UID LED is designated LE4 When you press the UID button on the front or rear of the server both the front and rear LEDs will turn on Press a UID button again to turn off both LEDs These UID LEDs provide easy identifica tion of a system located in a large rack of servers See the table on the right for pin definitions Note the UID LED is supported by either the physical button or the BMC When con trolled by the physical button it is solid on When controlled by the BMC it blinks Internal Speaker Attach a speaker to the JSPK1 pins to provide audible alarms for the beep codes See the t
76. ode 1 beep 5 short beeps 1 long Memory error beep Display memory read write error 8 beeps 1 continuous beep System Overheat with the front panel OH LED on Description Circuits have been reset Ready to power up No memory detected in the system Video adapter missing or with faulty memory 1 continuous beep with the front panel OH LED on A 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Notes Appendix B Installing Windows Appendix B Installing Windows After all hardware components have been installed you must first configure Intel South Bridge RAID Settings before you install the Windows OS and other software drivers To configure RAID settings please refer to RAID Configuration User Guides posted on our web site at www supermicro com support manuals Note the following instructions apply to installing Windows XP or Windows 2003 only If installing Windows 2008 or Windows Vista please follow the instructions displayed on your screen after loading the Operating System CD B 1 1 Installing Windows for a RAID System Insert Microsoft s Windows XP Windows 2003 Setup CD in the CD drive and the system will start booting up from the CD Press the lt F6 gt key when the message Press F6 if you need to install a third party SCSI or RAID driver displays When the Windows XP Windows 2003 Setup screen appears press S to specify additional device s Insert
77. oot device 4th boot device oth boot device and Disabled e ist Boot Device USB XXXXXXXXX e 2nd Boot Device CD DVD XXXXXXXXX 7 26 Chapter 7 BIOS gt Hard Disk Drives This feature allows the user to specify the boot sequence from all available hard disk drives The settings are Disabled and a list of all hard disk drives that have been detected i e 1st Drive 2nd Drive 3rd Drive etc e 1st Drive SATA XXXXXXXXX gt Removable Drives This feature allows the user to specify the boot sequence from available Removable Drives The settings are 1st boot device 2nd boot device and Disabled e 1st Drive USB XXXXXXXXX e 2nd Drive gt CD DVD Drives This feature allows the user to specify the boot sequence from available CD DVD Drives i e 1st Drive 2nd Drive etc 7 6 Exit Options Select the Exit tab from the AMI BIOS Setup Utility screen to enter the Exit BIOS Setup screen BIOS SETUP UTILITY save Changes and Exit 1 21 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Save Changes and Exit When you have completed the system configuration changes select this option to leave the BIOS Setup Utility and reboot the computer so the new system con figuration parameters can take effect Select Save Changes and Exit from the Exit menu and press lt Enter gt Discard Changes and Exit Select this option to quit the BIOS Setup without making any permanent ch
78. ots or shuts down it s allowed to cancel the action Requirements Eeep Supero SDS3S5ennce Daemon rinnne at all times on this system Provide TOPI connectivity Power control zi Note SD III Software Revision 1 0 can be downloaded from our Web Site at ftp ftp supermicro com utility Supero_Doctor_Ill You can also download the SDIII User s Guide at lt http www supermicro com PRODUCT Manuals SDIII UserGuide pdf gt For Linux we will recommend using Supero Doctor Il 5 24 Chapter 6 Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform mainte nance on the SC818GTQ chassis For component installation follow the steps in the order given to eliminate the most common problems encountered If some steps are unnecessary skip ahead to the next step Tools Required The only tool you will need to install components and perform maintenance is a Philips screwdriver 6 1 Static Sensitive Devices Electrostatic Discharge ESD can damage electronic components To prevent damage to any printed circuit boards PCBs it is important to handle them very carefully The following measures are generally sufficient to protect your equipment from ESD damage Precautions e Use a grounded wrist strap designed to prevent static discharge e Touch a grounded metal object before removing any board from its antistatic bag e Handle a board by its edges on
79. ove t Note Notch should align Use your thumbs to with the receptive key gently push the release tabs near both ends of the module This should release it from the slot point on the slot Sdieace Tab y Release Tab OO TOO DOO COLL TOTO oon TO DARDCCAOODOCDDI amp Top View of DDR3 Slot 5 8 Chapter 5 Advanced Serverboard Setup DIMM Population Table DIMM DIMMs DIMM Type Reg Speeds in MHz Ranks per DIMM Slots per Populated Registered any combination Channel per Channel SR Single Rank DR Dual Rank QR Quad Rank Reg DDR3 ECC 800 1066 1333 SR or DR Reg DDR3 ECC 800 1066 QR Reg DDR3 ECC 800 1066 Mixing SR DR Reg DDR3 ECC 800 Mixing SR DR QR Notes Due to OS limitations some operating systems may not show more than 4 GB of memory Due to memory allocation to system devices the amount of memory that remains available for operational use will be reduced when 4 GB of RAM is used The reduc tion in memory availability is disproportional See chart below Possible System Memory Allocation amp Availability System Device i Physical Memory Available 4 GB Total System Memory Firmware Hub flash memory System BIOS Local APIC Area Reserved for the chipset I O APIC 4 Kbytes PCI Enumeration Area 1 256 MB PCI Express 256 MB 256 MB PCI Enumeration Area 2 if needed Aligned on 256 M 512 MB boundary TSEG 1 MB VGA Memory 16 MB Memory available for the OS
80. ower loss The options are Power On Power Off and Last State Watch Dog Timer If enabled the Watch Dog Timer will allow the system to reboot when it is inactive for more than 5 minutes The options are Enabled and Disabled gt Processor and Clock Options This submenu allows the user to configure the Processor and Clock settings Ratio CMOS Setting This option allows the user to set the ratio between the CPU Core Clock and the FSB Frequency Note if an invalid ratio is entered the AMI BIOS will restore the setting to the previous state The default setting depends on the type of CPU installed on the motherboard The default setting for the CPU installed in your motherboard is 18 Press or on your keyboard to change this value f9 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual C1E Support Select Enabled to use the feature of Enhanced Halt State C1E significantly reduces the CPU s power consumption by reducing the CPU s clock cycle and voltage during a Halt State The options are Disabled and Enabled Hardware Prefetcher Available when supported by the CPU If set to Enabled the hardware pre fetcher will pre fetch streams of data and instruc tions from the main memory to the L2 cache in the forward or backward manner to improve CPU performance The options are Disabled and Enabled Adjacent Cache Line Prefetch Available when supported by the CPU The CPU fetches the cache line for 64 byt
81. permicro CDs that came packaged with your system S SUPERMICRO X8 amp DTG D Motherboard Drivers amp Tools WinXP ae Intel 5500 5520 Chipset INF tiles S U PERMI C R Matros G200e Graphics Driver Drivers amp Tools Universal Audio Architecture Driver Intel 5520 Chipset Realtek High Definition Audio Driver ASDTG D Intel Watie Storage Manager Adaptec Storage Manager aa Intel PAO Network Connections Drivers hin re x H iaj SUPERMICRO Supero Doctor Ill SUPERMICRE Computer tric Build driver diskettes and manuals Browse CO Auto Start Up Nest Time For more information please visit SUPERMICRO s web site Driver Tool Installation Display Screen Note Click the icons showing a hand writing on paper to view the readme files for each item Click the computer icons to the right of these items to install each item from top to the bottom one at a time After installing each item you must re boot the system before moving on to the next item on the list The bottom icon with a CD on it allows you to view the entire contents of the CD 5 22 Chapter 5 Advanced Serverboard Setup Supero Doctor Ill The Supero Doctor Ill program is a web based management tool that supports remote management capability It includes Remote and Local Management tools The local management is called SD III Client The Supero Doctor IIl program in cluded on the CD ROM that came with your motherboard allows you to monitor the environment
82. rformance by increasing the amount of data transferred Only 512 bytes of data can be transferred per interrupt if Block Mode is not used Block Mode allows transfers of up to 64 KB per interrupt Select Disabled to allow data to be transferred from and to the device one sector at a time Select Auto to allow data transfer from and to the device occur multiple sectors at a time if the device supports it The options are Auto and Disabled PIO Mode The IDE PIO Programmable I O Mode programs timing cycles between the IDE drive and the programmable IDE controller As the PIO mode increases the cycle time decreases The options are Auto 0 1 2 3 and 4 Select Auto to allow the AMI BIOS to automatically detect the PIO mode Use this value if the IDE disk drive support cannot be determined Select 0 to allow the AMI BIOS to use PIO mode 0 It has a data transfer rate of 3 3 MBs Select 1 to allow the AMI BIOS to use PIO mode 1 It has a data transfer rate of 5 2 MBs Select 2 to allow the AMI BIOS to use PIO mode 2 It has a data transfer rate of 8 3 MBs Select 3 to allow the AMI BIOS to use PIO mode 3 It has a data transfer rate of 11 1 MBs 1 12 Chapter 7 BIOS Select 4 to allow the AMI BIOS to use PIO mode 4 It has a data transfer band width of 32 Bits Select Enabled to enable 32 Bit data transfer DMA Mode Select Auto to allow the BIOS to automatically detect IDE DMA mode when the IDE disk drive support cannot be
83. rier This extends the drive carrier handle 2 Use the handle to pull the drive carrier out of the chassis 6 4 Chapter 6 Advanced Chassis Setup Figure 6 3 Removing a Hard Drive Carrier Warning Except for short periods of time Swapping hard drives do not operate the server with the hard drive carriers removed 6 5 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Installing a Hard Drive to the Hard Drive Carrier 1 Remove the two screws securing the dummy drive to the carrier 2 Remove the dummy drive from the carrier 3 Install a new drive into the carrier with the printed circuit board side facing downward so that the mounting holes align with those in the carrier 4 Secure the hard drive by tightening all six screws Installing a Hard Drive Carrier Into the Chassis 1 Insert the loaded hard drive carrier into the drive bay of the chassis 2 Push the drive carrier into the drive bay pushing in the handle of the carrier until it clicks into the locked position Hard Drive Drive Carrier Figure 6 4 Installing a Hard Drive to the Carrier 6 6 Chapter 6 Advanced Chassis Setup Note When installing the hard drive carrier that is next to the power supply the power supply handle must be lifted before extending the hard drive carrier handle or before inserting the hard drive carrier into the drive bay Figure 6 5 Installing Removing the Carrier Next to the Power Supply Pe
84. ripheral Drive Installation Installing or Replacing a Peripheral Drive 1 Unplug the main power cord to the chassis 2 Unplug the power and data cables from the motherboard and or backplane 3 If you are adding a new drive Remove the dummy tray from the drive bay The mini bezel can be removed by pulling out the hard drive beneath the drive bay then pulling the mini bezel forward lf you are replacing a drive Locate the locking tab at the rear left hand side when viewed from the front of the peripheral drive Push the tab toward the drive and push the drive unit out the front of the chassis 4 Insert the new drive unit in the slot until the tab locks in place 5 Reconnect the data and power cables 6 Replace the chassis cover replace the server in the rack if necessary and power up the system 6 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 6 5 Installing the Air Shroud Air shrouds concentrate airflow to maximize fan efficiency The air shroud for the SC818GTQ chassis does not require screws to set up Installing the Air Shroud iP Position the air shroud in the chassis as illustrated above Align the notch A on the air shroud with the pin B on the add on card bracket Slide the pin B into the back of the notch A Lower the front of the air shroud over the fan tray sliding the front notches C over the pins on the fan tray D Checking the Air Flow Checking the Server s Air
85. rmal grease on the surface before you re install a heatsink Note see Chapter 6 for details on installing the air shroud 5 7 7 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual 5 6 Installing Memory CAUTION Exercise extreme care when installing or removing DIMM modules to prevent any possible damage Memory Support The X8DTG DF supports up to 96 GB of registered ECC or up to 24 GB 2 GB per slot of unbuffered ECC non ECC DDR3 1333 1066 800 MHz SDRAM in 12 DIMM slots See the following table for memory installation Notes With unbuffered ECC non ECC memory 2 GB is the maximum DIMM size that can be supported per slot Memory speed support is dependent on the type of CPU used on the board Installing Memory Modules 1 Insert the desired number of DIMMs into the memory slots starting with P1 DIMM 1A For best memory performance please install memory modules of the same type and same speed on the memory slots as indicated on the tables below 2 Insert each DIMM module vertically into its slot Pay attention to the notch along the bottom of the module to avoid installing incorrectly see Figure 5 4 3 Gently press down on the DIMM module until it snaps into place in the slot Repeat for all modules Figure 5 3 DIMM Installation Notch Notch To Install Insert module vertically and press down until it snaps into place Pay attention to the alignment notch at Front View the bottom To Rem
86. s are properly connected and not block ing the chassis airflow See Chapter 5 for details on cable connections Also check the air seals for damage The air seals are located under the blower fan and beneath the frame cross section that separates the drive bay area from the serverboard area of the chassis Checking the Drive Bay Setup Next you should check to make sure the hard drives have been properly installed and all connections have been made Checking the Drives i 2 For servicing the hard drives you will need to remove the top chassis cover If you need to remove or install hard drives please refer to Chapter 6 Checking the Airflow ip Airflow is provided by 4 cm counter rotating fans The system component layout was carefully designed to direct sufficient cooling airflow to the compo nents that generate the most heat Note that all power and data cables have been routed in such a way that they do not block the airflow generated by the fans 2 11 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Providing Power 1 The last thing you must do is to provide input power to the system Plug the power cord from the power supply unit into a high quality power strip that of fers protection from electrical noise and power surges It is recommended that you use an uninterruptible power supply UPS 2 Finish by depressing the power button on the chassis control panel 2 12 Chapter 3 System Int
87. sages The AMI BIOS Setup Utility uses a key based navigation system called hot keys Most of the AMI BIOS setup utility hot keys can be used at any time during the setup navigation process These keys include lt F1 gt lt F10 gt lt Enter gt lt ESC gt ar row keys etc Note Options printed in Bold are default settings f How To Change the Configuration Data The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility This Setup utility can be accessed by pressing lt Del gt at the appropriate time during system boot 1 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Starting the Setup Utility Normally the only visible Power On Self Test POST routine is the memory test As the memory is being tested press the lt Delete gt key to enter the main menu of the AMI BIOS Setup Utility From the main menu you can access the other setup screens An AMI BIOS identification string is displayed at the left bottom corner of the screen below the copyright message Warning Do not upgrade the BIOS unless your system has a BIOS related issue Flashing the wrong BIOS can cause irreparable damage to the system In no event shall Supermicro be liable for direct indirect special incidental or consequential damages arising from a BIOS update If you have to update the BIOS do not shut down or reset the system while the BIOS is updating This is to avoi
88. scale VGA COM1 LAN2 LAN4 J PMB fel nw am E S g IPMI_LAN D W LE2 i x J UID_OW JLPC80 g S 5 a W A Winbond JBMC1 450R 5I Intel BMC r 82576 LAN CTRL U Q m N JBT1 Oo x A Intel ICH10R Bios South Bridge Intel 5520 I IOH 36D a gt g z SUPER X8DTG DF rororo Q gt H BO Fe ussas p oo g da ie w X 7 ius F o w iss h x U U U U U U N lda a ak w Z Sgn 9 7 G E o 2 z zzz ziz zI zzz Zz IZ k k N N wo wo wl gt al gt wi gt X CPU1 1 oo 83 T sePio 0 0ko ice oo 1 SGPIO 1 oo 2 FANS o O a 13 FAN ogr roqrogroqrogro adl 53 eee less Battery fe O z FAN6 S O O eo FANS S OO U U U W U U N N N N N N gjgjgjgjgejg Z i Z Zi zZ CPU2 ZZ Zl Zizi ez wo wo N N k ae JPW1 gt gt wl gt w o m oo Oo o o o cae o o JPW2 e O O Oo o O m o ae oOo oo 00 JPW3 5 o O O mo eo 0 Za pan eS FAN4 FAN3 a m FAN2 _2 OJLO OJLO O O o mee j PWR 12C na Jf oll Notes Jumpers not indicated are for test purposes only a indicates the location of Pin 1 When the LE1 LED is on power is present on the board Make sure to unplug the AC power cable before removing or installing components 5 11 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual X8DTG DF Quick Reference Jumper Description Default Setting JBMC1
89. supply units in the system When working around exposed electrical circuits another person who is familiar with the power off controls should be nearby to switch off the power if neces sary Use only one hand when working with powered on electrical equipment This is to avoid making a complete circuit which will cause electrical shock Use extreme caution when using metal tools which can easily damage any electrical components or circuit boards they come into contact with Do not use mats designed to decrease static electrical discharge as protection from electrical shock Instead use rubber mats that have been specifically designed as electrical insulators The power supply power cords must include a grounding plug and must be plugged into grounded electrical outlets 4 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual e This product may be connected to an IT power system In all cases make sure that the unit is also reliably connected to Earth ground e Serverboard Battery CAUTION There is a danger of explosion if the onboard battery is installed upside down which will reverse its polarites see Figure 4 1 This battery must be replaced only with the same or an equivalent type recommended by the manufacturer Dispose of used batteries according to the manufacturer s instructions e DVD ROM Laser CAUTION this server may have come equipped with a DVD ROM drive To prevent direct exposure to the laser be
90. t Control The items included in the Advanced Settings submenu are listed below gt CPU Bridge Configuration QPI Links Speed This feature selects QPI s data transfer soeed The options are Slow mode and Full Speed QPI Frequency This selects the desired QPI frequency The options are Auto 4 800 GT 5 866GT 6 400 GT 1 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual QPI LOs and L1 This enables the QPI power state to low power LOs and L1 are automatically selected by the motherboard The options are Disabled and Enabled Memory Frequency This feature forces a DDR3 frequency slower than what the system has detected The available options are Auto Force DDR 800 Force DDR 1066 and Force DDR 1333 Memory Mode The options are Independent Channel Mirror Lockstep and Sparing Independent All DIMMs are available to the operating system Channel Mirror The motherboard maintains two identical copies of all data in memory for redundancy Lockstep The motherboard uses two areas of memory to run the same set of operations in parallel Sparing A preset threshold of correctable errors is used to trigger fail over The spare memory is put online and used as active memory in place of the failed memory Demand Scrubbing A memory error correction scheme where the Processor writes corrected data back into the memory block from where it was read by the Processor The op tions are Enabled and Disab
91. t are visible in the chassis Insert screws into all the mounting holes on your serverboard that line up with the standoffs and tighten until snug if you screw them in too tight you might strip the threads Metal screws provide an electrical contact to the serverboard ground to provide a continuous ground for the system Finish by replacing the top cover of the chassis Warning To avoid damaging the serverboard and its components do not apply any force greater than 8 lbs per square inch when installing a screw into a mount ing hole 5 2 Chapter 5 Advanced Serverboard Setup 5 3 Connecting Cables Now that the serverboard is installed the next step is to connect the cables to the board These include the data ribbon cables for the peripherals and control panel and the power cables Connecting Data Cables The ribbon cables used to transfer data from the peripheral devices have been care fully routed to prevent them from blocking the flow of cooling air that moves through the system from front to back If you need to disconnect any of these cables you should take care to keep them routed as they were originally after reconnecting them make sure the red wires connect to the pin 1 locations The following data cables with their locations noted should be connected See the layout on page 5 9 for connector locations e SATA drive data cable SATA1 3 e SGPIO cable T SGPIO 0 e Control Panel cable JF 1 e GPU po
92. tary design Refer to enna E the table on the right for the pin definitions rouna 4 of this connector You must also connect the 8 pin JPW2 JPW3 graphics card power connectors to your power supply see below Ground Ground 5 Ground NC1 12V 12V 12V 12V 12V 12V Graphics Card Power Connectors JPW2 and JPW3 must also be connected 1 12V 5 Ground to the power supply to provide power for 2 12V 6 Ground the GPUs See the table on the right for a 3 12V 7 Ground pin definitions 4 Ground 8 Ground Required Connection for GPUs Notes For the these proprietary connectors to work properly please customize your PWR cables based on the SMC PWR Connector Pin Out Definitions listed in the tables above For the GPUs to work properly connect the GPU power connectors JPW2 JPW3 to the power supply 6016GT series only Power Button Connector The PW_ON connector is on pins 1 and 2 of JF1 Momentarily contacting both pins will power on off the system This button can also be configured to function as a suspend button with a setting in the BIOS iliac ai see Chapter 4 To turn off the power dc a when set to suspend mode press the button for at least 4 seconds Refer to the table on the right for pin definitions This header should be connected to the chassis power button See the table on the right for pin definitions 1 Power Ground 5 13 Reset Connector The reset connector is
93. the power cord s and power on the system Note Do not use the PW ON connector to clear CMOS VGA Enable Disable VGA Enable Disable JPG1 allows you to enable or disable the pr CRIE VGA port The default position is on pins Jumper Setting Definition 1 and 2 to enable VGA See the table on Pins 1 2 Enabled the right for jumper settings Pins 2 3 Disabled 5 18 Chapter 5 Advanced Serverboard Setup LAN1 2 Enable Disable l l LAN1 2 Enable Disable Change the setting of jumper JPL1 to en Jumper Settings able or disable the LAN1 LAN2 Ethernet Jumper Setting Definition ports on the serverboard See the table on Pins 1 2 Enabled the right for jumper settings The default Pins 2 3 Disabled setting is enabled Watch Dog Enable Disable JWD controls the Watch Dog function Watch Dog is a system monitor that can reboot the system when a software appli cation hangs Jumping pins 1 2 will cause WD to reset the system if an application UUPA Teng hangs Jumping pins 2 3 will generate a t a Seen non maskable interrupt signal for the ap Pista Reset plication that hangs See the table on the Pins 2 3 NMI right for jumper settings Watch Dog must Open Disabled also be enabled in BIOS Note When enabled the user needs to write their own application software in order to disable the Watch Dog Timer J UID OW Overwriting When J_UID_ OW is set to Open default the red LED Overheat Fan Fail PWR Fail UID
94. tic bag e Handle a board by its edges only do not touch its components peripheral chips memory modules or gold contacts e When handling chips or modules avoid touching their pins e Put the serverboard add on cards and peripherals back into their antistatic bags when not in use e For grounding purposes make sure your computer chassis provides excellent conductivity between the power supply the case the mounting fasteners and the serverboard 5 1 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Unpacking The serverboard is shipped in antistatic packaging to avoid electrical static dis charge When unpacking the board make sure the person handling it is static protected 5 2 Serverboard Installation This section explains the first step of physically mounting the X8DTG DF into the SC818GTQ 1400 chassis Following the steps in the order given will eliminate the most common problems encountered in such an installation To remove the serverboard follow the procedure in reverse order Installing to the Chassis 1 Access the inside of the system by removing the screws from the back lip of the top cover of the chassis then pull the cover off Make sure that the I O ports on the serverboard align properly with their respective holes in the I O shield at the back of the chassis Carefully mount the serverboard to the serverboard tray by aligning the board holes with the raised metal standoffs tha
95. ure and press lt Enter gt to access the submenu and then type in a new Supervisor Password User Access Level Available when Supervisor Password is set as above Available options are Full Access grants full User read and write access to the Setup Utility View Only allows access to the Setup Utility but the fields cannot be changed Limited allows only limited fields to be changed such as Date and Time No Access prevents User access to the Setup Utility Change User Password Select this feature and press lt Enter gt to access the submenu and then type in a new User Password 1 25 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Clear User Password Available only when User Password has been set This ttem allows you to clear a user password after it has been entered Password Check This item allows you to check a password after it has been entered The options are Setup and Always Boot Sector Virus Protection When Enabled the AMI BOIS displays a warning when any program or virus is sues a Disk Format command or attempts to write to the boot sector of the hard disk drive The options are Enabled and Disabled 7 5 Boot Configuration Use this feature to configure boot settings BIOS SETUP UTILITY Boot Device Priority gt Boot Device Priority This feature allows the user to specify the sequence of priority for the Boot Device The settings are 1st boot device 2nd boot device 3rd b
96. wer cables JPW2 JPWS3 6016GT series only Important Make sure the the cables do not come into contact with the fans Connecting Power Cables The X8DTG DF has a 20 pin proprietary power supply connector JPW1 for con nection to the ATX power supply In addition there are two 8 pin secondary power connectors JPW2 JPWS that also must be connected to your power supply See Section 5 9 for power connector pin definitions Connecting the Control Panel JF1 contains header pins for various front control panel connectors See Figure 5 1 for the pin locations of the various front control panel buttons and LED indicators All JF1 wires have been bundled into a single ribbon cable to simplify this connec tion Make sure the red wire plugs into pin 1 as marked on the board The other end connects to the Control Panel PCB board located just behind the system status LEDs on the chassis See Chapter 5 for details and pin descriptions 5 3 SUPERSERVER 6016XT TF 6016GT TF TF TM2 TF TC2 User s Manual Figure 5 1 Control Panel Header Pins Power On LED 3 3V HDD LED FP UID 3 3V Stby NIC1 LED Activity NIC2 LED Link NIC2 LED Activity OH Fan Fail PWR Fail UID LED Blue LED UID Cathode 5V Stby PWR Fail LED 3 3V Ground Reset Button Ground Power Button 2 1 NIC1 LED Link 5 4 1 O Ports The I O ports are color coded in conformance with the PC 99 specification See Figure 5 2 below for the colors and locations of the

Download Pdf Manuals

Related Search

Related Contents

GHP™ Reactor SmartPump  N Latex Ferritin  MANUAL DE INSTRUCCIONES PRECAUCION  ARINC 818 HS SAM Gen II - Great River Technology  Ferramenta do Método ComStop Manual de Instruções  Origin Storage KB-Y94DX notebook spare part  CPSET-M11 - Leuze electronic  MCM 200 User's Manual - KEM Küppers Elektromechanik GmbH  Manual - Daymak  Sony MDR-NC33 User's Manual  

Copyright © All rights reserved. Failed to retrieve file