Home

Cisco Systems InfiniBand 4x User's Information Guide

1. Active PCI p5 2 Active PCI X ServeRAID Alert on LAN ServerGuide BladeCenter ServerProven C2T Interconnect TechConnect Chipkill ThinkPad EtherJet Tivoli e business logo Tivoli Enterprise FlashCopy Wake on LAN IBM XA 32 IBM logo XA 64 IntelliStation X Architecture NetBAY XceL4 Netfinity XpandOnDemand NetView xSeries OS 2 WARP Intel MMX and Pentium are trademarks of Intel Corporation in the United States other countries or both Microsoft Windows and Windows NT are trademarks of Microsoft Corporation in the United States other countries or both UNIX is a registered trademark of The Open Group in the United States and other countries Java and all Java based trademarks and logos are trademarks or registered trademarks of Sun Microsystems Inc in the United States other countries or both Adaptec and HostRAID are trademarks of Adaptec Inc in the United States other countries or both Linux is a trademark of Linus Torvalds in the United States other countries or both Red Hat the Red Hat Shadow Man logo and all Red Hat based trademarks and logos are trademarks or registered trademarks of Red Hat Inc in the United States and other countries Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NS 78 17838 01 Notices Important Notes Mi Other company product or service names may be trademarks or service marks of others Important Notes Processor sp
2. 2 Subject always to the Items for Which IBM is Not Liable below IBM will accept unlimited liability for physical damage to your tangible property resulting from the negligence of IBM 3 Except as provided in items and 2 above IBM s entire liability for actual damages for any one Default will not in any event exceed the greater of 1 EUR 125 000 or 2 125 of the amount you paid for the Machine directly relating to the Default Items for Which IBM is Not Liable Save with respect to any lability referred to in item above under no circumstances is IBM its suppliers or resellers liable for any of the following even if IBM or they were informed of the possibility of such losses 1 loss of or damage to data 2 special indirect or consequential loss or 3 loss of profits business revenue goodwill or anticipated savings Limitation of Liability The following is added to the end of the last paragraph The limitations apply to the extent they are not prohibited under 373 386 of the Slovak Commercial Code SOUTH AFRICA NAMIBIA BOTSWANA LESOTHO AND SWAZILAND Limitation of Liability The following is added to this section IBM s entire liability to you for actual damages arising in all situations involving nonperformance by IBM in respect of the subject matter of this Statement of Warranty will be limited to the charge paid by you for the individual Machine that is the subject of your claim from IBM UNITED KINGD
3. An initial diagnosis of your problem can be made either by a technician over the telephone or electronically by access to an IBM website The type of warranty service applicable to your Machine is specified in Part 3 Warranty Information You are responsible for downloading and installing designated Machine Code microcode basic input output system code called BIOS utility programs device drivers and diagnostics delivered with an IBM Machine and other software updates from an IBM Internet Web site or from other electronic media and following the instructions that IBM provides If your problem can be resolved with a Customer Replaceable Unit CRU e g keyboard mouse speaker memory hard disk drive IBM will ship the CRU to you for you to install If the Machine does not function as warranted during the warranty period and your problem cannot be resolved over the telephone or electronically through your application of Machine Code or software updates or with a CRU IBM or your reseller if approved by IBM to provide warranty service will either at its discretion 1 repair it to make it function as warranted or 2 replace it with one that is at least functionally equivalent If IBM is unable to do either you may return the Machine to your place of purchase and your money will be refunded IBM or your reseller will also manage and install selected engineering changes that apply to the Machine Cisco 4x InfiniBand Swit
4. 1974 or other similar legislation and are only limited to the extent permitted by the applicable legislation Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NN 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms W Limitation of Liability The following is added to this section Where IBM is in breach of a condition or warranty implied by the Trade Practices Act 1974 or other similar legislation IBM s liability is limited to the repair or replacement of the goods or the supply of equivalent goods Where that condition or warranty relates to right to sell quiet possession or clear title or the goods are of a kind ordinarily acquired for personal domestic or household use or consumption then none of the limitations in this paragraph apply Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws of the State or Territory CAMBODIA AND LAOS Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws of the State of New York United States of America CAMBODIA INDONESIA AND LAOS Arbitration The following is added under this heading Disputes arising out of or in connection with this Statement of Limited Warranty shall be finally settled by arbitration which shall be held in Singapore in accordance with the Arbitration Rules
5. Cisco 4x InfiniBand Switch module for IBM BladeCenter This chapter contains the following sections e Introduction page 1 1 e Topologies page 1 3 e Module Management page 1 3 e LEDs page 1 4 e External InfiniBand Ports page 1 5 Introduction The Cisco 4x InfiniBand Switch module for IBM BladeCenter hereafter Server Switch Module adds InfiniBand IB switching capability to hosts in your IBM BladeCenter H chassis When you add one or two Server Switch Modules to your BladeCenter chassis and add HCA expansion cards to your BladeCenter hosts your hosts can communicate to one another over IB within the chassis When you connect the Server Switch Module to an outside IB fabric BladeCenter hosts can communicate with all nodes that connect to the IB network Figure 1 1 shows the Server Switch Module Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 BRE Chapter1 About the Server Switch Module By Introduction Figure 1 1 Cisco 4x InfiniBand Switch Module for IBM BladeCenter Each Server Switch Module includes 16 4x ports to the backplane and 8 4x ports in the form of 2 4x connectors and 2 12x connectors on the front panel The Server Switch Module provides full non blocking switching for all 24 ports On the backplane 14 of the internal 4x ports provide 10 Gbps connections to the HCA expansion cards on server blades The two remaining internal 4x ports provide connections to the chassis e
6. Module Mi Step9 Open a Telnet session to the Server Switch Module with the IP address that you configured in Step 6 Log in to your Server Switch Module and then proceed to Changing the Default Password to secure your Server Switch Module Log in with the default user name of USERID and password of PASSWORD where the 0 in PASSWORD is a zero Switch Cisco BladeCenter Cisco BladeCenter login USERID Password XXXXXXXX Cisco BladeCenter gt Changing the Default Password Change the default password immediately to secure your Server Switch To change the default administrative password follow these steps Step 1 Switch to Privileged Exec mode by entering the enable command Cisco BladeCenterH enable Cisco BladeCenterH Switch to Global Configuration mode by entering the configure terminal command Cisco BladeCenterH configure terminal Cisco BladeCenterH config Step2 Change the password of the user ID by entering the username command Include the following e User ID for which you need to change the password in this case USERID e password keyword e New password that you want to apply to the user ID Cisco BladeCenterH config username USERID password n0accE Step3 Return to User Exec mode by entering the exit command with the all keyword Cisco BladeCenterH config exit all Cisco BladeCenterH gt Configuring the System Clock Configure your system clock immediately so that all system messages include acc
7. Module powered off or LED OK failure Blink Blink LED test first 1 3 seconds after power on Off Blink Test in progress On Off Critical module error detected operator intervention required On On Non critical module operating with no errors detected Off On Module operating with no detected errors Server Switch Module Status LEDs Module Status LEDs provide an at a glance indication of the health of the Server Switch Module The tables list and describe the states of the Module Status LEDs Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 1 4 78 17838 01 Chapter1 About the Server Switch Module Port Status LEDs External InfiniBand Ports W The port LEDs on the Server Switch Module indicate connection and transmission status see tables below Link LEDs indicate connection status Traffic LEDs indicate transmission status Table 1 2 IB 4x Port LED Status Indicators LED Label Color Function lt port gt Green LED Indication Decode TX RX Off 4x port has not established logical link On 4x port is logically connected Blinking 4x port is transmitting or receiving packets Table 1 3 IB 12x Port LED Status Indicators LED Label Color Function port gt Green LED Indication Decode TX RX Off 12x port has not established logical link On 12x port has established logical link Blinking 12x port is transmitting or receiving packets External InfiniBand P
8. User Guide NN 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms W THE FOLLOWING TERMS APPLY TO THE COUNTRY SPECIFIED AUSTRIA The provisions of this Statement of Limited Warranty replace any applicable statutory warranties What this Warranty Covers The following replaces the first sentence of the first paragraph of this section The warranty for an IBM Machine covers the functionality of the Machine for its normal use and the Machine s conformity to 1ts Specifications The following paragraphs are added to this section The limitation period for consumers in action for breach of warranty 1s the statutory period as a minimum In case IBM or your reseller is unable to repair an IBM Machine you can alternatively ask for a partial refund as far as justified by the reduced value of the unrepaired Machine or ask for a cancellation of the respective agreement for such Machine and get your money refunded The second paragraph does not apply What IBM Will Do to Correct Problems The following is added to this section During the warranty period IBM will reimburse you for the transportation charges for the delivery of the failing Machine to IBM Limitation of Liability The following paragraph is added to this section The limitations and exclusions specified in the Statement of Limited Warranty will not apply to damages caused by IBM with fraud or gross negligence and for expres
9. are optional xlylz Alternative keywords are grouped in braces and separated by vertical bars Braces can also be used to group keywords and or arguments for example interface interface type xlylz Optional alternative keywords are grouped in brackets and separated by vertical bars string A nonquoted set of characters Do not use quotation marks around the string or the string will include the quotation marks screen font Terminal sessions and information the system displays are in screen font boldface screen font Information you must enter is in boldface screen font italic screen font Arguments for which you supply values are in italic screen font The symbol represents the key labeled Control for example the key combination D in a screen display means hold down the Control key while you press the D key Nonprinting characters such as passwords are in angle brackets Default responses to system prompts are in square brackets An exclamation point or a pound sign at the beginning of a line of code indicates a comment line Notes use the following conventions Means reader take note Notes contain helpful suggestions or references to material not covered in the publication Cautions use the following conventions Means reader be careful In this situation you might do something that could result in equipment damage or loss of da
10. but do not have a user ID or password you can register at this URL http tools cisco com RPF register register do Note Use the Cisco Product Identification CPI tool to locate your product serial number before submitting a web or phone request for service You can access the CPI tool from the Cisco Technical Support amp Documentation website by clicking the Tools amp Resources link under Documentation amp Tools Choose Cisco Product Identification Tool from the Alphabetical Index drop down list or click the Cisco Product Identification Tool link under Alerts amp RMAs The CPI tool offers three search options by product ID or model name by tree view or for certain products by copying and pasting show command output Search results show an illustration of your product with the serial number label location highlighted Locate the serial number label on your product and record the information before placing a service call Submitting a Service Request Using the online TAC Service Request Tool is the fastest way to open S3 and S4 service requests 83 and S4 service requests are those in which your network is minimally impaired or for which you require product information After you describe your situation the TAC Service Request Tool provides recommended solutions If your issue is not resolved using the recommended resources your service request is assigned to a Cisco engineer The TAC Service Request Tool is located at thi
11. ib mpi rhel3 3 2 0 82 topspin ib rhel3 3 2 0 82 Downloading the Latest Software Release To verify that you are running the latest available release compare your version against the latest version on the Cisco support website at http www cisco com cgi bin tablebuild pl sfs linux After registering your product you should have received a username and password to give you access to this site Cisco Systems Support Contact Information Cisco Technical Support provides 24 hour a day award winning technical assistance The Cisco Technical Support amp Documentation website on Cisco com features extensive online support resources In addition if you have a valid Cisco service contract Cisco Technical Assistance Center TAC engineers provide telephone support If you do not have a valid Cisco service contract contact your reseller Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide viii 78 17838 01 Preface Contacting Technical Support W Cisco Technical Support amp Documentation Website The Cisco Technical Support amp Documentation website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies The website is available 24 hours a day at this URL http www cisco com techsupport Access to all tools on the Cisco Technical Support amp Documentation website requires a Cisco com user ID and password If you have a valid service contract
12. location only are competent 4 in France Algeria Benin Burkina Faso Cameroon Cape Verde Central African Republic Chad Comoros Congo Republic Djibouti Democratic Republic of Congo Equatorial Guinea French Guiana French Polynesia Gabon Gambia Guinea Guinea Bissau Ivory Coast Lebanon Madagascar Mali Mauritania Mauritius Mayotte Morocco New Caledonia Niger Reunion Senegal Seychelles Togo Tunisia Vanuatu and Wallis amp Futuna all disputes arising out of this Statement of Limited Warranty or related to its violation or execution including summary proceedings will be settled exclusively by the Commercial Court of Paris 5 in Russia all disputes arising out of or in relation to the interpretation the violation the termination the nullity of the Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NS 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms W execution of this Statement of Limited Warranty shall be settled by Arbitration Court of Moscow 6 in South Africa Namibia Lesotho and Swaziland both of us agree to submit all disputes relating to this Statement of Limited Warranty to the jurisdiction of the High Court in Johannesburg 7 in Turkey all disputes arising out of or in connection with this Statement of Limited Warranty shall be resolved by the Istanbul Central Sultanahmet Courts and Execution Directorates of Istanbul the Republic of
13. manager by entering the ib sm command with this information e subnet prefix keyword e Subnet prefix of the InfiniBand network to which the Server Switch belongs e priority keyword e Priority integer value of the subnet manager 1 is the lowest the priority Cisco BladeCenterH config ib sm subnet prefix fe 80 00 00 00 00 00 00 priority 1 Exit Global Configuration mode Cisco BladeCenterH config exit Cisco BladeCenterH Save the configuration by entering the copy running config startup config command Cisco BladeCenterH copy running config startup config Cisco BladeCenterH After you configure your subnet manager priority connect your Server Switch Module to the outside InfiniBand fabric By default the external interfaces on your Server Switch Module auto negotiate speed with the fabric Connecting InfiniBand Cables To plug in an InfiniBand cable push the connector into the interface until you hear feel a click To remove a cable with a pull connector grasp the connector with one hand and push it toward the port then pull the latch away from the port with your other hand and gently wiggle the connector away from the port Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 NON Chapter2 Installing and Configuring the Server Switch ES Connecting Beyond BladeCenter Figure 2 1 Removing a Pull Connector 154590 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NIN
14. of Singapore International Arbitration Center SIAC Rules then in effect The arbitration award shall be final and binding for the parties without appeal and shall be in writing and set forth the findings of fact and the conclusions of law The number of arbitrators shall be three with each side to the dispute being entitled to appoint one arbitrator The two arbitrators appointed by the parties shall appoint a third arbitrator who shall act as chairman of the proceedings Vacancies in the post of chairman shall be filled by the president of the SIAC Other vacancies shall be filled by the respective nominating party Proceedings shall continue from the stage they were at when the vacancy occurred If one of the parties refuses or otherwise fails to appoint an arbitrator within 30 days of the date the other party appoints its the first appointed arbitrator shall be the sole arbitrator provided that the arbitrator was validly and properly appointed All proceedings shall be conducted including all documents presented in such proceedings in the English language The English language version of this Statement of Limited Warranty prevails over any other language version HONG KONG S A R OF CHINA AND MACAU S A R OF CHINA Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws of Hong Kong Special Administrative Region of China Cisco 4x InfiniBand Switch Module for I
15. of the Code IBM may however institute proceedings in a competent court in the country of installation In Estonia Latvia and Lithuania all disputes arising in connection with this Statement of Limited Warranty will be finally settled in arbitration that will be held in Helsinki Finland in accordance with the arbitration laws of Finland then in effect Each party will appoint one arbitrator The arbitrators will then jointly appoint the chairman If arbitrators cannot agree on the chairman then the Central Chamber of Commerce in Helsinki will appoint the chairman EUROPEAN UNION EU THE FOLLOWING TERMS APPLY TO ALL EU COUNTRIES The warranty for Machines acquired in EU countries is valid and applicable in all EU countries provided the Machines have been announced and made available in such countries How to Obtain Warranty Service The following is added to this section To obtain warranty service from IBM in EU countries see the telephone listing in Part 3 Warranty Information You may contact IBM at the following address IBM Warranty amp Service Quality Dept PO Box 30 Spango Valley Greenock Scotland PAI6 OAH Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 NN IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 2 Country unique Terms CONSUMERS Consumers have legal rights under applicable national legislation governing the sale of consumer goods Such rights are no
16. with your Machine and are available from IBM at any time on your request Installation of Tier 1 CRUs is your responsibility If IBM installs a Tier 1 CRU at your request you will be charged for the installation You may install a Tier 2 CRU yourself or request IBM to install it at no additional charge under the type of warranty service designated for your Machine IBM specifies in the materials shipped with a replacement CRU whether a defective CRU must be returned to IBM When return is required 1 return instructions and a container are shipped with the replacement CRU and 2 you may be charged for the replacement CRU if IBM does not receive the defective CRU within 30 days of your receipt of the replacement On site Service IBM or your reseller will either repair or exchange the failing Machine at your location and verify its operation You must provide suitable working area to allow disassembly and reassembly of the IBM Machine The area must be clean well lit and suitable for the purpose For some Machines certain repairs may require sending the Machine to an IBM service center Courier or Depot Service You will disconnect the failing Machine for collection arranged by IBM IBM will provide you with a shipping container for you to return your Machine to a designated service center A courier will pick up your Machine and deliver it to the designated service center Following its repair or exchange IBM will arrange the return delivery o
17. 4753 08 04 2004 E Part 2 Country unique Terms URUGUAY VENEZUELA Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the City of Montevideo Court s Jurisdiction Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Courts of the Metropolitan Area Of the City of Caracas NORTH AMERICA CANADA UNITED STATES ASIA PACIFIC AUSTRALIA How to Obtain Warranty Service The following is added to this Section To obtain warranty service from IBM in Canada or the United States call 1 800 IBM SERV 426 7378 Limitation of Liability The following replaces item I of this section 1 damages for bodily injury including death or physical harm to real property and tangible personal property caused by IBM s negligence and Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws in the Province of Ontario Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws of the State of New York What this Warranty Covers The following paragraph is added to this section The warranties specified in this Section are in addition to any rights you may have under the Trade Practices Act
18. 5 555 055 Italy 39 800 820 094 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xxviii 78 17838 01 Notices This information was developed for products and services offered in the U S A IBM may not offer the products services or features discussed in this document in other countries Consult your local IBM representative for information on the products and services currently available in your area Any reference to an IBM product program or service is not intended to state or imply that only that IBM product program or service may be used Any functionally equivalent product program or service that does not infringe any IBM intellectual property right may be used instead However it is the user s responsibility to evaluate and verify the operation of any non IBM product program or service IBM may have patents or pending patent applications covering subject matter described in this document The furnishing of this document does not give you any license to these patents You can send license inquiries in writing to IBM Director of Licensing IBM Corporation North Castle Drive Armonk NY 10504 1785 U S A INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE SOME STATES DO NOT ALLO
19. 78 17838 01 CHAPTER Specifications This chapter details the Server Switch Module specifications Electrical Requirements Table 3 1 DC Supply Requirements Area Requirement DC Supply Voltage 12 2 Volts nominal DC Supply Current 6 0 Amps maximum DC Supply Power without External Port Powered Devices 39 watts maximum DC Supply Power with External Port Powered Devices 60 watts maximum N Note External port powered devices are limited to 21 watts total Environmental Requirements Table 3 2 Environmental Requirements Area Requirement Module Operating Temperature 0 to 60 degrees C module inlet Forced Air Cooling Rate 6 5 CFM minimum Module Non Operating Temperature 40 to 70 degrees C Operating Altitude 0 to 2133 meters Non Operating Altitude 0 to 11 000 meters Operating Humidity 5 to 85 non condensing Non Operating Humidity 5 to 95 non condensing Operational Shock 3 5G for 3 mSec Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 MEN Chapter3 Specifications E Environmental Requirements Area Requirement Operational Vibration 0 27G at 5Hz to 500Hz for 30 minutes Storage Shock 50G with a velocity change of 3454 mm sec squared Storage Vibration 0 5G at 2Hz to 200Hz for 15 minutes Note In the case of non uniform air flow the velocity at any point must meet or exceed 150 LFM Cisco 4x InfiniBand Switch Module for IBM Bla
20. BM BladeCenter User Guide 78 17838 01 xii IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 2 Country unique Terms INDIA Limitation of Liability The following replaces items I and 2 of this section 1 liability for bodily injury including death or damage to real property and tangible personal property will be limited to that caused by IBM s negligence and 2 asto any other actual damage arising in any situation involving nonperformance by IBM pursuant to or in any way related to the subject of this Statement of Limited Warranty the charge paid by you for the individual Machine that is the subject of the claim For purposes of this item the term Machine includes Machine Code and Licensed Internal Code LIC Arbitration The following is added under this heading Disputes arising out of or in connection with this Statement of Limited Warranty shall be finally settled by arbitration which shall be held in Bangalore India in accordance with the laws of India then in effect The arbitration award shall be final and binding for the parties without appeal and shall be in writing and set forth the findings of fact and the conclusions of law The number of arbitrators shall be three with each side to the dispute being entitled to appoint one arbitrator The two arbitrators appointed by the parties shall appoint a third arbitrator who shall act as chairman of the proceedings Vacancies in the post of c
21. Cisco SYSTEMS Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide Corporate Headquarters Cisco Systems Inc 170 West Tasman Drive San Jose CA 95134 1706 USA http www cisco com Tel 408 526 4000 800 553 NETS 6387 Fax 408 526 4100 Text Part Number 78 17838 01 A S THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE ALL STATEMENTS INFORMATION AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND EXPRESS OR IMPLIED USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California Berkeley UCB as part of UCB s public domain version of the UNIX operating system All rights reserved Copyright 1981 Regents of the University of California NOTWITHSTANDING ANY OTHER WARRANTY HEREIN ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED AS IS WITH ALL FAULTS CISCO AND THE ABOVE NAMED SUPPLIERS DISCLAIM ALL WARRANTIES EXPRESSED OR IMPLI
22. Does Not Cover This warranty does not cover the following e any software programs whether pre loaded or shipped with the Machine or installed subsequently e failure resulting from misuse including but not limited to use of any Machine capacity or capability other than that authorized by IBM in writing accident modification unsuitable physical or operating environment or improper maintenance by you e failure caused by a product for which IBM is not responsible and e any non IBM products including those that IBM may procure and provide with or integrate into an IBM Machine at your request The warranty is voided by removal or alteration of identification labels on the Machine or its parts IBM does not warrant uninterrupted or error free operation of a Machine Any technical or other support provided for a Machine under warranty such as assistance with how to questions and those regarding Machine set up and installation is provided WITHOUT WARRANTIES OF ANY KIND How to Obtain Warranty Service If the Machine does not function as warranted during the warranty period contact IBM or your reseller to obtain warranty service If you do not register the Machine with IBM you may be required to present proof of purchase as evidence of your entitlement to warranty service What IBM Will Do to Correct Problems When you contact IBM for service you must follow the problem determination and resolution procedures that IBM specifies
23. ED INCLUDING WITHOUT LIMITATION THOSE OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING USAGE OR TRADE PRACTICE IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT SPECIAL CONSEQUENTIAL OR INCIDENTAL DAMAGES INCLUDING WITHOUT LIMITATION LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES CCSP CCVP the Cisco Square Bridge logo Follow Me Browsing and Stack Wise are trademarks of Cisco Systems Inc Changing the Way We Work Live Play and Learn and iQuick Study are service marks of Cisco Systems Inc and Access Registrar Aironet BPX Catalyst CCDA CCDP CCIE CCIP CCNA CCNP Cisco the Cisco Certified Internetwork Expert logo Cisco IOS Cisco Press Cisco Systems Cisco Systems Capital the Cisco Systems logo Cisco Unity Enterprise Solver EtherChannel EtherFast EtherSwitch Fast Step FormShare GigaDrive GigaStack HomeLink Internet Quotient IOS IP TV iQ Expertise the iQ logo iQ Net Readiness Scorecard LightStream Linksys MeetingPlace MGX the Networkers logo Networking Academy Network Registrar Packet PIX Post Routing Pre Routing ProConnect RateMUX ScriptShare SlideCast SMARTnet The Fastest Way to Increase Your Internet Quotient and TransPath are registered trademarks of Cisco Systems Inc and or its affi
24. Guide ER 78 17838 01 Chapter1 About the Server Switch Module Topologies Mi Topologies With the Server Switch Module and HCA expansion cards you can create a non redundant single switch topology or a redundant dual switch topology S Note There are four I O module bays in the switch labelled 7 10 Bay 7 1s for the first InfiniBand interface and bay 9 is for the second InfiniBand interface Bays 8 and 10 are not supported Single Switch Topology When you populate just one BladeCenter module slot with a Server Switch Module you create a simple topology which provides full bandwidth between ports However this topology does not provide redundant links from the HCA expansion cards to the Server Switch Module We strongly recommend that you implement a Dual Switch Topology to avoid single points of failure Dual Switch Topology To enable IB redundancy on the BladeCenter chassis you must install one Server Switch Module in each available slot HCA expansion cards do not support redundant links to a single Server Switch Module slot When you add a second Server Switch Module to the BladeCenter chassis each port of each HCA expansion card connects to a Server Switch Module Note The Server Switch Modules do not connect to each other within the BladeCenter chassis To connect the modules to enable features such as subnet manager failover connect the modules with an IB cable through the external connectors Befo
25. Information EA ZS Se HANA zg gt Prije instalucrje ovog produkta obayezno pro itajte Sigurnosne Upute P ed instalac tohoto produktu si p e t te pfirueku bezpesnosmich instrukci L s sikkerhedsforskrifterne f r du installerer dette produkt Lees voordat u dit product installeert eerst de veiligheidsvoorschriften Ennen kuin asennat t m n tuotteen lue turvaohjeet kohdasta Safety Information Avant d installer ce produit lisez les consignes de s curit Vor der Installation dieses Produkts die Sicherheitshinweise lesen Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xxxvii Safety piv yaraor joere to npoi v aut Siaddote Tig TIANpPowoples aowpaAgias safety information Jnn e n mem ns WIP ITAM RN 397 A term k telepit se ek olvassa el a Biztons gi el r sokat Prima di installare questo prodotto leggere le Informazioni sulla Sicurezza Ss SRORENEOnBUII VLE BA 4 ESL Alass 210501 AW 24 AFE AOL Ale lI1pca ua cc mucraumpa OBO npourykT1 npounrajrc uadopmauajar a 3a 6c36ennoczi Les sikkerhetsinformasjonen Safety Information fer du installerer dette produktet Przed zainslalowanicm tego produktu nale y zapoznac si z ksiazka Informacje dotycz ce bezpiecze stwa Safety Information Antes de instalar este produto leia as Informa es sobre Seguran a Nepeg yCTaHOBKOM nponykra npo4TMTe MHCTPYKUMM no TEXHMKE 6ESONACHOCTH Pred ins
26. OM Limitation of Liability The following replaces the terms of this section in its entirety For the purposes of this section a Default means any act statement omission or negligence on the part of IBM in connection with or in relation to the subject matter of this Statement of Limited Warranty in respect of which IBM is legally liable to you whether in contract or tort A number of Defaults which together result in or contribute to substantially the same loss or damage will be treated as one Default Circumstances may arise where because of a Default you are entitled to recover damages from IBM This section sets out the extent of IBM s liability and your sole remedy 1 IBM will accept unlimited liability for a death or personal injury caused by the negligence of IBM and b any breach of its obligations implied by Section 12 of the Sale of Goods Act 1979 or Section 2 of the Supply of Goods and Services Act 1982 or any statutory modification or re enactment of either such Section 2 IBM will accept unlimited liability subject always to the Items for Which IBM is Not Liable below for physical damage to your tangible property resulting from the negligence of IBM Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 mu IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 3 Warranty Information 3 IBM s entire liability for actual damages for any one Default will not in an
27. THE DAMAGES OR 4 LOSS OF BUSINESS REVENUE GOODWILL OR ANTICIPATED SAVINGS FRANCE AND BELGIUM Limitation of Liability The following replaces the terms of this section in its entirety Except as otherwise provided by mandatory law 1 IBM s liability for any damages and losses that may arise as a consequence of the fulfillment of its obligations under or in connection with this Statement of Limited Warranty is limited to the compensation of only those damages and losses proved and actually arising as an immediate and direct consequence of the non fulfillment of such obligations if IBM is at fault for a maximum amount equal to the charges you paid for the Machine that has caused the damages For purposes of this item the term Machine includes Machine Code and Licensed Internal Code LIC The above limitation shall not apply to damages for bodily injuries including death and damages to real property and tangible personal property for which IBM is legally liable 2 UNDER NO CIRCUMSTANCES IS IBM ITS SUPPLIERS OR RESELLERS LIABLE FOR ANY OF THE FOLLOWING EVEN IF INFORMED OF THEIR POSSIBILITY 1 LOSS OF OR DAMAGE TO DATA 2 INCIDENTAL OR INDIRECT DAMAGES OR FOR ANY ECONOMIC CONSEQUENTIAL DAMAGES 3 LOST PROFITS EVEN IF THEY ARISE AS AN IMMEDIATE CONSEQUENCE OF THE EVENT THAT GENERATED THE DAMAGES OR 4 LOSS OF BUSINESS REVENUE GOODWILL OR ANTICIPATED SAVINGS Cisco 4x InfiniBand Switch Module for IBM BladeCenter
28. Turkey 8 in each of the following specified countries any legal claim arising out of this Statement of Limited Warranty will be brought before and settled exclusively by the competent court of a Athens for Greece b Tel Aviv Jaffa for Israel c Milan for Italy d Lisbon for Portugal and e Madrid for Spain and 9 in the United Kingdom both of us agree to submit all disputes relating to this Statement of Limited Warranty to the jurisdiction of the English courts Arbitration The following is added under this heading In Albania Armenia Azerbaijan Belarus Bosnia Herzegovina Bulgaria Croatia Georgia Hungary Kazakhstan Kyrgyzstan FYR Macedonia Moldova Poland Romania Russia Slovakia Slovenia Tajikistan Turkmenistan Ukraine Uzbekistan and FR Yugoslavia all disputes arising out of this Statement of Limited Warranty or related to its violation termination or nullity will be finally settled under the Rules of Arbitration and Conciliation of the International Arbitral Center of the Federal Economic Chamber in Vienna Vienna Rules by three arbitrators appointed in accordance with these rules The arbitration will be held in Vienna Austria and the official language of the proceedings will be English The decision of the arbitrators will be final and binding upon both parties Therefore pursuant to paragraph 598 2 of the Austrian Code of Civil Procedure the parties expressly waive the application of paragraph 595 1 figure 7
29. W DISCLAIMER OF EXPRESS OR IMPLIED WARRANTIES IN CERTAIN TRANSACTIONS THEREFORE THIS STATEMENT MAY NOT APPLY TO YOU This information could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to non IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 ix Notices SE Edition Notice Edition Notice Copyright International Business Machines Corporation 2004 All rights reserved U S Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp Trademarks The following terms are trademarks of International Business Machines Corporation in the United States other countries or both Active Memory Predictive Failure Analysis
30. Warranty balance this limitation of liability What this Warranty Covers The following is added to this section Except as expressly provided in these terms and conditions all statutory conditions including all warranties implied but without prejudice to the generality of the foregoing all warranties implied by the Sale of Goods Act 1893 or the Sale of Goods and Supply of Services Act 1980 are hereby excluded Limitation of Liability The following replaces the terms of this section in its entirety For the purposes of this section a Default means any act statement omission or negligence on the part of IBM in connection with or in relation to the subject matter of this Statement of Limited Warranty in respect of which IBM is legally liable to you whether in contract or tort A number of Defaults which together result in or contribute to substantially the same loss or damage will be treated as one Default occurring on the date of occurrence of the last such Default Circumstances may arise where because of a Default you are entitled to recover damages from IBM Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xxiv 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 SLOVAKIA Part 2 Country unique Terms W This section sets out the extent of IBM s liability and your sole remedy 1 IBM will accept unlimited liability for death or personal injury caused by the negligence of IBM
31. are both available for more information For support contact IBM before Cisco Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 ovii Preface BE Contacting Technical Support Before You Call Be prepared to provide the following information to support personnel General Information e Technical Support registration number if applicable e Error messages received e Detailed description of the problem and specific questions e Description of any troubleshooting steps already performed and results Server configuration e Type of server chip set CPU amount of RAM of nodes e Attached storage devices output from cat proc scsi scsi e InfiniBand configuration output from usr local topspin sbin hca self test Topspin Chassis configuration e Chassis model e Output from the show running status all command Topspin Chassis Serial Number The chassis serial number and corresponding bar code are provided on the serial number label This can be found on the bottom of the chassis or the outside of the Topspin chassis box packaging It can also be found in the output of the show backplane command Determining the Software Version If InfiniBand drivers are already installed on the host to determine the version of the Topspin Linux host drivers you are running enter the following command at the prompt rpm qa grep topspin topspin ib mod rhel3 2 4 21 32 ELsmp 3 2 0 82 topspin
32. browser and entering the IP address of the BladeCenter chassis in the address bar Step2 Log in The BladeCenter Chassis Manager interface appears Step3 Expand I O Module Tasks in the left hand navigation tree Step4 Select Management under I O Module Tasks in the left pane An I O Module Management heading appears in the display Step5 Click the link of the physical slot that holds the Server Switch Module that you want to configure A heading appears where X is the number of the slot Step6 Enter an IP address for the Server Switch Module in the IP address field of the New Static IP Configuration section S Note The IP address of the Server Switch Module must fall in the same subnet as the modules in the other slots Step7 Enter a subnet mask or the Server Switch Module in the Subnet mask field of the New Static IP Configuration section S Note The subnet mask of the Server Switch Module must match the subnet mask of the modules in the other slots Step8 Entera gateway IP address for the Server Switch Module in the Gateway address field of the New Static IP Configuration section and then click Save S Note The gateway address of the Server Switch Module must match the gateway address of the modules in the other slots Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NN 78 17838 01 Chapter2 Installing and Configuring the Server Switch Configuring the Server Switch
33. ch Module for IBM BladeCenter User Guide NN 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part1 General Terms W Exchange of a Machine or Part When the warranty service involves the exchange of a Machine or part the item IBM or your reseller replaces becomes its property and the replacement becomes yours You represent that all removed items are genuine and unaltered The replacement may not be new but will be in good working order and at least functionally equivalent to the item replaced The replacement assumes the warranty service status of the replaced item Your Additional Responsibilities Before IBM or your reseller exchanges a Machine or part you agree to remove all features parts options alterations and attachments not under warranty service You also agree to 1 ensure that the Machine is free of any legal obligations or restrictions that prevent its exchange 2 obtain authorization from the owner to have IBM or your reseller service a Machine that you do not own and 3 where applicable before service is provided a follow the service request procedures that IBM or your reseller provides b backup or secure all programs data and funds contained in the Machine c provide IBM or your reseller with sufficient free and safe access to your facilities to permit IBM to fulfill its obligations and d inform IBM or your reseller of changes in the Machine s location 4 a ensure all i
34. d Warranty for Machines a Glossary of IBM definitions Frequently Asked Questions FAQs and Support by Product Machine with links to Product Support pages The IBM Statement of Limited Warranty is also available on this site in 29 languages To obtain warranty service contact IBM or your IBM reseller In Canada or the United States call 1 800 IBM SERV 426 7378 In the EU countries see the telephone numbers below EU Country Telephone List Phone numbers are subject to change without notice For the warranty service contact telephone number in a country subsequently added to the EU and not yet reflected in the list below contact IBM in that country or visit the website above for a current telephone listing Austria 43 1 24592 5901 Latvia 386 61 1796 699 Belgium 32 70 23 3392 Lithuania 386 61 1796 699 Cyprus 357 22 841100 Luxembourg 352 298 977 5063 Czech Republic 420 2 7213 1316 Malta 356 23 4175 Denmark 45 4520 8200 Netherlands 31 20 5 14 5770 Estonia 386 61 1796 699 Poland 48 22 878 6999 Finland 358 8001 4260 Portugal 351 21 892 7147 France 33 238 557 450 Slovakia 4421 2 4954 1217 Germany 49 1805 253553 Slovenia 386 1 4796 699 Greece 30 210 680 1700 Spain 34 91 714 7983 Hungary 36 1 382 5720 Sweden 46 8 477 4420 Ireland 353 1 815 4000 United Kingdom 44 147
35. d in that Act Limitation of Liability The following is added to this section Where Machines are not acquired for the purposes of a business as defined in the Consumer Guarantees Act 1993 the limitations in this section are subject to the limitations in that Act Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xviii 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms W PEOPLE S REPUBLIC OF CHINA PRC PHILIPPINES SINGAPORE Governing Law The following replaces laws of the country in which you acquired the Machine in the first sentence laws of the State of New York United States of America except when local law requires otherwise Limitation of Liability tem 3 in the fifth paragraph is replaced by the following SPECIAL INCLUDING NOMINAL AND EXEMPLARY DAMAGES MORAL INCIDENTAL OR INDIRECT DAMAGES FOR ANY ECONOMIC CONSEQUENTIAL DAMAGES OR Arbitration The following is added under this heading Disputes arising out of or in connection with this Statement of Limited Warranty shall be finally settled by arbitration which shall be held in Metro Manila Philippines in accordance with the laws of the Philippines then in effect The arbitration award shall be final and binding for the parties without appeal and shall be in writing and set forth the findings of fact and the conclusions of law The number of arbitrators shall be three with eac
36. deCenter User Guide MEN 78 17838 01 A about the server switch module 1 1 C cable connection 2 5 change the default password 2 3 clock setting 2 3 configuration initial 2 2 configuring the server switch module 2 2 connect IB cables 2 5 connect to Topspin IB networks 2 5 D documentation conventions vV organization v HCA expansion cards about 1 2 I O module management 2 2 IB cable connection 2 5 initial configuration 2 2 installing the server switch module 2 1 IP address 2 2 INDEX L LEDs 1 4 port status 1 5 switch module status 1 4 management interfaces 1 3 new static IP configuration 2 2 P password changing 2 3 ports internal and external 1 2 port status LEDs 1 5 S server switch module initial configuration 2 2 management 1 3 ports 1 2 status LEDs 1 4 status LEDs 1 4 subnet mask 2 2 switch module about 1 1 switch module status LEDs 1 4 system clock setting 2 3 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 IN 1 B index T topology dual switch 1 3 single switch 1 3 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide IN 2 78 17838 01
37. eeds indicate the internal clock speed of the microprocessor other factors also affect application performance CD ROM drive speeds list the variable read rate Actual speeds vary and are often less than the maximum possible When referring to processor storage real and virtual storage or channel volume KB stands for approximately 1000 bytes MB stands for approximately 1 000 000 bytes and GB stands for approximately 1 000 000 000 bytes When referring to hard disk drive capacity or communications volume MB stands for 1 000 000 bytes and GB stands for 1 000 000 000 bytes Total user accessible capacity may vary depending on operating environments Maximum internal hard disk drive capacities assume the replacement of any standard hard disk drives and population of all hard disk drive bays with the largest currently supported drives available from IBM Maximum memory may require replacement of the standard memory with an optional memory module IBM makes no representation or warranties regarding non IBM products and services that are ServerProven including but not limited to the implied warranties of merchantability and fitness for a particular purpose These products are offered and warranted solely by third parties IBM makes no representations or warranties with respect to non IBM products Support if any for the non IBM products is provided by the third party not IBM Some software may differ from its retail version 1f availab
38. ervice or 2 from IBM If you purchase a Machine in a Middle Eastern or African country you may obtain warranty service for that Machine from the IBM entity within the country of purchase if that IBM entity provides warranty service in that country or from an IBM reseller approved by IBM to perform warranty service on that Machine in that country Warranty service in Africa is available within 50 kilometers of an IBM approved service provider You are responsible for transportation costs for Machines located outside 50 kilometers of an IBM approved service provider Governing Law The phrase the laws of the country in which you acquired the Machine is replaced by 1 the laws of Austria in Albania Armenia Azerbaijan Belarus Bosnia Herzegovina Bulgaria Croatia Georgia Hungary Kazakhstan Kyrgyzstan FYR Macedonia Moldova Poland Romania Russia Slovakia Slovenia Tajikistan Turkmenistan Ukraine Uzbekistan and FR Yugoslavia 2 the laws of France in Algeria Benin Burkina Faso Cameroon Cape Verde Central African Republic Chad Comoros Congo Republic Djibouti Democratic Republic of Congo Equatorial Guinea French Guiana French Polynesia Gabon Gambia Guinea Guinea Bissau Ivory Coast Lebanon Madagascar Mali Mauritania Mauritius Mayotte Morocco New Caledonia Niger Reunion Senegal Seychelles Togo Tunisia Vanuatu and Wallis amp Futuna 3 the laws of Finland in Estonia Latvia and Lit
39. f the Machine to your location You are responsible for its installation and verification Customer Carry In or Mail In Service You will deliver or mail as IBM specifies prepaid unless IBM specifies otherwise the failing Machine suitably packaged to a location IBM designates After IBM has repaired or exchanged the Machine IBM will make it available for your collection or for Mail in Service IBM will return it to you at IBM s expense unless IBM specifies otherwise You are responsible for the subsequent installation and verification of the Machine CRU and On site Service This type of Warranty Service is a combination of Type 1 and Type 2 see above CRU and Courier or Depot Service This type of Warranty Service is a combination of Type 1 and Type 3 see above CRU and Customer Carry In or Mail In Service This type of Warranty Service is a combination of Type 1 and Type 4 see above Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xxvii IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 3 Warranty Information When a 5 6 or 7 type of warranty service is listed IBM will determine which type of warranty service is appropriate for the repair This type of service is called ThinkPad EasyServ or EasyServ in some countries The IBM Machine Warranty World Wide Web site at http www ibm com servers support machine warranties provides a worldwide overview of IBM s Limite
40. h side to the dispute being entitled to appoint one arbitrator The two arbitrators appointed by the parties shall appoint a third arbitrator who shall act as chairman of the proceedings Vacancies in the post of chairman shall be filled by the president of the Philippine Dispute Resolution Center Inc Other vacancies shall be filled by the respective nominating party Proceedings shall continue from the stage they were at when the vacancy occurred If one of the parties refuses or otherwise fails to appoint an arbitrator within 30 days of the date the other party appoints its the first appointed arbitrator shall be the sole arbitrator provided that the arbitrator was validly and properly appointed All proceedings shall be conducted including all documents presented in such proceedings in the English language The English language version of this Statement of Limited Warranty prevails over any other language version Limitation of Liability The words SPECIAL and ECONOMIC in item 3 in the fifth paragraph are deleted EUROPE MIDDLE EAST AFRICA EMEA THE FOLLOWING TERMS APPLY TO ALL EMEA COUNTRIES The terms of this Statement of Limited Warranty apply to Machines purchased from IBM or an IBM reseller How to Obtain Warranty Service Add the following paragraph in Western Europe Andorra Austria Belgium Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Hungary Iceland Ireland Italy Latvia Liec
41. hairman shall be filled by the president of the Bar Council of India Other vacancies shall be filled by the respective nominating party Proceedings shall continue from the stage they were at when the vacancy occurred If one of the parties refuses or otherwise fails to appoint an arbitrator within 30 days of the date the other party appoints its the first appointed arbitrator shall be the sole arbitrator provided that the arbitrator was validly and properly appointed All proceedings shall be conducted including all documents presented in such proceedings in the English language The English language version of this Statement of Limited Warranty prevails over any other language version JAPAN Governing Law The following sentence is added to this section Any doubts concerning this Statement of Limited Warranty will be initially resolved between us in good faith and in accordance with the principle of mutual trust MALAYSIA Limitation of Liability The word SPECIAL in item 3 of the fifth paragraph is deleted NEW ZEALAND What this Warranty Covers The following paragraph is added to this section The warranties specified in this section are in addition to any rights you may have under the Consumer Guarantees Act 1993 or other legislation which cannot be excluded or limited The Consumer Guarantees Act 1993 will not apply in respect of any goods which IBM provides if you require the goods for the purposes of a business as define
42. he clip on the other end to unpainted metal Step2 Choose the I O slot into which you want to install the Server Switch Module You must install the module in I O slot 7 or slot 9 Step3 Refer to your BladeCenter unit documentation for standard hardware module installation instructions Downloading Operating System Software from Cisco com The operating system associated with the Cisco 4x InfiniBand HCA Expansion Card for IBM BladeCenter can be downloaded from www cisco com by using the Technical Support amp Documentation link To download the software follow these steps Step 1 Go to www cisco com and log in with your CCO user ID Step2 Click Technical Support amp Documentation Step3 Click Software Downloads Step4 Click Server Networking amp Virtualization Software Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 NIN Chapter2 Installing and Configuring the Server Switch BE Configuring the Server Switch Module Stepb Click Cisco InfiniBand Switch Module for IBM BladeCenter to obtain the operating system TopspinOS v2 6 0 The software is an ISO image Step6 Burn the ISO image onto a CD The ISO image contains the latest switch operating system software release notes and other documentation Configuring the Server Switch Module To configure the Cisco InfiniBand Server Switch Module follow these steps Step 1 Open the BladeCenter Chassis Manager log in screen by launching a Web
43. htenstein Lithuania Luxembourg Malta Monaco Netherlands Norway Poland Portugal San Marino Slovakia Slovenia Spain Sweden Switzerland United Kingdom Vatican State and any country subsequently added to the European Union as from the date of accession The warranty for Machines acquired in Western Europe shall be valid and applicable in all Western Europe countries provided the Machines have been announced and made available in such countries Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xix IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms If you purchase a Machine in one of the Western European countries as defined above you may obtain warranty service for that Machine in any of those countries from either 1 an IBM reseller approved to perform warranty service or 2 from IBM provided the Machine has been announced and made available by IBM in the country in which you wish to obtain service If you purchased a Personal Computer Machine in Albania Armenia Belarus Bosnia and Herzegovina Bulgaria Croatia Czech Republic Georgia Hungary Kazakhstan Kyrgyzstan Federal Republic of Yugoslavia Former Yugoslav Republic of Macedonia FYROM Moldova Poland Romania Russia Slovak Republic Slovenia or Ukraine you may obtain warranty service for that Machine in any of those countries from either 1 an IBM reseller approved to perform warranty s
44. huania 4 the laws of England in Angola Bahrain Botswana Burundi Egypt Eritrea Ethiopia Ghana Jordan Kenya Kuwait Liberia Malawi Malta Mozambique Nigeria Oman Pakistan Qatar Rwanda Sao Tome Saudi Arabia Sierra Leone Somalia Tanzania Uganda United Arab Emirates the United Kingdom West Bank Gaza Yemen Zambia and Zimbabwe and 5 the laws of South Africa in South Africa Namibia Lesotho and Swaziland Jurisdiction The following is added after the first sentence 1 In Austria the choice of jurisdiction for all disputes arising out of this Statement of Limited Warranty and relating thereto including its existence will be the competent court of law in Vienna Austria Inner City 2 in Angola Bahrain Botswana Burundi Egypt Eritrea Ethiopia Ghana Jordan Kenya Kuwait Liberia Malawi Malta Mozambique Nigeria Oman Pakistan Qatar Rwanda Sao Tome Saudi Arabia Sierra Leone Somalia Tanzania Uganda United Arab Emirates West Bank Gaza Yemen Zambia and Zimbabwe all disputes arising out of this Statement of Limited Warranty or related to its execution including summary proceedings will be submitted to the exclusive jurisdiction of the English courts 3 in Belgium and Luxembourg all disputes arising out of this Statement of Limited Warranty or related to its interpretation or its execution the law and the courts of the capital city of the country of your registered office and or commercial site
45. ial Published Specifications Specifications which are available on request The warranty period for the Machine starts on the original Date of Installation and is specified in Part 3 Warranty Information The date on your invoice or sales receipt is the Date of Installation unless IBM or your reseller informs you otherwise Many features conversions or upgrades involve the removal of parts and their return to IBM A part that replaces a removed part will assume the warranty service status of the removed part Unless IBM specifies otherwise these warranties apply only in the country or region in which you purchased the Machine THESE WARRANTIES ARE YOUR EXCLUSIVE WARRANTIES AND REPLACE ALL OTHER WARRANTIES OR CONDITIONS EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OR CONDITIONS OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE SOME STATES OR JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF EXPRESS OR IMPLIED WARRANTIES SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU IN THAT EVENT SUCH WARRANTIES ARE LIMITED IN DURATION TO THE WARRANTY PERIOD NO WARRANTIES APPLY AFTER THAT PERIOD SOME STATES OR JURISDICTIONS DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LASTS SO THE ABOVE LIMITATION MAY NOT APPLY TO YOU Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 TH IBM Statement of Limited Warranty 2125 4753 08 04 2004 isi Part 1 General Terms What This Warranty
46. ily injury including death and damage to real property and tangible personal property and Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xiii IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 2 Country unique Terms 2 the amount of any other actual direct damages up to the charges if recurring 12 months charges apply for the Machine that is subject of the claim For purposes of this item the term Machine includes Machine Code and Licensed Internal Code LIC This limit also applies to IBM s suppliers and your reseller It is the maximum for which IBM its suppliers and your reseller are collectively responsible UNDER NO CIRCUMSTANCES IS IBM ITS SUPPLIERS OR RESELLERS LIABLE FOR ANY OF THE FOLLOWING EVEN IF INFORMED OF THEIR POSSIBILITY 1 THIRD PARTY CLAIMS AGAINST YOU FOR DAMAGES OTHER THAN THOSE UNDER THE FIRST ITEM LISTED ABOVE 2 LOSS OF OR DAMAGE TO DATA 3 SPECIAL INCIDENTAL OR INDIRECT DAMAGES OR FOR ANY ECONOMIC CONSEQUENTIAL DAMAGES OR 4 LOST PROFITS BUSINESS REVENUE GOODWILL OR ANTICIPATED SAVINGS SOME STATES OR JURISDICTIONS DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES SO THE ABOVE LIMITATION OR EXCLUSION MAY NOT APPLY TO YOU SOME STATES OR JURISDICTIONS DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LASTS SO THE ABOVE LIMITATION MAY NOT APPLY TO YOU Governing Law Both you and IBM consent t
47. iod IBM will charge you for any labor provided in performance of the repair or replacement s in the second and third year of the warranty period Table 1 Machine type Cisco InfiniBand Switch Module for IBM BladeCenter Country or Region of Purchase Warranty Period Type of Warranty Service Worldwide year 1 See Types of Warranty Service for the legend and explanations of warranty service types Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide NN 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part3 Warranty Information Mi Types of Warranty Service If required IBM provides repair or exchange service depending on the type of warranty service specified for your Machine in the above table and as described below Warranty service may be provided by your reseller if approved by IBM to perform warranty service Scheduling of service will depend upon the time of your call and is subject to parts availability Service levels are response time objectives and are not guaranteed The specified level of warranty service may not be available in all worldwide locations additional charges may apply outside IBM s normal service area contact your local IBM representative or your reseller for country and location specific information 1 Customer Replaceable Unit CRU Service IBM provides replacement CRUs to you for you to install CRU information and replacement instructions are shipped
48. ion cards This product has been tested and found to comply with the limits for Class A Information Technology Equipment according to CISPR 22 European Standard EN 55022 The limits for Class A equipment were derived for commercial and industrial environments to provide reasonable protection against interference with licensed communication equipment Attention This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures Taiwanese Class A warning statement x ASA ER YOXRSUX o cd E 4E WB PAE RE gt T 8b e e RATA Pa gt AR fF LF de ex e E Se imag XD o Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xxxiii Notices NI Electronic Emission Notices Chinese Class A warning statement RH kA A Rm AERAR Ar ao Al BE S E bt 2 HH HERD WERE RAH FF BN LUS n AT BY EHE Ju er Japanese Voluntary Control Council for Interference VCCI statement OXI amp Id a cac oca ned ccs e SE CI ORS CIA E BSH CT CEMBHVET COBRA E RANURAS SKIER ef ccheusi Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide ETUM 78 17838 01 WEEE Notice Note This mark applies only to countries within the European Union EU and Norway This appliance is labelled in accordance with European Directive 2002 96 EC concerning waste electrical and electronic equipme
49. le and may not include user manuals or all program functionality Product Recycling and Disposal This unit contains materials such as circuit boards cables electromagnetic compatibility gaskets and connectors which may contain lead and copper beryllium alloys that require special handling and disposal at end of life Before this unit is disposed of these materials must be removed and recycled or discarded according to applicable regulations IBM offers product return programs in several countries Information on product recycling offerings can be found on IBM s Internet site at http www ibm com ibm environment products prp shtml Battery Return Program This product may contain a sealed lead acid nickel cadmium nickel metal hydride lithium or lithium ion battery Consult your user manual or service manual for specific battery information The battery must be recycled or disposed of properly Recycling facilities may not be available in your area For information on disposal of batteries outside the United States go to http www ibm com ibm environment products batteryrecycle shtml or contact your local waste disposal facility Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 NT Notices NI Electronic Emission Notices In the United States IBM has established a collection process for reuse recycling or proper disposal of used IBM sealed lead acid nickel cadmium nickel metal hydride and bat
50. liates in the United States and certain other countries All other trademarks mentioned in this document or Website are the property of their respective owners The use of the word partner does not imply a partnership relationship between Cisco and any other company 0601R Any Internet Protocol IP addresses used in this document are not intended to be actual addresses Any examples command display output and figures included in the document are shown for illustrative purposes only Any use of actual IP addresses in illustrative content is unintentional and coincidental Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 2006 Cisco Systems Inc All rights reserved Preface v Audience v Organization v Conventions v Related Documentation vi Contacting Technical Support vii IBM Support Contact Information vii Before You Call viii Determining the Software Version viii Downloading the Latest Software Release viii Cisco Systems Support Contact Information viii Cisco Technical Support amp Documentation Website ix Submitting a Service Request ix Definitions of Service Request Severity ix IBM Statement of Limited Warranty Z125 4753 08 04 2004 xi Part 1 General Terms xi What this Warranty Covers xi What This Warranty Does Not Cover xii How to Obtain Warranty Service xii What IBM Will Do to Correct Problems xii Exchange of a Machine or Part xiii Your Additional Responsibilities xiii Limitation of Liabi
51. lity xiii Governing Law xiv Jurisdiction xiv Part 2 Country unique Terms xiv AMERICAS xiv ARGENTINA xiv BOLIVIA xiv BRAZIL xv CHILE xv COLOMBIA xv Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 BEEN BE Contents EQUADOR xv MEXICO xv PARAGUAY xv PERU xv URUGUAY xvi VENEZUELA xvi NORTH AMERICA xvi CANADA xvi UNITED STATES xvi ASIA PACIFIC xvi AUSTRALIA xvi CAMBODIA AND LAOS xvii CAMBODIA INDONESIA AND LAOS xvii HONG KONG S A R OF CHINA AND MACAU S A R OF CHINA xvii INDIA xviii JAPAN xviii MALAYSIA xviii NEW ZEALAND xviii PEOPLE S REPUBLIC OF CHINA PRC xix PHILIPPINES xix SINGAPORE xix EUROPE MIDDLE EAST AFRICA EMEA xix EUROPEAN UNION EU xxi CONSUMERS xxii FRANCE AND BELGIUM xxii THE FOLLOWING TERMS APPLY TO THE COUNTRY SPECIFIED xxiii AUSTRIA xxiii EGYPT xxiii FRANCE xxiii GERMANY xxiv HUNGARY xxiv IRELAND xxiv SLOVAKIA xxv SOUTH AFRICA NAMIBIA BOTSWANA LESOTHO AND SWAZILAND xxv UNITED KINGDOM xxv Part 3 Warranty Information xxvi Warranty Period xxvi Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide BEBE 78 17838 01 Contents Hi Types of Warranty Service xxvii EU Country Telephone List xxviii Notices xxix Edition Notice xxx Trademarks xxx Important Notes xxxi Product Recycling and Disposal xxxi Battery Return Program xxxi Electronic Emission Notices xxxii Federal Communications Commission FCC S
52. n The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Civil Courts of Justice of Santiago COLOMBIA Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Judges of the Republic of Colombia EQUADOR Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Judges of Quito MEXICO Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Federal Courts of Mexico City Federal District PARAGUAY Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the courts of the city of Asuncion PERU Limitation of Liability The following is added at the end of this section In accordance with Article 1328 of the Peruvian Civil Code the limitations and exclusions specified in this section will not apply to damages caused by IBM s willful misconduct dolo or gross negligence culpa inexcusable Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 NAM IBM Statement of Limited Warranty 2125
53. nded audience is the administrator responsible for installing configuring and managing Server Switch equipment This administrator should have experience administering similar networking or storage equipment Organization This publication is organized as follows Chapter Title Description Chapter 1 About the Server Switch Module Describes the server switch module and HCA expansion cards including topology management the LEDs and external InfiniBand ports Chapter 2 Installing and Configuring the Installation configuration and external Server Switch connection of the server switch module are described Chapter 3 Specifications Electrical and environmental requirements are described in this chapter Conventions This document uses the following conventions Convention Description boldface font Commands command options and keywords are in boldface Bold text indicates Chassis Manager elements or text that you must enter as is italic font Arguments in commands for which you supply values are in italics Italics not used in commands indicate emphasis Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 wv Preface SE Related Documentation Note gt Caution Convention Description Menul gt Menu2 gt Item Series indicate a pop up menu sequence to open a form or execute a desired function Elements in square brackets
54. nformation about identified or identifiable individuals Personal Data is deleted from the Machine to the extent technically possible b allow IBM your reseller or an IBM supplier to process on your behalf any remaining Personal Data as IBM or your reseller considers necessary to fulfill its obligations under this Statement of Limited Warranty which may include shipping the Machine for such processing to other IBM service locations around the world and c ensure that such processing complies with any laws applicable to such Personal Data Limitation of Liability IBM is responsible for loss of or damage to your Machine only while it is 1 in IBM s possession or 2 in transit in those cases where IBM is responsible for the transportation charges Neither IBM nor your reseller are responsible for any of your confidential proprietary or personal information contained in a Machine which you return to IBM for any reason You should remove all such information from the Machine prior to its return Circumstances may arise where because of a default on IBM s part or other liability you are entitled to recover damages from IBM In each such instance regardless of the basis on which you are entitled to claim damages from IBM including fundamental breach negligence misrepresentation or other contract or tort claim except for any liability that cannot be waived or limited by applicable laws IBM is liable for no more than 1 damages for bod
55. nt WEEE The Directive determines the framework for the return and recycling of used appliances as applicable throughout the European Union This label is applied to various products to indicate that the product is not to be thrown away but rather reclaimed upon end of life per this Directive HE 207414 EU HBli ku v 2r Ilz5vocton s5xmzxhzd oni rt EU EDIT ats ea ES RBH 2002 98 EC WEEE OS v wont WET DOMAI EUIS IH RARO DLE Ue V DETUR EC Ed IOs MARA ORB oo Cu EMS angi tz F H Ed 57 8 IH aS iR T F F3 7 Low gk d Remarque Cette marque s applique uniquement aux pays de l Union Europ enne et la Norv ge L tiquette du syst me respecte la Directive europ enne 2002 96 EC en mati re de D chets des Equipements Electriques et Electroniques DEEE qui d termine les dispositions de retour et de recyclage applicables aux syst mes utilis s travers l Union europ enne Conform ment la directive ladite tiquette pr cise que le produit sur lequel elle est appos e ne doit pas etre jet mais etre r cup r en fin de vie Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 ET WEEE Notice Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xxxvi 78 17838 01 Safety Before installing this product read the Safety Information Be er A da ony wf Kin w ue Antes de instalar este produto leia as Informa es de Seguran a ERRATA TFA Safety
56. o the application of the laws of the country in which you acquired the Machine to govern interpret and enforce all of your and IBM s rights duties and obligations arising from or relating in any manner to the subject matter of this Statement of Limited Warranty without regard to conflict of law principles THESE WARRANTIES GIVE YOU SPECIFIC LEGAL RIGHTS AND YOU MAY ALSO HAVE OTHER RIGHTS WHICH VARY FROM STATE TO STATE OR JURISDICTION TO JURISDICTION Jurisdiction All of our rights duties and obligations are subject to the courts of the country in which you acquired the Machine Part 2 Country unique Terms ARGENTINA Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Ordinary Commercial Court of the city of Buenos Aires BOLIVIA Jurisdiction The following is added after the first sentence Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xiv 78 17838 01 IBM Statement of Limited Warranty 2125 4753 08 04 2004 Part 2 Country unique Terms W Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the courts of the city of La Paz BRAZIL Jurisdiction The following is added after the first sentence Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the court of Rio de Janeiro RJ CHILE Jurisdictio
57. ollowing two conditions 1 this device may not cause harmful interference and 2 this device must accept any interference received including interference that may cause undesired operation Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide adi 78 17838 01 Notices Electronic Emission Notices W Industry Canada Class A emission compliance statement This Class A digital apparatus complies with Canadian ICES 003 Avis de conformit a la r glementation d Industrie Canada Cet appareil num rique de la classe A est conforme a la norme NMB 003 du Canada Australia and New Zealand Class A statement Attention This is a Class A product In a domestic environment this product may cause radio interference in which case the user may be required to take adequate measures United Kingdom telecommunications safety requirement Notice to Customers This apparatus is approved under approval number NS G 1234 J 100003 for indirect connection to public telecommunication systems in the United Kingdom European Union EMC Directive conformance statement This product is in conformity with the protection requirements of EU Council Directive 89 336 EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a nonrecommended modification of the product including the fitting of non IBM opt
58. onfig ntp server one 10 2 0 13 Step4 Optional Recommended Assign a secondary NTP server by entering the ntp command with this information e server two keyword e P address of the NTP server Cisco BladeCenterH config ntp server two 10 2 0 14 Stepb Optional Recommended Assign a tertiary NTP server by entering the ntp command with this information e server three keyword e P address of the NTP server Cisco BladeCenterH config ntp server three 10 2 0 15 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 2 4 78 17838 01 Chapter2 Installing and Configuring the Server Switch Connecting Beyond BladeCenter W Connecting Beyond BladeCenter Step 1 Step 2 Step 3 Step 4 Step 5 To extend your InfiniBand fabric beyond your BladeCenter cluster you must configure the priority of the subnet manager on your Server Switch Module then connect one or more of the external interfaces on your Server Switch Module to an outside InfiniBand fabric The device with the highest subnet manager priority becomes the master subnet manager in the InfiniBand network To configure subnet manager priority follow these steps Switch to Privileged Exec mode by entering the enable command Cisco BladeCenterH enable Cisco BladeCenterH Switch to Global Configuration mode by entering the configure command Cisco BladeCenterH configure Cisco BladeCenterH config Configure the priority of the subnet
59. orts The Server Switch Module has both 4x IB and 12x IB external connectors The 12x IB connectors support three 4x connections using an octopus cable This cable begins as one 12x connector which connects to your Server Switch Module then branches into three 4x connectors that you can attach to 4x IB interfaces The external ports are numbered 17 24 Ports 19 20 21 and ports 22 23 24 are on 12x connectors and can be set up as 12x or three 4x connections Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 1 5 Chapter1 About the Server Switch Module El External InfiniBand Ports Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide L 78 17838 01 CHAPTER Installing and Configuring the Server Switch This chapter describes installing and configuring the Server Switch Module and configuring the password and system clock Additional configuring includes synchronizing with NTP and extending an InfiniBand fabric This chapter contains the following sections e Installing the Server Switch Module page 2 1 e Downloading Operating System Software from Cisco com page 2 1 e Configuring the Server Switch Module page 2 2 e Connecting Beyond BladeCenter page 2 5 Installing the Server Switch Module To install the Cisco Server Switch Module follow these steps Step1 X Ensure that you are properly grounded by attaching the ESD wrist strap to bare skin and attaching t
60. r your reseller is unable to repair an IBM Machine you can alternatively ask for a partial refund as far as justified by the reduced value of the unrepaired Machine or ask for a cancellation of the respective agreement for such Machine and get your money refunded The second paragraph does not apply What IBM Will Do to Correct Problems The following is added to this section During the warranty period transportation for delivery of the failing Machine to IBM will be at IBM s expense Limitation of Liability The following paragraph is added to this section The limitations and exclusions specified in the Statement of Limited Warranty will not apply to damages caused by IBM with fraud or gross negligence and for express warranty The following sentence is added to the end of item 2 IBM s liability under this item is limited to the violation of essential contractual terms in cases of ordinary negligence Limitation of Liability The following is added at the end of this section The limitation and exclusion specified herein shall not apply to liability for a breach of contract damaging life physical well being or health that has been caused intentionally by gross negligence or by a criminal act The parties accept the limitations of liability as valid provisions and state that the Section 314 2 of the Hungarian Civil Code applies as the acquisition price as well as other advantages arising out of the present Statement of Limited
61. re you connect the two Server Switch Modules in your chassis configure the priority of the subnet managers on the modules For step by step instructions see the Connecting Beyond BladeCenter section on page 2 5 Module Management You can manage your Server Switch Module with any of the following interfaces e Simple Network Management Protocol SNMP versions 1 2 and 3 with Cisco s Management Information Base MIBs e TopspinOS command line interface CLI e Chassis Manager Web based GUI e Element Manager Java based GUI e APIs through SNMP For instructions that show how to configure your Server Switch Module with the CLI see the Command Line Interface Reference Guide For instructions that show how to configure your Server Switch Module with Chassis Manager see the Chassis Manager User Guide For instructions that show how to configure your Server Switch Module with Element Manager see the Element Manager User Guide Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 MEN Chapter1 About the Server Switch Module M LEDs LEDs The Server Switch Module provides module status LEDs and port status LEDs Table 1 1 provides more information about the LEDs Note External port numbers begin at 17 because ports 1 through 16 are internal Table 1 1 Server Switch Module LED Status LED Label Color Function Status Yellow Yellow OK Green Decode Green Off Off
62. rity 3 S3 Operational performance of your network is impaired but most business operations remain functional You and Cisco will commit resources during normal business hours to restore service to satisfactory levels Severity 4 S4 You require information or assistance with Cisco product capabilities installation or configuration There is little or no effect on your business operations Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide EE 3 78 17838 01 IBM Statement of Limited Warranty 7125 4753 08 04 2004 Part 1 General Terms Part 1 General Terms This Statement of Limited Warranty includes Part 1 General Terms Part 2 Country unique Terms and Part 3 Warranty Information The terms of Part 2 replace or modify those of Part 1 The warranties provided by IBM in this Statement of Limited Warranty apply only to Machines you purchase for your use and not for resale The term Machine means an IBM machine its features conversions upgrades elements or accessories or any combination of them The term Machine does not include any software programs whether pre loaded with the Machine installed subsequently or otherwise Nothing in this Statement of Limited Warranty affects any statutory rights of consumers that cannot be waived or limited by contract What this Warranty Covers IBM warrants that each Machine 1 is free from defects in materials and workmanship and 2 conforms to IBM s Offic
63. rst remove power cords from outlet 3 Attach signal cables to connectors 3 Remove signal cables from connectors 4 4 5 Attach power cords to outlet Remove all cables from devices Tum device OM Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 ETT Safety C Statement 3 CAUTION When laser products such as CD ROMs DVD drives fiber optic devices or transmitters are installed note the following Do not remove the covers Removing the covers of the laser product could result in exposure to hazardous laser radiation There are no serviceable parts inside the device Use of controls or adjustments or performance of procedures other than those specified herein might result in hazardous radiation exposure Some laserproducts contain an embedded Class 3A or Class 3B laser diode Note the following Laser radiation w hen open Do not stare into the beam do not view directly with op tical instruments and avoid direct exposure to the beam Class 1 Laser Product Laser Klasse 1 Laser Klass 1 Luokan 1 Laserlaite Appareil Laser de Classe 1 Statement 21 AA CAUTION Hazardous energy is present when the blade is connected to the power source Always replace the blade cover before installing the blade isco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 CHAPTER 1 About the Server Switch Module This chapter describes the
64. s URL http www cisco com techsupport servicerequest For S1 or S2 service requests or if you do not have Internet access contact the Cisco TAC by telephone S1 or S2 service requests are those in which your production network is down or severely degraded Cisco engineers are assigned immediately to S1 and S2 service requests to help keep your business operations running smoothly To open a service request by telephone use one of the following numbers Asia Pacific 61 2 8446 7411 Australia 1 800 805 227 EMEA 32 2 704 55 55 USA 1 800 553 2447 For a complete list of Cisco TAC contacts go to this URL http www cisco com techsupport contacts Definitions of Service Request Severity To ensure that all service requests are reported in a standard format Cisco has established severity definitions Severity 1 S1 Your network is down or there is a critical impact to your business operations You and Cisco will commit all necessary resources around the clock to resolve the situation Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 ix Preface BE Contacting Technical Support Severity 2 S2 Operation of an existing network is severely degraded or significant aspects of your business operation are negatively affected by inadequate performance of Cisco products You and Cisco will commit full time resources during normal business hours to resolve the situation Seve
65. s warranty The following sentence is added to the end of item 2 IBM s liability under this item is limited to the violation of essential contractual terms in cases of ordinary negligence EGYPT Limitation of Liability The following replaces item 2 in this section as to any other actual direct damages IBM s liability will be limited to the total amount you paid for the Machine that is the subject of the claim For purposes of this item the term Machine includes Machine Code and Licensed Internal Code LIC Applicability of suppliers and resellers unchanged FRANCE Limitation of Liability The following replaces the second sentence of the first paragraph of this section In such instances regardless of the basis on which you are entitled to claim damages from IBM IBM is liable for no more than items and 2 unchanged Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 xxiii IBM Statement of Limited Warranty 2125 4753 08 04 2004 E Part 2 Country unique Terms GERMANY HUNGARY IRELAND What this Warranty Covers The following replaces the first sentence of the first paragraph of this section The warranty for an IBM Machine covers the functionality of the Machine for its normal use and the Machine s conformity to its Specifications The following paragraphs are added to this section The minimum warranty period for Machines is twelve months In case IBM o
66. t affected by the warranties provided in this Statement of Limited Warranty AUSTRIA DENMARK FINLAND GREECE ITALY NETHERLANDS NORWAY PORTUGAL SPAIN SWEDEN AND SWITZERLAND Limitation of Liability The following replaces the terms of this section in its entirety Except as otherwise provided by mandatory law 1 IBM s liability for any damages and losses that may arise as a consequence of the fulfillment of its obligations under or in connection with this Statement of Limited Warranty or due to any other cause related to this Statement of Limited Warranty is limited to the compensation of only those damages and losses proved and actually arising as an immediate and direct consequence of the non fulfillment of such obligations if IBM is at fault or of such cause for a maximum amount equal to the charges you paid for the Machine For purposes of this item the term Machine includes Machine Code and Licensed Internal Code LIC The above limitation shall not apply to damages for bodily injuries including death and damages to real property and tangible personal property for which IBM is legally liable 2 UNDER NO CIRCUMSTANCES IS IBM ITS SUPPLIERS OR RESELLERS LIABLE FOR ANY OF THE FOLLOWING EVEN IF INFORMED OF THEIR POSSIBILITY 1 LOSS OF OR DAMAGE TO DATA 2 INCIDENTAL OR INDIRECT DAMAGES OR FOR ANY ECONOMIC CONSEQUENTIAL DAMAGES 3 LOST PROFITS EVEN IF THEY ARISE AS AN IMMEDIATE CONSEQUENCE OF THE EVENT THAT GENERATED
67. ta Related Documentation e Cisco 4x InfiniBand HCA Expansion Card for IBM BladeCenter User Guide e Cisco Boot over IB User Guide for Linux e Cisco Boot over IB User Guide for Windows Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide oi 78 17838 01 Preface Contacting Technical Support ll e Cisco Command Line Interface Reference Guide e Cisco Chassis Manager User Guide Web GUI e Cisco Element Manager User Guide Contacting Technical Support Please read this section before contacting IBM or Cisco technical support IBM Support Contact Information For technical support see the following Web site http www ibm com support To contact technical support send E mail to support ibm com or see one of the telephone numbers below To obtain warranty service contact IBM or your IBM reseller In Canada or the United States call 1 800 IBM SERV 426 7378 In the EU countries see the telephone numbers in Table 1 Table 1 EU Country Telephone List Austria 43 1 24592 5901 Italy 9 02 482 9202 Belgium 02 718 4339 Luxembourg 352 360385 1 Denmark 45 20 8200 Netherlands 020 5 14 5770 Finland 358 9 4591 Portugal 351 21 7915 147 France 0238 557 450 Spain 34 9 662 4916 Germany 07032 15 4920 Sweden 46 8 477 4420 Greece 30 210 688 1220 United Kingdom 01475 555 055 Ireland 353 1 815 4000 Phone numbers are subject to change without notice Note IBM and Cisco
68. tal ciou tohto zariadenia si pecitaje Bezpe nostn predpisy Pred namestitvijo tega proizvoda preberite Varnostne informacije Antes de instalar este producto lea la informaci n de seguridad Las sakerhetsinformationen innan du installerar den h r produkten Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide xxxviii 78 17838 01 Safety Statement 1 DANGER Flectrical current from power telephone and communication cables is hazardous To avoid a shock hazard Do not connect or disconnect any cables orperform installation maintenance or reconfiguration of this product during an electrical storm Connect all pow er cords to a properly wired and grounded electrical outlet Connect to properly wired outlets any equip ment that will be attached to this product When possible use one hand only to connect or disconnect signal cables Never turn on any equipment w hen there is evidence of fire w ater or structural damage Disconnect the attached pow er cords telecommunications systems networks and modems before you open the device covers unles ins tructed otherwise in the installation and configuration procedures Connect and disconnect cables as described in the follow ing tab le w hen installing moving or opening covers on this product or attached devices To Connect To Disconnect 1 Tum everything OFF 1 Tumeverything OFF 2 First attach all cables to devices 2 Fi
69. tatement xxxii Industry Canada Class A emission compliance statement xxxiii Australia and New Zealand Class A statement xxxiii United Kingdom telecommunications safety requirement xxxiii European Union EMC Directive conformance statement xxxiii Taiwanese Class A warning statement xxxiii Chinese Class A warning statement xxxiv Japanese Voluntary Control Council for Interference VCCI statement xxxiv WEEE Notice xxxv Safety xxxvii cHAPTER 1 About the Server Switch Module 1 1 Introduction 1 1 server switch Module and HCA Expansion Cards 1 2 Topologies 1 3 single Switch Topology 1 3 Dual Switch Topology 1 3 Module Management 1 3 LEDs 1 4 server Switch Module Status LEDs 1 4 Port Status LEDs 1 5 External InfiniBand Ports 1 5 cHAPTER 2 Installing and Configuring the Server Switch 2 1 Installing the Server Switch Module 2 1 Downloading Operating System Software from Cisco com 2 1 Configuring the Server Switch Module 2 2 Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 BEIM BE Contents Changing the Default Password 2 3 Configuring the System Clock 2 3 Connecting Beyond BladeCenter 2 5 Connecting InfiniBand Cables 2 5 CHAPTER 3 Specifications 3 1 Electrical Requirements 3 1 Environmental Requirements 3 1 INDEX Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide by 78 17838 01 Preface Audience The inte
70. tery packs from IBM equipment For information on proper disposal of these batteries contact IBM at 1 800 426 4333 Have the IBM part number listed on the battery available prior to your call In the Netherlands the following applies Electronic Emission Notices Federal Communications Commission FCC Statement N Note This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This equipment generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment Unauthorized changes or modifications could void the user s authority to operate the equipment This device complies with Part 15 of the FCC Rules Operation is subject to the f
71. urate timestamps You can either configure the clock setting on the onboard Server Switch clock or you can synchronize your Server Switch to a network time protocol NTP server To configure the clock settings on the onboard clock follow these steps Step 1 Switch to Privileged Exec mode by entering the enable command Cisco BladeCenterH gt enable Cisco BladeCenterH Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide 78 17838 01 23 Chapter2 Installing and Configuring the Server Switch BE Configuring the Server Switch Module Step2 Set the on board clock by entering the clock set command with the following variables e the time of day in hh mm ss format e the day in dd format e the month in mm format e the year in yy format The example that follows sets the date to 1 45 am on June 3rd 2004 Cisco BladeCenterH clock set 01 45 00 03 06 04 To configure primary secondary and tertiary NTP servers to synchronize the Server Switch with the network follow these steps Step 1 Switch to Privileged Exec mode by entering the enable command Cisco BladeCenterH enable Cisco BladeCenterH Step2 Switch to Global Configuration mode by entering the configure terminal command Cisco BladeCenterH configure terminal Cisco BladeCenterH config Step3 Assign a primary NTP server by entering the ntp command with this information e server one keyword e P address of the NTP server Cisco BladeCenterH c
72. xpansion modules All external 4x connectors provide 10 Gbps connections to the outside IB network and can autonegotiate connection speed Server Switch Modules transmit information to and from BladeCenter Management Modules over Ethernet through an internal Ethernet switch to facilitate setup and management After you set up a Server Switch Module and bring it online the on board Cisco Subnet Manager brings distributed intelligence to the IB network Cisco Server Switch Modules allow you to perform a field upgrade to load the latest firmware on the Server Switch Module You can perform a firmware upgrade even following a failed upgrade CLI and GUI interfaces both support upgrades For details see the Command Line Interface Reference Guide or the Element Manager User Guide Server Switch Module and HCA Expansion Cards Within the BladeCenter unit Server Switch Modules manage traffic to and from HCA expansion cards on the BladeCenter hosts Each HCA expansion card adds two IB ports to a BladeCenter host Each HCA port connects through the unit backplane to a particular Server Switch Module slot The first IB port of each HCA card 1b0 connects to the Server Switch Module in I O slot 7 and the second IB port of each HCA card ibl connects to I O slot 9 For detailed information about the HCA expansion card see the Cisco 4x InfiniBand HCA Expansion Card for IBM BladeCenter User Guide Cisco 4x InfiniBand Switch Module for IBM BladeCenter User
73. y event except as provided in items 1 and 2 above exceed the greater of 1 Pounds Sterling 75 000 or 2 125 of the total purchase price payable or the charges for the Machine directly relating to the Default These limits also apply to IBM s suppliers and resellers They state the maximum for which IBM and such suppliers and resellers are collectively responsible Items for Which IBM is Not Liable Save with respect to any liability referred to in item 1 above under no circumstances is IBM or any of its suppliers or resellers liable for any of the following even if IBM or they were informed of the possibility of such losses 1 loss of or damage to data 2 special indirect or consequential loss or 3 loss of profits business revenue goodwill or anticipated savings Part 3 Warranty Information This Part 3 provides information regarding the warranty applicable to your Machine including the warranty period and type of warranty service IBM provides Warranty Period The warranty period may vary by country or region and is specified in the table below N Note Region means either Hong Kong or Macau Special Administrative Region of China A warranty period of 3 years on parts and 1 year on labor means that IBM provides warranty service without charge for 1 parts and labor during the first year of the warranty period and 2 parts only on an exchange basis in the second and third years of the warranty per

Cisco Systems InfiniBand 4x User's Information Guide

Contents

Download Pdf Manuals

Related Search

Related Contents