Home

Sun Netra CP3240 Switch Installation Guide

1. TABLE 1 4 Hot Swap LED States Order Visible State State 1 Solid M1 FRU Inactive 2 Blinking from solid M2 Activation Request 3 Off M3 M4 Active 4 Blinking from off M5 M6 Deactivation Request Back to 1 Description The Intelligent Platform Management Interface IPMI microcontroller is booted but the payload is not The bottom latch is not fully closed The IPMI microcontroller has requested permission to boot the payload from the shelf management controller The IPMI microcontroller has received permission to boot the payload and has done so This should be the state under normal operation The IPMI microcontroller has requested permission to shut down the payload Opening the bottom latch activates this state Note A board should be hot swapped only when the LED is solid blue 1 16 Sun Netra CP3240 Switch Installation Guide September 2009 CHAPTER 2 Overview This chapter introduces the key features of the switch and RTMs This chapter includes a product definition a list of product features and functional block diagrams with brief descriptions This chapter can be used to compare the features of the switch against the needs of a specific application This chapter contains the following topics m Section 2 1 Features on page 2 2 m Section 2 2 Switch Components on page 2 6 m Section 2 3 Protocols RFCs and MIBs Support on page 2 8 m Section 2 4 Fun
2. 10G Infrastructure None None XAU XAU XAU XAU XAU XAU 2 22 Sun Netra CP3240 Switch Installation Guide September 2009 I I 10G Port None None SFP LX SX LRM SFP LX SX LRM SFP LX SX LRM SFP LX SX LRM SFP LX SX LRM SFP LX SX LRM 2 4 3 Base Fabric Switch Subsystem FIGURE 2 4 Base Fabric Switch Subsystem Broadcom Redundant BCMSASAR 32MB FLASH Bad Ip BCM56503 24 1GbE Freescale 3 10GbE Switch Li MPC8247 400MHz CPU Broadcom BCM5464R 4 PHY Broadcom Broadcom Broadcom Broadcom BCM5464R BCM5461S BCM5464R 4 PHY 1 PHY 4 PHY PICMG 3 0 AdvancedTCA defines 10 100 1000Base T Ethernet over the Base Fabric called Base in this guide The Base is designed to be the control plane for the shelf Scaling from 10Mbps to 1000Mbps the Base interface can accommodate a wide variety of node boards The Base interface on the Sun Netra CP3240 switch is based around three main components the Broadcom BCM56503 the Broadcom BCM5464x and the Freescale MPC8247 Chapter2 Overview 2 23 2 4 4 Expansion Fabric Switch Subsystem FIGURE 2 5 Expansion Fabric Switch Subsystem Redundant 32MB FLASH Freescale MPC8247 400MHz CPU Broadcom BCM56800 20 10GbE Switch PICMG 3 0 AdvancedTCA provides an agnostic mesh on the backplane called the Expansion Fabric This interface is the data plane in the shelf The Expansion Fabric is called Fabric in this guide This fabric can be several d
3. m Two separate subsystems providing two separate networks on a single PCB m 14 slot shelf supported m Manage both switches with a single serial port and Ethernet management port m Low power lt 100 watts under heavy load without AMCs m Operates with or without an RTM m Changeable RTM to support different technologies for example RJ 45 versus SFP XFP versus CX4 m AdvancedTCA and AdvancedMC IPMI support with Pigeon Point Systems BMR H8S AMCc Board Manager m Dual image IPMI firmware Sun Netra CP3240 Switch Installation Guide September 2009 2 1 2 Base Interface Broadcom BCM56503 based design Full gigabit non blocking wire speed switching routing Layer 2 switching Layer 3 routing 27 ports m 14 10 100 1000Base T Ethernet ports for node slots m 110 100 1000Base T Ethernet port for redundant switch m 210 100 1000Base T Ethernet ports for front panel access m 210 100 1000Base T Ethernet ports for rear panel access with RTM m 3 1000Base BX Ethernet ports for AMC sites AMC 2 Type E1 compliant m 110 100 1000Base T Ethernet port primary shelf manager m 110 100Base TX Ethernet port for redundant shelf manager cross connect 1 10GBase BX4 Ethernet port to the redundant hub board via the Update Channel m 2 10GBase CX4 Ethernet ports for rear panel access with RTM 400MHz Freescale MPC8247 control CPU 256MB PC100 SDRAM 64MB on board flash Hardware redundant flash for guaranteed flash recovery 10 100BaseTX
4. vi 1 8 1 1 Removing a Switch From the Front of the Server 1 11 1 8 1 2 Removing a Rear Transition Module for a Switch 1 13 1 8 2 Installing a Switch Set 1 14 1 8 2 1 Installing the Rear Transition Module for a Switch 1 14 1 8 2 2 Installing a Switch 1 14 19 Switch LEDs 1 15 1 9 1 ATCA Board Status LEDs 1 15 1 9 2 Hot Swap LED 1 16 2 Overview 2 1 2 1 Features 2 2 2 1 1 General 2 2 2 1 2 Base Interface 2 3 2 1 3 Fabric Gigabit Interface 2 4 2 14 AMC Sites 2 5 2 2 Switch Components 2 6 2 2 1 Broadcom StrataXGS 3 BCM56503 Ethernet Switch 2 6 2 2 2 Broadcom StrataXGS 3 BCM56800 Ethernet Switch 2 6 2 2 3 Broadcom BCM5464R and BCM5461S 10 100 1000Base T Ethernet PHY 2 6 2 2 4 Freescale PowerQUICC II MPC8247 Communications Processor 2 7 2 25 Pigeon Point BMR H8S AMCc AdvancedTCA IPMI Subsystem 2 7 2 3 Protocols RFCs and MIBs Support 2 8 2 3 1 FASTPATH Switching 2 8 2 3 1 1 Additional Layer 2 Functionality 2 9 2 3 1 2 System Facilities 2 9 2 3 1 3 Switching MIBs 2 10 2 3 1 4 Routing MIBs 2 10 Sun Netra CP3240 Switch Installation Guide September 2009 2 3 2 2 3 3 FASTPATH Routing 2 11 FASTPATH Quality of Service 2 12 2 3 3 1 DiffServ 2 12 2 3 3 2 Access Control Lists ACLs 2 12 2 3 3 3 Class of Service CoS 2 13 2 3 3 4 Quality of Service MIBs 2 13 FASTPATH Multicast 2 13 2 3 4 1 Multicast MIBs 2 14 FASTPATH IPv6 Routing 2 14 2 3 5 1 IPv6 Routing MIBs 2 15 FASTPATH Management 2 15 2 3 6 1 SSL 3 0 and TL
5. DA2 DA2 DB2 DC2 DD2 DD2 Base BI BI_ BI_ BI_ DB3 BIL BI_ DC3 BIL BI_ 7 Ch3 DA3 DA3 DB3 DC3 DD3 DD3 Base BI BI_ BI_ BI_ DB4 BIL BI_ DC4 BIL BI_ 8 Ch4 DA4 DA4 DB4 DC4 DD4 DD4 Base BI BI_ BI_ BI_ DB5 BIL BI_ DC5 BIL BI 9 Ch5 DA5 DA5 DB5 DC5 DD5 DD5 B 8 Sun Netra CP3240 Switch Installation Guide September 2009 B 7 ATCA Zone 2 P24 ZD Connector J1 TABLEB 7 ATCA Zone 2 P24 ZD Connector J1 B 8 Serial RJ 45 Connector J13 Top This connector is the Cisco Intel pinout TABLE B 8 Serial RJ 45 Connector J13 Top Pin Signal I RTS 2 DTR 3 TXD 4 GND 5 GND Appendix B Connectors B 9 TABLE B 8 Serial RJ 45 Connector J13 Top Continued Pin Signal 6 RXD 7 DSR 8 CTS B 9 B 10 Serial Cable The switch uses RJ 45 connectors for its serial ports To connect to a PC s DB9 connector a special cable or adapter is needed These cables and adapters are available through various sources or can be made easily The cable must cross over the TXD and RXD signals as both the PC and switch are DTE The minimum cable pinout is listed in the following table TABLE B 9 Minimum Serial Cable Pinouts RJ 45 DB9 RXD to TXD 6 3 TXD to RXD 3 2 GND to GND 5 5 Sun Netra CP3240 Switch Installation Guide September 2009 B 10 10 100 1000Base T RJ 45 Connector J1
6. Forcing power to the board is not enough for the board to boot The board could still be held in reset Configre P11 3 4 jumper setting as well to bring the board out of reset TABLE 3 10 P11 1 2 Forced Board Enable Jumper Settings P11 1 2 Default Function ON Force power on Use this to run without a ShMC OFF Default IPMI controls power to the board P11 3 4 IPMC Board Reset This jumper configres the IPMI to send a reset signal that will reset the entire board TABLE 3 11 P11 3 4 IPMC Board Reset Jumper Settings P11 3 4 Default Function ON IPMI subsystem cannot reset the switch Use this to run without a ShMC OFF Default IPMI subsystem can reset the switch and hold it in reset Chapter 3 Configuring Jumper Settings 3 5 3 1 11 3 1 12 P12 1 2 and P12 3 4 EMI Ground to Logic Ground The switch and the entire AdvancedTCA shelf separate the ground of the chassis itself from digital ground for EMI protection This jumper configures the two grounds TABLE 3 12 P12 1 2 and P12 3 4 Grounding Jumper Settings P12 1 2 3 4 Default Function OFF Default Separate EMI ground and logic ground 1 2 Connect EMI ground to logic ground 3 4 Connect EMI ground to logic ground P13 Serial Direction The front panel serial port and the RTM serial port are mutually exclusive only one can be used at a time The serial port can be forced to the front or the RTM or it can be controll
7. Port 4 7 Port 8 11 10GbE Port 12 Port 13 14 Port 15 Port 17 20 AMC Site 23 Port 0 1GbE Port 1 Port2 Port3 Port 4 7 Port 8 11 Port 12 Port 13 14 Port 15 Port 17 20 2 26 Sun Netra CP3240 Switch Installation Guide September 2009 Base 1GbE Port 22 Port 23 Port 24 Fabric 10GbE Port 16 Update Channel TABLE 2 7 AMC Ethernet Port Availability Slot Location 1G Infrastructure 10G Infrastructure AMC 1 Top 1G Base SGMII None AMC 2 Middle 1G Base SGMII XAUI from BCM56800 Fabric Port 16 AMC 3 Bottom 1G Base SGMII None TABLE 2 8 AMC Site 1 AMC 0 Mid size AMC 2 Type E1 AMC 2 Type 5 Optional LED Module Support Port Type Connected 0 GB Base 3 0 switch 1 Any Not connected 2 Any Port 3 of AMC 3 usually used for SAS SATA B Any Port 3 of AMC 2 usually used for SAS SATA 4 Any Ports 4 7 of AMC 2 usually used for PCIE 5 6 7 8 INot connected D 10 11 12 Custom LED board support 13 Not connected 14 Not connected 15 Not connected 17 Any IRTM for future use 18 Any IRTM for future use 19 Any IRTM for future use 20 Any IRTM for future use TCLK1 CLK IN IFPGA and Zarlink Chapter 2 Overview 2 27 TABLE 2 8 AMC Site 1 AMC 0 Mid size AMC 2 Type E1 AMC 2 Type 5 Optional LED Module Support Continued TCLK2 CLK OUT FPGA and Zarlink TCLK3 CLK IN IFPGA and Zarlink TCLK4 CLK OUT FPGA and
8. SFP Fabric 10GbE SFP Fabric 10GbE SFP Serial MGMT Chapter 2 Overview 2 19 TABLE 2 3 Copper RTM External Ports Port Type RTM Module Logical Port Comments Base 10GBE XAUI CX4 Base 27 Base 10GBE XAUI CX4 Base 26 Base 1GBE 10 100 1000Base T RJ 45 Base 20 Standard I F is copper Base 1GBE 10 100 1000Base T RJ 45 Base 21 Standard I F is copper Management 10 100 Base T RJ 45 Serial RS 232 RS 232 RJ 45 Fabric 10GBE XAUI CX4 Fabric 17 Fabric 10GBE XAUI CX4 Fabric 18 Fabric 10GBE XAUI CX4 Fabric 19 Fabric 10GBE XAUI CX4 Fabric 20 TABLE 2 4 Copper RTM Port Restrictions Port 1G Infrastructure 1G Port 10G Infrastructure 10G Port Base Port 20 SERDES 1000Base T RJ45 None None Base Port 21 SERDES 1000Base T RJ45 None None Base Port 26 None None XAUI 10GBase CX4 Base Port 27 None None XAUI 10GBase CX4 Fabirc Port 17 None None XAUI 10GBase CX4 Fabirc Port 18 None None XAUI 10GBase CX4 Fabirc Port 19 None None XAUI 10GBase CX4 Fabirc Port 19 None None XAUI 10GBase CX4 Fabirc Port 20 None None XAUI 10GBase CX4 2 20 Sun Netra CP3240 Switch Installation Guide September 2009 2 4 2 2 Fiber Optic RTM The XCP3240H RTM OP Z is the Sun Netra CP3240 switch s fiber optic RTM pairing This RTM supports all the ports the Netra CP3240 switch provides using 10GBase X for the 10Gigabyte and 1000Base X for the 1Gigabyte ports FIGURE 2 3 Fiber Optic RTM Functional Block Diagram
9. 4 3 1 e Keying on page 4 7 for a description of e Keying and how it is supported To disable e Keying use the noekey environment variable List the ports to be disabled separated by only commas set noekey 1 2 3 4 Or use the word all to disable e Keying completely set noekey all To re enable e Keying clear the variable set noekey After changing the environment variables you must always save if you would like the change to persist though a reset Sun Netra CP3240 Switch Installation Guide September 2009 4 2 3 Serial Baud Rate Control in uBoot You can change the serial baud rate from within FASTPATH the boot menu or in uBoot Changing it in uBoot is the only method that allows it to persist through a reset Only standard baud rates are accepted Note Change the baud rate on the Fabric first then on the Base If the baud rate on the Fabric and Base do not match the Fabric will not be accessible If the Fabric is not accessible change the baud rate on the Base until the Fabric is accessible To change the baud rate in uBoot enter the command as in the following example set baudrate lt 115200 gt After changing the rate you must save if you would like the change to persist though a reset 4 3 4 3 1 Linux The switch uses Linux as an operating system The Monta Vista 3 1 Pro 2 4 20 kernel is used There are no settings to change and the OS is c
10. AaBbCc123 Book titles new words or terms words to be emphasized Replace command line variables with real names or values Edit your login file Use 1s a to list all files You have mail su Password Read Chapter 6 in the User s Guide These are called class options You must be superuser to do this To delete a file type rm filename Note Characters display differently depending on browser settings If characters do not display correctly change the character encoding in your browser to Unicode UTF 8 Preface xxi Related Documentation The following table lists the documentation for this product The online documentation is available at http docs sun com app docs prod cp3240 switch l en hic Application Title Part Number Format Location Latest Sun Netra CP3x40 Switch Product 820 3260 xx PDF Online information Notes Ponter doc Sun Netra CP3240 Switch Getting 820 3254 xx Printed Shipping Kit Started Guide Usage Sun Netra CP3240 Switch User s 820 3252 xx PDF Online Guide Reference Sun Netra CP3240 Switch Software 820 3253 xx PDF Online Reference Manual AMC Ponter Sun Netra CP3240 Advanced 820 7260 xx Printed Shipping Kit doc Mezzanine Card Getting Started Guide AMC Sun Netra CP3240 Advanced 820 7261 xx PDF Online Installation Mezzanine Card 10G Copper User s Guide AMC Sun Netra CP3240 Advanced 820 7262 xx PDF Online Installation Mezzanine Card 10G Optic User s Guide AMC Sun Netr
11. Backup Image option can be used From within FASTPATH the boot system command in combination with the update bootcode commands can be used Chapter 4 Configuring Switch Software 4 13 4 8 2 4 8 3 Updating the Non Active Image All of the update methods supported by the active image imagel by default are also supported for the non active image image2 Fabric 1G 10G Auto negotiation The Fabric networks support both 1Gigabyte and 10Gigabyte operation No configuration is required to put the switch into either a 1Gigabyte or 10Gigabyte mode The switch will dynamically connect at the appropriate speed 4 9 4 14 Network Boot The switch supports network booting This feature can be used to test updates to FASTPATH without installing them Updates containing changes to uBoot Linux or the IPMC must be installed to the flash before they can be used 1 Setup a TFTP server on the update network Tftpd is the standard TFTP server for Linux and Solaris For Windows Solarwinds http www solarwinds net offers a free TFTP server 2 Place the update image on the TFTP server It will have a tgz file extension 3 Connect to the serial management port of the network to be updated and connect the MGMT port to the update network 4 Reboot the switch using the reboot button hotswap handle or reload command 5 As the switch boots press number 2 to enter the Utility Menu 6 Press number 8 to change the boot me
12. RFC 2295 Transparent content negotiation RFC 2296 Remote variant selection RSVA 1 0 state management cookies draft ietf http state mgmt 05 RFC 2570 Introduction to SNMPv3 RFC 2576 Coexistence between SNMP v1 v2 and v3 RFC 2578 SMI v2 RFC 2579 Textual conventions for SMI v2 RFC 2580 Conformance statements for SMI v2 RFC 3410 Introduction and applicability statements for Internet Standard Management Framework RFC 3411 Architecture for describing SNMP management frameworks RFC 3412 Message processing and dispatching for SNMP RFC 3413 SNMP applications RFC 3414 User based security model for SNMP v3 RFC 3415 View based access control model for SNMP RFC 3416 Version 2 of the protocol operations for SNMP Chapter 2 Overview 2 15 RFC 3417 Transport mappings for SNMP RFC 3418 MIB for SNMP Configurable management VLAN 2 3 6 1 SSL 3 0 and TLS 1 0 RFC 2246 TLS protocol version 1 0 RFC 2346 AES Ciphersuites for transport layer security RFC 2818 HTTP over TLS 2 3 6 2 SSH 1 5 and 2 0 m Draft ietf secsh transport 16 SSH Transport Layer Protocol m Draft ietf secsh userauth 17 SSH Authentication Protocol m Draft ietf secsh connect 17 SSH Connection Protocol m Draft ietf secsh architecture 14 SSH protocol architecture m Draft ietf secsh publickeyfile 03 SECSH Public Key File format m Draft ietf secsh dh group exchange 04 Diffie Hellman Group Exchange for the SSH Transport Layer Protoco
13. September 2009 4 10 3 3 4 10 4 4 10 4 1 4 10 4 2 SNMP Defaults SNMP is enabled by default The default read only community string is public The default read write community string is private Secure Remote Access SSH and SSL TLS Keys The switch supports SSH for a secure CLI console as well as SSL TLS for secure HTTP By default SSH and SSL are disabled The switch cannot generate its own keys Keys must be generated on an external PC and uploaded to the switch via TFTP Once the keys are on the switch SSH and HTTPS must be enabled to be used Enabling SSH and SSL First the certifications and keys must be uploaded to the switch using a command such as the following copy tftp lt ip gt lt file gt lt location gt Upload the following files to the switch File Location rsal key nvram sshkey rsal rsa2 key nvram sshkey rsa2 dsa key nvram sshkey dsa dh512 pem nvram sslpem dhweak dh1024 pem nvram sslpem dhstrong server pem nvram sslpem server rootcert pem nvram sslpem root Enable secure access SSH Telnet and disable non secure access SSL HTTP ip ssh configure Chapter4 Configuring Switch Software 4 21 4 10 5 4 10 6 lineconfig no transport input telnet exit ip http secure server no ip http server Default Settings The switch comes configured with a default configuration This configuration boots the board to Layer 2 switching
14. deux conditions suivantes 1 Ce dispositif peut ne pas causer l interf rence nocive 2 Ce dispositif doit accepter n importe quelle interf rence re ue y compris l interf rence qui peut causer l op ration peu d sir e Appendix D Agency Certifications D 5 D 6 Sun Netra CP3240 Switch Installation Guide September 2009 Index A Airflow requirements 1 7 C cable management bracket lowering 1 11 1 14 H handling cards cautions 1 4 l installing switches 1 14 switches rear transition cards 1 14 L LEDs switches 1 15 R removing switches 1 11 switches rear transition cards 1 13 S switches installing 1 14 LEDs 1 15 removing 1 11 switches rear transition cards installing 1 14 removing 1 13 Index 1 Index 2 Sun Netra CP3240 Switch Installation Guide September 2009
15. edges of the board with the guides in the slot Look into the enclosure to verify correct alignment of the rails in the guides Caution Do not force the module into the slot If it does not fit properly check to ensure that you have the correct matching RTM for the switch Keeping the board aligned in the guides slide the board in until the injector ejector mechanisms engage the retention bar Simultaneously push in the board and rotate the injector ejector handles to their closed positions rotate inward to seat the midplane connectors Tighten the board retention screws to anchor the board in the shelf Connect the cables to the rear transition module Installing a Switch Locate the switch slots The switches can be inserted only in slot 7 or slot 8 in the Netra CT 900 server Move the front cable management bracket to the lower position FIGURE 1 6 Remove the filler panel if necessary Sun Netra CP3240 Switch Installation Guide September 2009 Prepare the switch by opening its injector ejector handles FIGURE 1 7 Carefully align the edges of the board with the guides in the slot Look into the enclosure to verify correct alignment of the rails in the guides Keeping the board aligned in the guides slide the board in until the injector ejector mechanisms engage the retention bar Simultaneously push in the board and rotate the injector ejector handles to their closed p
16. mib 11 txt DVMRP MIB IANA RTP PROTO MIB FASTPATH Enterprise MIBs supporting multicast features 2 3 5 FASTPATH IPv6 Routing RFC 1981 Path MTU for IPv6 RFC 2373 IPv6 addressing RFC 2460 IPv6 protocol specification RFC 2461 Neighbor discovery RFC 2462 Stateless autoconfiguration RFC 2463 ICMPv6 RFC 2464 IPv6 over Ethernet REC 2711 IPv6 router alert RFC 2740 OSPFv3 FASTPATH supports Broadcast and Point to Point interfaces RFC 2893 Transition mechanisms for IPv6 hosts and routers 6over4 configured RFC 3315 DHCPv6 stateless relay RFC 3484 Default address selection for IPv6 RFC 3493 Basic Socket Interface for IPv6 RFC 3513 Addressing architecture for IPv6 RFC 3542 Advanced Sockets API for IPv6 RFC 3587 IPv6 Global Unicast Address format RFC 3736 Stateless DHCPv6 Dual IPv4 IPv6 TCP IP stack 2 14 Sun Netra CP3240 Switch Installation Guide September 2009 2 3 5 1 2 3 6 IPv6 Routing MIBs RFC 2465 IPv6 MIB RFC 2466 ICMPv6 MIB FASTPATH Enterprise MIBs supporting IPv6 features FASTPATH Management RFC 854 Telnet RFC 855 Telnet option specifications RFC 1155 SMI v1 RFC 1157 SNMP RFC 1212 Concise MIB definitions RFC 1867 HTML 2 0 forms with file upload extensions RFC 1901 Community based SNMP v2 RFC 1908 Coexistence between SNMP v1 and SNMP v2 RFC 2068 HTTP 1 1 protocol as updated by draft ietf http v11 spec rev 03 RFC 2271 SNMP framework MIB
17. out of band management Ethernet port Front and rear access RJ 45 serial management port Full IPv6 support L2 and L3 Multicast support Chapter 2 Overview 2 3 2 55 2 4 Fabric Gigabit Interface Broadcom BCM56800 based design Full gigabit non blocking wire speed switching routing Layer 2 switching Layer 3 routing 20 total ports m 14 10GBase BX4 Ethernet ports for node slots m 1 10GBase BX4 Ethernet port for redundant switch a 1 10GBase BX4 for AMC site AMC 2 Type 5 a 4 10GBase CX4 for rear panel access with RTM Auto negotiation between 1GbE 1000Base BX 3 1 Option 1 and 10GbE 10GbEBase BX4 3 1 Option 9 400MHz Freescale MPC8247 control CPU 256MB PC100 SDRAM 64MB on board flash Hardware redundant flash for guaranteed flash recovery 10 100BaseTX out of band RJ 45 management Ethernet port Front and rear access RJ 45 serial management port Full IPv6 support L2 and L3 multicast support Sun Netra CP3240 Switch Installation Guide September 2009 2 1 4 AMC Sites m Site 1 1000Base BX to 3 0 network AMC port 0 is ethernet port 22 m Site 2 1000Base BX to 3 0 network AMC port 0 is ethernet port 23 m Site 2 10GBase BX to 3 1 network AMC port 8 11 is ethernet port 16 m Site 3 1000Base BX to 3 0 network AMC port 0 is ethernet port 24 Site 1 AMC 0 Mid size AMC 2 Type E1 m 1000Base BX to 3 0 network AMC port 0 m AMC ports 4 7 connected to AMC site 2 m SAS SATA ports routed between AMCs AMC p
18. second ShMC port is number 17 on the Base TABLE 3 2 P4 Cross Connect Jumper Settings P4 Default Function OFF Software control of cross connect 1 2 Default Force cross connect enabled base channel 1 is two 10 100BaseTX ports 3 4 No cross connect base channel 1 is 10 100 1000Base T 3 2 Sun Netra CP3240 Switch Installation Guide September 2009 3 1 2 3 1 3 3 1 4 P6 1 2 Fabric Zero Reset Configuration Word This jumper is used to configure the Fabric Gigabyte CPU to use the default Reset Configuration Word or use the one in the flash TABLE 3 3 P6 1 2 Fabric Zero Reset Jumper Settings P6 1 2 Default Function ON Use default Reset Configuration Word all zeros OFF Default Use Reset Configuration Word in flash P6 3 4 Base Zero Reset Configuration Word This jumper is used to configure the Base CPU to use the default Reset Configuration Word or use the one in the flash TABLE 3 4 P6 3 4 Base Zero Reset Jumper Settings P6 3 4 Default Function ON Use default Reset Configuration Word all zeros OFF Default Use Reset Configuration Word in flash P8 1 2 Base Write Protect This jumper configures write protection on the Base reset configuration word TABLE 3 5 P8 1 2 Base Write Protect Jumper Settings P8 1 2 Default Function ON Disable the write protection of the Base reset configuration word OFF Default Write protect the Base reset configuration word Chapter 3 Configu
19. to the voltage monitoring temperature monitoring e Keying and other services it provides for the Sun Netra CP3240 switch Pigeon Point Systems is the leading provider of IPMI firmware for AdvancedTCA and the firmware has been thoroughly tested to be fully compliant with the specification Chapter 2 Overview 2 7 2 3 Protocols RFCs and MIBs Support The Sun Netra CP3240 switch features Level7 FastPath 2340 switching software version 4 4 4 and newer This software provides layer 2 switching quality of service IPv4 routing IPv6 routing and IP multicast 2 3 1 FASTPATH Switching IEEE 802 1ab Link Level Discovery IEEE 802 1D Spanning Tree IEEE 802 1p Ethernet Priority with User Provisioning and Mapping IEEE 802 1Q Virtual LANs with Port based VLANs IEEE 802 1S Multiple Spanning Tree IEEE 802 1v Protocol based VLANs IEEE 802 1W Rapid Spanning Tree IEEE 802 1X Port based Authentication IEEE 802 3 10 Base T IEEE 802 3ab 1000 Base T IEEE 802 3ac VLAN Tagging IEEE 802 3ad Link Aggregation IEEE 802 3ae 10 Gigabyte IEEE 802 3u 100 Base T GARP Generic Attribute Registration Protocol Clause 12 802 1D 2004 GMRP Dynamic L2 Multicast Registration Clause 10 802 1D 2004 GVRP Dynamic VLAN Registration Clause 11 2 802 1Q 2003 IEEE 802 3x Flow Control draft ietf magma snoop 10 txt Considerations for IGMP and MLD Snooping Switches 2 8 Sun Netra CP3240 Switch Installation Guide Septem
20. 0 BI_ DD20 5 BI_ DAZI BI DAZI BI_ DB21 BI_ DB21 BI_ DC21 BI_ DC21 BI_ DD2I BI_ DDZI 6 Base 27 x2 Base 27 x2 Base 27 RxU Base 27 RxU Base 27 Tx3 Base 27 Tx3 Base 27 RxI Base 27 RxI 7 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB Base 27 TxU Base 27 TxU Base 27 RXZ Base 27 RXZ Base 27 TXI Base 27 TXI Base 27 Rx3 Base 27 Rx3 8 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB ase X ase x ase ase ase X ase X ase ase 9 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB ase XI ase X ase ase ase X ase X ase ase 10 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB Appendix B Connectors B 13 APPENDIX C Datasheet Reference This appendix provides links to datasheets standards and specifications for the technology designed into the switch IEEE 802 3 2002 CDMA CD Ethernet and Other IEEE 802 3 802 1 Documents This document defines Ethernet and several of the protocols used in Ethernet Any 802 document can be obtained for free six months after it has been published or for a fee a document can be obtained right after it is published http standards ieee org getieee802 PICMG 3 0 AdvancedTCA AdvancedTCA specifications can be purchased from the PCI Industrial Computer Manufacturers Group PICMG for a nominal fee A short form AdvancedTCA specification is also available on PICMG s Website http www picmg org PICMG 3 1 AdvancedTCA Ethernet and Fibre Channel AdvancedTCA specificatio
21. 009 FIGURE 1 4 Netra CP3240H RTM OP Airflow Pa z 5 i Chapter 1 Getting Started 1 9 1 8 Removing and Installing Switches This section describes how to remove and install switches If you are hot swapping the rear transition module for a switch you must remove the switch from the front of the system before removing the rear transition module from the rear of the system Do not remove the rear transition module without first removing the accompanying switch from the front 1 8 1 Removing a Switch Set Following are the instructions for removing a switch and if necessary the accompanying rear transition module 1 10 Sun Netra CP3240 Switch Installation Guide September 2009 1 8 1 1 Removing a Switch From the Front of the Server 1 Move the front cable management bracket to the lower position FIGURE 1 6 FIGURE 1 6 Front Cable Management Bracket in Lower Position 2 Disengage the injector ejector mechanisms at the top and bottom of the board to notify software that the board is about to be removed Wait for the Hot Swap LED to light FIGURE 1 7 shows the proper way to remove or insert a hot swappable board into a system Chapter 1 Getting Started 1 11 FIGURE 1 7 Injector Ejector on the Switch Open Position injector ejector mechanism 3 Disconnect all cables connected to the switch 4 Loosen the two board retention screws that fasten the board to the enclosure 5 Open the ejectors fully rotat
22. 11 11 11 11 Appendix B Connectors B 5 TABLE B 4 ATCA Zone 2 P21 ZD Connector J4 TXZ TXZ RXZ RX3 RG 10GB 10GB 10GB 10GB 10GB 5 10 10 10 10 10 Fabri To TXU U RxI RXT cCh 10GB 10GB 10GB 10GB 10GB 6 10 10 10 10 10 10 Tx Tx2 2 RX3 Rx3 10GB 10GB 10GB 10GB 10GB 7 91 9 9 9 9 Fabri Tu TXU RXU RXT RXT cCh 10GB 10GB 9 9 X 10GB 10GB 10GB 10GB 9 8 8 8 8 8 Fabri 7 TXU RxU RXT RXT 1 Ch 10GB 10GB 10GB 10GB 10GB o 8 8 8 8 8 8 B 6 Sun Netra CP3240 Switch Installation Guide September 2009 B 5 ATCA Zone 2 P22 ZD Connector J3 TABLE B 5 ATCA Zone 2 P22 ZD Connector J3 10GB 4 RXT 10GB 4 RXS 10GB BI RXT 10GB 3 B 6 ATCA Zone 2 P23 ZD Connector J2 TABLE B 6 ATCA Zone 2 P23 ZD Connector J2 Appendix B Connectors B 7 TABLE B 6 ATCA Zone 2 P23 ZD Connector J2 ShM SHMC SHMC SHMC SHMC SHMC SHMC SHMU SHMC Cc BI A BI_A BI_B BI_B BI_C or BI_C or BI D or BI D or Port SHMC2 SHMC2 SHMC2 SHMC2 5 s BI_A BI_A BI_B BI_B Base BI BI_ BI_ BI_ DBZ BIL BI_ DCZ BI BI_ 6 Ch2
23. 3 3rd J13 Bottom TABLE B 10 10 100 1000Base T RJ 45 Connector J13 3rd and Bottom Signal MDI_0 MDI _0 MDI_1 MDI_2 MDI_2 MDI _1 MDI_3 o N o O OA Oo N e MDI 3 B 11 10 100Base TX RJ 45 Connector J13 2nd TABLE B 11 10 100Base TX RJ 45 Connector J13 2nd Signal Tx Tx Rx unused unused Rx unused o N o O A N e unused Appendix B Connectors B 11 B 12 ATCA Zone 3 RTM Connector Top J8 TABLE B 12 ATCA Zone 3 RTM Connector J8 Top Base MDC XE Base MDIO XE 19 Fabric MDC Fabric MDIO Base MDCGE Base MDIO GE Base PHY RST Fabric PHY IRST DOS LED D D LED N CED D LEDBLUE LED RTM T PMI SDA PMI SCL 2 ILED SOFT OFF D D 3 RSVD RSVD VD VD D D D D RSVD RSVD RSVD RSVD 5 3 3V STBY 3 3V STBY IRSVD IRSVD IRSVD IRSVD IRSVD IRSVD 3 3V 3 3V 3 3V 3 3V 3 3V 3 3V 3 3V 3 3V F T ZV T ZV T ZV T ZV TZV TZV TZV TZV B 13 ATCA Zone 3 RTM Connector J7 Middle TABLE B 13 ATCA Zone 3 RTM Connector J7 Middle a b c d e f h AMCI P20 AMCI P20 AMCT P20 AMCT P20 AMCT PIJ AMCI PTY Arci PI9 AMCI PTY 1 TX TX RX RX TX TX RX RX AMCI P18 AMCI PI8 AMCI P18 AMCI PI8 AMCI P17 AMCI PI7 AMCI PI7 AMCI PI7 2 TX TX RX RX TX TX RX RX AMCZ P20 AMCZ P20 AMCZ P20 AMCZ P20 AMCZ PI9 AMCZ PI9
24. 3253 Management Options The switch can be controlled by a CLI a web interface and through SNMP All management interfaces other than serial can be enabled or disabled provided over both the out of band management port and or any in band ports and be limited to certain in band ports CLI The switch provides an industry standard CLI The CLI is provided over the serial port telnet and SSH This section only describes some basic commands For detailed command syntax refer to the Netra CP3240 Switch Command Reference Manual 820 3253 The CLI is mode based It works similarly to a console in Linux or Windows Commands are grouped under modes and those commands only work when the user is in the current mode There are very few global commands To return to one mode higher than the current mode use exit For example to shutdown port 17 switch to enable mode configure mode interface 17 mode then issue the shutdown command Use exit to return to configure mode and exit again to return to enable mode Many commands have a no form The no form is used to disable the command With the previous example to re enable port 17 once you are in the interface 17 mode you would issue the no shutdown command 4 18 Sun Netra CP3240 Switch Installation Guide September 2009 4 10 2 TABLE 4 6 Basic CLI Commands Basic CLI Commands Command enable show port all show interface ethernet 0 x clear counters clear confi
25. A KAKA switch Base Primary Flash imagel Utility Menu Start Switch Application Load Code Update Package using TFTP FTP Load Code Update Package using XMODEM YMODEM ZMODEM Copy Primary Flash to Backup Flash Select Serial Speed Uu BUNE I Chapter 4 Configuring Switch Software 4 15 CODE EXAMPLE 4 5 Example Console Output Continued 6 Retrieve Error Log using TFTP 7 Retrieve Error Log using XMODEM YMODEM ZMODEM 8 Erase Current Configuration 9 Erase Permanent Storage 10 Select Boot Method 11 Activate Backup Image 12 Start Diagnostic Application 13 Reboot Select option 1 13 10 Current Boot Method FLASH 1 Flash Boot 2 Network Boot 3 Serial Boot 4 Exit without change Select option 1 4 2 Enter Server IP 10 10 3 199 Enter Host IP or dhcp dhcp Enter Transfer Method tftp or ftp ftp Enter Filename switch 1 0 1 0 stk Accept changes Press Y N y KKKAKKAKAKAKAKAKAAKAAKAAKAKAKAAAAKAAKAKFAKAAAAAKAKFAKAAKAAKAAAKAKFAKAAAAAKAKFAAAAAAKAAKFAAAA KAKA Use the key above the TAB to switch between BASE and FABRIC KKKAKKAKAKAKAKAKAKAKKAAKAKAKAKAAAAKAAKAKFAKAAAKAAAKAAKFAKAAKAAAAAKAKAKAAAAAKAKFAAAAAAKAAKRAAAA KAKA switch Base Primary Flash imagel Utility Menu 1 Start Switch Application 2 Load Code Update Package using TFTP FTP 3 Load Code Update Package using XMODEM YMODEM ZMOD
26. A 1 7 HA 2 8 HA 3 9 HA 4 10 HA 5 11 HA 6 12 HA 7 13 SCL_A 14 SCD_A 15 SCL_B 16 SCD_B 17 NC Pin 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 Pin Name SHELF_GND GND NC VRTN_A VRTN_B EARLY_A EARLY_B NC 48V_A 48V_B FIGURE B 2 ATCA Zone 1 Connector J9 Sun Netra CP3240 Switch Installation Guide September 2009 B 3 ATCA Zone 2 P20 ZD Connector J5 TABLE B 3 ATCA Zone 2 P20 ZD Connector J5 1 Clks 2 Upd 3 ate Ch and 4 Clks a Fabri cCh 6 15 di Fabri cCh 8 14 9 Fabri 131 13 13 13 13 13 13 13 EN y TxU RXU RxU TXI TXI RxI Rxl cCh 10GbE 10GbE 10GbE 10GbE 10GbE 10GbE 10GbE 10GbE 10 13 131 13 13 13 13 13 13 13 B 4 ATCA Zone 2 P21 ZD Connector J4 TABLE B 4 ATCA Zone 2 P21 ZD Connector J4 a b c d e f g h TXZ TXZ RXZ RXZ Tx3 Tx3 Rx3 RXZ 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB 12 12 12 12 12 12 12 1 12 Fabri Tx TXU RXU RxU TXI TXI RXT RXI cCh 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB 2 12 12 12 12 12 12 12 12 12 Tx2 Tx2 RXZ Rx2 Tx3 Tx3 Rx3 Rx3 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB 3 Fabri t 11 11 11 11 11 11 11 TxU TxU RXU RX TXI TXI RXT RXT cCh 10GB 10GB 10GB 10GB 10GB 10GB 10GB 10GB 4 11 11 11 11 11
27. AMCZ P19 AMCZ P19 3 TX TX RX RX TX TX RX RX AMCZ PIS AMCZ PI8 AMCZ P18 AMCZ PI8 AMCZPI7 AMCZPI7 AMCZ P17 AMCZ P17 4 TX TX RX RX TX TX RX RX AMC3 PU AMC3 P20 AMC3 P20 AMC3 P20 AMC3 PI9 AMC3 PI9 AMC3 PI9 AMC3 P19 5 TX TX RX RX TX TX RX RX _ AMC3PIS AMC3PI8 AMC3PI8 AMC3PI8 AMC3PI7 AMC3PI7 AMC3PI7 AMC3PI7 6 TX TX RX RX TX TX RX RX x x x x 7 17 17 17 17 17 17 17 17 TxU IUGB TxU IUGB RxU IUGB RxU IUGB TxI IUGB TxI IUGB RxI IUGB RxI IUGB 8 17 17 17 17 17 17 17 17 TxZ IUGB TxZ IUGB RXZ IUGB RxZ IUGB Tx3 IUGB Tx3 IUGB Rx3 IUGB Rx3 IUGB 9 18 18 18 18 18 18 18 18 TxU IUGB TxU IUGB RxU IUGB RxU IUGB TxI IUGB TXI IUGB RxI IUGB RxI IUGB 10 18 18 18 18 18 18 18 18 B 12 Sun Netra CP3240 Switch Installation Guide September 2009 B 14 ATCA Zone 3 RTM Connector J6 Bottom TABLE B 14 ATCA Zone 3 RTM Connector J6 Bottom a b c d e f g h x x x x 1 19 19 19 19 19 19 19 19 x x X x 2 19 19 19 19 19 19 19 19 Tx2 TOGB Tx2 1UGB RxZ IUGB RXZ IUGB Tx3 IUGB Tx3 IUGB Rx3 IUGB Rx3 IUGB 3 20 20 20 20 20 20 20 20 TxU IUGB TXU IUGB RxU IUGB Rx0 IUGB TxI IUGB TXI IUGB RxI IUGB RxI IUGB 4 20 20 20 20 20 20 20 20 BI_ DA20 BI_ DAZU BI_ DB20 BI_ DB20 BI_ DC20 BI_ DC20 BI_ DD2
28. DIUS accounting MIB RFC 2674 VLAN MIB RFC 2737 Entity MIB version 2 RFC 2819 RMON groups 1 2 3 and 9 RFC 3291 Textual conventions for Internet Network Addresses RFC 3635 Definitions of managed objects for the Ethernet like interface types IEEE 802 1X MIB IEEE802 1 PAE MIB IEEE 802 3AD MIB IEEE802 3 AD MIB FASTPATH Enterprise MIBs supporting switching features 2 3 1 4 Routing MIBs RFC 1724 RIP v2 MIB extension RFC 1850 OSPF MIB RFC 2096 IP forwarding table MIB RFC 2787 VRRP MIB RFC 2863 The Interfaces Group MIB FASTPATH Enterprise MIBs supporting routing features 2 10 Sun Netra CP3240 Switch Installation Guide September 2009 Zid FASTPATH Routing REC 826 Ethernet ARP RFC 894 Transmission of IP Datagrams over Ethernet networks REC 896 Congestion control in IP TCP networks RFC 919 IP Broadcast RFC 922 IP Broadcast in the presence of subnets RFC 950 IP subnetting RFC 1027 Using ARP to implement Transparent Subnet Gateways proxy ARP RFC 1058 RIP v1 RFC 1256 ICMP router discovery messages RFC 1321 Message Digest Algorithm RFC 1765 OSPF database overflow RFC 1812 Requirements for IP version 4 routers RFC 2082 RIP 2 MD5 authentication RFC 2131 DHCP relay RFC 2328 OSPFv2 FASTPATH supports Broadcast interfaces RFC 2453 RIP v2 RFC 3046 DHCP BootP relay RFC 3101 OSPF Not So Stubby Area NSSA option RFC 3768 Virtual Router Redundancy Pro
29. Double module support LED Module Support 2 28 AMC Site 3 AMC 0 Mid size AMC 2 Type E1 Master Clock Generator Support LED Support 2 29 AMC Modules by Site 2 30 AMC Port Restrictions for Copper RTMs 2 30 AMC Port Restrictions for Fiber Optic RTMs 2 30 Switch Configuration Jumper Settings 3 2 P4 Cross Connect Jumper Settings 3 2 XV TABLE 3 3 TABLE 3 4 TABLE 3 5 TABLE 3 6 TABLE 3 7 TABLE 3 8 TABLE 3 9 TABLE 3 10 TABLE 3 11 TABLE 3 12 TABLE 3 13 TABLE 4 1 TABLE 4 2 TABLE 4 3 TABLE 4 4 TABLE 4 5 TABLE 4 6 TABLE 4 7 TABLE A 1 TABLE A 2 TABLE A 3 TABLE B 1 TABLE B 2 TABLE B 3 TABLE B 4 TABLE B 5 TABLE B 6 TABLE B 7 TABLE B 8 TABLE B 9 P6 1 2 Fabric Zero Reset Jumper Settings 3 3 P6 3 4 Base Zero Reset Jumper Settings 3 3 P8 1 2 Base Write Protect Jumper Settings 3 3 P8 3 4 Fabric Write Protect Jumper Settings 3 4 P9 IPMC Firmware Program Jumper Settings 3 4 P10 1 2 IPMC Reset Jumper Settings 3 4 P10 3 4 IPMC FWE Reserved Jumper Settings 3 5 P11 1 2 Forced Board Enable Jumper Settings 3 5 P11 3 4 IPMC Board Reset Jumper Settings 3 5 P12 1 2 and P12 3 4 Grounding Jumper Settings 3 6 P13 Serial Direction Jumper Settings 3 6 IPMI State Sensors 4 2 0 42 IPMI Sensor Logic 4 3 IPMI Thresold Sensors 4 4 uBoot Console Commands 4 6 Basic CLI Commands 4 19 Port Order List 4 22 Absolute Maximum Electrical and Temperature Ratings A 2 Normal Operating Electrical and Temperature Rat
30. EM 4 Copy Primary Flash to Backup Flash 5 Select Serial Speed 6 Retrieve Error Log using TFTP 7 Retrieve Error Log using XMODEM YMODEM ZMODEM 8 Erase Current Configuration 9 Erase Permanent Storage 10 Select Boot Method 11 Activate Backup Image 12 Start Diagnostic Application 13 Reboot 4 16 Sun Netra CP3240 Switch Installation Guide September 2009 CODE EXAMPLE 4 5 Example Console Output Continued Select option 1 13 1 Creating tmpfs filesystem on tmpfs for download done Bringing up eth0 interface done HOST IPADDR 10 10 2 246 Transferring switch 1 0 1 0 stk from 10 10 3 199 via ftp done Bringing down eth0 interface done Extracting Application done Destroying tmpfs filesystem on tmpfs done Loading Application done SOC unit 0 attached to PCI device BCM56503_B2 FASTPATH starting started Unit 1 gt User 10 Use option 8 of the Utility Menu to change the boot method back to flash when desired Chapter4 Configuring Switch Software 4 17 4 10 4 10 1 4 10 1 1 FASTPATH The switch features LVL7 Systems FASTPATH 2340 software version 4 4 FASTPATH is a software package providing the robust management needed to control a modern switch router This section serves as a quick primer on using FASTPATH on the switch FASTPATH is not covered in detail in this guide but is covered in the Netra CP3240 Switch Command Reference Manual 820
31. Electronic Industries Alliance at http www eiae org Chapter 1 Getting Started 1 3 1 2 Unpacking Check the shipping carton for damage If the shipping carton or contents are damaged notify the carrier and Sun Retain the shipping carton and packing material for inspection by the carrier Obtain authorization before returning any product to Sun Refer to the Netra CP3240 Switch Getting Started Guide 820 3254 for return instructions Caution This board must be protected from static discharge and physical shock Never remove any of the socketed parts except at a static free workstation Use the anti static bag shipped with the product to handle the board Wear a wrist strap grounded through one of the system s ESD ground jacks when installing or servicing system components 1 4 Handling Switches Caution The system is sensitive to static electricity To prevent damage to the assembly always connect an antistatic wrist strap between you and the system Caution Do not flex the switches the surface mounted components can break if the switch is bent To minimize the amount of switch flexing observe the following precautions m When removing a switch from an electrostatic discharge bag keep it vertical until you place the switch on the electrostatic discharge mat m Do not place a switch on a hard surface Use a cushioned antistatic mat The switch connectors and components have very thin pins that
32. GURE B 1 FIGURE B 2 Switch and RTM Faceplates 1 6 Netra CP3240H RTM CU Airflow Pa 1 8 Netra CP3240H RTM CU Airflow InchesH20 1 8 Netra CP3240H RTM OP Airflow Pa 1 9 Netra CP3240H RTM OP Airflow InchesH20 1 9 Front Cable Management Bracket in Lower Position 1 11 Injector Ejector on the Switch Open Position 1 12 Switch Functional Block Diagram 2 17 Copper RTM Functional Block Diagram 2 19 Fiber Optic RTM Functional Block Diagram 2 21 Base Fabric Switch Subsystem 2 23 Expansion Fabric Switch Subsystem 2 24 AMC Port Map Diagram 2 26 Switch Jumper Locations 3 7 PCB Dimensions A 4 Connector Locations Topside B 3 ATCA Zone 1 Connector J9 B 5 xiii xiv Sun Netra CP3240 Switch Installation Guide September 2009 Tables TABLE 1 1 TABLE 1 2 TABLE 1 3 TABLE 1 4 TABLE 2 1 TABLE 2 2 TABLE 2 3 TABLE 2 4 TABLE 2 5 TABLE 2 6 TABLE 2 7 TABLE 2 8 TABLE 2 9 TABLE 2 10 TABLE 2 11 TABLE 2 12 TABLE 2 13 TABLE 3 1 TABLE 3 2 Power Requirements 1 2 Airflow Requirements 1 7 ATCA Board Status LEDs 1 15 Hot Swap LED States 1 16 Switch External Ports 2 18 Zone 3 RTM Ports 2 18 Copper RTM External Ports 2 20 Copper RTM Port Restrictions 2 20 Fiber Optic External RTM Ports 2 22 Fiber Optic RTM Port Restrictions 2 22 AMC Ethernet Port Availability 2 27 AMC Site 1 AMC 0 Mid size AMC 2 Type E1 AMC 2 Type 5 Optional LED Module Support 2 27 AMC Site 2 AMC 0 Mid Size AMC 2 Type E1 AMC 2 Type 5
33. P LX SX None SERDES SFP LX SX None 10 100 1000 BaseT RJ 45 10 100 1000 BaseT RJ 45 2 30 Sun Netra CP3240 Switch Installation Guide September 2009 CHAPTER 3 Configuring Jumper Settings This chapter describes jumper settings for configuring the switch Other configuration options are software controlled Software configuration options are described in Chapter 4 This chapter contains the following topics m Section 3 1 Jumper Settings on page 3 2 m Section 3 2 Jumper Locations on page 3 7 3 1 3 1 Jumper Settings The following jumper settings are available for configuring the switch Each of jumper settings is described in the subsections TABLE 3 1 Switch Configuration Jumper Settings Jumper Default Purpose P4 L2 Cross Connect Control P6 1 2 OFF Fabric Zero Reset Configuration Word P6 3 4 OFF Base Zero Reset Configuration Word P8 1 2 OFF Base Write Protect Disable P8 3 4 OFF Fabric Write Protect Disable P9 OFF IPMC Firmware Write P10 1 2 OFF IPMC Disable P10 3 4 OFF IPMC FWE P11 1 2 OFF Forced Board Enable P11 3 4 OFF IPMC Board Reset Disable P12 OFF EMI Ground to Logic Ground P13 OFF Serial Direction 3 1 1 P4 Cross Connect Control This jumper is used to control ShMC cross connect ShMC cross connect is the ability to connect to two ShMCs at 10 100 each rather than use a single 10 100 1000 for a single ShMC The first ShMC port is number 1 on the Base The
34. P one slot Weight 2 12 kg without AMCs Appendix A Environment Specifications A 3 A 4 FIGURE A 1 PCB Dimensions 322 5mm s Ol co mass magie wooo GIE Dos que Sw Sun Netra CP3240 Switch Installation Guide September 2009 APPENDIX B Connectors This appendix describes the switch s connectors you can use to interface to application specific devices B 1 B 1 B 2 Connector Assignments TABLE B 1 Connector Assignments Connector Function J13 Top Serial MGMT Port RJ 45 Base and Fabric J13 2nd 10 100 Ethernet MGMT Port RJ 45 Base and Fabric J13 3rd 10 100 1000 Ethernet Port RJ 45 Base J13 Bottom 10 100 1000 Ethernet Port RJ 45 Base J8 ATCA Zone 3 RTM Connector Top 7 ATCA Zone 3 RTM Connector Middle J6 ATCA Zone 3 RTM Connector Bottom J9 ATCA Zone 1 Connector J5 ATCA Zone 2 P20 ZD Connector J4 ATCA Zone 2 P21 ZD Connector J3 ATCA Zone 2 P22 ZD Connector J2 ATCA Zone 2 P23 ZD Connector jl ATCA Zone 2 P24 ZD Connector Sun Netra CP3240 Switch Installation Guide September 2009 B 2 Connector Locations Topside FIGURE B 1 Connector Locations Topside Appendix B Connectors B 3 TABLE B 2 ATCA Zone 1 Connector J9 Pins Pin Pin Name 1 NC 2 NC 3 NC 4 NC 5 HA 0 6 H
35. RTM Connector Broadcom BCM8726B 2 PHY Broadcom BCM8726B 2 PHY Broadcom BCM5464R 4 PHY 2 unused Broadcom BCM8726B 2 PHY Fabric 10GbE SFP Fabric 10GbE SFP Fabric 10GbE SFP Serial MGMT Chapter 2 Overview 2 21 TABLE 2 5 Fiber Optic External RTM Ports Port Type Fiber Optic RTM Module Logical Port Comments Management 10 100 Base T RJ 45 Not a module 10 100Base T Base 10GBE 10GBase X SFP Base 27 Cannot Support 1G Operation Base 10GBE 10GBase X SFP Base 26 Cannot Support 1G Operation Base 1GBE 1000Base X SFP Base 20 Can Support 1G SFP Copper Base 1GBE 1000Base X SFP Base 21 Can Support 1G SFP Copper Serial RS 232 10GBase X SFP Fabric 17 Can Support 1G SFP Copper Fabric 10GBE 10GBase X SFP Fabric 18 Can Support 1G SFP Copper Fabric 10GBE 10GBase X SFP Fabric 19 Can Support 1G SFP Copper Fabric 10GBE 10GBase X SFP Fabric 20 Can Support 1G SFP Copper Serial RS 232 Serial RS232 RJ 45 Not a module RS232 Serial TABLE 2 6 Note For enabling 1G operation of Fabric ports 17 20 see Section 4 12 Fiber Optic RTM Configuration on page 4 25 Fiber Optic RTM Port Restrictions Port Base Port 20 Base Port 21 Base Port 26 Base Port 27 Fabric Port 17 Fabric Port 18 Fabric Port 19 Fabric Port 20 1G Infrastructure SERDES SERDES None None SERDES SERDES SERDES SERDES 1G Port SFP LX SX SFP LX SX None None SFP LX SX SFP LX SX SFP LX SX SFP LX SX
36. S amp o SUN microsystems Sun Netra CP3240 Switch Installation Guide Sun Microsystems Inc www sun com Part No 820 3251 13 September 2009 Revision A Submit comments about this document at http www sun com hwdocs feedback Copyright 2009 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 U S A All rights reserved Sun Microsystems Inc has intellectual property rights relating to technology embodied in the product that is described in this document In pee and without limitation these intellectual property rights may include one or more of the U S patents listed at ttp www sun com patents and one or more additional patents or pending patent applications in the U S and in other countries This distribution may include materials developed by third parties Parts of the produet may be derived from Berkeley BSD systems licensed from the University of California UNIX is a registered trademark in the U S and in other countries exclusively licensed through X Open Company Ltd Sun Sun Microsystems the Sun logo Solaris Netra and the Netra logo are trademarks or registered trademarks of Sun Microsystems Inc or its subsidiaries in the U S and other countries Products covered by and information contained in this service manual are controlled by U S Export Control laws and may be subject to the export or import laws in other countries Nuclear missile chemical biological weapons or n
37. S 1 0 2 16 2 3 6 2 SSH15and2 0 2 16 2 3 6 3 Additional Management Features 2 16 2 4 Functional Diagrams and Port Maps 2 17 2 4 1 2 4 2 2 4 3 2 4 4 2 4 5 Switch 2 17 Rear Transition Modules RTM s 2 18 2 421 Copper RTM 2 19 2422 Fiber Optic RTM 2 21 Base Fabric Switch Subsystem 2 23 Expansion Fabric Switch Subsystem 2 24 AdvancedMC Sites 2 25 2 4 5 1 AMC Port Maps 2 26 2 4 5 2 AMC Module Support by Site 2 30 2 4 5 3 AMC Port Restrictions for RTMs 2 30 3 Configuring Jumper Settings 3 1 3 1 Jumper Settings 3 2 3 1 1 P4 Cross Connect Control 3 2 Contents vii 3 2 3 1 2 3 1 3 3 1 4 3 1 5 3 1 6 3 1 7 3 1 8 3 1 9 3 1 10 3 1 11 3 1 12 P6 1 2 Fabric Zero Reset Configuration Word 3 3 P6 3 4 Base Zero Reset Configuration Word 3 3 P8 1 2 Base Write Protect 3 3 P8 3 4 Fabric Write Protect 3 4 P9 IPMC Firmware Program 3 4 P10 1 2 IPMC Reset 3 4 P10 3 4 IPMC FWE 3 5 P11 1 2 Forced Board Enable 3 5 P11 3 4 IPMC Board Reset 3 5 P12 1 2 and P12 3 4 EMI Ground to Logic Ground 3 6 P13 Serial Direction 3 6 Jumper Locations 3 7 4 Configuring Switch Software 4 1 4 1 4 2 4 3 4 4 4 5 IPMI Firmware Sensors 4 2 4 1 1 4 1 2 uBoot 4 2 1 4 2 2 4 2 3 Linux 4 3 1 4 3 2 4 3 3 State Sensors 4 2 Threshold Sensors 4 4 4 5 uBoot Console 4 5 E Keying Control in uBoot 4 6 Serial Baud Rate Control in uBoot 4 7 4 7 e Keying 4 7 e Keying Bypass 4 8 ATCA LEDs 4 8 Seri
38. This configuration is very basic and should be updated for your environment The default settings are as follows m every port is in VLAN 1 m every port is configured in switching mode m management interfaces are enabled m spanning tree is enabled on every port m everything else is disabled The settings of the switch can be checked with the show running config command This command shows how the current configuration is different than the default configuration This command can be very useful because the output is in script format This output can be backed up or copied to another switch Port Ordering The ports are ordered the same way as the ATCA channels The ATCA specification allows for backplanes to be routed differently This means that logical slots and physical slots often do not match The switch supports an abstraction layer that allows the port order to be changed This allows vendors to match logical slots and physical slots independent of routing Contact Sun if you would like a non standard port order Sun s port ordering is shown in the following table for shelves with middle hub slots that is slots 7 and 8 TABLE 4 7 Port Order List Shelf Physical Slot Base Port Fabric Port 1 13 12 2 11 10 4 22 Sun Netra CP3240 Switch Installation Guide September 2009 TABLE 4 7 Port Order List Continued o o wu o O I Q 10 11 12 13 14 15 16 ShMC 1 ShMC 2 if cross connect 9o oa N 0 Netr
39. This option boots the Broadcom diag shell currently SDK version 5 4 1 This environment is provided as is with no support Several commands provided in this shell are not supported and will not work This shell is provided mainly for debug testing and diagnostics purposes This shell has many low level tests and low level register access It can be used to check the integrity of particular boards Help is provided in the shell with and commands followed by a single question mark Some commands of interest are TestList and TestRun 4 7 Primary and Backup Flash The switch features hardware flash redundancy If the switch fails to boot from the primary flash for any reason the onboard IPMC will reset the board and attempt to boot out of the backup flash No user interaction is required The switch backup flash comes preprogrammed with default settings You can change what is loaded on the backup flash by using the Copy Primary Flash to Backup Flash command from the utility menu 4 8 4 8 1 Dual Firmware Images The switch supports dual firmware images of the Base and Fabric software While this feature does not provide high availability the hardware redundant flash provides that it does provide a way to store two copies of the firmware on the switch This allows you to switch between firmware as needed Booting the Non Active Image Which image is active can be changed several ways From the boot menu the Activate
40. V Volts 1 156 1 009 0 7546 1 5582 1 754 1 9502 line 18 Base Thresh Base CPU C n a n a n a 60 70 80 CPU Temp Temp 19 RTM Thresh RTM oC n a n a n a 55 65 75 temp Temperatu re 20 Fabric Thresh Fabric C n a n a n a 60 70 80 CPU CPU Temp Temp 21 15V Thresh 1 5V line Volts 1 4014 1 303 1 1074 1 6072 1 7052 1 9012 22 1 8V Thresh 1 8V line Volts 1 656 1 509 1 303 1 9502 2 107 2 303 23 1 0V Thresh 1 0V line Volts 0 902 0 706 0 51 1 1074 1 303 1 509 24 12V Thresh 1 2V line Volts 1 107 1 009 0 804 1 303 1 4014 1 607 25 Site 1 Thresh AMC Slot Amps n a n a n a 5 5 6 023 6 517 Pwr current Cur sense 26 Site 1 Thresh AMC Slot Volts n a n a n a 13 048 13 44 13 608 Pwr 12V 27 Site 1 Thresh AMC Slot Volts n a n a n a 3 456 3 514 3 6 MP Managem ent Pwr 28 Site2 Thresh AMC Slot Amps n a n a n a 5 5 6 023 6 517 Pwr current Cur sense 29 Site 2 Thresh AMC Slot Volts n a n a n a 13 048 13 44 13 608 Pwr 12V 4 4 Sun Netra CP3240 Switch Installation Guide September 2009 TABLE 4 4 IPMI Thresold Sensors Continued Lower Upper Sensor Name Type Description Units Thresholds Thresholds 30 Site 2 Thresh AMC Slot Volts n a n a n a 3 456 3 514 3 6 MP Managem ent Pwr 31 Site3 Thresh AMC Slot Amps n a n a n a 5 5 6 023 6 517 Pwr current Cur sense 32 Site 3 Thresh AMC Slot Volts n a n a n a 13 048 13 44 13 608 Pwr 12V 33 Site 3 Thresh AMC Slot Volts n a n a n a 3 456 3 514 3 6 MP Managem ent Pwr 4 2 uBoot 4 2 1 uBoot is the boot load
41. Zarlink FCLK lOOMHz 1 OOMHz TABLE 2 9 AMC Site 2 AMC 0 Mid Size AMC 2 Type E1 AMC 2 Type 5 Double module support LED Module Support Port Type Connected U GbE Base 3 0 switch ny ort Io usually used for ny ort 2 0 usually used for 3 Any Port 3 of AMC FI usually used for SAS SATA 1 Any Ports 4 7 of AMC 1 usually used for PCIE 5 6 yi 8 IUGbE Fabric 3 1 switch Fa TO TI TZ custom LED board support 13 Not connected 14 Not connected 15 Not connected 17 Any RTM for future use I8 Any RIMforfutureuse I19 Any RIM for future use 20 Any RIM for future use TCLKI CLK IN FPGA amp Zarlink TCLKZ CLK OUT FPGA amp Zarlink TCLK3 CLK IN FPGA amp Zarlink TCLK4 CLK OUT FPGA amp Zarlink FCLK PCIE CLK TOUMHz Sun Netra CP3240 Switch Installation Guide September 2009 TABLE 2 10 AMC Site 3 AMC 0 Mid size AMC 2 Type El Master Clock Generator Support LED Support Port Type Connected 0 GB Base 3 0 switch 1 Any Port 1 of AMC 2 usually used for GB 2 Any Port 2 of AMC 2 usually used for SAS SATA B Any Port 2 of AMC 1 usually used for SAS SATA 4 Not connected p INot connected 6 Not connected 7 Not connected B Not connected D Not connected 10 Not connected 11 Not connected 12 custom LED board support 13 Not connected 14 Not connected 15 An
42. a CP3240 2 4 6 8 10 12 14 15 16 1 17 8 6 4 2 Netra CP3240 1 3 5 7 9 11 13 14 15 none none Note If ports are ordered the same as the ATCA channels Base and Fabric are always one number off So if a board is in slot 6 it is connected to Base channel 3 and Fabric channel 2 Chapter 4 Configuring Switch Software 4 23 4 11 Firmware Updates All of the firmware listed in this section is field upgradeable There is a single update image that supports the Base firmware Fabric firmware and IPMC firmware This update image must be installed twice though once on the Base and once on the Fabric The IPMC update happens during a Base update Each firmware can be updated independently without affecting other firmware for example FASTPATH can be updated without touching uBoot and Linux 4 11 1 Firmware List m IPMC firmware m Base Firmware a uBoot m Linux m FASTPATH m Fabric Firmware a uBoot m Linux m FASTPATH 4 11 2 Firmware Upgrades For up to date instructions on upgrading the firmware packages refer to the following documentation m Netra CP32X0 Product Notes 820 3260 m README files within the download package 4 24 Sun Netra CP3240 Switch Installation Guide September 2009 4 12 4 12 1 4 12 2 4 12 3 Fiber Optic RTM Configuration For the fiber optic RTM XCP3240H RTM OP Z to work correctly switch firmware 1 2 1 0 or newer is required The following se
43. a CP3240 Advanced 820 7263 xx PDF Online Reference Mezzanine Card LED User s Guide Safety Sun Netra CP3x40 Switch Safety 820 3505 xx PDF Online and Compliance Manual The following table lists the documentation that is related to this product The online documentation is available at http docs sun com app docs prod n900 srvr hic xxii Sun Netra CP3240 Switch Installation Guide September 2009 Application Title Part Number Format Location Latest Netra CT 900 Server Product Notes 819 1180 xx PDF Online information Pointer Doc Netra CT 900 Server Getting Started 819 1173 xx Printed Shipping kit Guide Overview Netra CT 900 Server Overview 819 1174 xx PDF Online Installation Netra CT 900 Server Installation 819 1175 xx PDF Online Guide Service Netra CT 900 Server Service Manual 819 1176 xx PDF Online Administration Netra CT 900 Server Administration 819 1177 xx PDF Online and Reference Manual Programming Netra CT 900 Software Developer s 819 1178 xx PDF Online Guide Safety Netra CT 900 Server Safety and 819 1179 xx PDF Online Compliance Guide Setup Netra CT 900 Server Hardware 819 1647 xx PDF Online Setup Guide Safety Important Safety Information for 816 7190 xx Printed Shipping kit Sun Hardware Systems Third Party Web Sites Sun is not responsible for the availability of third party web sites mentioned in this document Sun does not endorse and is not responsible or liable for any content advertising products or o
44. able components This chapter contains the following topics m Section 1 1 System Requirements on page 1 2 m Section 1 2 Unpacking on page 1 4 m Section 1 3 Handling Switches on page 1 4 m Section 1 4 Connectors on page 1 5 m Section 1 5 Jumper Options on page 1 5 m Section 1 6 Switch and RTM Faceplates on page 1 6 m Section 1 7 RTM Airflows on page 1 7 m Section 1 8 Removing and Installing Switches on page 1 10 m Section 1 9 Switch LEDs on page 1 15 1 1 System Requirements The following sections briefly describe the minimum system requirements and the configurable features Links are provided to other chapters and appendices containing more detailed information 1 1 1 Connectivity The switch can work in any AdvancedTCA shelf It is mainly designed to be used as hub blade however it can also operate a node or a full mesh blade 1 1 1 1 Hub Connectivity In AdvancedTCA the hub board defines the system so it is important that it be put in the correct slot In all shelves there are two slots specifically designated for hub boards logical slots 1 and 2 If the slots are not labeled these slots are easily identifiable because they have a larger number of Zone 2 connectors than the other slots the only slots with all five Zone 2 connectors Base is always routed in a dual star This means every node slot has a Base channel routed to each of the hub slots Ind
45. al Select 4 8 Serial Location 4 9 4 5 1 4 5 2 Changing Serial Location from UBoot 4 9 Changing Serial Location from FASTPATH 4 9 viii Sun Netra CP3240 Switch Installation Guide September 2009 4 6 4 7 4 8 4 9 4 10 4 11 Boot Sequence 4 10 4 6 1 Boot Utility Menu 4 11 4 6 1 1 Load Code Update Package using TFTP FTP 4 12 4 6 1 2 Erase Current Configuration 4 12 4 6 1 3 Erase Permanent Storage 4 12 4 6 1 4 Select Boot Method 4 12 4 6 1 5 Start Diagnostic Application 4 13 Primary and Backup Flash 4 13 Dual Firmware Images 4 13 4 8 1 Booting the Non Active Image 4 13 48 2 Updating the Non Active Image 4 14 4 8 3 Fabric 1G 10G Auto negotiation 4 14 Network Boot 4 14 FASTPATH 4 18 4 10 1 Management Options 4 18 4 10 1 1 CLI 4 18 4 10 2 Basic CLI Commands 4 19 410 3 Logins and Prompts 4 20 4 10 3 1 CLI Defaults 4 20 4 10 3 2 Web Interface Defaults 4 20 4 10 3 3 SNMP Defaults 4 21 4 10 4 Secure Remote Access 4 21 410 41 SSH and SSL TLS Keys 4 21 410 42 Enabling SSH and SSL 4 21 4 10 5 Default Settings 4 22 4 10 6 Port Ordering 4 22 Firmware Updates 4 24 411 1 Firmware List 4 24 Contents ix 4 12 4 11 2 Firmware Upgrades 4 24 Fiber Optic RTM Configuration 4 25 4121 Module Support 4 25 4 12 2 Backplane Ports Versus RTM Optical Ports 4 25 412 3 10G Configuration for RTM Optical Port 4 25 4124 1G Configuration for RTM Optical Port 4 26 A Environment Specifications A 1 A l A 2 A 3 Electrical and Enviro
46. ate Package using TFTP FTP FASTPATH can be updated from within FASTPATH itself but it can also be updated from this menu m The update image must be on a TFTP server or FTP server m The server must be on the same network as the out of band management port m You need to have the IP of the server the desired IP of the board being updated the gateway if needed and the file name Note DHCP can be used to obtain an IP for the switch during this update Enter dhcp as the IP address This entry begins the update and provides status information as it is updating Erase Current Configuration This is the same as clear config from within FASTPATH This option can be used if the switch is in an unknown state and restoring the default settings is desired Erase Permanent Storage This command completely erases FASTPATH any log files and any configurations It does not erase uBoot or Linux Use of this command is never recommended Updates can safely be installed without running this option and configurations and log files are preserved Select Boot Method The switch supports three boot methods m from the local image on the flash m from an image over the network m from an image over the serial port The default option is booting from the flash See Section 4 9 Network Boot on page 4 14 for more information Sun Netra CP3240 Switch Installation Guide September 2009 4 6 1 5 Start Diagnostic Application
47. bend easily m Be careful of small parts located on the component side of a switch m Do not use an oscilloscope probe on the components The soldered pins are easily damaged or shorted by the probe point m Transport a switch in an antistatic bag Sun Netra CP3240 Switch Installation Guide September 2009 Caution The heat sinks on a switch can be damaged by incorrect handling Do not touch the heat sinks while installing or removing a switch Hold a switch only by the edges If a heat sink is loose or broken obtain a replacement switch Caution The heat sinks on a switch can be damaged by improper packaging When storing or shipping a switch ensure that the heat sinks have sufficient protection gt gt 1 4 Connectors The switch includes several connectors to interface to application specific devices Refer to the Chapter B for complete connector descriptions and pin outs 1 5 Jumper Options The switch provides several jumper configuration options for features Location figures and descriptions are provided in Chapter 3 Chapter 1 Getting Started 1 5 1 6 Switch and RTM Faceplates The following shows the Sun Netra CP3240 switch and the copper RTM XCP3240H RTM CU Z and the fiber optic RTM XCP3240H RTM OP Z FIGURE 1 1 Switch and RTM Faceplates Copper RTM Fiber Optic j RTM amp Switch a Faceplate yd i 28px Gps n e Bea u 1 6 Sun N
48. ber 2009 2 3 1 1 2 3 1 2 Additional Layer 2 Functionality Broadcast Multicast Unknown Unicast storm recovery Double VLAN vMAN tagging DHCP filtering Jumbo Ethernet frames Many to one port mirroring Tx Rx both Static MAC filtering MAC based VLANs IP subnet based VLANs Port description Protected ports Network and host DoS attack suppression System Facilities Event and Error Logging Facility Run time and configuration download capability PING utility XMODEM RFC 768 UDP RFC 783 TFTP RFC 791 IP RFC 792 ICMP RFC 793 TCP REC 951 BootP RFC 1321 Message Digest Algorithm RFC 1534 Interoperation between BootP and DHCP RFC 2030 Simple Network Time Protocol SNTP V4 for IPv4 IPv6 and OSI RFC 2131 DHCP client server RFC 2132 DHCP options and BootP vendor extensions RFC 2865 RADIUS client RFC 2866 RADIUS accounting RFC 2868 RADIUS attributes for Tunnel protocol support RFC 2869 RADIUS extensions rfc2869bis RADIUS support for Extensible Authentication Protocol EAP Chapter 2 Overview 2 9 REC 3164 BSD Syslog protocol REC 3396 Encoding long options in the Dynamic Host Configuration Protocol DHCPv4 RFC 3580 802 1X RADIUS usage guidelines 2 3 1 3 Switching MIBs RFC 1213 MIB II RFC 1493 Bridge MIB RFC 1643 Ethernet like MIB RFC 2233 The Interfaces Group MIB using SMI v2 RFC 2618 RADIUS authentication client MIB RFC 2620 RA
49. ctional Diagrams and Port Maps on page 2 17 2 1 Zi Zib 1 2 2 Features Part of Sun s ATCA platform the Sun Netra CP3240 switch complies with PICMG 3 0 R2 0 ECN002 and PCIMG 3 1 Option 1 and Option 9 The Sun Netra CP3240 switch implements two separate switched networks on a single PCB By separating the Base and Fabric networks the Sun Netra CP3240 switch provides a separate control plane and data plane It provides 1Gigabyte Ethernet switching on the 3 0 Base Fabric and the 3 1 Expansion Fabric provides 1Gigabyte 10Gigabyte Ethernet switching Both of these networks are fully managed with the robust FASTPATH management suite Both networks support Layer 2 switching as well as Layer 3 routing The Sun Netra CP3240 switch can host three AdvancedMC mid size modules A variety of different AMC types can be used including AMC 1 AMC 2 and AMC 3 Netra CP3240 switch supports connectivity to three AMCs and to RTMs with multiple 10Gigabyte Ethernet links The XCP3240H RTM CU Z copper and XCP3240H RTM OP Z fiber optic are Sun s RTMs that are paired with the Sun Netra CP3240 switch The following sections briefly outline the features of the Sun Netra CP3240 switch General m PICMG 3 0 AdvancedTCA form factor m PICMG 3 0 R2 0 ECNOO2 compliant m PICMG 3 0 compliant 10 100 1000Base T Ethernet Base Fabric hub board m PICMG 3 1 Option 1 1000Base BX and Option 9 10GBase BX4 compliant Ethernet Expansion Fabric hub board
50. ctions describe support and requirements for configuring the RTM Module Support The Fiber Optic RTM was designed to work with any standard compliant SFP or SFP module Backplane Ports Versus RIM Optical Ports The Sun Netra CP3240 switch s backplane ports are capable of auto negotiating between 1G and 10G speeds without any user input However the RTM optical ports must be explicitly configured without auto negotiation for 1G operation This requirement is due to the underlying technology used in 10G interfaces 10G Configuration for RTM Optical Port For 10G operation an SFP module must be used and the port must be set to no auto negotiate For all 10G RTM ports no auto negotiate is the default setting CODE EXAMPLE 4 6 Enabling 10G Operation on RTM Optical Ports configure interface lt 0 xx gt no auto negotiate exit exit where lt 0 xx gt is the port number of the RTM on Fabric Valid entries are 0 17 0 18 0 19 and 0 20 For each port on the RTM enter the command Chapter 4 Configuring Switch Software 4 25 4 12 4 1G Configuration for RTM Optical Port For 1G operation an SFP module must be used and the port 17 20 must be set to auto negotiate When you enable auto negotiation 1G operation is automatically enabled and 10G operation is automatically disabled For all 10G RTM optical ports no auto negotiate is the default setting Therefore 1G operation must be explicitly enabled Note tha
51. e privilege privilege privilege privilege privilege privilege privilege privilege privilege privilege privilege privilege privilege vlan privilege Chapter 4 Configuring Switch Software 4 19 TABLE 4 6 Basic CLI Commands Continued interface 0 x Switch to interface mode You must be in configure interface mode to change most port specific settings vlan participation include x Add interface to VLAN x interface vlan pvid x Change interface s pvid to VLAN x interface 410 3 Logins and Prompts FASTPATH supports multiple users with different security levels By default there is one admin user with no password In the CLI privilege mode is password protected separately from the default mode but also has a default of no password 4 10 3 1 CLI Defaults A CLI is provided on the serial console telnet console and SSH console The serial console is always enabled The telnet console is enabled by default SSH is disabled by default Username admin Password gt enable Password The prompts always show the current mode Here are a few examples default mode privilege mode configure mode interface 0 2 interface 0 2 mode 4 10 3 2 Web Interface Defaults The username and password are the same as the CLI The web interface is enabled by default Java is enabled by default HTTPS is disabled by default 4 20 Sun Netra CP3240 Switch Installation Guide
52. ed by the software TABLE 3 13 P13 Serial Direction Jumper Settings P13 Default Function OFF Default Software control of serial direction 1 2 Front serial port active RTM serial port disabled 3 4 Front serial port disabled RTM serial port active 3 6 Sun Netra CP3240 Switch Installation Guide September 2009 OZ Jumper Locations FIGURE 3 1 shows the locations of the jumper settings FIGURE 3 1 Switch Jumper Locations mi FAE Oo Chapter 3 Configuring Jumper Settings 3 7 3 8 Sun Netra CP3240 Switch Installation Guide September 2009 CHAPTER 4 Configuring Switch Software This chapter describes how to configure the switch software The switch incorporates four main software components IPMI firmware which runs on a separate microcontroller uBoot loads the boot for the system It can be compared to a BIOS on a node board Operating system OS which uses Monta Vista 3 1 Pro based on the 2 4 20 Linux kernel LVL7 Systems FASTPATH software which provides all of the management and control features of the switch The IPMI firmware uBoot and OS are covered in this chapter FASTPATH is described however for detailed information and command syntax refer to the Netra CP3240 Switch Command Reference Manual 820 3253 This chapter contains the following topics Section 4 1 IPMI Firmware Sensors on page 4 2 Section 4 2 uBoot on page 4 5 Section 4 3 Linux on
53. ed features presented to the user via the FASTPATH software See Section 4 10 FASTPATH on page 4 18 for more information Broadcom BCM5464R and BCM5461S 10 100 1000Base T Ethernet PHY Quad and single ports respectively the Broadcom PHYs provide the physical interfacing for 10 100 1000Base T They are low power devices and provide features such as jumbo frames support auto MDIX and cable testing Sun Netra CP3240 Switch Installation Guide September 2009 224 2 2 0 Freescale PowerOUICC II MPC8247 Communications Processor The Freescale MPC8247 is a microprocessor designed for maximum flexibility It features a dual core architecture with a PPC G2 LE core and a RISC core controlling the peripherals Running at 400MHz with only 1 watt of power the MPC8247 provides high performance with incredibly low power consumption Paired with the 256MB PC100 SDRAM and 64MB flash the CPU subsystem of the Sun Netra CP3240 switch is more than enough to handle the switching application and future upgrades Pigeon Point BMR H85 AMCc Advanced TCA IPMI Subsystem The Sun Netra CP3240 switch uses the near industry standard Pigeon Point Systems BMR H8S AMCc for dedicated IPMI management It controls all interaction between the Sun Netra CP3240 switch and the shelf management controller It fully supports the PICMG 3 0 R2 0 ECN002 and the AMC 0 R2 0 specifications The BMC H8S AMCc provides all required management for the AMC modules in addition
54. eded to install and make the Sun Netra CP3240 switch operational Chapter 2 introduces the key features of the switch This chapter includes a product definition a list of product features and a functional block diagram with a brief description of each block This chapter can be used to compare the features of the switch against the needs of a specific application Chapter 3 describes the jumper settings on the switch This chapter details factory default settings and provides information about tailoring the board to the needs of specific applications Chapter 4 describes the software packages running on the switch This section serves as a primer for using the software on the switch Appendix A contains the electrical environmental and mechanical specifications for the switch Appendix B This appendix provides a connector location illustration and connector pin out tables A detailed description and pin out for each connector is given Appendix C provides links to websites with information about many of the devices and technologies used in the switch Appendix D presents UL CE and FCC agency approval and certification information for the switch Sun Netra CP3240 Switch Installation Guide September 2009 Typographic Conventions Typeface Meaning Examples AaBbCc123 The names of commands files and directories on screen computer output AaBbCc123 What you type when contrasted with on screen computer output
55. ependent of how the Fabric is used a hub board is always needed for Base If full mesh node boards are used in a full mesh shelf a hub board is not needed for Fabric 1 1 2 Electrical and Environmental The switch has the following power requirements TABLE 1 1 Power Requirements State Power in Watts W Idle no AMCs 45W All ports linked with RTM no AMCs 72W All ports linked with RTM heavy traffic no AMCs 78W Designed max power with 15W RTM and 100W 200W shared for all AMC sites 1 2 Sun Netra CP3240 Switch Installation Guide September 2009 gt The 48VDC has a tolerance of OVDC to 75VDC without damage The switch will operate when 48VDC is 36VDC to 72VDC inclusive Caution Any input voltage outside the range of OVDC to 75VDC can damage the switch The switch requires air flow A minimum of 100 LFM should be kept on the board at all times If an RTM is being used active RTM cooling is not required Caution None of the integrated chips junction temperature should exceed 125 C The switch requires air flow to meet this requirement Testing should be done in your shelf to find the quantity of air flow needed 100 LFM is the recommended minimum quantity of air flow The switch might contain materials that require regulation upon disposal Please dispose of this product in accordance with local rules and regulations For disposal or recycling information please contact your local authorities or the
56. er Much like a BIOS it brings the system to a usable state for the operating system OS to boot It also performs a POST of the CPU subsystem It can be used as a recovery console if the firmware image becomes corrupt or a firmware update fails Several important environment variables are stored in uBoot only some of which should ever be changed namely noekey and baudrate uBoot Console To get to a uBoot console you must prevent the switch from booting into the OS Shown here is an example of the start of a boot sequence CPU 400 MHz DRAM 256 MB FLASH 64 MB Base Primary Flash JFFS2 loading imagel to 0x400000 Scanning JFFS2 FS done JFFS2 load complete 10026940 bytes loaded to 0x400000 Booting Loading Ramdisk to 0fdf6000 end 0ff8d551 OK Press any key before JFFS2 loading imagel to 0x400000 appears Chapter4 Configuring Switch Software 4 5 4 2 2 4 6 There is only a one second delay to press a key When the uBoot prompt is displayed you can then enter any of the following commands TABLE 4 5 uBoot Console Commands Command Result print or Shows the current environment variables printenv set Followed by an environment variable this command changes the lt variable gt environment variable or setenv save or Writes the variables to flash You must save the changes if you want them saveenv to persist through a reset E Keying Control in uBoot See the Section
57. etra CP3240 Switch Installation Guide September 2009 1 6 1 1 6 2 1 6 3 Base 10 100 1000 Uplink Ports RJ 45 There are two front panel Base 10 100 1000Base T Ethernet uplink ports on the faceplate They are ports number 18 and 19 on the Base network 10 100 Management Port RJ 45 There is a 10 100 management Ethernet port on the faceplate This port can be used to manage the Base and Fabric This port and the 10 100 management port on the RTM can be used at the same time Serial Management Port RJ 45 There is a RS 232 serial management port on the faceplate This port can be used to manage the Base and Fabric See Section 4 4 Serial Select on page 4 8 for information about how to switch between managing the Base and the Fabric 1 7 RTM Airflows 1 7 1 RTM Airflow Requirements The following chart provides the RTM airflow requirements No alarms are triggered at any of the listed temperatures for the given airflow TABLE 1 2 Airflow Requirements Watts m min CFM Power Level 25 C 28 C 40 C 55 C 25 C 28 C 40 C 55 C 25 0 07 0 07 0 14 0 14 2 5 2 5 5 5 Chapter 1 Getting Started 1 7 172 RTM Pressure Drop Versus Airflows Impedence Curves The following graphs plot the impedance curves for the RTMs per PICMG 3 0 requirements FIGURE 1 2 Netra CP3240H RTM CU Airflow Pa Fa eo P 20 1 8 Sun Netra CP3240 Switch Installation Guide September 2
58. g show running config copy system running config nvram startup config serviceport protocol dhcp serviceport protocol none serviceport ip lt ip gt lt netmask gt lt gateway gt network parms lt ip gt lt netmask gt lt gateway gt show network show serviceport serial baudrate vlan database vlan x exit configure Function Switch to privilege mode You must be in enabled mode for most options Show status of the ports Show detailed statistics on port 0 x Clear all statistics Restore the default configuration Show the current configuration of the switch This command shows everything that is not set to the default value The output is a script that can be copied to a file for later use or for another switch Save the current configuration though a reboot Use DHCP on the out of band port Only one of the serviceport and network can use DHCP To enable DHCP on one you must disable it on the other The same command works for network Use user assigned IP NOTE the same command works for network Force an IP for serviceport Force an IP for network View the in band management settings View the out of band management settings Change the serial baudrate Switch to vlan database mode Create and delete VLANs here Create a VLAN with number x Return to one mode higher Switch to configure mode You must be in configure mode to change most settings Mode default privileg
59. ifferent technologies defined by AdvancedTCA sub specifications The Sun Netra CP3240 switch is designed to comply with PICMG 3 1 Ethernet Fibre Channel for AdvancedTCA Systems options 1 and option 9 That means the Sun Netra CP3240 switch provides a single 1 10Gigabyte port to each node board The Fabric uses 10GBase BX4 Ethernet to provide connectivity between boards though the backplane The Fabric can scale down to 1Gigabyte and work with 1000Base BX boards The Fabric subsystem is based around two main components the Broadcom BCM56800 and the Freescale MPC8247 2 24 Sun Netra CP3240 Switch Installation Guide September 2009 2 4 5 AdvancedMC Sites PICMG AdvancedMC AMC 0 defines hot swappable daughter cards to be used in PICMG architectures The Sun Netra CP3240 switch supports three AMC sites so that the functionality of the Sun Netra CP3240 switch can be expanded AMC 2 Ethernet AMCs are supported with direct connections to the Base and Fabric subsystems Other types of AMCs such as AMC 1 PCI Express or AMC 3 SAS SATA can be used as well Nearly any type of AMC can be supported because the Sun Netra CP3240 switch connects the AMCs sites directly together on certain ports Chapter2 Overview 2 25 2 4 5 1 AMC Port Maps FIGURE 2 6 AMC Port Map Diagram AMC Site 1 Port 0 1GbE Port 1 Port 2 Port3 Port 4 7 Port 8 11 Port 12 Port 13 14 Port 15 Port 17 20 AMC Site 2 Port 0 1GbE Port 1 Port2 Port3
60. igned to meet section 4 m Telcordia GR 1089 CORE Safety for Network Telecommunication Equipment Issue 4 Jun 2006 meets Section 7 D 2 Sun Netra CP3240 Switch Installation Guide September 2009 D 4 D 4 1 D 4 2 Emissions Test Regulations FCC Part 15 Subpart B Class A Commercial Equipment Industry Canada ICES 003 Class A Commercial Equipment CISPR 22 EN 55022 1998 Class A Radiated Power line Conducted Telcordia GR 1089 CORE EMC For Network Telecommunication Equipment Issue 4 Jun 2006 Designed to meet Sections 2 and 3 EN 50081 1 Emissions Telcordia GR 1089 CORE EMC For Network Telecommunication Equipment Issue 4 Jun 2006 designed to meet 3 2 EN55022 1998 Limits and Methods of Measurement of Radio Interference A1 2000 A2 2003 Characteristics of Information Technology Equipment IEC CISPR22 2003 Limits and Methods of Measurement of Radio Interference Characteristics of Information Technology Equipment IEC CISPR 16 1 1999 Specification for radio disturbance and immunity measuring apparatus and methods Part 1 Radio disturbance and immunity measuring apparatus IEC CISPR 16 2 1999 Specification for radio disturbance and immunity measuring apparatus and methods Part 2 Methods of measurement of disturbances and immunity AS NZS CISPR 22 2004 Limits and Methods of Measurement of Radio Disturbance Characteristics of Information Technology Equipment EN 55024 Immunity Telcordia GR 1089 CORE EMC For Network Teleco
61. indicates FASTPATH signal has loaded 15 Fabric Early State Fabric firmware Asserted indicates Uboot signal prompt 16 Fabric Full State Fabric firmware Asserted indicates Linux has signal booted 17 Fabric Good State Fabric firmware Asserted indicates FASTPATH signal 4 2 Sun Netra CP3240 Switch Installation Guide September 2009 has loaded These sensors represent the software state of the switch The following tables lists the logic that drives these sensors TABLE 4 3 IPMI Sensor Logic State Timeout Failover Condition Early Full Good Initial power on state 5 sec Uboot corrupted or 0 0 1 erased uBoot initial state 5 sec Uboot finds no 0 0 0 image uBoot console n a Failover timer stops 1 0 0 Linux booted 90 sec Soft off now occurs 0 1 0 Linux boot menu n a Failover timer stops 1 1 0 user interruption FASTPATH booted 90 sec Timer stops if this 0 1 1 state is reached in time Critical code update n a An update is in 1 1 1 progress the failover time stops Chapter 4 Configuring Switch Software 4 3 4 1 2 Threshold Sensors TABLE 4 4 IPMI Thresold Sensors Lower Upper Sensor Name Type Description Units Thresholds Thresholds Minor Major Critical Minor Major Critical 7 12 0V Thresh 12V Volts 11 016 10 21 9 02 13 45 13 72 13 77 main power 8 3 3V Thresh 3 3V line Volts 3 126 3 02 2 914 3 563 3 654 3 805 9 2 5V Thresh 2 5V line Volts 2 308 2 202 2 106 2 701 2 808 2 904 10 1 25V Thresh 1 25
62. ing the handles outward until the board disengages from the midplane 6 Slide the board evenly out of the enclosure 7 Determine if you are going to replace the rear transition module m If you are going to replace the rear transition module go to Removing a Rear Transition Module for a Switch on page 1 13 m If you are not going to replace the rear transition module you must install a replacement switch or a filler panel to maintain the enclosures shielding and cooling performance Refer to Section 1 8 2 2 Installing a Switch on page 1 14 1 12 Sun Netra CP3240 Switch Installation Guide September 2009 1 8 1 2 Note As long as the switch is removed from the slot and the system is running with only the single remaining switch you do not have redundancy for that component Both switches must be installed and running to have redundancy for that component Removing a Rear Transition Module for a Switch Remove the switch from the front of the server if you have not already done so Refer to Removing a Switch From the Front of the Server on page 1 11 for those instructions Do not remove the rear transition module until you have first removed the switch Note Opening the handle on the RTM shuts down both the RTM and the switch Disconnect any cables connected to the rear transition module for the switch Loosen any retention screws that fasten the module to the enclosure Open the ejector
63. ings A 2 Board Dimensions and Weight A 3 Connector Assignments B 2 ATCA Zone 1 Connector J9 Pins B 4 ATCA Zone 2 P20 ZD Connector J5 B 5 ATCA Zone 2 P21 ZD Connector J4 B 6 B 6 ATCA Zone 2 P23 ZD Connector J2 B 7 ATCA Zone 2 P22 ZD Connector J3 ATCA Zone 2 P24 ZD Connector J1 B 8 Serial RJ 45 Connector J13 Top B 8 Minimum Serial Cable Pinouts B 9 xvi Sun Netra CP3240 Switch Installation Guide September 2009 TABLE B 10 TABLE B 11 TABLE B 12 TABLE B 13 TABLE B 14 10 100 1000Base T RJ 45 Connector J13 3rd and Bottom B 10 10 100Base TX RJ 45 Connector J13 2nd B 10 ATCA Zone 3 RTM Connector J8 Top B 11 ATCA Zone 3 RTM Connector J7 Middle B 11 ATCA Zone 3 RTM Connector J6 Bottom B 12 Tables xvii xviii Sun Netra CP3240 Switch Installation Guide September 2009 Preface The Sun Netra CP3240 Switch Installation Guide describes the installation and configuration of the Sun Netra CP3240 switch This guide also includes information about software environment specifications connectors and certifications Before You Read This Document Obtain and read the following documents m Sun Netra CP3x40 Switch Safety and Compliance Manual 820 3505 m Sun Netra CP3240 Switch Product Notes 820 3260 xix XX How This Document Is Organized Chapter 1 provides unpacking instructions and initial setup information for the switch It provides information and procedures ne
64. l m HTML 4 0 Specification December 1997 m Java and Java Script 1 3 2 3 6 3 Additional Management Features m Industry Standard CLI with the following features Scripting capability m Command completion m Context sensitive help m User password encryption m Multi session Telnet server m TACACS m Dual firmware image support 2 16 Sun Netra CP3240 Switch Installation Guide September 2009 2 4 Functional Diagrams and Port Maps 2 4 1 Switch FIGURE 2 1 Switch Functional Block Diagram RTM AMC Site 1 ee 1GbE to Base Redund Ports 4 7 to AMC Site 2 32MB FLASH in SAS SATA between AMCs Fabric 4 10GbE Freescale AMC IO MPC8247 AMC Site 2 400MHz CPU 1GbE to Base Fabric 10GbE to Fabric 15 10GbE Ports 4 7 to AMC Site 1 Broadcom BCM56800 20 10GbE Switch 1GbE to Base Port 15 to update channel Upda SAS SATA between AMCs y aen 10G Sync Broadcom BCM5464R Base 4 PHY 16 1G Broadcom amp 1100M BCM56503 Broadcom 24 1GbE a 3 10GbE Switch Hr PR MP C8247 400MHz CPU Broadcom BCM5464R Serial 4 PHY MGMT Broadcom Broadcom Broadcom BCM5464R BCM5461S BCM5464R 10 100 MGMT 4 PHY 1 PHY 4 PHY 1GbE RJ45 1GbE RJ45 Chapter2 Overview 2 17 TABLE 2 1 Switch External Ports Front Panel Port Type Fiber Optic AMC Module _ Logical Port Comments RJ 45 1 Serial RS 232 RS 232 RJ 45 RJ 45 2 Management 10 100 Base T RJ 45 RJ 45 3 Base 1GBE 10 100 1000Base T RJ 45 Base 18 Standard I F i
65. ment to Flash Un Protected 1 sectors Erasing Flash done Erased 1 sectors Writing to Flash done Protected 1 sectors gt boot Changing Serial Location from FASTPATH In this example the serial port direction is changed to the RTM Note that the change is instantaneous and lasts though a reboot CODE EXAMPLE 4 2 Serial Port Change from FASTPATH configure lineconfig serial location rtm set location to front for the front panel Chapter 4 Configuring Switch Software 4 9 4 6 4 10 Boot Sequence The following is an example of a boot sequence CODE EXAMPLE 4 3 Boot Sequence Example CPU 400 MHz DRAM 256 MB FLASH 64 MB Base Primary Flash JFFS2 loading imagel to 0x400000 Scanning JFFS2 FS done JFFS2 load complete 10026500 bytes loaded to 0x400000 Booting Loading Ramdisk to 0fdf6000 end 0ff8d4c2 OK Mounting dev mtdblock2 at mnt fastpath done Mounting tmpfs at mnt application done KAKKAKAKKAKAKAKAKAKAKAKAKAKAKAKAAKAAKAAKAKAKAAKAAKAAKAAKAAKAAKAAKAAKAAKAAKAAKAKAKAAKAAKAAKAAKALAKALAKAAKAAA kkk Use the key above the TAB to switch between BASE and FABRIC kkxkxkxkxkxkxkxkxkxkkxkkkkkkxkkkkkkkkkkkkkkkkkkxkkkkkkkkkkkkkkkkkkkkkkkkkkxkxkxk kkk switch Base Primary Flash imagel Select startup mode If no selection is made within 5 seconds the Application will start automatically Main Menu 1 Start Switch Application 2 Dis
66. mmunication Equipment Issue 4 Jun 2006 Sections 2 1 ESD designed to meet 2 2 EFT 3 3 EN 55024 1998 Information Technology Equipment Immunity A1 2001 A2 2003 characteristics limits and methods of measurements EN 300 386 2002 Electromagnetic compatibility and Radio spectrum Matters ERM Telecommunication network equipment EMC requirements IEC 61000 4 2 2001 EMC Part 4 Testing and measurement techniques Section 4 2 Electrostatic discharge immunity test Basic EMC Publication 8KV contact and 15KV air discharge Appendix D Agency Certifications D 3 m IEC 61000 4 3 2003 EMC Part 4 Testing and measurement techniques Section 3 Radiated radio frequency electromagnetic field immunity test m IEC 61000 4 4 2004 EMC Part 4 Testing and measurement techniques Section 4 Electrical fast transient burst immunity test Basic EMC Publication m IEC 61000 4 5 2001 EMC Part 4 Testing and measurement techniques Section 5 Surge immunity test m IEC 61000 4 6 1996 EMC Part 4 Testing and measurement techniques Section 6 A1 2001 Immunity to conducted disturbances induced by radio frequency fields D 5 D 5 1 D 4 Regulatory Information Caution If you make any modification to the switch not expressly approved by Sun you could void your warranty and or regulatory authority to operate the component D 4 1FCC USA This product has been tested and found to comply with the limits for a Clas
67. nal operating voltage 36 VDC to 72VDC Operating temperatures e 60m below sea level up to 1800m above sea level 5 to 55 Celsius from 1800m up to 4000m above sea level 5 to 40 C Operating humidity lt 85 at 40 Celsius Idle power consumption without links 45W Maximum power consumption with 15W RTM and 100W no AMCs Maximum power consumption with 15W RTM and 200W 100W shared for all AMC sites The MTBF will be significantly reduced if operated above 45 C for more than 96 consecutive hours The MTBF will be significantly reduced if operated above 30 C for more than 96 consecutive hours A 2 Sun Netra CP3240 Switch Installation Guide September 2009 A 2Reliability Reliability prediction was done using Issue 6 Method I Case 3 of the Bellcore Industrial Reliability program The prediction assumed 25 operating temperature with 100 duty cycle in a ground benign controlled environment a MTBF 122 173 hours m 2 year limited warranty A 3 A 3 1 Mechanical This section includes the mechanical specifications for dimensions and weight Board Dimensions and Weight The switch meets the PICMG 3 0 AdvancedTCA Specification R2 0 ECN002 and AMC 0 R2 0 for all mechanical parameters Mechanical dimensions are shown in the illustration and are outlined in the following table TABLE A 3 Board Dimensions and Weight Item Dimensions or Weight PCB 280mmx 322 5mm x2 4mm Board 8U x 6H
68. nmental A 2 A 1 1 Absolute Maximum Ratings A 2 A 1 2 Normal Operating Ranges A 2 Reliability A 3 Mechanical A 3 A 3 1 Board Dimensions and Weight A 3 B Connectors B 1 B 1 B 2 B 3 B 4 B 5 B 6 B 7 B 8 B 9 B 10 B 11 B 12 B 13 Connector Assignments B 2 Connector Locations Topside B 3 ATCA Zone 2 P20 ZD Connector J5 ATCA Zone 2 P21 ZD Connector J4 BO B 6 ATCA Zone 2 P22 ZD Connector J3 B 6 ATCA Zone 2 P23 ZD Connector J2 ATCA Zone 2 P24 ZD Connector J1 B 7 B 8 Serial RJ 45 Connector J13 Top B 8 Serial Cable B 9 10 100 1000Base T RJ 45 Connector J13 3rd J13 Bottom B 10 10 100Base TX RJ 45 Connector J13 2nd B 10 ATCA Zone 3 RTM Connector Top J8 B 11 ATCA Zone 3 RTM Connector J7 Middle B 11 x Sun Netra CP3240 Switch Installation Guide September 2009 B 14 ATCA Zone 3 RTM Connector J6 Bottom B 12 Datasheet Reference C 1 Agency Certifications D 1 D 1 CE Certification D 1 D2 NEBS ETSI D 1 D3 Safety D 2 D 4 Emissions Test Regulations D 3 D 4 1 EN 50081 1 Emissions D 3 D 4 2 EN 55024 Immunity D 3 D 5 Regulatory Information D 4 D 5 1 D 41FCC USA D 4 D 5 2 Industry Canada Canada D 5 Index Index 1 Contents xi xii Sun Netra CP3240 Switch Installation Guide September 2009 Figures FIGURE 1 1 FIGURE 1 2 FIGURE 1 3 FIGURE 1 4 FIGURE 1 5 FIGURE 1 6 FIGURE 1 7 FIGURE 2 1 FIGURE 2 2 FIGURE 2 3 FIGURE 2 4 FIGURE 2 5 FIGURE 2 6 FIGURE 3 1 FIGURE A 1 FI
69. ns can be purchased from the PCI Industrial Computer Manufacturers Group PICMG for a nominal fee http www picmg org C 1 Broadcom Datasheets A non disclosure agreement NDA with Broadcom is required to view their datasheets Contact Broadcom for more information http www broadcom com MPC 272 PowerQUICC II Family Reference Manual This and other Freescale documents about the MPC8247 are available at http www freescale com webapp sps site prod summary jsp code MPC8247 IETF RFCs The IETF makes all RFCs freely available on their website http www ietf org C 2 Sun Netra CP3240 Switch Installation Guide September 2009 APPENDIX D Agency Certifications This appendix lists standards agencies and the certifications related to the switch D 1 CE Certification The Sun Netra CP3240 switch and RTM meets the intent of Directive 89 336 EEC for Electromagnetic Compatibility EN55024 1998 EN55022 1998 and Low Voltage Directive 73 23 EEC for Product Safety EN60950 2000 A certificate of incorporation is available upon request The final system configuration must be reconsidered as a whole per these directives D 2 NEBS ETSI The Sun Netra CP3240 switch and RTM has been designed to meet or exceed m Telcordia specification FR 2063 Issue 2 Dec 2002 Network Building Requirements a Telcordia GR 63 Issue 3 March 2006 Network Eguipment Building System NEBS Requirements Physical Protection Telc
70. ns must be met for this LED to be on 4 4 4 8 Serial Select A single serial port is provided to control both CPUs The key usually in the upper left key on the keyboard and the same key as can be used to switch between controlling the Base 3 0 and the Fabric 3 1 The key works in uBoot Linux the BCM debug shell and FASTPATH When you switch between Base and Fabric Base or Fabric is printed to the console so that you know which one you are currently controlling switch Base and then ENTER is pressed here switch Base Fabric and then ENTER is pressed here switch Fabric Base switch Base User Sun Netra CP3240 Switch Installation Guide September 2009 4 5 4 5 1 4 5 2 Serial Location The switch supports running its serial port to both the front panel and the RTM It does not support both the front panel and RTM at the same time You must configure the port to go to the location needed By default the port is routed to the front panel Changing Serial Location from UBoot In this example the serial port direction is to the RTM CODE EXAMPLE 4 1 Serial Port Change from uBoot CPU 400 MHZ DRAM 256 MB FLASH 64 MB Base Primary Flash Use the key above the TAB key to switch between BASE and FABRIC Break UBoot by pressing a key when the switch boots gt set console rtm set console to front for the front panel gt save Saving Environ
71. ompletely transparent to the user e Keying e Keying is implemented as a Linux driver The CPUs for both Base and Fabric have a direct connection to the IPMI controller which is used to communicate e Keying messages The CPU is interrupted when an e Keying event occurs The driver handles these interrupts and disables ports based on the information it receives This disables the port at the PHY level e Keying can be ignored by creating a uBoot environment variable as described in the Section 4 2 2 E Keying Control in uBoot on page 4 6 Chapter 4 Configuring Switch Software 4 7 4 3 2 4 3 3 e Keying Bypass e Keying can be ignored by creating a uBoot environment variable as described in Section 4 2 2 E Keying Control in uBoot on page 4 6 When e Keying is bypassed ports are no longer enabled or disabled based on the e Keying state The e Keying information is still shared with the shelf manager as usual but now ports are enabled regardless if the shelf manager enables them or not ATCA LEDs The ATCA LEDs can be turned on from several sources one of which is a Linux driver Both the Base and Fabric drive these LEDs The red OOS LED is driven until FASTPATH has loaded at which point the green Healthy LED is driven The OOS LED signals are OR so that if one or more are active the LED is on The Healthy LED signals are AND The Base and Fabric must be booted into FASTPATH as well as several hardware conditio
72. ordia GR 1089 Issue 4 June 2006 Electromagnetic Compatibility And Electrical Safety Generic Criteria For Network Telecommunication Equipment m ETSI EN 300 019 2 1 V2 1 2 2000 09 2 2 V2 1 1 1999 09 2 3 V2 2 2 2003 04 Environmental conditions and environmental tests for telecommunication eguipment Part 2 m ETSI EN 300 119 5 V1 2 2 2004 12 Part 4 Engineering requirements for subracks in miscellaneous racks and cabinets D 1 m ETSI EN 300 132 2 September 1996 Equipment Engineering Power Supply Interface At The Input To Telecommunications Equipment Part 2 Operated by direct current dc m ETSI EN 300 753 October 1997 Acoustic Noise Emitted By Telecommunications Equipment Certification is dependent on your configuration D 3 Safety m UL cUL 60950 1 Safety for Information Technology Equipment UL File E130569 m EN IEC 60950 1 2001 1ST ED CB CCA scheme Safety for Information Technology Eguipment TUV CB certificate and report The following group and or national deviations were considered m CENELEC Common Modifications Annex ZA m AU Australia and New Zealand m CH Switzerland m DE Germany m DK Denmark m ES Spain m FI Finland m GB United Kingdom m IE Ireland m KR Korea m NO Norway m SE Sweden m China deviations to IEC 60950 3 d Ed considered m Telcordia GR 63 CORE Network Eguipment Building System NEBS Reguirements Issue 3 Mar 2006 Physical Protection Des
73. ort 2 3 Site 2 AMC 0 Mid size AMC 2 Type 5 and E1 m 10GBase BX4 to 3 1 network AMC port 8 11 m 1000Base BX to 3 0 network AMC port 0 m AMC ports 4 7 connected to AMC site 1 m SAS SATA ports routed between AMCs AMC port 2 3 Site 3 AMC 0 Mid size AMC 2 Type E1 m 1 1000Base BX to 3 0 network AMC port 0 m SAS SATA ports routed between AMCs AMC port 2 3 m Update channel support for redundant master clock generators AMC port 15 m PCI E Fabric clock support Chapter 2 Overview 2 5 22 2 241 ZdZ Din 2 6 Switch Components The following sections list and describe key components of the Sun Netra CP3240 switch Broadcom StrataXGS 3 BCM56503 Ethernet Switch The Sun Netra CP3240 switch uses Broadcom StrataXGS 3 BCM56503 for Base Ethernet switching routing This chip is an Ethernet switch with 24 1Gigabyte ports and 3 10Gigabyte ports It provides non blocking wire speed switching and routing on all ports under 100 load The BCM56503 features many advanced features presented to the user via the FASTPATH software See the Section 4 10 FASTPATH on page 4 18 for more information Broadcom StrataXGS 3 BCM56800 Ethernet Switch The Sun Netra CP3240 switch uses Broadcom StrataXGS 3 BCM56800 for Fabric Ethernet switching routing This chip is an Ethernet switch with 20 10Gigabyte ports It provides non blocking wire speed switching and routing on all ports under 100 load The BCM56800 features many advanc
74. ositions rotate inward to seat the midplane connectors If system power is on the Hot Swap LED should light up The Hot Swap LED should blink for several seconds and then go off If the Hot Swap LED does not go off after several seconds push harder on the injector ejector handles to verify that they are pushed in all the way Tighten the board retention screws to anchor the board in the shelf Connect the cables to the switch 1 9 1 9 1 Switch LEDs The following sections give the status information for all of the LEDs on the switch m ATCA Board Status LEDs on page 1 15 m Hot Swap LED on page 1 16 ATCA Board Status LEDs TABLE 1 3 describes the three LEDs defined by ATCA to monitor board status TABLE 1 3 ATCA Board Status LEDs LED Color Normal Operation Description OOS Red Off Out of service This LED lights on a critical switch error such that the board should be removed OK Green On This LED is lit when the switch is booted and switching A Amber Off Minor Error User Defined This LED can be defined by the user via software applicatons Chapter 1 Getting Started 1 15 Note that both the OOS and MINOR LEDs are lit when the board is powered but not booted This includes all Hot Swap states M1 through M3 Refer to Hot Swap LED on page 1 16 1 9 2 Hot Swap LED This blue LED communicates the Hot Swap status of the switch TABLE 1 4 shows the different states of the Hot Swap LED
75. page 4 7 Section 4 4 Serial Select on page 4 8 Section 4 5 Serial Location on page 4 9 Section 4 6 Boot Sequence on page 4 10 Section 4 7 Primary and Backup Flash on page 4 13 Section 4 8 Dual Firmware Images on page 4 13 Section 4 9 Network Boot on page 4 14 Section 4 10 FASTPATH on page 4 18 Section 4 11 Firmware Updates on page 4 24 Section 4 12 Fiber Optic RTM Configuration on page 4 25 4 1 4 1 This section describes the IPMI firmware sensors 4 1 1 State Sensors IPMI Firmware Sensors TABLE 4 1 IPMI State Sensors Sensor Name Type Description Discrete States Returned TABLE 42 State hotswap discrete M state per ATCA spec OHOT_SWAP state 1 RTM hotswap State hotswap discrete M state per ATCA spec state 2 AMC 0 State hotswap discrete M state per ATCA and AMC hotswap state spec 3 AMC 1 State hotswap discrete M state per ATCA and AMC hotswap state spec 4 AMC 2 State hotswap discrete M state per ATCA and AMC hotswap state spec 5 IPMB physical State IPMB Link sensor Defined in ATCA spec 6 BMC Watchdog State Watchdog timer Discrete Watchdog 2 per the IPMI spec 11 RTM Presence State Rear Module State 01h Device absent 02h Present Signal Device present 12 Base Early State Base firmware Asserted indicates Uboot signal prompt 13 Base Full State Base firmware Asserted indicates Linux has signal booted 14 Base Good State Base firmware Asserted
76. play Utility Menu Select 1 2 Extracting Application from imagel done Loading Application done SOC unit 0 attached to PCI device BCM56503_B2 FASTPATH starting started Unit 1 gt User Sun Netra CP3240 Switch Installation Guide September 2009 4 6 1 The switch takes approximately 50 seconds to boot to a console and be fully functional Boot Utility Menu There is a utility menu that can be used before FASTPATH boots During boot there is a two option menu displayed for five seconds This menu allows access to the utility menu if you press number 2 and Enter CODE EXAMPLE 4 4 Boot Utility Menu Access Switch Base Primary Flash image2 Utility Menu Start Switch Application Load Code Update Package using TFTP FTP Load Code Update Package using XMODEM YMODEM ZMODEM Copy Primary Flash to Backup Flash Select Serial Speed Retrieve Error Log using TFTP Retrieve Error Log using XMODEM YMODEM ZMODEM Erase Current Configuration Erase Permanent Storage 10 Select Boot Method 11 Activate Backup Image 12 Start Diagnostic Application 13 Reboot AANA UT amp amp NN I to Select option 1 13 Most of the options are self explanatory based on their names The following sections describe some of the options more fully Chapter4 Configuring Switch Software 4 11 4 6 1 1 4 6 1 2 4 6 1 3 4 6 1 4 4 12 Load Code Upd
77. ribution peut comprendre des composants d velopp s par des tierces parties Des parties de ce produit pourront tre d riv es des syst mes Berkeley BSD licenci s par l Universit de Californie UNIX est une marque d pos e aux Etats Unis et dans d autres pays et licenci e exclusivement par X Open Company Ltd Sun Sun Microsystems le logo Sun Solaris Netra et le logo Netra sont des marques de fabrique ou des marques d pos es de Sun Microsystems Inc ou ses filiales aux Etats Unis et dans d autres pays Ce produit est soumis la l gislation am ricaine en mati re de contr le des exportations et peut tre soumis la r glementation en vigueur dans d autres pays dans le domaine des exportations et importations Les utilisations ou utilisateurs finaux pour des armes nucl aires des missiles des armes biologiques et chimiques ou du nucl aire maritime directement ou indirectement sont strictement interdites Les exportations ou reexportations vers les pays sous embargo am ricain ou vers des entit s figurant sur les listes d exclusion d exportation am ricaines y compris mais de mani re non exhaustive la liste de personnes qui font objet d un ordre de ne pas participer d une fa on directe ou indirecte aux exportations des produits ou des services qui sont r gis par la l gislation am ricaine en mati re de contr le des exportations et la liste de ressortissants sp cifiquement d sign s sont rigoureusement in
78. ring Jumper Settings 3 3 3 1 5 3 1 6 REZ 3 4 P8 3 4 Fabric Write Protect This jumper configures write protection on the Fabric reset configuration word TABLE 3 6 P8 3 4 Fabric Write Protect Jumper Settings P8 3 4 Default Function ON Disable the write protection of the Fabric reset configuration word OFF Default Write protect the Fabric reset configuration word P9 IPMC Firmware Program These jumpers configure IPMC firmware write actions via the debug serial port TABLE 3 7 P9 IPMC Firmware Program Jumper Settings P4 Default Function OFF Default Normal operation 1 2 Install to program IPMC firmware via the debug serial port 3 4 Install to program IPMC firmware via the debug serial port P10 1 2 IPMC Reset This jumper configures the IPMI subsystem reset function TABLE 3 8 P10 1 2 IPMC Reset Jumper Settings P10 1 2 Default Function ON Disable IPMI subsystem hold it in reset OFF Default Enable IPMI subsystem Sun Netra CP3240 Switch Installation Guide September 2009 3 1 8 SHE 3 1 10 P10 3 4 IPMC FWE These are reserved and should be left configured for the default setting TABLE 3 9 P10 3 4 IPMC FWE Reserved Jumper Settings P10 3 4 Default Function ON OFF Default Normal operation P11 1 2 Forced Board Enable This jumper controls whether the switch is forced on when it is powered up or if the IPMI subsystem controls the power up of the switch
79. s A digital device pursuant to Part 15 of the FCC rules These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment This product generates uses and can radiate radio frequency energy and if not installed and used in accordance with the instruction manual may cause harmful interference to radio communications Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at the user s own expense This switch complies with Part 15 of the FCC Rules Operation is subject to the following two conditions 1 This device may not cause harmful interference 2 This device must accept any interference received including interference that may cause undesired operation Sun Netra CP3240 Switch Installation Guide September 2009 D 5 2 Industry Canada Canada This Class A digital apparatus meets all requirements of the Canadian Interference Causing Equipment Regulations Operation is subject to the following two conditions 1 This device may not cause harmful interference 2 This device must accept any interference received including interference that may cause undesired operation Cet appareillage num rique de la classe A r pond toutes les exigences de l interf rence canadienne causant des r glements d quipement L op ration est sujette aux
80. s copper RJ 45 4 Base 1GBE 10 100 1000Base T RJ 45 Base 19 Standard I F is copper 2 4 2 Rear Transition Modules RTM s The Sun Netra CP3240 switch supports RTMs through ATCA Zone 3 connectors see TABLE 2 2 The Sun Netra CP3240 switch was designed to support multiple RTM designs 4 Fabric 10Gigabyte 2 Base 10Gigabyte 2 Base 1Gigabyte AMC I O and management ports are run to the RTM Several voltage rails are supplied and all of the signals needed to design an ECN002 compliant RTM are present TABLE 2 2 Zone 3 RTM Ports Base Ports 1G Infrastructure 10G Infrastructure Base Port 20 1G SGMII None Base Port 21 1G SGMII None Base Port 26 None 10G XAUI Base Port 27 None 10G XAUI Fabirc Port 17 1G SGMH 10G XAUI Fabirc Port 18 1G SGMH 10G XAUI Fabirc Port 19 1G SGMH 10G XAUI Fabirc Port 20 1G SGMH 10G XAUI The Sun Netra CP3240 switch is paired with either a copper or fiber optic RTM The following sections describe each RTM 2 18 Sun Netra CP3240 Switch Installation Guide September 2009 2 4 2 1 Copper RTM The XCP3240H RTM CU Z is the Sun Netra CP3240 switch s copper RTM pairing This RTM supports all the ports the Sun Netra CP3240 switch provides using 10GBase CX4 for the 10Gigabyte and 10 100 1000Base T for the 1Gigabyte ports FIGURE 2 2 Copper RTM Functional Block Diagram RTM Connector Broadcom BCM8726B 2 PHY Broadcom BCM8726B 2 PHY Broadcom BCM5464R 4 PHY 2 unused Broadcom BCM8726B 2 PHY Fabric 10GbE
81. s fully rotating the handles outward until the board disengages from the midplane Slide the module evenly out of the enclosure Install a replacement rear transition module or a filler panel to maintain the enclosure s shielding and cooling performance Refer to Section 1 8 2 1 Installing the Rear Transition Module for a Switch on page 1 14 Caution Failure to cover all rear panel slots with rear transition modules or filler panels can negatively impact the cooling of the system Chapter 1 Getting Started 1 13 1 8 2 1 8 2 1 1 8 2 2 1 14 Installing a Switch Set If you have a rear access server you must install the rear transition module before installing the front switch m If you want to install the rear transition module go to Section 1 8 2 1 Installing the Rear Transition Module for a Switch on page 1 14 m If you want to install a switch go to Section 1 8 2 2 Installing a Switch on page 1 14 Installing the Rear Transition Module for a Switch Choose an appropriate slot for the rear transition module Rear transition modules must be installed inline behind the accompanying front board For example if the accompanying front board is installed in slot 7 its rear transition module must be installed at the back of the system in slot 7 Remove the filler panel if necessary Prepare the rear transition module by opening its injector ejector handles Carefully align the
82. t Base 10G port 0 25 and 0 27 do not support 1G operation The Fabric 10G RTM optical ports support both 1G and 10G operation CODE EXAMPLE 4 7 Enabling 1G Operation on RTM Optical Ports configure interface lt port numbers range in 0 20 format gt auto negotiate exit exit where lt 0 xx gt is the port number of the RTM on Fabric Valid entries are 0 17 0 18 0 19 and 0 20 For each port on the RTM enter the command 4 26 Sun Netra CP3240 Switch Installation Guide September 2009 APPENDIX A Environment Specifications This appendix describes the electrical environmental and mechanical specifications It includes connector descriptions and pin outs as well as illustrations of the board dimensions and connector locations A 1 Electrical and Environmental The following sections provide tables and illustrations showing the electrical and environmental specifications A 1 1 Absolute Maximum Ratings The following values are stress ratings only Do not operate at these maximums See Section A 1 2 Normal Operating Ranges on page A 2 for normal operating conditions TABLE A 1 Absolute Maximum Electrical and Temperature Ratings Supply Voltage 48V 0 VDC to 75VDC Storage Temperature 40 to 85 Celsius Non Condensing Relative Humidity lt 95 at 40 Celsius A 1 2 Normal Operating Ranges TABLE A 2 Normal Operating Electrical and Temperature Ratings Description Range Nomi
83. terdites L utilisation de pi ces d tach es ou d unit s centrales de remplacement est limit e aux r parations ou l change standard d unit s centrales pour les produits export s conform ment la l gislation am ricaine en mati re d exportation Sauf autorisation par les autorit s des Etats Unis l utilisation d unit s centrales pour proc der des mises jour de produits est rigoureusement interdite LA DOCUMENTATION EST FOURNIE EN L ETAT ET TOUTES AUTRES CONDITIONS DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE A UAPTITUDE A UNE UTILISATION PARTICULIERE OU A L ABSENCE DE CONTREFACON LD com CA Adobe PostScript LD com CA Adobe PostScript Contents Preface xix Getting Started 1 1 1 1 1 2 1 3 1 4 1 5 1 6 1 7 1 8 System Requirements 1 2 1 1 1 Connectivity 1 2 1 1 1 1 Hub Connectivity 1 2 1 1 2 Electrical and Environmental 1 2 Unpacking 1 4 Handling Switches 1 4 Connectors 1 5 Jumper Options 1 5 Switch and RTM Faceplates 1 6 1 6 1 Base 10 100 1000 Uplink Ports RJ 45 1 7 1 6 2 10 100 Management Port RJ 45 1 7 1 6 3 Serial Management Port RJ 45 1 7 RTM Airflows 1 7 1 71 RTM Airflow Requirements 1 7 1 7 2 RTM Pressure Drop Versus Airflows Impedence Curves 1 8 Removing and Installing Switches 1 10 1 8 1 Removing a Switch Set 1 10
84. ther materials that are available on or through such sites or resources Sun will not be responsible or liable for any actual or alleged damage or loss caused by or in connection with the use of or reliance on any such content goods or services that are available on or through such sites or resources Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions You can submit your comments by going to Preface xxiii http www sun com hwdocs feedback Please include the title and part number of your document with your feedback Sun Netra CP3240 Switch Installation Guide part number 820 3251 13 xxiv Sun Netra CP3240 Switch Installation Guide September 2009 CHAPTER 1 Getting Started gt gt This chapter provides information and procedures needed to install and make the Sun Netra CP3240 switch operational This chapter should be read before using the board In addition to this chapter refer to the following safety documentation m Netra CP3X20 Switch Safety and Compliance Manual 820 3505 m Important Safety Information for Sun Hardware Systems 816 7190 Caution When the system is plugged in energy hazards are present on the midplane Do not reach into the enclosure Caution Static electricity can damage electronic components Wear a wrist strap grounded through one of the system s ESD ground jacks when removing and replacing hot swapp
85. thod 7 Press number 3 to select network as the boot method 8 Enter the information for your TFTP server For host IP you can enter dhcp if you would like to use DHCP to obtain a valid IP address Sun Netra CP3240 Switch Installation Guide September 2009 9 Press number 1 to boot the system CODE EXAMPLE 4 5 Example Console Output CPUs 400 MHz DRAM 256 MB FLASH 64 MB Base Primary Flash JFFS2 loading imagel to 0x400000 Scanning JFFS2 FS done JFFS2 load complete 10026500 bytes loaded to 0x400000 Booting Loading Ramdisk to 0fdf6000 end 0ff8d4c2 OK Mounting dev mtdblock2 at mnt fastpath done Mounting tmpfs at mnt application done KAKKAKAKKAKAKKAKAKAKAKAKAAKAKAKAAKAKAKAKAKAKAKAAKAKAKAAKAKAKAKAKAAKAAKAAKAAKAAKAAKAAKAAKAAKAAKAAKALAKALAKAAKAAA kkk Use the key above the TAB to switch between BASE and FABRIC kkxkkxkxkxkxkxkxkkkxkkkkkkxkkkkkkkkkkkkxkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkxkxkxk kkk switch Base Primary Flash imagel Select startup mode If no selection is made within 5 seconds the Application will start automatically Main Menu 1 Start Switch Application 2 Display Utility Menu Select 1 2 2 kkxkkxkxkxkxkxkxkxkkxkxkxkkkkxkkxkkkkkkxkkkkkkxkxkkkkkxkkxkkkkxkkxkkkkxkkxkkkkkkxkkkkkkx k kkk Use the key above the TAB to switch between BASE and FABRIC KKAKKKAKAKAKAKAAKAKAAKAKAKAKAAAAKAKAKAAAAAKAKFAAAKAAAAAKAKFAKAAAAAKAKFAAAAAAKAAKFAAA
86. tion Guide September 2009 2 3 3 3 2 3 3 4 2 3 4 Class of Service CoS Direct user configuration of the following IP DSCP to traffic class mapping Interface trust mode 802 1p IP DSCP or untrusted Interface traffic shaping rate Minimum and maximum bandwidth per queue Strict priority versus weighted WRR WFO scheduling per queue Tail drop versus weighted random early detection WRED queue depth management Quality of Service MIBs RFC 3289 MIB for the Differentiated Services Architecture read only Private MIBs for full configuration of DiffServ ACL and CoS functionality FASTPATH Multicast RFC 1112 Host Extensions for IP multicasting RFC 2236 IGMPv2 RFC 2362 PIM SM RFC 2365 Administratively scoped boundaries RFC 3376 IGMPv3 IP multicast traceroute Draft ietf pim v2 dm 03 PIM DM Draft ietf idmr dvmrp v3 10 DVMRP Static RP configuration Draft holbrook idmr igmpv3 ssm 08 txt IGMPv3 MLDv2 for SSM Draft ietf magma igmp proxy 06 txt IGMP MLD based multicast forwarding IGMP MLD Pproxying Draft ietf smm arch 06 txt Source specific multicast for IP Draft ietf magma igmpv3 and routing 05 txt IGMPv3 and Multicast Routing Protocol interaction Chapter 2 Overview 2 13 2 3 4 1 Multicast MIBs RFC 2932 IPv4 multicast routing MIB RFC 2933 IGMP MIB RFC 2934 PIM MIB for IPv4 Draft ietf magma mgmd mib 03 txt Multicast Group Membership Discovery MIB Draft ietf idmr dvmrp
87. tocol Route redistribution across RIP and OSPF VLAN routing Weighted static routes Chapter 2 Overview 2 11 2 FASTPATH Ouality of Service 2 3 3 1 DiffServ RFC 2474 Definition of the Differentiated Services field DS field in the IPv4 and IPv6 headers RFC 2475 Architecture for differentiated services RFC 2597 Assured Forwarding PHB Group RFC 3246 Expedited forwarding PHB Per Hop Behavior RFC 3260 New terminology and clarifications for DiffServ Optional policy attributes Assign matching traffic flow to a specific gueue Redirect or mirror flow based mirroring matching traffic flow to a specific port 2 3 3 2 Access Control Lists ACLs Permit Deny actions for inbound or outbound IP traffic classification based on Type of Service TOS or Differentiated Services DS DSCP field Source IP address Destination IP address TCP UDP source port TCP UDP destination port IP protocol number Permit Deny actions for inbound or outbound Layer 2 traffic classification based on Source MAC address Destination MAC address Ethertype 802 1p user priority outer and or inner VLAN tag VLAN identifier value or range outer and or inner VLAN tag Optional rule attributes Assign matching traffic flow to a specific queue Redirect or mirror flow based mirroring matching traffic flow to a specific port Generate trap log entries ACL logging containing rule hit counts 2 12 Sun Netra CP3240 Switch Installa
88. uclear maritime end uses or end users whether direct or indirect are strictly prohibited Export or reexport to countries subject to U S embargo or to entities identified on U S export exclusion lists including but not limited to the denied persons and specially designated nationals lists is strictly prohibited Use of any spare or replacement CPUs is limited to repair or one for one i placement of CPUs in products exported in compliance with U S export laws Use of CPUs as product upgrades unless authorized by the U S Government is strictly prohibited DOCUMENTATION IS PROVIDED AS IS AND ALL EXPRESS OR IMPLIED CONDITIONS REPRESENTATIONS AND WARRANTIES INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY FITNESS FOR A PARTICULAR PURPOSE OR NON INFRINGEMENT ARE DISCLAIMED EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID Copyright 2009 Sun Microsystems Inc 4150 Network Circle Santa Clara California 95054 Etats Unis Tous droits r serv s Sun Microsystems Inc d tient les droits de propri t intellectuels relatifs la technologie incorpor e dans le produit qui est d crit dans ce document En particulier et ce sans limitation ces droits de propri t intellectuelle peuvent inclure un ou plus des brevets am ricains list s l adresse http www sun com patents et un ou les brevets suppl mentaires ou les applications de brevet en attente aux Etats Unis et dans les autres pays Cette dist
89. y Update channel usually used for clock sync 17 Any IRTM for future use 18 Any IRTM for future use 19 Any IRTM for future use 20 Any IRTM for future use TCLK1 CLK IN IFPGA and Zarlink TCLK2 CLK OUT IFPGA and Zarlink TCLK3 CLK IN IFPGA and Zarlink TCLK4 CLK OUT IFPGA and Zarlink IFCLK 100MHz 100MHz Chapter2 Overview 2 29 2 4 5 2 AMC Module Support by Site TABLE 2 11 AMC Modules by Site AMC Module AMC10G XFP AMC10G CX4 AMCLED001 PCI Express AMC 1G Common Options Ethernet AMC 10G Fat Pipe Ethernet AMC Site 1 top most when the board is vertical 2 4 5 3 AMC Port Restrictions for RTMs The following tables list AMC port restrictions for RTMs TABLE 2 12 AMC Port Restrictions for Copper RTMs Site 2 middle Yes Yes Yes Yes Yes Yes Site 3 bottom most site when the board is vertical 1G Infrastructure 1G Base Ports 10G Infrastructure 10G Fabric Ports BCM5464R Copper PHY Port 10 100 1000 BaseT RJ 45 XAUI Pass through BCM5464R Copper PHY 22 BCM5464R Copper PHY Port 10 100 1000 BaseT RJ 45 None 23 BCM5464R Copper PHY Port 10 100 1000 BaseT RJ 45 None 24 Front panel Base Port 18 J13 3rd Front panel Base Port 19 J13 Bottom BCM5464R Copper PHY 10G Fabric XAUI CX4 None None TABLE 2 13 AMC Port Restrictions for Fiber Optic RTMs 1G Infrastructure 1G Base Ports 10G Infrastructure 10G Fabric Ports SERDES SFP LX SX SFP LRM SERDES SF

Sun Netra CP3240 Switch Installation Guide

Contents

Download Pdf Manuals

Related Search

Related Contents