IBM Flex System PCIe Expansion Node
Contents
1. 23 7 in Weight 9 5 kg 21 Ib Operating environment When the unit is powered on it is supported in the following environment Temperature 5 C to 40 C 41 F to 104 F Humidity noncondensing 12 C dew point 10 F and 8 85 relative humidity Maximum dew point 24 C 75 F Maximum altitude 3048 m 10 000 ft Maximum rate of temperature change 5 C hr 41 F hr IBM Flex System PCle Expansion Node 7 Regulatory compliance The unit conforms to the following standards ASHRAE Class A3 FCC Verified to comply with Part 15 of the FCC Rules Class A Canada ICES 004 issue 3 Class A UL IEC 60950 1 CSA C22 2 No 60950 1 NOM 019 Argentina IEC 60950 1 Japan VCCI Class A IEC 60950 1 CB Certificate and CB Test Report China CCC GB4943 GB9254 Class A GB17625 1 Taiwan BSMI CNS13438 Class A CNS14336 Australia New Zealand AS NZS CISPR 22 Class A Korea KN22 Class A KN24 Russia GOST ME01 IEC 60950 1 GOST R 51318 22 GOST R 51318 249 GOST R 51317 3 2 GOST R 51317 3 3 IEC 60950 1 CB Certificate and CB Test Report CE Mark EN55022 Class A EN60950 1 EN55024 EN61000 3 2 EN61000 3 3 CISPR 22 Class A TUV GS EN60950 1 IEC 60950 1 EK1 ITB2000 Related publications For more information see the following resources IBM US Announcement Letter http ibm com common ssi cgi bin ssialias infotype dd amp subtype ca amp amp htmlfid 89 7 ENUS 112 139 IBM Flex System product page h2. ul ye Redbooks IBM Flex System PCle Expansion Node IBM Redbooks Product Guide The IBM Flex System PCle Expansion Node provides the ability to attach additional PCI Express cards such as High IOPS SSD adapters fabric mezzanine cards and next generation graphics processing units GPU to supported IBM Flex System compute nodes This capability is ideal for many applications that require high performance I O special telecommunications network interfaces or hardware acceleration using a PCI Express GPU card The PCle Expansion Node supports up to four PCle adapters and two additional Flex System I O expansion adapters Figure 1 shows the IBM Flex System PCle Expansion Node attached to an IBM Flex System x240 Compute Node Figure 1 IBM Flex System PCle Expansion Node right attached to an x240 Compute Node left Did you know The PCle Expansion Node is ideal for application environments that are written to take advantage of acceleration and visualization performance using GPUs that are connected to Flex System Compute nodes It is also useful for environments that require specific PCle adapter connectivity to a Flex System Compute node IBM Flex System PCle Expansion Node 1 Part number information Table 1 Ordering part number and feature code IBM Flex System PCle Expansion Node 81Y8983 A1BV The part number includes the following items IBM Flex System PCle Expansion Node Two riser assemblies Inte
3. M2090 is installed in the Expansion Node then an adapter cannot be installed in the other full height slot The low profile slots and Flex System I O expansion slots can still be used however Table 4 Supported adapter cards Description Part number Feature code Maximum supported 640GB High IOPS MLC Duo Adapter full height 81Y4519 5985 2 adapter 1 28TB High IOPS MLC Duo Adapter full height 81Y4527 A1NB 2 adapter IBM 1 2TB High IOPS MLC Mono Adapter 90Y4377 A3DY low profile adapter IBM 2 4TB High IOPS MLC Duo Adapter 90Y4397 A3DZ full height adapter NVIDIA Tesla NVIDIA Tesla M2090 full height adapter NVIDIA Tesla M2090 full height adapter height adapter 94Y5960 A1R4 if the NVIDIA Tesla M2090 is installed in the Expansion Node then an adapter cannot be E in the other full height slot The low profile slots and Flex System I O expansion slots can still be used Consult the IBM ServerProven site for the current list of adapter cards that are supported in the Expansion Node http ibm com systems info x86servers serverproven compat us flexsystems html For information about the IBM High IOPS adapters see the following IBM Redbooks Product Guide http www redbooks ibm com abstracts tipsO729 html Note Although the design of Expansion Node allows for a much greater set of standard PCle adapter cards the preceding table lists the adapters that are specifically supported If the PCI Express adapter that you r
4. a 2 port or 4 port adapter Similarly the number of ports to the I O module depend on the number of ports activated in the switch Table 3 Adapter to I O bay correspondence I O expansion slot Port on the adapter Corresponding O module bay in the chassis Ports 3 and 4 require that a four port card be installed in the expansion slot Might require one or more port upgrades to be installed in the I O module IBM Flex System PCle Expansion Node 5 Supported PCle adapter cards The Expansion Node supports the following general adapter characteristics Full height cards 4 2 in 107 mm Low profile cards 2 5 in 64 mm Half length cards 6 6 in 168 mm Full length cards 12 3 in 312 mm Support for up to four low profile PCle cards Support for up to two full height PCle cards Support for up to one full height double wide PCle card Support for PCle standards 1 1 and 2 0 PCle 3 0 adapters supported operating in PCle 2 0 The front facing bezel of the Expansion Node is inset from the normal face of the compute nodes This inset is to allow for the use of cables connected to PCle adapter cards that support external connectivity The Expansion Node provides up to 80 mm of space in the front of the PCle adapter cards to allow for the bend radius of these cables Table 4 lists the PCle adapters that are supported in the Expansion Node Some adapters must be installed in one of the full height slots as noted If the NVIDIA Tesla
5. ary power connections up to 75W each for a total of 150W of additional power using standard 2x3 12V six pin power connectors These connectors are placed on the base planar so that they both can provide power to a single adapter card up to 225W or to two adapters up to 150W each Power cables are used to connect from these connectors to the PCle adapters and are included with the PCle Expansion Node Two Flex System I O expansion connectors The I O expansion connectors are labeled I O expansion 3 connector and I O expansion 4 connector in Figure 2 These I O connectors expand the I O capability of the attached compute node The layout of the PCle Expansion Node is shown in Figure 2 The four PCle slots are routed through two riser connectors on the system planar Full height pana m PCle riser VO expansion 3 NO expansion 4 connector connector con HAN a A i E b ff f U ha eY k anm m H a E in a Ea ne Sm aoa eT H a Aux power2 Aux power 1 Low profile PCle interposer connector connector PCle riser switch cable connector connector Figure 2 Layout of the PCle Expansion Node IBM Flex System PCle Expansion Node 3 Architecture Figure 3 shows the architecture of the PCle Expansion Node when connected to a compute node Compute Node PCle Expansion Node M nterposer cable PCle Jd i 3 e k 20 PCle 2 0x18 FHFL H PCle 2 0 x16 FHFL Front of Compute Node Front of Expansi
6. ent to IBM for the purposes of developing using marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written These examples have not been thoroughly tested under all conditions IBM therefore cannot guarantee or imply reliability serviceability or function of these programs Copyright International Business Machines Corporation 2012 All rights reserved Note to U S Government Users Restricted Rights Use duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp IBM Flex System PCle Expansion Node 9 This document was created or updated on August 1 2012 Send us your comments in one of the following ways e Use the online Contact us review form found at ibm com redbooks e Send your comments in an e mail to redbook us ibm com e Mail your comments to IBM Corporation International Technical Support Organization Dept HYTD Mail Station PO99 2455 South Road Poughkeepsie NY 12601 5400 U S A This document is available online at http www ibm com redbooks abstracts tips0906 html Trademarks IBM the IBM logo and ibm com are trademarks or registered trademarks of International Business Machines Corporation in the United States other countries or both These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol or ind
7. equire is not on the ServerProven web site use the IBM ServerProven Opportunity Request for Evaluation SPORE process to confirm compatibility in the desired configuration IBM Flex System PCle Expansion Node 6 Supported I O expansion cards Table 5 lists the Flex System I O expansion cards that are supported in the PCle Expansion Node Table 5 Supported I O expansion cards IBM Flex System CN4054 10Gb Virtual Fabric Adapter IBM Flex System CN4054 Virtual Fabric Adapter SW Upgrade IBM Flex System EN2024 4 port 1Gb Ethernet Adapter IBM Flex System EN4132 2 port 10Gb Ethernet Adapter IBM Flex System IB6132 2 port FDR InfiniBand Adapter IBM Flex System FC5022 2 port 16Gb FC Adapter IBM Flex System FC3172 2 port 8Gb FC Adapter IBM Flex System FC3052 2 port 8Gb FC Adapter Consult the IBM ServerProven site for the current list of adapter cards that are supported in the Expansion Node http ibm com systems info x86servers serverproven compat us flexsystems html For information about these adapters see the IBM Redbooks Product Guides for Flex System in the Adapters category http www redbooks ibm com portals puresystems Open amp page pg amp cat adapters Physical specifications Dimensions and weight approximate Height 56 mm 2 2 in Depth 489 mm 19 25 in Width 217 mm 8 6 in Maximum weight 5 4 kg 11 9 Ib Shipping dimensions and weight approximate Height 240 mm 9 5 in Depth 680 mm 26 8 in Width 601 mm
8. icating US registered or common law trademarks owned by IBM at the time this information was published Such trademarks may also be registered or common law trademarks in other countries A current list of IBM trademarks is available on the Web at http www ibm com legal copytrade shtml The following terms are trademarks of the International Business Machines Corporation in the United States other countries or both IBM Flex System IBM Redbooks Redbooks logo ServerProven Other company product or service names may be trademarks or service marks of others IBM Flex System PCle Expansion Node
9. ing to IBM Director of Licensing IBM Corporation North Castle Drive Armonk NY 10504 1785 U S A The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION AS IS WITHOUT WARRANTY OF ANY KIND EITHER EXPRESS OR IMPLIED INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF NON INFRINGEMENT MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE Some states do not allow disclaimer of express or implied warranties in certain transactions therefore this statement may not apply to you This information could include technical inaccuracies or typographical errors Changes are periodically made to the information herein these changes will be incorporated in new editions of the publication IBM may make improvements and or changes in the product s and or the program s described in this publication at any time without notice Any references in this information to non IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you Information concerning non IBM products was obtained from the s
10. on Node Figure 3 Architecture of the PCle Expansion Node The Expansion Node connects to a standard width compute node using the interposer cable which plugs into the expansion connector and interposer connector on the compute node and Expansion Node respectively This link forms a PCle 2 0 x16 connection between the compute node and the PCle switch in the Expansion Node The PCle switch has connections to the six PCle slots in the Expansion Node e PCle 2 0 x16 connections to the two full length full height PCle slots e PCle 2 0 x8 connections to the two low profile PCle slots e PCle 2 0 x16 connectors to the two Flex System I O expansion slots labeled I O 3 and I O 4 in the figure Notes e Incompute nodes such as the x220 and x240 I O expansion slot 1 and 2 in the server operate at PCle 3 0 speeds However I O expansion slots 3 and 4 in the PCle Expansion Node and also the four standard PCle slots operate at PCle 2 0 speeds e The expansion connector in the compute node is routed through processor 2 Therefore processor 2 must be installed in the compute node IBM Flex System PCle Expansion Node 4 When adapters are installed in the two I O expansion slots they connect to the chassis midplane and provide additional connections to I O module bays in the chassis Table 3 shows the connections between the expansion slots and the module bays Note that the ports available from the adapter vary depending on whether the adapter is
11. rposer cable assembly Double wide shelf Two auxiliary power cables for adapters that require additional 12V power Four removable PCle slot air flow baffles Documentation CD that contains the nstallation and Service Guide Warranty information and Safety flyer and Important Notices document Supported servers The IBM Flex System PCle Expansion Node is supported when it is attached to the IBM Flex System compute nodes listed in Table 2 Only one Expansion Node can be attached to each compute node Table 2 Supported servers o S Part q a A Expansion card number IBM Flex IBM Flex System PCle Expansion Node IBM Flex System PCle Expansion Node Expansion Node 81Y8983 LERA E The PCle Expansion Node requires that both processors be installed in the x220 and x240 IBM Flex System PCle Expansion Node 2 Features The PCle Expansion Node has the following features Support for up to four standard PCle 2 0 adapters e Two PCle 2 0 x16 slots that support full length full height adapters 1x 2x 4x 8x and 16x adapters supported e Two PCle 2 0 x8 slots that support low profile adapters 1x 2x 4x and 8x adapters supported Support for PCle 3 0 adapters by operating them in PCle 2 0 mode Support for one full length full height double wide adapter consuming the space of the two full length full height adapter slots Support for PCle cards with higher power requirements The Expansion Node provides two auxili
12. ttp ibm com systems flex IBM Flex System Information Center http publib boulder ibm com infocenter flexsys information index jsp IBM ServerProven hardware compatibility page for IBM Flex System http www ibm com systems info x86servers serverproven compat us IBM Flex System x240 Compute Node BM Redbooks Product Guide http www redbooks ibm com abstracts tipsO860 html IBM Flex System x220 Compute Node BM Redbooks Product Guide http www redbooks ibm com abstracts tips0885 html IBM Flex System PCle Expansion Node Notices This information was developed for products and services offered in the U S A IBM may not offer the products services or features discussed in this document in other countries Consult your local IBM representative for information on the products and services currently available in your area Any reference to an IBM product program or service is not intended to state or imply that only that IBM product program or service may be used Any functionally equivalent product program or service that does not infringe any IBM intellectual property right may be used instead However it is the user s responsibility to evaluate and verify the operation of any non IBM product program or service IBM may have patents or pending patent applications covering subject matter described in this document The furnishing of this document does not give you any license to these patents You can send license inquiries in writ
13. uppliers of those products their published announcements or other publicly available sources IBM has not tested those products and cannot confirm the accuracy of performance compatibility or any other claims related to non IBM products Questions on the capabilities of non IBM products should be addressed to the suppliers of those products This information contains examples of data and reports used in daily business operations To illustrate them as completely as possible the examples include the names of individuals companies brands and products All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental Any performance data contained herein was determined in a controlled environment Therefore the results obtained in other operating environments may vary significantly Some measurements may have been made on development level systems and there is no guarantee that these measurements will be the same on generally available systems Furthermore some measurement may have been estimated through extrapolation Actual results may vary Users of this document should verify the applicable data for their specific environment COPYRIGHT LICENSE This information contains sample application programs in source language which illustrate programming techniques on various operating platforms You may copy modify and distribute these sample programs in any form without paym
Download Pdf Manuals
Related Search