SmartWindow User Guide
Contents
1. 2 a 4 F B Fi g 4 o d ab e3 37 00 0000 00 00 00 04 IF QO00 a5 e3 91 00 00 00 00 00 00 04 IP 00 00 a5 e3 91 00 00 00 00 0000 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IP 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 d ab es 91 00 0000 00 00 00 4 IF OO00 ab e3 371 00 0000 00 00 00 4 IF OO 00 ab e3 37 00 00 00 00 00 00 04 IF 00 00 ah e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IF 00 00 a5 e3 91 00 00 00 00 00 00 04 IP 00 d ab es 91 00 0000 00 00 00 4 IF 00 d ab es 37 00 0000 00 00 00 4 IF O0 g a e391 00 00 00 00 00 00 04 IP 00 0A a5e3 91 00 00 00 00 0000 04 IP 010 000 000 004 020 000 000 005 010 000 000 005 020 000 000 006 010 000 000 006 020 000 000 007 010 000 000 007 020 000 000 008 010 000 000 008 020 000 000 003 010 000 000 003 020 000 000 070 010 000 000 010 020 000 000 011 010 000 000 011 020 000 000 012 010 000 000 012 020 000 000 013 010 000 000 013 020 000 000 014 010 000 000 014 020 000 000 015 010 000 000 015 020 000 000 016 010 000 000 016 020 000 000 017 010 000 000 017 020 000 000 018 010 000 000 018 020 000 000 015 010 000 000 013 020 000 000 020 010 000 000 020 020 000 000 021 010 000 000 021 020 000 000 022 010 000 000 022 020 000 000 023 010 000 000 023 0 ap OOO QOG2. Rs Ports Options Select the card for which you want to view results To save test results to a file select File gt Save or Save As The default file format is Excel SmartWindow User Guide Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests Selecting and Deselecting Ports for SmartMetrics Tests Select transmitting ports and receiving ports separately You can select a single port all ports at once or all of the same type of SmartCard ports at once if you have more than one 1 From the main menu choose Actions gt SmartMetrics Tests To select ports individually e Click the check box beside the port To select all or a group of ports 1 Click the Tx Ports or Rx Ports button q_____ Receive Ports button Select All Cards CO ML Feo Oo ML 7710 O03 WN 3420 DOS WN 341 Cerin Cade O 06 L3 6710 3 6710 Cards ML 7710 Cards ML 7711 Cards Wh g405 Cards WIN 3415 Cards WN 3420 Cards Clear Card Selections 2 Select one of the following e Select All Cards to select all ports e Clear Card Selections to clear all existing selections e The SmartCard type to select all of the same type of cards SmartWindow User Guide 161 162 Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests SmartMetrics Test Results Window Menus File Edit Actions View Format Window Help Vv Open an existing results file save or print the a
3. Store and Forward devices receive a complete packet on the input port before beginning transmission on the output port For these devices the latency is defined as the difference between the time the last byte leaves the transmitting device and the time at which the first byte arrives at the destination device SmartWindow User Guide 177 178 Chapter 7 SmartMetrics Testing SmartMetrics Test Results The results are presented to cover both possibilities A result of NO 1s shown in the Store and Forward column if the system 1s able to detect the type of device under test is a cut through switch Interpreting SmartMetrics Test Results Smart Window places test results for a receiving port into a spreadsheet that you view from within the SmartMetrics Tests window Use the SmartMetrics Test window toolbar buttons or the menu options to modify the spreadsheet format and selectively display information similar to the way you do with traditional spreadsheet applications Timestamps Tests that use latency histograms Sequence Latency Latency over time utilize a timestamp of when the packet was transmitted The timestamp is the transmit time for a packet to a 100 ns resolution The transmit hardware adds this time stamp It represents the actual time the packet exited the card rather than the time the packet was prepared for transmission It is an absolute number representing the clock tick at the time of transmission Manageme
4. Yes Yes Yes No Yes Yes Yes Yes Yes Yes ML 7710 ML 7711 Yes FV gt 1 07 Yes Yes Yes Yes FV gt 1 00 Yes Yes FV gt 2 00 Yes Yes Yes Yes Requires SmartMetrics mode FV Firmware version SmartWindow User Guide ML 5710A Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes WN 3405 WN 3415 WN 3420A No Yes Yes Yes No Yes Yes Yes Yes Yes Yes POS 6500A 3500A POS 6500B 3500B POS 6502A 3502A Yes Yes Yes Yes No Yes Yes No No LAN 6201A 32014 Yes Yes Yes Yes No Yes Yes No No Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests How to Run SmartMetrics Tests 1 Ensure that both transmitting and receiving SmartCards are in Layer 3 mode Either e Right click the card and choose SmartMetrics Mode e Check the SmartMetrics Mode box on the Virtual Transmit Engine VTE Setup dialog box 2 Ensure that at least one VTE exists for the transmitting and receiving SmartCards and that the VTEs are activated Check here to activate a VTE VWirtualTransmitEngine TE Setup Smarty indow Port 01 Iois You must have Select the TEs Use the Ctrl key for multiple selections a E Selected VTEs at least one W Len MAC Dst MAC Sre Net Dst VTE set up and BO FEFEFE EE OO OO 00000001 IP 135 013 001 002 135 S1 FEFFE FEFEFE OO OOOO O00001 IP 198 019 00
5. wo oo oc O OOO jojo jojojo jojo jojojo jo o o OOOO OO OO OO OO OO OO OOO OO OOODOODOOAOAOAODO M Oo b Paste data into selected cells from the Clipboard Test Idle Total 20 record s ACI 1 T 0 CO 0 CS 4 Figure 7 6 Latency Distribution Test window When you run the test the buckets are used for holding the distributed latency results for the received packets in the burst If the latency results exceed the upper limit of the selected range for any Precision scale see Table 7 4 Latency ranges by Histogram Precision setting on page 170 for range limits the test is invalid You must then either run the test for a shorter period or set the granularity of the Histogram Precision scale to a new range SmartWindow User Guide 169 170 Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests Setting the Precision Precision means finer granularity on the scale of measurement As the scale increases it shifts from us to seconds The increments of measurement become larger and granularity 1s lost Table 7 4 Latency ranges by Histogram Precision setting Minimum latency Maximum latency lus 6 5536ms 2US 13 1ms Aus 26 2ms SUS 52 4ms 1 6uUs 104 8ms 3 2us 209 7ms 6 4us 419 4ms 12 8us 83 89sec 25 6US 1 68sec 51 2uUs 3 36sec 102 4us 6 71sec 204 8us 13 4sec 409 6us 26 8sec 819 2us 53 7sec 1638 4us 107 4sec 3276 8Us 214 7sec 6553 6u
6. Choose Test Type gt ARP exchange times Click on Ports 2 and 6 for Tx and Rx Ports Each port will send ARPs to the DUT and receive a response time for each stream 02 ML 7710 02 ML 7710 06 ML 7710 MOG ML 10 Click the Start button After a few seconds click the Stop button Click the Results button and select port 2 results Then click Port 6 results A separate Results window appears for each port SmartWindow User Guide 185
7. Chapter 7 SmartMetrics Testing Layer 3 Switching Layer 3 Switching In most cases a Layer 3 switch is in fact a fast protocol based router minus certain router functions A Layer 3 switch typically works with only one or two protocols performs at or close to wire speed is good at keeping streaming packets in order and makes routing decisions based on ASICs unlike a router which is software based The 10 Mbps 100 Mbps and Gigabit Ethernet Layer 3 switches are expected to operate at full line rate at Layer 2 and wire speed IP routing at Layer 3 simultaneously on all ports with zero packet loss and extremely low latency Test Methodology The SmartWindow tests and results which demonstrate the performance capability of the switch include the following topics About Streams 20 Counters transmit and receive packets and bytes packet loss triggers tags collisions errors ARP and ping counters Sequence Tracking data Latency Distribution data Latency over Time data It is essential to understand SmartBits streams which provide the basis for using the ML 7710 traffic and test capability Each stream generated by its own Virtual Transmit Engine VTE represents a repeated packet with the following characteristics Designed to set up traffic for testing layer 2 switching or layer 3 routing A signature field in each packet contains its source and destination location its sequence in the traffic flow and when it was
8. Start Start Start Start Start a eea een e SSS SSE SSS ESS SS Start 144 SmartWindow User Guide Preferences to Review See Preferences on page 38 Chapter 7 SmartMetrics Testing Setting One Stream per Card Right click an ML 7710 SmartCard and choose SmartMetrics Mode then Transmit Setup g ML 7710 100Mb SmartMetrics Ethernet TP Transmit Setup Alternate Transmit Setup Trigger Setup 100 Megabit Full Duplex Layer 3 Setup SmartMetrics Mode Layer 3 Send ARP Requests IGMP gt 7x10 Setup MII Registers Capture Display Counters Par lsounters Copy Port Data Paste Port Data 4 Group Member SmartCard Open SmartCard Merge SmartCard Save Change SmartCard to gt In the Virtual Transmit Engine VTE Setup dialog select This Port Background fili Transmit mode __ ia ae pattern inside the p ate IP packet between Front ie eaten H the IP header and the signature field a sa an is Al i ir Interpacket Gap Error Generation ONCH USGA efault is set for l Full Wire Speed O E E B Select Error Alignment 7 Symbol Lome Mee Generation type Units olson Enable of Packets 4 Layer 3 Cancel This dialog allows you to configure streams Although you can vary many parameters most fields are optional
9. There are three preferences which merit quick consideration Choose Options gt Preferences The default inter ARP gap is set to 9 6 uSec as a standard specification and by default cannot be changed for a SmartCard However 1f you wish to change this gap for instance if a switch cannot process ARP requests at full wire speed you must turn on the Preference checkbox Allow time control of ARP requests Then you can re set 8 SmartWindow User Guide 145 146 Chapter 7 SmartMetrics Testing Setting One Stream per Card the inter ARP gap for each port as needed right click the SmartCard and choose Layer 3 Setup e To automatically update with speeds duplex mode and auto negotiation settings the Fast Ethernet cards with the last saved configuration or a newly opened configuration file click the checkbox Restore MII Control register 0 after File Open Smatwindow Preferences East Ethernet Cards S s05 59 7810 ML Pee T Allow MII Auto Megotiate T Restore Ml Control register 0 after File Open I Restore Ml Control register 0 after Connect General T Connect to SmartBits at Startup Initialize Ports after Connect M Initialize Ports after File Open or File New M Display 3D dialogs M Use small fonts in dialogs Se B 05 TOMb Ethernet T Allow bit level control of YFD1 amp 2 T Use Left Click popup menu over SmartCards Smarth etice Ethernet Cards L3 Tia Eo aie beanie vee saa aA ERE MERE hs O estore d
10. e Traffic can be used to test Layer3 Multiple frame blueprints i Index 1 MAC Dest MACS Prot Header Signature CRC different rc yload Signature CRC protocols and Index 2 MAC Dest MAC Src Prot Header Payload varied frame Index 3 MAC Dest MAC Src IP Prot Header Payload sizes possible in Index 4 MAC Dest MAC Src Prot Header Payload stream configurations If enabled the Signature field overwrites 18 bytes of data at the end of the payload It contains information such as the time stamp Steam ID and frame sequence Figure 7 4 Four Streams frame blueprints on a single SmartMetrics card Ethernet and Frame Relay cards in SmartMetrics mode support the use of a Signature field This field contains information about the specific frame The information in the Signature field is a powerful feature used by the receiving card to analyze network traffic Histograms 2 SS ee Se Gmi iU ee ee Ge a Ee tes GS en Se Ee ee de a F a A 2 byte 4 byte stream VTE 4 byte sequence 4 byte Tx timestamp 4 byte check pattern time offset number count inverse timestamp lt Bits 0 15 Stream VTE ID 1 n Bits 16 23 Card ID 0 79 Bits 24 27 Chassis ID 0 for now Bits 28 31 Check Number example IP 2 Figure 7 5 SmartMetrics signature field SmartWindow User Guide Chapter 7 SmartMetrics Testing About SmartMetrics SmartMetrics Test Requirements Tx requirements The following must be configured in order for a c
11. 0 4 ta AA CAA ee ee Selected TEs Activate Deactivate Delete Add VTEs Edit Settings for This Fort Selected TEs 10 Options OF M Smarthetrics Mode Repeat above steps 1 through 7 for Port 5 using the following IP addresses Use the Port 5 addresses for Destination IP addresses Port 5 Stream IP addresses 20 0 0 005 through 20 0 0 024 Gateway for Port 5 20 0 0 100 To configure the Dest MAC addresses choose Actions gt Layer 3 ARP to send ARP requests to all configured ports To check that all ports have sent and received ARPs you can perform the ARP Exchange Times test see Viewing ARP Response Times on page 185 To confirm that the SmartBits links to the DUT are working properly ping the port IP addresses as shown in Pinging each SmartCard on page 150 SmartWindow User Guide Chapter 7 SmartMetrics Testing Setting Multiple Streams per Card Using Group Start Creating an SMB Group Transmitting Traffic amp Viewing Counters 1 Frequently it is useful to start all transmissions of multiple SmartCards at the same time To do this right click on SMB Group and choose Set Group Biel Es t Half Halt Half Halt Halt Hed Transmit Setup Tigger Setup Display Counters Hear Eounters Copy SmartBits Data Paste SmartPits Data Set Group 2 Click the None button to clear all ports then click on P
12. 0O wD BAe UNS Oo M SmartMetrics Tests Test Idle Total 20 record s B2 YW The 20 streams are summarized with the minimum maximum and average for each stream The latency range is relatively wide And now the 3 Choose Test Type gt Latency Distribution Click Start button run for a few seconds Latency then click the Stop bottom Click Results button and select the receive Port 02 Here Distribution the latency has dropped dramatically to the later low level shown in step 7 so that the 13 4 to 14 2 mSec shows consistently under the 20 mSec time interval SmartWindow User Guide 183 184 Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results Inspecting Raw Packets Vv To look closely at the content of the last 131 000 packets received use the Test Type Raw Packet Tags test 4 To use full wire rate in Single Burst mode click the Port 4 SmartCard choose Trans mit Setup and click This Port button Set mode to Single Burst and select Units gt utilization and Rate gt 100 in the Interpacket Gap field which will create a 10 sec ond burst at full wire rate Click OK Transmit Setup Smarhindow Port 04 Mode Background Custom H Edit Error Generation CRC Dribble Alignment P Symbol Single Burst ih Count fio T mec Interpacket Gap Rate 17100 Uruts Utilization T Eallisian P Enable of Packets Layer 3 Can
13. and RIP packets that simulate typical background traffic The intervals at which these packets are transmitted can be specified in whole seconds or in 1 seconds for the ML 7710 The Ping Target specifies the IP address to which the Ping packet is sent Some systems cannot handle ARP requests sent at full wire speed If the device s under test misses the ARPs the tests will fail If needed you can set this parameter to set a gap between ARP requests This setting will apply to all ARPs sent from the selected port This feature is only enabled if the Allow time control of ARP Requests check box is set in the Preferences dialog box This dialog allows you to set the InterARP GAP This is the setting that will be applied to all ARP requests sent by all SmartMetrics SmartCards in a chassis Checked The SmartCard replies with Layer 3 MAC addresses to each ARP request it receives without setting up any streams Unchecked Default This is the most common setting for this checkbox The SmartCard does not reply to each ARP request it receives with Layer 3 Setup MAC addresses SmartWindow User Guide 141 142 Chapter 7 SmartMetrics Testing Required Steps for Layer 3 Testing Address Resolution Protocol ARP In order for data streams to be sent through a router the L3 6705 and other multilayer SmartCards have to know the MAC address of the router port and the Router has to know the MAC addresses of the L3 cards This is done
14. conjunction with the Protocol VED to facilitate mesh tests of components such as routers In the Raw Packet Tags test packets are stored and sent directly to SmartWindow without any calculations or filtering performed on the VTE stream tags received The test can store up to 4 000 packet tags The results spreadsheet for the test displays one line of information for every tagged packet of each VTE Note The Raw Packets Test retrieves and displays a maximum of 16 300 packets SmartWindow monitors the received data and displays these results for each packet of each VTE e Port The port on which the packet was received e VTE The number of the VTE identifying the VTE source of the stream e Sequence The packet sequence number which is incremented for each packet transmitted Sequence numbers are maintained independently for each destination VTE stream They are reset to zero whenever the card is started e TxTime The timestamp of when the packet was transmitted It is the timestamp of transmit time for a packet to 100 ns resolution This time stamp is added by the transmit hardware and represents the actual time the packet exited the card rather than the time the packet was prepared for transmission It is an absolute number representing the clock tick at the time of transmission It is relative to Rx Time e RxTime The timestamp of when the packet was received It is an absolute number representing the clock tick at the t
15. e Sequence Latency both16 and 32 bit tests does not apply to ML 7710 SmartCard e 16 Latency per VTE e 16 Latency distribution e 16 Latency over time e ARP exchange times e Raw packet tags e Frame variation The 16 in front of some test options refers to the number of bits available for counter results Tests with no 16 contain 32 bit counters Before running the 16 bit counter tests refer to SmartMetrics 16 bit Tests on page 166 Latency in SmartMetrics Test Results All of the SmartMetrics latency tests measure the difference between transmit and arrival time Specifically this is the difference between the time at which a tagged byte leaves the transmitting port and the time at which that byte arrives at the receiving port However each test result differs in how it measures latency per VTE over time or by distribution The Sequence Latency tests combines three tests Sequence tracking Latency per VTE and Latency distribution Cut Through and Store and Forward Devices Latency test results are typically used to measure the performance of cut through devices Measurement of latency through one or more store and forward switches can be calculated by adding the time to transfer any remaining bytes out of the transmitting port Cut Through devices begin retransmission after receiving packet headers This increases performance over store and forward devices Latency of these devices is described above
16. receive card Port 02 wit Smarhetrics Tests File Edit Actions View Format Window Help lula Da ela Sen el wit Sequence Tracking 6 14 1999 10 24 26 Port 02 ML 7710 untitled P VTE 50 Frames Duplicate Lost Limits 1 1 47599 47549 0 1 2 47598 47451 0 1 3 47598 46899 0 1 4 47598 47598 0 1 5 47598 47598 0 1 6 47598 46950 0 1 7 47598 47598 0 RxPots SDE SE E 01 ML 710 Clot ML 7710 J 1 2 tinii tsi l O02 ML 7710 02 ML 7710 io 1 10 47598 47598 0 re a r C 06 L3 6710 C 06 L3 6710 12 l l Aa in a 5 To set a lighter load and determine the rate at which there is little or no packet loss right click Port 1 select Transmit Setup and click This Port button Transmit Setup Smarhindow Port 01 Mode Background Continuous Edita Error Generation CRC T Dribble T Alignment P Symbol lnterpacket Gap Rate 90 Units Utilization pollistan P Enable of Packets Layer 3 Cancel 6 From the drop down menu for Interpacket Gap select Utilization in the Units field then enter 90 in the Rate field Click OK 7 Click OK again to close the Transmit Setup window 180 9 SmartWindow User Guide Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results 8 Run the Sequence Tracking test again After a few more test runs the 80 load produced the following sequence tracking You may wish to repeat this tes
17. would slightly increase latency for a short time latency would remain constant for most of the test then decrease as the ML 7710 stops transmitting An increasing latency from start to finish indicates that the switch cannot handle the load for long sustained periods As the latency increases the switch buffers more frames A spike in the latency indicates a problem with buffer scheduling and warrants more investigation Maximum Average 1 1044796 145795 9 2 20 1488 0 1 1053946 6 13876 3 3 30 1488 0 1 1055081 4 2501 5 4 40 1488 0 1 0 2 0 2 5 al 1488 0 1 0 2 0 2 E 60 1488 0 1 0 2 0 2 7 fall 1488 0 1 0 2 0 2 gl a0 1488 0 1 0 2 0 2 gl 30 1488 0 1 0 2 0 2 1 After approximately 1 second the latency drops to a reasonable level A possible cause of this change is the use of a Fast Path mechanism 182 SmartWindow User Guide Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results A closer look at 2 Choose Test Type gt Latency per VTE Click Start button run for a few seconds then the Latency per click the Stop bottom Click Results button and select the receive Port 02 Here again VTE spikes in the latency are apparent wit SmarthMetrics Tests File Edit Actions View Format Window Help S He gt a oo Blo S S e Test Type RGIS ata 2 Maximum Average Limits ony nm amp whe eae co O 02 ML 710 02 ML 7710 06 ML 710 O 06 ML 7710 jab b h h t h jt jd fat O
18. 0 or ML 7710 ML 5710 SmartMetrics SmartCard and choose SmartMetrics Mode from the drop down menu then choose Layer 3 Setup Layer 3 Setup Jesse s SMB 2000 Port 06 MAC Address 0o00 00000005 IP Address 000 000 000 000 Caneel Hetmazk 255 000 000 000 Gateway 192 168 011 001 Ping J arget o00 000 000 000 Ping frequency a 110th seconds SNMP frequency a 110th seconds RIF frequency a 1 10th seconds T Reply to all ARP requests do not use for on line testing SmartWindow User Guide Chapter 7 SmartMetrics Testing Required Steps for Layer 3 Testing Table 7 1 Layer 3 Setup field descriptions Field MAC Address IP Address Gateway Netmask Ping Target InterARP GAP Reply to all ARP requests Description A user defined MAC address for the SmartMetrics SmartCard used to respond to ARP requests from connected devices These responses are only transmitted if the Reply to all ARP requests box is checked The SmartMetric SmartCard s IP address This address should be different from the IP addresses of the Layer 3 streams The gateway should be set to the IP address of the router port connected to the SmartCard A valid gateway IP address must exist either in this dialog box or in the Gateway field in the Virtual Transmit Engine VTE Setup dialog box This is the netmask used in conjunction with the Gateway router port The L3 6705 L3 6710 or ML 7710 SmartCards can issue Ping SNMP
19. 1 002 198 019 0 activated You Y FRR RR FF RF RF OO OO O0 0O O0 01 IP 199 079 007 002 019 0 i fF fF RE EE EE EE Od Go Gd Gio Goi iP ja gia cor oo ji Deactivate can add other 5 1235 FEE FE FEFE OO 00 00 00 00 01 IF 158 015 001 002 Delete VTEs includin g variable length Add TEs frames Edit Settings for This Port Selected YTE V SmartMetrics Mode Options OK Cancel Make sure this box is checked 3 Choose Options gt SmartMetrics Tests from the Main Menu The SmartMetrics Tests window is displayed SmartMetrics Tests File Edit Actions View Format Window Help come e Hae Se BE a 16 Latency per YTE M Latency distribution Raw packet tags Frame Variation O 06 L3 6710 SmartWindow User Guide 159 160 Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests 10 11 Select the test you want to run from the Jest Type drop down menu Specify any parameters needed for the test such as intervals for Sequence Latency test results Select the transmitting and receiving ports Click the Start button to start the test While the test is running the port selection area and most toolbar buttons are greyed out The status bar at the bottom of the window displays Test Running Click the Stop button to stop the test The status bar at the bottom of the window displays Test Idle To view test results click the Results button The Results drop down menu appears
20. 1000 streams you may need to allocate 5 to 7 Mb of hard drive Multiply by 20 cards 120 Mb of hard drive per test setup Multiply by 4 chassis 480 Mb of hard drive per test setup If you want to make histogram measurements double your estimated hard drive requirement SmartWindow User Guide 139 140 Chapter 7 SmartMetrics Testing Required Steps for Layer 3 Testing Required Steps for Layer 3 Testing These following steps describe the addresses to set up and the use of ARP exchange which is necessary to route packets properly through attached devices e Layer 3 Setup e Layer 3 ARP Important Testing routers requires some preparatory work You must do these two steps in order prior to running any of the Layer 3 tests Layer 3 Setup A Use the Layer 3 Setup dialog box to configure the required information prior to running SmartMetrics tests on a router and to control management frames per RFC 1944 You must provide the gateway of the router or the Layer 3 switch Caution Never check the Reply to all ARP requests box when connected to a live net work SmartMetrics SmartCards automatically respond to ARP requests Use this box only for back to back testing You can still automatically update the router s ARP table for each stream by selecting Layer 3 Send ARP Requests from the SmartCard s popup menu or Layer3 ARP from the Actions menu Configuring Layer 3 Setup 1 Right click on an L3 6705 L3 671
21. SmartBits Multiport Port Stream Performance Analysis System SmartWindow User Guide Version 6 53 December 1999 imartWindow est Explorer _ for Ethernet Token Ring Frame Relay and ATM 7 SmartMetrics Testing SmartWindow is a highly effective front panel GUI designed for developers and QA personnel who wish to create traditional and custom tests The ML 5710 and 7710 SmartCards can simulate up to 1000 hosts sending varied or uniform traffic to the Layer 3 switch and can fully characterize the switch for both Layer 2 and Layer 3 A range of tests for Layer 3 functions including SmartMetrics tests can be performed that monitor and measure traffic received from any combination of SmartMetrics SmartCards including multiple VTEs sent by multiple SmartCards This allows testing of complex protocol sensitive application and systems scenarios What s in this chapter This chapter contains the following sections Section 1 Layer 3 Switching Section 2 Required Steps for Layer 3 Testing Section 3 Setting One Stream per Card Section 4 Setting Multiple Streams per Card Section 5 About SmartMetrics Section 6 How to Run SmartMetrics Tests Section 7 How to Optimize 16 bit Latency Testing Section 8 SmartMetrics 16 bit Tests Section 9 Other SmartMetrics Tests Section 10 SmartMetrics Test Results Section 11 Detailed Tracking and Statistical Results SmartWindow User Guide 137 138
22. This section illustrates a sample configuration procedure for the latency and sequence tracking tests to inspect the raw packet results by using data capture Performing Latency and Sequence Tracking tests Inspecting Raw Packets Using Triggers and Capture The Latency and Sequence Tracking tests provide valuable statistical data for performance analysis of the Layer 3 switch router 1 Before running these tests confirm that your links are alive m Smarty indow LAH prf Jal Edit Actons Options ET 1000 Help oea S lt gt s gt Transmit Status Tri Collision Receive Cre Error voona MI X ERRE l OnLine T TCF Seral 9920 4 Link displayed on the SmartCard indicates an active link to the DUT In this example the following parameters are set up using 20 streams for Ports 1 and 2 e Transmit Setup Continuous Mode 9 6 uSec interpacket gap for 100 utilization e Frame length for all streams 60 Choose Actions gt Layer 3 Send ARP Requests To run SmartMetrics tests on traffic from Port 1 to Port 2 choose Options gt Smart Metrics Tests SmartWindow User Guide 179 Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results Sequence 4 Choose Test Type gt Sequence Tracking select checkboxes for Tx Port 01 and Rx Port Tracking 02 then click Start button at the bottom of the window After several seconds click the Stop button Then click Results button and select the
23. ard to transmit SmartMetrics streams e The card must be one mentioned in Table 7 2 on page 158 e Streams must exist be activated and Frame Rate gt 0 e Signature field must be activated on all SmartMetrics cards To activate the Signature Field e ML 5710 ML 6705 ML 6710 ML 7710 Edit the smartbit ini file by making the following entry in the Preferences section See Table 5 4 SmartBit ini file important commands and settings on page 87 Layer3 Signature Control 1 e POS cards and LAN 6201 Select the Signature Field checkbox in the Transmit Setup dialog box Rx requirements The following must be configured in order for a card to receive SmartMetrics streams e The card must be one mentioned in Table 7 2 on page 158 e The firmware must support the requested test See Table 7 2 on page 158 e The Card needs to be in SmartMetrics mode e The Card must support the requested test See Table 7 2 on page 158 1 This entry causes a checkbox to appear between Net Dst and ARP in the Virtual Transmit Setup VTE dialog box SmartWindow User Guide 157 158 Chapter 7 SmartMetrics Testing About SmartMetrics Table 7 2 SmartMetrics Cards Test Compatibility Test Type Latency Per VTE Latency over Time Latency Distribution Raw Packet Tags Frame Variation Sequence Tracking Sequence Latency ARP exchange times 16 Latency Per VTE 16 Latency over time 16 Latency distribution L3 6710 No
24. ayer 3 Send ARP The MAC Src is the MAC Requests commands address of the stream Protocol Editor IP File Edit View P IF HAC Dest HAC Sic ToS ID TTL prot SourcelP DestiP 1 0000 a5e391 00 00000gooo00o4 oo O 64 4 010 000 000 010 020 009 000 010 The Source IP is the IP The Dest IP is the address of the stream destination or target IP address y Note Note that when an ARP response is received the ARPs are handled internally therefore the MAC Dest will not be updated 148 9 SmartWindow User Guide Port 5 Layer 3 Setup Stream on port 5 v Chapter 7 SmartMetrics Testing Setting One Stream per Card Important The MAC and IP addresses of streams must be unique to the streams and cannot be used for SMB or DUT ports The Source IP addresses of each stream and its associated SMB port should be on the same subnet as its associated router gateway For Layer 3 routing tests each pair of SMB and DUT ports should be on the separate subnets as suggested in Figure 7 2 8 Now configure the port and stream for ML 7710 Port 5 Right click the Port 5 Smart Card and choose Layer 3 Setup 9 Set the MAC and IP addresses and gateway address as shown below Remember the card must have a different MAC and IP address than any of the streams Layer 3 Setup Smartindow Port 05 Ea MAC Address J0 00 00 00 00 05 IP Address 020 000 000 001 Cancel Netmask 255 000 000 000 Gateway 020 000 000 100 Ping I ar
25. cel Note The two active ML 7710 SmartCards show the live Link status and Burst mode File Edit Actions Options ET 1000 Help Debug Ban Petet kak CE E E Transmit Status Trigger Collision Receive Cre Error Teo D MZN Fo 3 k ey Download SmartBits Smartllards OnLine TCP Sernal 9920 re Burst Mode sends 100 frames from Port 6 to Port 2 5 Nowchoose Options gt Layer 3 Tests and then Test Type gt Raw Packet Tags SmartWindow User Guide Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results 6 Click the Start Stop and Results buttons to view raw packets in detail fie Fay packet tags in microseconds 10 1 1999 18 53 39 Port 02 ML 7 ie E a Chassis Port VTE Sequence TsTime Ax T ine delta 179556 179558 179623 179625 179691 179692 179758 179759 179825 179827 179892 179894 179959 179961 180027 180028 180094 180095 180161 180163 mM Se bo Pa oS on ee ts st 0 0 0 0 0 1 1 1 1 1 ee lM E Notice how the test cycles continuously through the five streams set up on Port 4 Viewing ARP Response Times It can be helpful to look at ARP response times which may vary with traffic load time of day and the characteristics of each switch The ARP response times also confirm that all ports are sending and receiving ARPs properly Perform an ARP 1 Choose Options gt SmartMetrics Tests exchange and view the ARP response times
26. ctive spreadsheet Manipulate highlighted information such as copying and pasting it to another spreadsheet Clear highlighted areas such as an entire line or remove formatting that you set Select whether you want to view the toolbar and or status bar Specify the elements of the spreadsheet you want to appear such as column headings Toolbar and events only and the mouse keyboard actions allowed to edit Define the appearance of the window such as font used and column dimensions Specify how you want multiple spreadsheets displayed in the window Identifies the SmartMetrics Test module Note If results for more than one port are displayed when you save to a file only the active spreadsheet will be saved to the file SmartWindow User Guide Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests SmartMetrics Test Results Window Toolbar e E be Be E eE E amp EE L m The SmartMetrics Test window displays a toolbar if the Toolbar option is checked on the View menu Opens an existing results file Saves the active results file Prints the results file Cuts the selected area to the Clipboard Copies selected area to the Clipboard Pastes selected area from the Clipboard Start transmission Stop transmission Stop getting test results in the current active Results window Stop getting test results in all Results windows Adjust column width to match contents Adjust row height Ar
27. ds all packets received with timestamp data and calculates the average latency for all currently active VTEs The test also records data for discard eligible packets Before running this test refer to SmartMetrics 16 bit Tests on page 166 SmartWindow monitors the received data and displays these results for all packets and as well as separate columns for discard eligible packets e MiulliSec The time interval over which the data was gathered e Frames Total number of packets received e Minimum Maximum Average Minimum maximum and average latency time in microseconds between time sent and time received Running the Latency Over Time test 1 Select Latency over time from the Test Type field drop down menu 2 Specify the Precision in microseconds in the Latency Precision field or use the default Select the ports to transmit VTEs of data in the test Select the ports to be monitored as they receive data Click the Start button to start the tests for all of the ports involved in transmitting and receiving the data streams Run the test for a period of time Then click the Stop button to terminate the test To view the results click the Results button and select the port in the drop down menu SmartWindow User Guide 172 Chapter 7 SmartMetrics Testing Other SmartMetrics Tests EXAMPLE If you set the test for a time interval of 5000 milliseconds and the test runs for minute The Resul
28. ear All Counters Alt Shift C Card Type 67 Eonnect Eg Smartaits 6 Disconnect Shit F S Update Chrl H Send AAF requests from all Smarthetics SmartCards OnLine TCP seral 3920 re SmartWindow User Guide Chapter 7 SmartMetrics Testing Required Steps for Layer 3 Testing 2 To send ARP requests for a single card right click the mouse button on a Layer 3 card then choose Layer 3 Send ARP Requests Ly ML 7710 SmartMetrcs 10 100Mb Ethernet TP Transmit Setup Alteniate liransmit Setup Trigger Setup YIU Megat Bol Dopler Layer 3 Setup v SmartMetics Mode Layer 3 Send ARP Requests IGMP gt 7x10 Setup Mill Registers Capture Display Counters Clear Counters Copy Port Data Paste Port Data Preparing the Device Under Test DUT Important SNMP functionality proprietary polling and Spanning Tree frames gener ated by the DUT will lower the measured performance of the DUT It is recommended that you turn off all traffic generated by the DUT to get performance of the switching fabric SmartWindow User Guide 143 Chapter 7 SmartMetrics Testing Setting One Stream per Card Setting One Stream per Card This section presents introductory startup procedures and a basic test scenario based on a single stream from each SmartCard e Default Global Settings to Review e Preferences to Review e Set Up One Layer 3 Stream per ML 7710 Sma
29. eereramar Router port Stream 010 000 000 014 IANI Fill Decrement gt MAC address MAC address 010 000 000 015 PANI Fill Random gt 010 000 000 016 010 000 000 017 AUNAN 010 000 000 018 Gaeta 010 000 000 019 MAAN nnn 010 000 000 020 QAAN 010 000 000 021 PIATA n rnn 010 000 000 022 User specified entries are required for Source IP and Dest IP Figure 7 3 Editing default IP addresses 158 019 001 002 138 019 001 002 198 019 001 002 138 019 001 002 198 015 001 002 158 019 001 002 138 019 001 002 158 019 001 002 138 019 001 002 198 019 001 002 158 019 001 002 138 015 001 002 158 019 001 002 138 019 001 002 198 015 001 002 158 019 001 002 198 015 001 002 158 019 001 002 135 015 001 002 Stream source IP address 158 019 001 001 138 015 001 001 198 015 001 001 138 015 001 001 198 015 001 001 158 019 001 001 138 015 001 001 158 019 001 001 138 015 001 001 198 015 001 001 158 019 001 001 138 015 001 001 158 019 001 001 138 015 001 001 198 015 001 001 158 019 001 001 198 015 001 001 158 019 001 001 138 015 001 001 Stream destination IP address SmartWindow User Guide 153 154 Chapter 7 SmartMetrics Testing Setting Multiple Streams per Card 7 Click the Close button and view the 20 streams for port 5 in the Transmit Setup win dow Click OK Virtuall ransmitEngine TE Setup Smart indow Port 04 Select the TEs Use the Chl key for multiple selections a ST a a T
30. eive data Click the Start button to start the tests for all of the ports involved in transmitting and receiving the data streams Run the test for a period of time Then click the Stop button to terminate the test To view the results click the Results button and select the port in the drop down menu Adjusting the Precision granularity After you run this test a few times you will be able use the latency results to run other SmartMetrics tests with greater precision 1 Run the test using the default Precision 2 When the test is finished view the results 3 For example if the results fall between 25 6 and 51 2 us adjust the Precision so that 51 2 us falls at the upper limit of the range i e select a Precision of 1 6 us 4 Run the test again Test Type 16 Latency distribution Histogram Precision 1 uSec 29214 10661 5 Ifthe results fall within the lower end of the range modify the buckets for greater granularity 8 SmartWindow User Guide 167 168 Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests You can modify the values in the configurable buckets scale When you run the test again this modifies the header values on the Results spreadsheet Test Type 16JLatency distribution When you change the bucket values the corresponding headers in the Results spreadsheet change too The Latency Distribution Test transmits a burst of packets including variable length packets
31. g to use Randomized Click OK The Protocol Editor appears with default addresses for 20 streams Edit the first stream as follows Source IP address for the first stream 10 0 0 4 Destination IP address for the stream which is the Port 5 VTE stream 20 0 0 5 6 Highlight each column the SourceIP then DestIP individually right click on the first entry select Copy Down then select Fill Increment 0 0 0 x Default view Protocol Editor IP Iof x File Edit View Help IP HAC Dest HAC Srce SourcelP DestiP Editing the Default SourcelP 010 000 000 004 010 000 000 005 010 000 000 006 i 010 000 000 007 fai DestIP FEFE FEEF FEE OO OO OO 0O 0O 04 FF FEFEFE REF OO 0O OO 00 00 04 EF RF RFR FF OO 0O OO 00 00 04 FF FE RF AFR EF OO 0O OO 00 00 04 FF FE RF RFR EF OO 0O OO 00 00 04 FEFE RR RF RF FE OO OO OO 00 00 04 FF FE FEEFFE EE OO 0O 0O 00 00 04 FEFE FR RF FF FE OO 00 00 00 00 04 FF FE RF RF RF OO OO OO 00 00 04 fFF FE EEEF EEEE OO OO OO 00 00 04 00 00 00 00 00 04 00 00 00 00 00 04 00 00 00 00 00 04 00 00 00 00 00 04 00 00 00 00 00 04 00 00 00 00 00 04 FE FF FE EF FF FE FE FF FE FF FF FF FE FF FE EF FF FF Fr FF FE EF FF FE FF FF FE FF FF FF FE FF FE EF FF FF 2 Beeps te Copy FAP FEFE FEFE OO OO DO 00 DO 04 oo ooo ooa oto Gm Eeste FE FE FE FEFEFE DO OO 0O 0O O0 D4 10 000 000 011 MAMA Copy Right FE FEFE FEFEFE DO 00 0O 00 O0 04 010 000 000 012 Pius Copy Down 010 000 000 013 PA IaaST i pre
32. get 000 000 000 000 Ping frequency o 110th seconds SWAMP frequency a 110th seconds AIP frequency o 110th seconds Reply to all ARP requests do not use for on line testing 10 Once addresses are entered click OK Right click the port 5 SmartCard and select Transmit Setup then follow Steps 4 6 Be sure to press the Enter key after each text entry to save it Click the Close button to exit the window Note Note that Source and Destination IPs mirror the settings on port 4 SmartWindow User Guide 149 150 Chapter 7 SmartMetrics Testing Setting One Stream per Card As each SmartCard transmits an ARP request look for a brief green transmit and receive LED If you do not see a momentary green receive LED light the ARP response was not received Pinging to Check Links Learning MAC addresses with Layer 3 ARP Now as an alternate procedure for learning the MAC destination addresses you can send Layer 3 ARPs from each card Protocol Editor IP OF x File Edit View Help IP HAC Dest HMAC Sie ToS ID TTL prot SourcelP DestiP 1 FF FEFEFE EFF OO OO OO 00 OO 05 0 0 64 4 020 000 000 070 010 000 000 010 1 Click on each SmartCard and choose Layer 3 Send ARP Requests or to send ARP requests from all configured ports at one time choose Actions gt Layer 3 ARP 2 Watch the SmartBits hardware or SmartWindow front panel LEDs For other streams and ARPs try the ARP Exchange T
33. if you wish monitors the received latency data and distributes the results into spreadsheet buckets according 16 specified intervals Table 7 3 Bucket default values Bucket Default Value 1 25 6 2 51 2 3 128 4 256 5 512 6 1 280 7 2 560 8 5 120 9 12 800 10 25 600 11 51 200 12 128 000 13 256 000 14 512 000 15 1 280 000 16 1 677 696 SmartWindow User Guide Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests Using the Histogram Precision settings You may change the Histogram Precision setting of the buckets For instance if Precision is set to the default 25 6 us then upper limit of the test will be 1 677 696 us 1 Histogram Precision scale drop down menu 2 controls current bucket values and 3 Header values in Results spreadsheet wit Smarthetrics Tests Iof x File Edit Act ns View Format Window Help F FEEN ejl ou ela Selm el U B Latency Aistribution_ E mut 16 Latency distribution in mic oseconds 671571999 11 52 50 Port 02 Ea Frames lt 25 6 lt 51 2 lt 128 0 lt 256 0 lt 512 4 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127290 127289 127289 127289 127289 1 2 3 4 5 6 7 8 01 ML 7710 O 02 ML 7710 O 03 WN 3420 O 05 WN 3415 O 06 L3 6710 jah t d h jt jd d ft on none wwe SH oO wo
34. ime of receipt It is relative to Tx Time e Delta The amount of change between Tx Time and Rx Time To run the Raw Packet Tags test 1 Select Raw packet tags from the Test Type field drop down list 2 Select the ports to transmit VTEs of data in the test 3 Select the ports to be monitored as they receive data 4 Click the Start button to start the tests for all of the ports involved in transmitting and receiving the data streams Run the test for a period of time Then click the Stop button to terminate the test View the results by clicking the Results button The raw data is shown in the spreadsheet and can be copied or saved for detailed pro cessing elsewhere SmartWindow User Guide Chapter 7 SmartMetrics Testing Other SmartMetrics Tests ARP Exchange Times Test This is a test of ARP Address Resolution Protocol response For each VTE stream that uses IP or UDP the card transmits an ARP request The timestamp of the request and its response is stored per stream Information is stored for each active stream For each VTE stream SmartWindow displays these results e DestMAC the MAC address of the connected device under test e ReplyTime the time in microseconds before an ARP response was received To run the ARP Exchange Times test 1 Select ARP Exchange Times from the Test Type field drop down list 2 Select the ports to transmit VTEs of data in the test 3 Select the ports to be monitored as they receive da
35. imes test to ensure that ARPs for all streams were received See Viewing ARP Response Times on page 185 Pinging each SmartCard Before transmitting traffic it is worthwhile to ping the SmartCard IP addresses to confirm that the links to the DUT are working properly 1 Right click on port 4 choose Layer 3 Setup enter the target IP address for port 5 and set the ping frequency to 10 Layer 3 Setup Smartindow Port 04 MAC Address pooo onoono IP Address 010 000 000 001 Cancel Netmask 255 000 000 000 Gateway 010 000 000 100 Ping I arget 010 000 000 150 i 0 110th seconds SWAMP frequency a 110th seconds Ping frequency AIP frequency a 110th seconds Reply to all ARP requests do not use for on line testing 2 Click OK Right click on port 5 select Layer 3 Setup enter the target IP address for port 4 and set the ping frequency to 10 4 Click OK SmartWindow User Guide Chapter 7 SmartMetrics Testing Setting One Stream per Card The ML 7710 default is 10 Mbps You may require 100 Mbps Transmitting Traffic and Viewing Counters 5 To view counters for pings choose Actions gt SmartCounters then choose File gt New Counter Window Highlight ports 4 and 5 Click on the Start command on each SmartCard and watch SmartCounters for the ping counters After the pinging is performed go back to the Layer 3 Setup of each card to turn off pinging by setting the Ping F
36. n the correct sequence and whether there are duplicate or missing packets This test is a combination of the Sequence Tracking Latency per VTE and Latency Distribution tests The Sequence and Latency test is run per VTE stream SmartWindow reports test results for each active VTE stream separately For the duration of the test the results show the minimum maximum and average latency in microseconds for each VTE stream received from each port transmitting to the receiving port SmartWindow User Guide Chapter 7 SmartMetrics Testing Other SmartMetrics Tests Important This test does not apply to ML 7710 SmartCards SmartWindow monitors the received data and displays results for e Port Transmitting port number e VTE Transmitting VTE stream number e Frames Total number of packets received InSeq Number of packets received in sequence Duplicate Number of duplicate packets received e Lost Number of packets lost e Minimum Maximum Average Minimum maximum and average latency time in microseconds between time sent and time received e 16 Latency intervals Latency distribution for default or user specified times in microseconds y Note For this release use a rate less than 133 000 per second You set the rate at the Interpacket Gap area of the Transmit Setup dialog box To run the Sequence Latency test 1 Select Sequence Latency from the Test Type list box 2 Enter a time in microseconds for an i
37. ndow right click on the ML 7710 Port 4 SmartCard and choose Smart Metrics Mode 2 Click the SmartCard again then choose Layer 3 Setup The Layer 3 Setup window describes the local stack and is optional for most testing requirements This window is edited for the following purposes To set the gateway IP address of the router port DUT REQUIRED for Layer 3 switches To change MAC and IP addresses if needed so that they do not duplicate stream addresses To set the netmask for management frames if needed optional ignored by streams To specify a Ping IP address for pings and SNMP frames if needed optional To specify frequency for Ping SNMP or RIP optional 3 Set the MAC and IP addresses and gateway address as shown below Gateway is the IP address of router port MAC address is for the card not stream The IP address must be in the same subnet as the router port gateway Once addresses are entered click OK Layer 3 Setup SmartWindow Port 04 MAC Address oono op oo Of IP Address 010 000 000 001 Cancel Netmask 255 000 000 000 Gateway far 0 000 000 100 Ping Target 000 000 000 000 Ping frequency p 110th seconds SNMP frequency po 1 10th seconds RIF frequency po 1 10th seconds Inter SAP Gap j T Reply to all ARP requests do not use for on line testing Warning Do not check the Reply to all ARP Requests checkbox on a live network This is useful for unidirectional traffic only
38. nt Frames You can add management frames RIP and SNMP to any SmartMetrics tests as per RFC 1944 from the Layer 3 Setup dialog box Management frames are relatively low rate streams containing authentic packets that are designed to inject management and routing control traffic into a test stream Note If you display results for more than one port at a time when you save to a file only the active spreadsheet will be saved to the file Viewing SmartMetrics Test Results Histograms To view results for a single destination SmartCard 1 Click the Results button or select Actions gt Get Results from the menu 2 Select the port for which you want to view results A spreadsheet containing the results appears in the right pane of the window 3 Specify any formatting or window elements that you want using the toolbar or menu bar options To view results for more than one port repeat these steps Spreadsheets for subsequent ports that you select will display in the window according to which command 1s in effect on the toolbar To change the order in which the results are retrieved 1 Click the Results button then choose Options from the pop up menu 2 From the SmartMetrics Test Options dialog select the port to reorder the test results SmartWindow User Guide Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results Detailed Tracking and Statistical Results Performing Latency and Sequence Tracking Tests
39. nterval and press Enter or use the default times that are displayed for the test These times are used to create a histogram of packets received within the specified time intervals You can specify up to 16 counter ranges incrementing each histogram counter for each packet received within the range of the counter Each counter can be specified in bit times for example 0 1 usec 3 Then select which time intervals you want to use for the test If you do not select any intervals each of the 16 will be used 4 Select the ports to transmit VTEs of data in the test Only SmartMetrics SmartCards appear Select the ports that will be monitored as they receive data Click the Start button to start the tests for all of the ports involved in transmitting and receiving the VTE data streams 7 Run the test for a period of time Then click the Stop button to terminate the test 8 View the results by clicking the Results button You can save the results to an Excel or Layer 3 Editor file or copy and paste them to other applications SmartWindow User Guide 173 174 Chapter 7 SmartMetrics Testing Other SmartMetrics Tests Raw Packet Tags Test In Layer 3 VTE streams contains a 16 byte packet tag field in each transmitted packet This tag is inserted at the end of the packet and consists of packet sequence number source VTE stream destination VTE stream and timestamp This function is used to determine transit latency and in
40. ort 1 and Port 2 checkboxes to constitute the group All other ports are grayed out because the box in use is fitted for Multi user Then click OK SmarBits MultiPort Selection x 1234567 8 910111213141516171819 20 ed Bf El Ei tt Cancel 3 To see results of multiple SmartCards on a single screen choose Actions gt SmartCounters Then choose File gt New Counter Window Highlight the port numbers whose counters you wish to view here Ports 1 and 2 Keep this win dow open Choose View gt Show and check the boxes for rows and columns To define a custom indicator select an empty cell to the right of the cells where data will be entered Left click inside this cell then insert your math equation press F2 twice using spreadsheet conventions 6 Now click Start on the SMB Group and watch SmartCounters 6 SmartWindow User Guide 156 Chapter 7 SmartMetrics Testing About SmartMetrics About SmartMetrics SmartMetrics refers to a method of generating test traffic that supports many unique streams definitions Some of the characteristics of Ethernet and Frame Relay SmartMetrics are e Unique streams of traffic generated from multiple frame blueprints e Information tracking on a per stream basis as opposed to a per port basis e A CRC check on the entire frame e Embedded Signature fields with information about each frame e In depth latency and sequence information e An IP checksum for IP streams
41. range open files in cascade formation Arrange open Results files in tile formation horizontally SmartWindow User Guide 163 Chapter 7 SmartMetrics Testing How to Run SmartMetrics Tests im Arrange open Results files in tile formation vertically Display About information for the current window 164 SmartWindow User Guide amp Chapter 7 SmartMetrics Testing How to Optimize 16 bit Latency Testing How to Optimize 16 bit Latency Testing The notion of having to know the latency of a DUT before running a latency test may seem like a backwards approach to latency testing However the reason for latency tests is to verify the accuracy of your own latency estimates Netcom Systems recommends that you proceed as follows 1 Using your own Latency estimates for a given DUT run the Latency Distribution Test as described in 6 Latency Distribution Test on page 167 Take a look at the results Are the latency results distributed over a few buckets e Reset the Precision to narrow the scale For example if the latency results fall within two or three buckets toward the center at the default precision of 25 6 us you can change the Precision factor and run the test again e Try using several frames of variable lengths When you are satisfied with the granularity of the Latency Distribution Test run the other latency tests Refer to SmartMetrics 16 bit Tests on page 166 for addi
42. requency to 0 This will keep other results more clearly segregated Checking SmartCard Speed Setting If the link 1s not active check that the correct speed is selected To reset the SmartCard speed click on each card and select JOOMbps from the drop down menu of each SmartCard nigger setup 100 Mea ESR Full Duplex Now you are ready to transmit traffic and view counters 1 Choose Actions gt SmartCounters then choose File gt New Counter Window to view all counters during transmission Repeat for the port 5 SmartCard You can save SmartCounters to an Excel spreadsheet file with the File gt Save As com mand Click Start on transmitting SmartCard to start transmission For bi directional trans mission click Start on both SmartCards 6 SmartWindow User Guide 151 Chapter 7 SmartMetrics Testing Setting Multiple Streams per Card Setting Multiple Streams per Card This section presents detailed procedures for creating and using multiple streams on two ML 7710 SmartCards and then producing counters and test results e Setting Up 20 Streams per ML 7710 SmartCard e Creating SMB Group Transmitting Traffic and Viewing Counters This test setup uses two ML 7710s Additional SmartCards that support this test gt Setting Up 20 The following procedure describes how to quickly set up 20 consecutive streams from Streams per ML each SmartCard with varied IP and MAC addresses as well as with va
43. ried packet lengths 7710 SmartCard If desired you can also assign different protocols and add up to 1000 streams to further Two L3 6710s or ML 5710s could be substituted for the ML 7710s mimic real world networks One ML 7710 card configured with 40 streams can easily simulate 40 PC Hosts sending and receiving traffic through a DUT 1 Click on the Port 4 SmartCard and choose Transmit Setup Highlight the default stream and click the Delete button It is helpful to delete the default stream and then configure all new streams 2 Click Add VTEs Add VirtuallransmitEngine Smarta indow Port 04 wes Frame Length Cancel E Giles E0 Protocol P 3 Enter 20 VTEs Click the Randomized radio button in the Frame Length field Select IP from the Protocol drop down menu 152 SmartWindow User Guide To change IP address defaults 1 Edit Stream 1 Source and Dest IP address 2 Hightlight Source IP column right click then Copy Down gt Fill Increment 0 0 0 x 2 Highlight Dest IP column right click then Copy Down gt Fill Increment 0 0 0 x MAC destination addresses are filled by ARP exchange Chapter 7 SmartMetrics Testing Setting Multiple Streams per Card Note Netcom Systems recommends that you start with Fixed frame lengths to set initial testing benchmarks then try Randomized frame lengths for contrast However for this test we are goin
44. rtCard e Pinging and ARPing to Check Links e Transmit Traffic and View Counters The test configuration illustrated in the first five procedures has the following connections e Two ML 7710 SmartCards are installed in slots 4 and 5 of a SmartBits chassis e The SmartBits chassis is connected to a PC with SmartWindow via an Ethernet port e The two ML 7710 ports of the SmartBits chassis is connected to two gateway ports on the Layer 3 switch router Device under Test This test setup uses two ML 7710s Additional SmartCards that support this test Two L3 6710s or ML 5710s could be substituted for the ML 7710s Review Default The default settings of each SmartCard should be checked to ensure that they are Global Settings appropriate 1 Open SmartWindow File Edit Actions Options ET 1000 Help Cc tel Bs O Transmit olo Status Trigger Collision Receive Cre E War _ F 4 Y tt 4 tt kt E kt 4 4 4 4 4 4 4 Mode gt Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half Half VCODD MZA Card Type 7710 7710 7710 7710 a 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 6205 Smartees 01 02 03 04 07 08 09 10 11 12 13 14 15 16 17 18 19 20 1 Netom _ E ceed ee ee ed ed ed p svs reo s Start Start Start Start Start Start Start Start Start Start Start Start Start Start Start
45. s 429 4sec The lower limit is used to select the range in the Histogram Precision scale 16 Latency per VTE Test The Latency per VTE test checks the latency for each active VTE of the transmitting port Before running this test refer to SmartMetrics 16 bit Tests on page 166 SmartWindow monitors the received data and displays these results e Port Transmitting port number e VTE Transmitting VTE stream number e Frames Total number of packets received e Minimum Maximum Average Minimum maximum and average latency time in microseconds between time sent and time received SmartWindow User Guide Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests Running the Latency per VTE test 1 Select Latency per VTE from the Test Type field drop down list Specify a Precision in microseconds in the Latency Precision field or use the default Select the ports to transmit VTEs of data in the test Select the ports to receive data n Aa Ww N Run the test for a specified period of time Then click the Stop button to terminate the test 6 To view the results click the Results button and select the port in the drop down menu The values show the latency of all received packets in the burst and are dependent on the Precision setting 16 Latency Over Time Test You must specify a time period e g 1 millisecond increments The test will store results in up to 4 000 data collectors The test recor
46. sent and received Each stream has its own IP MAC source and destination addresses frame length protocol or custom packet IP gateway for routing and statistics histogram tracking capability With IP each stream also has ARP request and response ability The stream of one card typically transmits to the stream of another card simulating transmission from one host computer to a second host computer Both can be on the same subnet or on different subnets If 10 streams are defined the 10 packets are transmitted in the order created then re cycled to transmit the next 10 until the transmission is stopped If only one stream 1s created for a card then the traffic is comprised of the one packet type Each ML 7710 SmartCard may transmit up to 1000 streams per card and may track statistics histogram information on up to approximately 80 000 streams SmartWindow User Guide Chapter 7 SmartMetrics Testing Layer 3 Switching Unlike the older SmartCards such as the SX 7410 Ethernet SmartCard which is a packet blaster for hubs and switches the ML 5710 and 7710 are equivalent to 1000 IP connections now condensed into a simple format for creating 1000 streams which closely mimic real world traffic Place 20 ML 7710 cards into a SmartBits chassis then stack 4 chassis with 80 cards you can simulate up to 80 000 streams Hard Disk Requirements for Streams Each stream s setup configuration requires 4 5 Kb per stream per card For
47. t a number of times over a period of time to track the consistency of the router and potential interruptions during the same and different loads with increased or decreased number of streams with varied frame lengths either fixed or random m Sequence Tracking 6 14 1999 11 22 36 Port 02 ML 7710 untitled D Fot WTE Frames n5eg Duplicate Lost co Oy oe wo ha aA Zi kei k ee a l mo MNM N P to Po oc ow co D Z AAA AA AA AAAA AAAA AAGA AA GAA GAA D oo ce co co 7 AAG 7 GA GAA GA AA 1 1 1 1 1 1 1 1 L 1 1 1 1 1 1 L 1 1 hh oo The remaining tests are run at the 80 utilization rate with the same switch SmartWindow User Guide 181 Chapter 7 SmartMetrics Testing Detailed Tracking and Statistical Results Latency Tests 1 Choose Test Type gt Latency over Time Click Start button run for a few seconds then click the Stop bottom Click Results and select the receive Port 02 File Edit Actons View Format Window Help sael ESO Ha SO SEO el l f t Latency over time in microseconds 10 1 1999 16 53 11 Port 02 Test Type Latency over time la l Frames Revd Minimum Masinnurn Average ee 148662 0 0 2 E 148807 0 1 0 2 02 1000 148808 0 1 0 2 Z 148808 0 1 0 2 Oz 148807 0 1 0 2 Oz 148808 0 1 0 2 Z 146807 0 1 0 2 148808 0 1 O2 C02 ML 7710 02 ML 7710 ee ai 0 2 D e 06 ML 7710 O06 ML 7710 101 10000 25619 0 1 0 2 0z 11l 11000 0 i An ideal switch
48. ta 4 Click the Start button to start the tests for all of the ports involved in transmitting and receiving the data streams Run the test for a period of time Then click the Stop button to terminate the test View the results by clicking the Results button Frame Variation Test Packets that were transmitted at regularly spaced intervals can be delayed once they enter the network and arrive at varying intervals due to factors such as jitter or the device s buffering This test measures variations in how soon one packet follows another in a VTE stream It measures for example the time interval between packets and 2 then between packets 2 and 3 and so on as they arrive at the device under test This test plots the number of packets that arrive within each of the 16 user specified time intervals SmartWindow monitors the received data and displays these results for each packet of each VTE e Port The port on which the packet was received e VTE The number of the VTE identifying the VTE source of the stream e Frames Total number of packets received e 16 Intervals Time interval default or user specified times in microseconds by which to track packet arrival times To run the Frame Variation test 1 Select Frame Variation from the Test Type field drop down list 2 Enter a time in microseconds for an interval and press Enter or use the default times that are displayed for the test These times are used to create a his
49. tional information on setting up 16 bit tests SmartWindow User Guide 165 166 Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests SmartMetrics 16 bit Tests 16 bit SmartMetrics Tests may generate incorrect results when numbers exceed the upper limit of a given Histogram Precision range When this occurs the results displayed are meaningless and the test should be run again within prescribed guidelines for a given DUT SmartMetrics Tests use a 32 bit latency counter whenever possible to gather and display statistical data Some earlier cards only had 16 bit counter capability for gathering statistical data this is a firmware limitation However for cards that do support 32 bit counters only 16 bits out of 32 bits are retrieved and displayed for the 16 bit test results The retrievable 16 bit portion depends on the Precision setting By default the Precision is set to 25 6 a range of 25 6 us to 1 677 696 us 1 6 secs This limitation only applies to the 16 bit tests all 32 bit tests such as Raw Packet Tag test Sequence Tracking test etc use the entire 32 bit counter contents and no Precision setting 1s required The following SmartMetrics Tests are affected e 16 Latency per VTE e 16 Latency over Time e 16 Latency Distribution As an example suppose you run the 6 Latency per VTE test transmitting a single burst of frames from the SmartBits Port 1 through a DUT back to Port 2 on the SmartBi
50. to set up transmission of IP addresses Important The gateway IP address is the target address for ARP frames If the gateway IP address is zero the ARP frames will target the destination IP addresses of the streams SmartWindow User Guide 147 Chapter 7 SmartMetrics Testing Setting One Stream per Card 4 Right click the card then choose Transmit Setup Highlight the default stream and click the Delete button The default stream is deleted so that it can be replaced with more fully defined streams Virtuall ransmitEngine TE Setup Smartindow Port 01 of Select the TEs Use the Chl key for multiple selections Selected VTE Len MAC Dst MAC Src AR Plus isis set 160 fF FR RFR RF E OOOO 00000001 0000 Arch ete 5 To add a stream to Port 4 click the Add VTEs button Choose P from the Protocol pull down menu and click OK Use Figure 7 2 as a guide for entering the IP addresses of the streams Stream on Port 4 ZN PC workstation Stream 1 Port 4 with SmartWindow Source IP 10 0 0 10 Dest IP 20 0 0 10 Stream 2 Port 5 Source IP 20 0 0 10 Dest IP 10 0 0 10 Switch Router Figure 7 2 Stream IP addresses by port association 7 Inthe Protocol Editor choose View gt Invert Table then View gt Concise Detail to see more fields Enter the appropriate addresses MAC Dest is the MAC address of router port it may be automatically updated via the Actions gt Layer 3 ARP or the L
51. togram of packets received within the specified time intervals SmartWindow User Guide 175 176 Chapter 7 SmartMetrics Testing Other SmartMetrics Tests You can specify up to 16 counter ranges incrementing each histogram counter for each packet received within the range of the counter Each counter can be specified in bit times for example 0 1 Usec Select which time intervals you want to use for the test If you do not select any inter vals each of the 16 will be used Select the ports to transmit VTEs of data in the test Only SmartMetrics SmartCards appear Select the ports that will be monitored as they receive data Click the Start button to start the tests for all of the ports involved in transmitting and receiving the VTE data streams Run the test for a period of time Then click the Stop button to terminate the test View the results by clicking the Results button SmartWindow User Guide Chapter 7 SmartMetrics Testing SmartMetrics Test Results SmartMetrics Test Results The SmartMetrics tests emulate live network traffic They provide information about the relationships and timing of frames so you can evaluate the functionality and performance of a device under load They dynamically track data per stream and change in latency Since the results are in spreadsheet format you can also obtain totals for a single SmartCard The stream based SmartMetrics test results include e Sequence tracking
52. ts Each frame s latency is estimated at 100 us We send a single burst but when the test finishes the cumulative latency does not fall between 25 6 us 1 68 seconds The test results are incorrect and we need to recalculate the burst size in frames or change the latency range For greater granularity the expected latency for one frame should fall somewhere close to the lower limit of the target Precision setting in Table 7 4 Caution When running 16 bit SmartMetrics Tests you should take the following con ditions into consideration e At Precision 6 5 milliseconds the maximum time of any 16 bit test is 429 seconds SmartWindow User Guide Chapter 7 SmartMetrics Testing SmartMetrics 16 bit Tests 16 Latency Distribution Test The following section describes how to optimize and run this 16 bit test As explained in How to Optimize 16 bit Latency Testing on page 165 this test is used to e Narrow down latency estimates e Calculate the number of frames in a burst e Optimize the Precision setting for other 16 bit latency tests Running the Latency Distribution test 1 From the SmartMetrics Tests window select Latency Distribution from the Test Type drop down menu 2 Specify a Precision in microseconds in the Histogram Precision field or use the default See Using the Histogram Precision settings on page 169 Select the ports to transmit VTEs of data in the test Select the ports to be monitored as they rec
53. ts spreadsheet will contain 12 rows showing the number of packets minimum maximum and average latency during that time period Other SmartMetrics Tests Refer to Required Steps for Layer 3 Testing on page 140 to set up Smartmetrics tests and How to Run SmartMetrics Tests on page 159 to run them Sequence Tracking Test The Sequence Tracking test checks if any packets were dropped not received or received out of sequence for each active VTE SmartWindow monitors the received data and displays results for e Port Transmitting port number e VTE Transmitting VTE stream number e Frames Total number of packets received InSeq Number of packets received in sequence Duplicate Number of duplicate packets received e Lost Number of packets lost To run the Sequence Tracking test 1 Select Sequence Tracking from the Test Type field drop down list Select the ports to transmit VTEs of data in the test 2 3 Select the ports to be monitored as they receive data 4 Click the Start button to start the tests for all of the ports involved in transmitting and receiving the data streams Run the test for a period of time Then click the Stop button to terminate the test View the results by clicking the Results button Sequence Latency Test The Sequence Latency test checks packet tags to verify that packets transmitted by other SmartMetrics SmartCards are received correctly whether they are received i
54. uplex setting atter riles Upen Default 4 6 TA 8405 Token Aing T Context menu Speed Duplex control Default Gateway joni 001 001 001 Restore ring parameters after File Open T Use BuillnAddress as Sourcedddress Use UpstreamNeighbor as Dest ddress cancel _ e To allow MII auto negotiation for all the Fast Ethernet SmartCards check Allow MII Auto Negotiation Then to selectively enable auto negotiation for each or any SmartCard click the SmartCard select MII Registers and click Enable Auto Default Netmask 255 255 255 255 T Default to Smarthetrics mode after File New Negotiate Setting Up One This procedure shows how to configure a single stream in each of two ML 7710 Layer 3 Stream SmartCards ports 4 and 5 of an SMB 2000 chassis with SmartWindow The SmartBits per ML 7710 chassis is connected to a Layer 3 switch or router It is helpful to set IP address SmartCard assignments in patterns that are easy to remember and interconnect Before setting up streams you need to configure the IP addresses of the SMB and DUT ports Figure 7 1 illustrates a sample topology ZN Port 4 Port 5 PC workstation 10 0 0 1 20 0 0 1 with SmartWindow Gateway Gateway 10 0 0 100 20 0 0 100 255 0 0 0 255 0 0 0 Switch Router Figure 7 1 2 ML 7710 cards connected to router ports SmartWindow User Guide Port 4 Layer 3 Setup Chapter 7 SmartMetrics Testing Setting One Stream per Card 1 In SmartWi
55. using ARP Address Resolution Protocol packet exchanges ARP maps an IP address to a MAC address This IP address is the address of the Router port connected to the L3 card not the IP destination of a packet The router port address is specified in the entry called Default Gateway When this entry is set that is not zero the ARPs generated by the L3 card will go to this address instead of the specified IP destination address The Router will also issue ARP requests to the L3 cards These will be replied to by either the local stack or the protocol stream if the target IP address in the ARP request packet matches the Source IP address in the stream or stack If a VFD has been set up for the destination IP address then the ARPs will fail In this case the alternative is to set a General ARP Reply flag which will cause the L3 card to respond to all unsatisfied ARP requests using a MAC address generated from the card number Sending Layer 3 ARP Requests To ensure proper transmission of VTEs of data through routers and Layer 3 switching products it is normally necessary to send a Layer 3 ARP on behalf of the active streams 1 To send ARPs from all Layer 3 cards choose Actions gt Layer 3 ARP This is should be done each time the device or devices under test are connected pow ered up or reset Transmit Status Trigger Collision t uU SB Queries Start All Cards FS Stop All Cards FE SmartCounters F3 Boece Cl
Download Pdf Manuals
Related Search