Cisco ASR 9000 Architecture and Troubleshooting
Contents
1. CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 78 Pau c i hi W REB VER WR W oo Uo Em LC amp NP Resources L2 service resources RP 0 RSP0 CPU0 rasr9000 2w a show 12vpn forwarding resource hardware ingress detail location 0 0 CPUO wed Dec 11 22 26 07 070 EST L2VPN forwarding resource availability summary state GREEN shared memory resource CurrMode GREEN CurrAvail 1609412608 bytes MaxAvail 1650212864 bytes AC hardware resource GREEN MPLS hardware resource GREEN PBB PORT hardware resource GREEN NHOP hardware resource GREEN L2TP hardware resource GREEN L2TP SESSION hardware resource GREEN VFI hardware resource GREEN BRIDGE hardware resource GREEN BRIDGE SHG hardware resource GREEN BRIDGE PORT hardware resource GREEN BRIDGE MAC hardware resource GREEN MSTI MAIN PORT hardware resource GREEN BRIDGE MAIN PORT hardware resource GREEN MCAST TABLE hardware resource GREEN MCAST LEAF hardware resource GREEN MCAST XID hardware resource GREEN PBB BMAC SA hardware resource GREEN CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 79 Pau c i h WE BER EE WR WR oo Uo Am TCP Resources TCP connections states RP 0 RSPO CPUO rasr9000 2w a show tcp brief Fri Dec 13 22 29 33 189 EST PCB VRF ID Recv Q Send Q Local Address Foreign Address State 0x10174ad8 0x60000000 0 0 179 220 LISTEN 0x101745f8 0x60000001 0 O 1792. pfm node rp 354 65PLATFORM DIAGS 3 PUNT FABRIC DATA PATH FAILED Clearlonline diag rsp 237686 System Punt Fabric data Path Test 0x2000004 failure threshold is 3 slot NP failed 0 2 CPUO 0 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 77 P MZ ASN i hi W RE VER WR W oo UD Em LC amp NP Resources L3 forwarding resources RP O0 RSPO0 CPU0 rasr9000 2w a show cef resource hardware ingress detail location 0 0 CPUO wed Dec 11 22 27 57 319 EST CEF resource availability summary state GREEN CEF will work normally 1pv4 shared memory resource CurrMode GREEN CurrAvail 1609412608 bytes MaxAvail 1683308544 bytes 1pv6 shared memory resource CurrMode GREEN CurrAvail 1609412608 bytes MaxAvail 1683308544 bytes mpls shared memory resource CurrMode GREEN CurrAvail 1609412608 bytes MaxAvail 1683308544 bytes common shared memory resource CurrMode GREEN CurrAvail 1609412608 bytes MaxAvail 1683308544 bytes DATA TYPE TABLE SET hardware resource GREEN DATA TYPE TABLE hardware resource GREEN DATA TYPE IDB hardware resource GREEN DATA TYPE IDB EXT hardware resource GREEN DATA TYPE LEAF hardware resource GREEN DATA TYPE LOADINFO hardware resource GREEN DATA TYPE PATH LIST hardware resource GREEN DATA TYPE NHINFO hardware resource GREEN DATA TYPE LABEL INFO hardware resource GREEN DATA TYPE FRR NHINFO hardware resource GREEN DATA TYPE ECD hardware resource GREEN
3. router bgp 100 l2vpn policy map foo mpls ldp ipv4 access list block junk Admin Chassis operations i e fans amp power RP 0 RSP1 CPUO viking 1 admin Config register lt 0x1922 gt show platform Admin Config admin plane config CSC ASR9000 e asr9001Cadmin show platform Node Type State Config State O RSPO CPUO ASR9001 RP Active IOS XR RUN PWR NSHUT MON O FTO SP FAN TRAY READY 0 0 CPUO ASR9001 LC IOS XR RUN PWR NSHUT MON A9K MPA 4X10GE OK PWR NSHUT MON A9K MPA 4Xx10GE OK PWR NSHUT MON 0 PM0 SP A9K 750W AC READY PWR NSHUT MON eee asr9001 nv EdgeCadmin show platform Node Type State Config State O RSPO CPUO ASR9001 RP Active IOS XR RUN PWR NSHUT MON 0 FTO SP FAN TRAY READY 0 0 CPUO ASR9001 LC IOS XR RUN PWR NSHUT MON 0 0 0 A9K MPA 20X1GE OK PWR NSHUT MON 0 0 1 A9K MPA 4X10GE OK PWR NSHUT MON pU A9K 7 5Ow DC READY PWR NSHUT MON 1 RSPO CPUO ASR9001 RP Acti ve IOS XR RUN PWR NSHUT MON 1 FTO SP KA DE A 1 0 CPUO ASR9001 LC IOS XR RUN A cluster node 1 0 0 A9K MPA 20X1GE OK 1 0 1 A9K MPA 2X10GE OK PWR NSHUT MON 1 PMO SP A9K 750w DC READY PWR NSHUT MON CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 47 g Ad hostname Oda nh Active Configuration Ec e 1440 0 E exec timeout Before Commit Las kgroup ops task read boot task write boot task execute bgp router static address
4. New DC Tray CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 14 ASR9000 Power Supplies Max Power 3 kW 6 kW 2 1 kW 4 4 kW of Feeds 1 2 2 2 Feed redundancy in PEM n a No Yes No Of PSs per power tray 4 3 4 4 Redundancy scheme N N N N N 1 N N number of modules required to protect from feed failure e g power grid outage CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 15 PLM PES l Oj SUM oo o COE ASR 9K Ethernet Line Card Overview Ont OC DC Qe JC Qa Gat nC JC ea L B E t QC ORC OHC ORC ONCNET dN 3uep 11 97 uonejouoP jsi J TR SE Tomahawk 8x100GE CPAK Line Card MPAs i 20x1GE 8 2x10GE 3 m m X 4x10GE A9K 36x10GE 4 TaN 8x10GE 1x40GE 2x40GE ymeyeuwuo 27 ueB pJiu L CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 16 AM M a A A O WE ORI Iq AA ae m a AN ASR 9000 Tomahawk Line Cards Cutting Edge e Unprecedented Scale 240Gbps in one ASIC Hardware Offload of CPU Intensive Protocols Flexible Common Sparing and Onetime LC Qualification CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 17 PAM A A O ee TE Breakout Cable Solution 100G gt 10x 10G gt 10 1 Breakout Cable with a MPO24 MMF or SMF cable gt Only 20 fibers are used from
5. CSC ASR9000 Minimal bootup level test Complete bootup level test NA Basic ondemand test not Ondemand test NA Per port test Per device test NA Disruptive test Non disruptive test NA only applicable to standby unit NA Every minute or Not a health monitoring test NA every 5 seconds Fixed monitoring interval test NA Always enabled monitoring test NA Monitoring is active Monitoring is inactive Test Interval Thre Test Name Attributes mm ss ms shold CPUCtrlScratchRegister Nee 01 00 Error threshold ClkctrlscratchRegister NA 01 00 consecutive ZenJfScratchRegister 3 767 HA FabSwitchIdRegister SrspStandbyEobcHeartbeat SrspActiveEobcHeartbeat FabricLoopback PuntFabricDataPath A al al al J tw tw tw tw hy al al al al al _ tC 2015 Cisco and or its affiliates All rights reserved Cisco Public 74 PAM PES 0 iS SEE l ee TE EN Background Diagnostics Test example PuntFabricDataPath CSC ASR9000 pJe aur uoou dA 17 pJe aur uap Looping the path between RP CPU and each NP RSP CPU http www cisco com c en us support docs routers asr 9000 series agqgregation services routers 116 72 troubleshoot punt 00 htm 2015 Cisco and or its affiliates All rights reserved Cisco Public 75 PLM A NES B o l a oo Uo o Background Diagnostics LC default diagnostics RP O RSPO CPUO rasr9000 2w a admin show diag
6. Mon Dec CSC ASR9000 9 13 53 37 848 EST SFP EEPROM port 0 Xcvr Type Xcvr Code Encoding 64B66B Bit Rate 10300 Mbps Link Reach 50u fiber 80 meter Link Reach 62 5u fiber 20 meter vendor Name CISCO FINISAR vendor OUI 00 90 65 vendor Part Number Laser wavelength 850 nm fraction Optional SFP Signal Rate Sel LOS vendor Serial Number FNS164018G7 Date Code yy mm dd 12 10 06 lot code SFP SFP 10G SR FILX8571D3BCL C2 rev A 0 00 nm Thresholds Temperature Voltage Bias Transmit Power Receive Power Temperature 26 684 Voltage 3 301 volt TX Bias 7 612 mAmps Tx Power 0 613 mw 2 13 dBm Rx Power 0 567 mw 2 46 dBm Oper Status Contro Warning High 70 000 C 3 465 Volt 10 800 mAmps 0 741 mw 1 30 dBm 0 794 mw 1 00 dBm Alarm High 75 000 C 3 630 Volt 11 800 mAmps 1 479 mw 1 70 dBm 1 585 mw 2 00 dBm 2015 Cisco and or its affiliates All rights reserved Cisco Public 84 Warning Low 0 000 C 3 135 volt 5 000 mAmps 0 186 mw 7 30 dBm 0 102 mw 9 90 dBm Alarm Low 5 000 C 2 970 Volt 4 000 mAmps 0 074 mw 11 30 dBm 0 041 mw 13 90 dBm P V il U The Physical Reading the controller counters In out invalid unicast mcast frame sizes RP O RSPO CPUO rasr9k 1 y show controllers TenGigE0 4 0 20 stats Sun Feb 24 14 44 18 899 UTC Statistics for interface TenGigE0 4 0 20 cached values Ingress Input total bytes
7. 2015 Cisco and or its affiliates All rights reserved Cisco Public 29 MT A iE e ASR 9001 Architecture Identical HW Components as the Modular Systems Internal On board 4x10 SFP ports Switch Fabric eee man Disabled inASR9001 S CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 30 a Me A VA m z Edge Linecard Silicon Slice Evolution S EE Trident Class Trident Octopus Santa Cruz PowerPC 120G 90nm 130nm 130nm DIVE TE Ove 15 Gbps 60 Gbps 90 Gbps 1 2 Ghz g ET Typhoon Class Typhoon Skytrain Sacramento PowerPC 360G sonm 65nm 65nm Quad Core 60 Gbps 60 Gbps 220 Gbps 1 5 Ghz 2 Tomahawk Tigershark SM15 28nm 28nm 28nm 240 Gbps 200 Gbps 1 20Tbps EN NL NI IE NN IH CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 31 PLM ES oo jj Bt EE ee Network Processor Architecture Details TR and SE have different memory size TR and SE have same memory size 4 NP complex LOOKUP Forwarding chip multi core MEMORY wee ee x x mm 9 D e TCAM VLAN tag QoS and ACL classification e Stats memory interface statistics forwarding statistics etc Frame memory buffer Queues Lookup Memory forwarding tables FIB MAC ADJ TR Transport optimized TR SE Different TCAM frame stats memory size for different per LC QoS ACL logical interface scale Same lookup
8. next hop 192 6 1 2 local adjacency LEAF HAL pd context sub type IPV4 ecd marked 0 has collapsed Id1 0 collapse bwalk required 0 ecdv2 marked 0 Leaf H W Result Physical Result 0x11e80300 LE Raw 20 1101000 00001 73 40400000 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public TX H W Result for NP 6 Cindex 0x38a BE Raw Data0 0x91080000 1d000000 dc050000 400b5f00 Raw Datal 0x0000c006 201020000 00000000 00000000 adj resolve control byteO reserved O egr uidb internal 1 match 1 valid 1 1ptunl adj 0 adj resolve control bytel tx adj null0 0 tx drop O default action 1 tx punt O spare O adj resolve control byte2 spare O spare cb 0 flags gre adj uidb index 0 0x1d00 LE reserve pad word 0 13 mtu 1500 reserve pad 1 0 adj stats index 0x400b5f00 dest mac 0x0000 c006 0102 ether reserved 0000000000000000 A Aa s co ou Ee Traffic Transit For us and Exceptions Differentiate on ingress NP Transit Ml cru Look up re write 1j forward IT For us cpu li Destined to RP or link local scope Punt to RP or ingress LC CPU i m Exceptions amp some For Exce ption FP us traffic L2 BFD ARP For us traffic processed by MTU failure TTL 515 13 control traffic failure etc Should management have been transit Transit traffic Puntto LC CPU CSC ASR9000 2015 Cisco
9. 4M pps NP flood MAC notification data plane message to all other NPs in the system to sync up the MAC address system wide MAC notification and MAC sync are all done in hardware Data TE packet a 3x10GE RAND a 3x10GE j k rs SFP Tl 3x10GE 3x10GE i a SFP T W SFP T 3x10GE o pi S SFP gt 2 32106 o 3x10GE 2 SFP gt SFP 5 3x10GE o 3x10GE mue U SFP O 3x10GE pia SFP z 3x10GE E a u EE EE EEE EEE EE EEE EE EEE EE EE EE EEE EEE EE EE EE EE U EEE U E E E E E EEE E E EEE E E E E E UW U U U U U eee SFP CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 59 P J MAC learning and synchronization show controllers np struct 18 detail all entries npx location O x cpuO i 000006073600 lt lt lt replace your client MAC RP 0 RSPO CPUO rasr9k 1y show 12vpn forwarding bridge domain BRIDGES DOMAIN A mac address hardware ingress location 0 4 CPUO Fri Feb 22 18 50 08 433 UTC To Resynchronize MAC table from the Network Processors use the command 12vpn resynchronize forwarding mac address table location lt r s 1 gt Mac Address Type Learned from Filtered on LC learned Resync Age Mapped to 0167 dynamic G10 0 1 0 0 0 CPUO N A 016b dynamic G10 0 1 0 0 0 CPUO N A 016c dynamic G10 0 1 0 0 0 CPUO N A 016d dynamic G10 0 1 0 0 0 CPUO N A 016e dynamic G10 0 1 0 0 0 CPUO N A 016f dynamic G10 0 1 0 0 0 CPUO N A 0171 dynamic G1
10. Prio Medium TOS 192 TTL 255 Hash index 717 Local host 10 101 111 1 Local port 179 Local App PID 287053 Foreign host 10 100 103 1 Foreign port 59214 Current send queue size in bytes 0 max 24576 Current receive queue size in bytes 0 max 32768 mis ordered 0 bytes Current receive queue size in packets 0 max 0 Timer Starts Retrans 9789 Sendwnd 0 Timewait 0 AckHold 9817 KeepAlive 1 PmtuAger 0 GiveUp 0 Throttle 0 Wakeups Next msec iss 2038437204 snduna 2038628753 sndnxt 2038628753 sndmax 2038628753 sndwnd 31856 sndcwnd 3648 irs 2495655735 rcvnxt 2495854116 rcvwnd 31894 rcvadv 2495886010 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public SRTT 217 ms RTTO 300 ms RTV 11 ms KRTT 0 ms minRTT 1 ms maxRTT 289 ms ACK hold time 200 ms Keepalive time 0 sec SYN waittime 30 Sec Giveup time 0 ms Retransmission retries 0 Retransmit forever FALSE Connect retries remaining O connect retry interval O secs State flags none Feature flags MD5 win Scale Nagle Request flags win Scale Datagrams in bytes MSS 1216 peer MSS 1216 min MSS 1240 max MSS 1240 Window scales rcv 0 snd 0 request rcv 0 request snd 0 Timestamp option recent 0 recent age 0 last ACK sent 0 Sack blocks start end none Sack holes start end dups rxmit none Socket options SO_REUSEADDR SO_REUSEPORT SO_NBIO Socket states SS_ISCONNECTED SS_PRIV
11. cO 02 01 02 81 00 00 0 0010 00 45 00 8b 0020 c0 01 0030 00 00 0040 11 05 0050 00 00 wm UP to 300 B 0060 00 00 ad No CRC 0070 00 00 0080 00 00 0090 00 00 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 93 Pu A c NES MD DSS o UD Am Packet Capture Problem Packets Decoding https scripts cisco com ui u se xr monitor np counter i Destination Xerox 81 61 98 ee 00 02 01 61 1 58 gt Source WesternD 02 01 02 080 00 c0 02 01 02 i Type 802 10 Virtual LAN 8x8100 4 802 1Q Virtual LAN PRI 8 CFI 8 ID 18 Priority 8 CFI 0008 0008 1918 ID 10 i i Type IP 9x9890 4 J Internet Protocol Src 192 1 1 1 192 1 1 1 Dst 192 1 1 2 192 1 1 2 Version 4 Header length 28 bytes 5 J Differentiated Services Field 8x80 DSCP 0x00 Default ECN exee Total Length 9 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 94 Use a decoder X Packet Capture Transit Packets Example IPv4 L3VPN ingress RP O RSPO CPUO rasr9000 2w b show running config ipv4 access list CAPTURE Sat Jan 18 20 13 35 941 EST 1pv4 access list CAPTURE 10 permit ipv4 192 4 1 0 24 10 10 6 0 24 capture 20 permit ipv4 any any ES Letall else go RP 0 RSPO CPUO rasr9000 2w b show running config interface TenGigE 0 0 0 2 Sat Jan 18 20 13 50 654 EST interface TenG1gE0 0 0 2 vrf TRAFFIC l
12. expect traffic check drops at interface controller 5 Lookup the counter description 6 If required capture the packets hitting the counter typhoon only f W packets are forwarded to the fabric run fabric troubleshooting steps 8 Identify egress NP and repeat 3 to 6 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 86 LL Plu E ee l AN Inside Typhoon NP show controllers np descriptions location Reading pipeline counters cpu i PARSE DROP IN UIDB TCAM MISS RP 0 RSPO CPUO rasr9000 2w a show controllers NP counters npO location 0O 1 CPUO wed Nov 27 21 09 07 635 EST Node 0 1 CPU0 NS U dL List of NP counters Show global stats counters for NPO revision v2 https supportforums cisco com docs DOC 26566 Read 64 non zero NP counters offset Counter Framevalue Rate pps 16 MDF TX LC CPU 6722114 10 17 MDF TX WIRE 1826039 21 MDF TX FABRIC 1635541 29 PARSE FAB RECEIVE CNT 1837406 33 PARSE INTR RECEIVE CNT 5083364 37 PARSE INJ RECEIVE CNT 1228130 499 RSV ING L2 SMAC MISS 60 302 RSV ING L2 LEARN 60 541 RSV REFRESH FROM NOTIFY CNT 62 584 RSV L2BC BVI 2 604 RESOLVE REMOTE RACK PREP CNT 5539915 708 LRN PERIODIC AGING DELETE ENTRY 60 774 ARP 119 848 PUNT_ADJ 2 852 PUNT ACL DENY 161 900 PUNT STATISTICS 5083356 902 PUNT_DIAGS_RSP_ACT 11419 904 PUNT_DIAGS_RSP_STBY 11427 3 2 3 7 2 0 0 0 0 8 0 0 0 0 7 0 0 CSC ASR9000 2015 Cisco and or i
13. family ipv4 unicast Active Configuration 0 0 0 0 0 7 1 9 1 After Commit E T Da 1 Syntax Check after each line PASSES No Change line default exec timeout 1440 0 I Las kgroup ops task read boot task write boot task execute bgp 1 Interface GigabitEthernet0 3 0 0 ipv4 address 9 9 9 9 24 Semantic Check during commit FAILS BGP cannot be taskgroup name taskgroup bgp task read bgp task write bgp router static address family ipv4 unicast POOL O Po Een crore eil Target Configuration CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 48 PM Ao jj B l oo XR Configuration Key Concepts contig load rollback changes Rollback a Specific Commit BGP Change or commit id Commit History Rollback Just a paste operation Can be edited interface gig 0 3 0 5 ipv4 ade 1 Still requires commit 2 BGP_Change router bgp 100 address family ipv4 unicast neighbor 5 5 5 5 xec timeout 1440 0 Interface GigabitEthernet0 3 0 0 ipv4 address 9 9 9 9 24 taskgroup ops task read boot task write boot task execute bgp no router bgp 100 router ospr 100 area 0 interface GigabitEthernet0 3 0 0 area 1 interface TenGigh0 2 0 0 1 Commit Target Configuration CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 49 1255522 M cs ce XR Configurati
14. ipv4 address 192 4 1 1255 255 255 0 Apply to transit 1pv4 access group CAPTURE ingress RP O RSPO CPUO rasr9000 2w b Zshow controllers NP counters npO location 0 0 CPUO include ACL CAPTURE NO SPAN Sat Jan 18 20 14 26 109 EST 477 ACL CAPTURE NO SPAN 6802507 38003 RP O RSPO CPUO rasr9000 2w b show cot MLD aters location 0 0 CPUO include E e nuu EE _Z q NPACL capture 477 ACL CAPTURE NO SPAN 6905417 368 counter RP O RSPO CPUO rasr9000 2w b Zshow controllers NP counters npO location 0 0 ACL CAPTURE NO SPAN incrementing Sat Jan 18 20 14 34 597 EST 477 ACL CAPTURE NO SPAN 7124969 37991 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 95 Lh Packet Capture Transit Packets Example IPv4 L3VPN ingress RP O RSPO CPUO rasr9000 2w b monitor np counter ACL_CAPTURE_NO_SPAN npO count 3 location 0 Sat Jan 18 20 31 53 311 EST Warning Every packet captured will be dropped If you use the count option to capture multiple protocol packets this could disrupt protocol sessions eg OSPF session flap So if capturing protocol packets capture only 1 at a time Warning A mandatory NP reset will be done after monitor to clean up This will cause 50ms traffic outage Links will stay Up Proceed y n y Monitor ACL CAPTURE NO SPAN on NPO Ctrl C to quit Tnose 3 packets Sat Jan 18 20 32 34 2014 NPO packet are dropped From TenG1 rahe 250 byt
15. memory for same system wide scale mixing different variation of LCs doesn t impact system wide scale CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 32 SE Service Edge optimized je WE TY up 77952 i y OY a PE O EE RG HEN IOS XR Operating System Kernel and distributed processes Distributed SubsystemsPr ossses ontro Plane Micro kernel QNX kernel Restartable processes Aprocess may start terminate based on configuration re Scheduler keeps e CA A L2 Drivers Fi 1 M 20 A A U A az E d M lt A Aus FE d t NM TI track of process starts spawning 0 priority path ributed Infrastructure A process can crash restart patched Synch Services dy ye Lightweight Micro Kernel e Distributed processing Processes run on RP and LC CPU s Kernel System Services CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 34 LAL A ll EE UL NN IOS XR Operating System RSP and LC CPU s as processes cpu location 0 RSP0 CPU0 exclude wed Nov 28 01 36 52 203 UTC To monitor a CPU on CPU utilization for one minute 26 five minutes 25 fifteen minutes 22 every card PID lMin 5Min 15Min Process 8 94243 3 3 3 spp Instances of l 254074 23 22 19 netio n ke ca NA JR En RP O RSPO CPUO rasr9k 1y Zshow processe
16. name Choice fallback three path dumper disk0a dumper compress on filename process name Kernel dump not configured Tftp route for kernel core dump not configured No config for pakmem tuple No config for sparse tuple No config for sprsize tuple No config for coresize tuple No config for memory threshold tuple No config for core verification tuple RP O RSPO CPUO rasr9000 2w a dir harddisk dumper Sat Jan 4 00 16 10 138 EST Directory of harddisk dumper 24922 rw 216304651 00 16 08 ce_switch log 24665 rw 42408 19 06 35 crashinfo by kernel 19070930 173606 24694 rw 1586390 19 06 36 kernel core by kernel 19070930 173606 Z 24695 rw 1044480 19 06 36 pcds_dump 19070930 173606 24697 rw 4813080 17 03 11 first mpls 1sd 338 node0 RSPO CPUO x86 Z CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 37 ites P V AL ZA O EE Soo UL EN Reading Installed Packages Example RP O RSPO CPUO rasr9000 2w b s how detail Sun Jan 4 23 43 14 325 EST Secure Domain Router Owner Node O RSPO CPUO RP SDR Owner Boot Device diskO Boot Image disk0 asr9k os mbi 5 1 3 0x100305 mbiasr9k rsp3 vm Active Packages disk0 asr9k mpls px 5 1 3 disk0 1osxr mpls 5 1 3 disk0 asr9k mgbl px 5 1 3 disk0 asr9k mgb supp 5 1 3 disk0 1osxr mgbl 5 1 3 disk0 asr9k opti c px 5 1 3 disk0 asr9k optics supp 5 1 3 disk0 asr9k k9sec px 5 1 3 disk0 1osxr security 5 1 3 d
17. reloads or goes down for some reason you can press CTRL C to get back the RP s prompt Manual FPD upgrade If you are executing the cmd for _all_ locations and a node reloads or is down please allow other nodes to finish the upgrade process before pressing CTRL C RELOAD REMINDER The upgrade operation of the target module will not interrupt its normal operation However for the changes to take effect the target module will need to be manually reloaded after the upgrade operation This can be accomplished with the use of hw module lt target gt reload command If automatic reload operation is desired after the upgrade please use the reload option at the end of the upgrade command The output of show hw module fpd location command will not display correct version information after the upgrade if the target module is not reloaded NOTE Chassis CLI will not be accessible while upgrade is jin progress Continue confirm CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 45 Ad MEd 0 AWEEEEENA Oe EE ee Command Modes Kec exec config admin admin contic Exec Normal operations monitoring interfaces routing CEF and VPNs RP 0 RSP1 CPUO viking 1f show ipv4 interfaces brief show running config show install active show cef summary location 0 5 CPU0 show l2vpn xconnect Config Normal configuration for router RP 0 RSP1 CPU0 viking 1 config
18. the Data Plane as that is where the traffic comes from Network Time Protocol NTP Syslog CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 69 PE REESE SUM aE S Um Em Management Traffic Management interfaces Out of band in band and glgbal ASR 9000 Inband i f Out of band i f Em Ho Interface lt gt Transit traffic gt Management traffic No communication permitted between inband and out of band e Management VRF is not necessary but looks cleaner CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 70 AB Md SS RAMA VA MM MMO O Vc NN Management Traffic Out of Band Virtual address interfaces and protocols RP O RSPO CPUO ras r9k Ly show mgmt plane wed Dec 5 00 46 26 162 UTC RP O RSPO CPUO rasr9k ly show running config control plane management plane out of band wed Dec 5 00 45 07 132 UTC control plane management plane out of band vrf MGMT interface MgmtEthO RSPO CPUO O allow SSH peer address ipv4 172 16 1 0 24 allow SNMP peer address 1pv4 172 16 1 98 interface MgmtEthO RSP1 CPUO O allow SSH peer address ipv4 172 16 1 0 24 Management Plane Protection 1nband interfaces interface TenGigEO 0 0 2 ssh configured peer v4 allowed 192 168 1 0 24 outband interfaces interface MgmtEthO RSPO CPUO 0 ssh configured peer v4 allowed 172 16 1 0 24 snmp configured peer v4
19. 0 0 1 0 0 0 CPUO N A 0102 dynamic Te0 4 0 20 0 4 CPUO N A 0104 dynamic Te0 4 0 20 0 4 CPUO N A 0105 dynamic Te0 4 0 20 0 4 CPUO N A 0106 dynamic Te0 4 0 20 0 4 CPUO N A 0107 dynamic Te0 4 0 20 0 4 CPUO N A 0108 dynamic Te0 4 0 20 0 4 CPUO N A 0109 dynamic Te0 4 0 20 0 4 CPUO N A 010a dynamic Te0 4 0 20 0 4 CPUO N A CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 60 erase use a m UN m m n nn Sad L3 Unicast Packet Journey PSE yi 10 40 100 Typhoon Mapping the port to NP and FIA Path from GigabitEthernet0 0 1 0 192 3 1 2 TO TenGigE0 4 0 20 6 192 6 1 2 Example RP O RSPO CPUO rasr9k 1y Zshow controllers NP ports all location 0 0 CPUO Fri Feb 22 15 57 32 307 UTC Node 0 0 CPUO TenGigE0 0 0 0 TenGigE0 0 0 1 TenGigEO 0 0 2 TenG1gE0 1 GigabitEthernet0 0 1 0 GigabitEthernet0 0 1 19 RP O RSPO CPUO rasr9k ly show controllers NP ports all location 0 4 CPUO Fri Feb 22 15 55 22 370 UTC CSC ASR9000 Node 0 4 CPUO TenG1gE0 4 0 0 TenGigE0 4 0 1 TenGigE0 4 0 2 TenGigEO 4 0 3 TenGigE0 4 0 4 TenGigE0 4 0 5 TenG1gE0 4 0 6 TenG1gE0 4 0 7 TenGigE0 4 0 8 TenG1gE0 4 0 9 TenGigE0 4 0 10 TenGigE0 4 0 11 TenG1gE0 4 0 12 TenG1gE0 4 0 13 TenGigE0 4 0 14 TenGigE0 4 0 15 TenGigEO 4 0 16 TenG1gE0 4 0 17 TenGigE0 4 0 18 TenGi
20. 0 LISTEN 0x10174798 0x60000002 0 0 179 0 LISTEN 0x10174938 0x6000000 3 0 0 179 0 LISTEN Ox101cce2c 0x6000000b 0 O 179 0U LISTEN Ox1016fefc 0x00000000 0 0 179 22 LISTEN 0Ox101ac7ac 0x60000000 0 0 10 101 111 1 179 10 100 101 1 20100 ESTAB 0x1017bbf4 0x60000000 0 0 10 101 111 1 646 10 101 188 1 30687 ESTAB 0x10182b38 0x60000000 0 0 10 101 111 1 179 10 100 103 1 59214 ESTAB 0x1002e004 0x6000000d 0 0 10 100 111 1 17514 10 100 111 100 13680 ESTAB 0x10161e18 0x60000000 0 0 0 0 0 0 23 0 0 0 0 0 LISTEN 0x101cc968 0x00000000 0 0 0 0 0 0 23 0 0 0 0 0 LISTEN 0x101594b4 0x60000000 0 0 0 0 0 0 646 0 0 0 0 0 LISTEN 0Ox1016f7f0 0x60000000 0 0 0 0 0 0 179 0 0 0 0 0 LISTEN 0x10165d74 0x60000001 0 0 0 0 0 0 179 0 0 0 0 0 LISTEN Ox1016f4b0 0x60000002 0 0 0 0 0 0 179 0 0 0 0 0 LISTEN 0x1016f 650 0x60000003 0 0 0 0 0 0 179 0 0 0 0 0 LISTEN Ox101ade54 0x6000000b 0 0 0 0 0 0 179 0 0 0 0 0 LISTEN 0x1016276c 0x00000000 0 O 0 0 0 0 179 0 0 0 0 0 LISTEN 0x1015e304 0x00000000 0 0 0 0 0 0 0 0 0 0 0 0 CLOSED CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 80 PM ES 0 5 o jjj tl tt o oo Uo o TCP Resources TCP connections parameters RP O RSPO CPUO rasr9000 2w a show tcp detail pcb 0x10182b38 wed Dec 11 22 47 18 708 EST Connection state is ESTAB I O status 0 socket status 0 Established at Thu Dec 5 04 13 28 2013 PCB 0x10182b38 SO 0x10182968 TCPCB 0x101cc2b4 vrfid 0x60000000 Pak
21. 24 Fibers of one MPO24 cable MPO24 to LC SMF MPO24 to LC MMF 10x 10GE SR LC connector Fiber num Fiber num TX network lan MPO 24 connector CSC ASR9000 2015 Cisco and or its affiliates All ights reserved Cisco Public 18 ES o o jjj Bit tt o oo Uo ee Cisco ASR 9000 Hardware System Components Integrated on RSP or Separated fabric card CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 19 Route Switch Processors and Route Processors RSP used in ASR9904 9006 9010 RP in ASR9922 9912 9006 9010 9904 9006 9010 9922 9912 RSP880 9922 9912 RP2 RSP RSP440 RP1 150 Gen RP 200 Gen RP and Fabric ASIC 3rd Gen RP and Fabric ASIC Freescale 8641D Intel x86 Intel x86 Processors 2x 1 5GHz 4 Core 2 27 GHz 4 Core 2 27 GHz E RSP A4G AGB RSP440 TR 6GB R 6GB TR 16GB TR 16GB RSP 8G 8GB RSP440 SE 12GB SE 12GB SE 32GB SE 32GB SSD N A 4G 30G HDD 2x 16GB Slim SATA M EE SATA de N A 2x 1G 10G SFP 2x 1G 10G SFP 4x 1 10G SFP 4x 1 10G SFP 460G 460G 220G 220G 9006 9010 Switch 92G 92G JaV a 1 38Tb 230G fabric 385G 385G 9904 separated fabric 805G 805G 9904 bandwidth 9006 9010 s 1 a separated fabric card fabric integrated on RSP Card fabric integrated on RSP CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 20 P EE o o RSP440 Faceplate and Interfaces GPS Interfa
22. 4 O deleted adjacencies of type IPv4 in quarantine list O interface adjacencies of type IPv4 4 multicast adjacencies of type IPv4 FIB Forwarding Information Base LSD Label Switch Database CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 57 AM Mf OS OEE EEE Ee NEN The NP FIB FIB entry in NP example RP 0 RSPO CPUO asr sh cef 222 0 0 6 hardware ingress lo 0 1 CPUO 222 0 0 6 31 version 1 internal 0x40000001 Oxbid66c6c 1 00 Oxb1b4f758 0x0 0x0 Updated Mar 2 17 58 11 987 local adjacency 222 0 0 2 Prefix Len 31 traffic index 0 precedence routine 0 via 222 0 0 2 TenGigE0 1 0 3 5 dependencies weight 0 class 0 next hop 222 0 0 2 local adjacency RSP CPU EZ 0 Leaf Search ctrl byte0 0x3 ctrl bytel 0x8 ctrl byte2 0x5 Leaf Action FORWARD prefix length 31 Search Control Flags match 1 valid 1 done 0 1fib_lookup 0 ext lsp array 0 match all bit 0 recursive 0 nonrecursive 1 default_ action 1 Non Recursive Leaf MED O P l AIB Adjacency Information Base 1di ptr 10936 0x2ab8 igp statsptr 0 RIB Routing Information Base FIB Forwarding Information Base LSD Label Switch Database rpf ptr 0x0000 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 58 LM E l G O ee ee MAC learning and synchronization Hardware based MAC learning 4Mpps NP CD NP learn MAC address in hardware around
23. 5 082s 21 760 user 2 619 kernel TimeInState 0 00 03 0395 Cisco Public RP O RSPO CPUO rasr9000 2w a process restart bgp wed Jan 15 18 03 24 836 EST RP O RSPO CPUO Jan 15 18 03 24 874 sysmgr_control 65784 OS SYSMGR 4 PROC_RESTART_NAME requested a restart of User cisco conO RSPO CPUO process bgp at O RSPO CPUO RP O RSPO CPUO rasr9000 2w a show processes bgp Wed Jan 15 18 03 28 726 EST Job Id PID Executable path 1048 3182840 disk0 1osxr routing 4 2 3 CSCuh52959 1 0 0 0x100305 bin bgp Instance Version ID Respawn Respawn count Max spawns per minute Last started Process state Package state Started on config Feature name default Tag Process group core Max core Placement startup path Ready 1 00 00 0000 ON 2 12 wed Jan 15 18 03 24 4 Run last exit due to SIGTERM Normal default ON v4 routing MAINMEM 0 Placeable pkg startup bgp startup 0 225s PLM PES o jjj B l v e z oo Uo ee Process Dumps Where RP O RSPO CPUO rasr9000 2w a admin show exception Sat Jan 4 00 15 27 885 EST Exception path for choice 1 is not configured or removed Exception path for choice 2 is not configured or removed Exception path for choice 3 is not configured or removed Choice fallback one path dumper harddisk dumper compress on filename process name Choice fallback two path dumper_diskla dumper compress on filename process
24. 922 Large Scale Chassis Shipping since IOS XR 4 2 2 August 2012 EEEl sal Engineering testbed 4 Power Shelves 12 16 Power Modules 4 4 2 1 kW DC 6 0 3 0 kW AC supplies N N AC supply redundancy N N N 1 DC supply redundancy Fan 4 Fan Trays Front to back airflow P I O Slots 20 I O slots m PRP X 1 1 RPredundancy 7 6 1 fabricredundancy 7 Bandwidth Phase 1 550Gb per Slot Phase 2 1 6Tb per Slot Future 2 Tb per Slot XR 4 2 2 August 2012 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 9 P L ASR 9912 Large Scale Chassis shipping since XR4 3 2 8 5 1 0 Sep 2013 Features _ Description Fan 2 Fan Trays E Front to back airflow i dar dam 30 RU 1 RP 1 1 RP redundancy e le kpl 6 1 fabricredundancy 3 Power Shelves 9 12 Power Modules 4 4 2 1 kW DC 6 0 3 0 kW AC supplies N N AC power supply redundancy N N N 1 DC power supply redundancy Bandwidth Phase 1 550Gb per Slot Phase 2 1 6Tb per Slot Future 2 Tb per Slot XR 4 3 2 amp 5 1 0 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 10 PUES A NA O ASR 9000v Satellite Local or remote 10G to 1G fan out Local or remote Up to 4x 10GE links or bundle All configuration done on host L2 3 4 operation done on host No local switching on satellite ASR Ingress 8 egress QoS done on host aant e 1G
25. B l v jj oo Uo ERD Enhancement TS commands The show drops location was available before 5 3 0 but it only listed the NP and fabric drops so HW drops With the all keyword being introduced we now have the ability to check both HW and oW drops the command is extensible live on the router by editing a grammer file saved under diskOa usr packet drops lis default path pkg etc packet drops lis CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public RP O RSPO CPU0 ASR901 0 1 show drops all location 0 6 cpuO Sun Jul 26 23 14 14 374 UTC show arp traffic arp ARP IP Packet drop count for node 0 6 CPUO 4 show cef drops cef 0 6 CPUO No route drops cef 0 6 CPUO Discard drops packets 69 packets 5 show controllers fabric fia drops egress fabric FIA 0 Uc eq pkt len crc lookup drp 7 fabric FIA 1 Uc eq pkt len crc lookup drp 3 show controllers fabric fia drops ingress fabric FIA 0 spO align fail 5 fabric FIA 0 sp1 crc err 21 90 M Ir 1m 1 A ill t s D JEN I PM El S EEE ER la ee Packet Capture Problem Packets Example incrementing drops RP O RSPO CPUO rasr9000 2w b Zshow controllers NP counters npO location 0 0 CPUO include DROP Sat Jan 18 18 46 52 618 EST 370 404 411 1171 1178 1246 209680463 3719838164404 RSV_DROP_XID_NO_MATCH RSV_ING_VPWS_ERR_DROP RSV_L2_SHG_DROP 27390624 MDF PUNT POL
26. Cisco ASR 9000 Architecture and Troubleshooting CSC ASR9000 Yong Zhao Customer Support Engineer CCIE 23507 RS amp SP swiss Army Knife Built for Edge Routing World Cisco ASR9000 Market Roles 1 High End Aggregation amp Transport Carrier Ethernet Cable MSO Mobile Backhaul L2 Metro Aggregation CMTS Aggregation Video Distribution amp Mobile Backhaul Services Broadband Gateway 3 Services Router Large Enterprise WAN Business Services Residential Broadband Converged Edge Core Enterprise WAN CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 2 ocalable System Architecture and Portfolio Physical and Virtual 96Tbps System nV Cluster El 1 3 f D Jm IOS XRv XR virtualization nV Satellite 9000v 901 903 9001 9904 9006 9010 9912 9922 9001 S CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 3 Agenda Hardware Architecture Operating System amp Configuration Frame Journey Control Management amp Security Troubleshooting CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public et 4 PAM Sl SG 8 So ASR 9010 and ASR 9006 Chassis Shipping since day 1 E 97 D ontto back gt airflow Front to back air flow E p with air flow baffles 13RU vertical 3 s HE
27. E ports can be assigned to a g se fev Bae at av Par an Pav Pav tot artar Fae fas tov iiss MB an Fae Bas d ov Dos specific 10G ports or bundle TT Up to 44x 1GE user links CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 11 PLM ES iXiGO EE ee Power and Cooling ASR 9006 FAN ei HE ci Ke lt lt m e Power Supply CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 12 ES 5 OU Lu olo Version 3 AC Power Supply New Power Tray and Power Supply Three 6kW AC PMs per tray Two logically AND ed single phase 3kW amp AC power inputs per PM f both inputs are active output is max 6kW f only one input is active Power Supply is still working output will be max 3kW Input 16 20A 230V AC amp same power cords gt easily upgradeable P gt New AC Tray Front CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 13 PUES A SG EE So ee Version 3 DC Power Supply New Power Tray and Power Supply Four 4 4kW DC PMs per tray Two logically AND ed DC power feeds per PM f both inputs are active output is max 4 4kW f only one input is active Power Supply is still working output will be max 2 2kW DC power requirements 8 DC lug gt easily upgradeable if you like copper
28. ICE DROP 7924962278163 MODIFY_PUNT_REASON_MISS_DROP 1 VIRTUAL IF GENERIC INPUT DROP 1 11160601 23809032 RP O RSPO CPUO rasr9000 2w b Zshow controllers NP counters npO location 0 0 CPUO de DPOD Sat Jan 18 18 46 56 297 EST 370 404 411 1171 1178 1246 CSC ASR9000 209680463 3719879236984 27390624 7925049898728 1 RSV_DROP_XID_NO_MATCH RSV_ING_VPWS_ERR_DROP RSV_L2_SHG_DROP MDF_PUNT_POLICE_DROP MODIFY_PUNT_REASON_MISS_DROP VIRTUAL_IF_GENERIC_INPUT_DROP 1 2015 Cisco and or its affiliates All rights reserved Cisco Public 92 incrementing 0 11161027 23809936 0 0 Rate PPS or increments from last command run MZ AA O ERR Packet Capture Problem Packets Example incrementing drops RP O RSPO CPUO rasr9000 2w b monitor np counter RSV_ING_VPWS_ERR_DROP npO count 3 location 0 0 CPUO Sat Jan 18 19 02 36 386 EST Warning Every packet captured will be dropped If you use the count option to capture multiple protocol packets this could disrupt protocol sessions eg OSPF session flap So 1f capturing protocol packets capture only 1 at a time Warning A mandatory NP reset will be done after monitor to clean up This will cause 50ms traffic outage Links will st Ignore Proceed y n y gt Monitor RSV_ING_VPWS_ERR_DROP on NPO Ctrl C to qui internal Sat Jan 18 19 02 44 2014 NPO packet From TenGi ov dk 157 byte packet bytes 0 3 invalid 0000 00 00 02 01 61 90 00 00
29. Input good bytes 3081227904920 3081227904920 Input total packets 23220024479 Input 802 1Qframes 0 Input pause frames 0 Input pkts 64 bytes 7143534733 Input pkts 65 127 bytes 9 Input pkts 128 255 bytes 13124923916 Input pkts 256 511 bytes 62799261 Input pkts 512 1023 bytes 0 Input pkts 1024 1518bytes 0 Input pkts 1519 Max bytes 0 Input good pkts 23220024479 Input unicast pkts 23220023458 Input multicast pkts 62 Input broadcast 5 9 Input drop overrun 0 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public Egress Output total bytes Output good bytes 1345771624 1345771624 Output total packets 21895707 Output 802 1Q frames 0 Output pause frames 0 Output pkts 64 bytes 21665536 Output pkts 65 127bytes 21179 Output pkts 128 255 bytes 168767 Output pkts 256 511 bytes 40225 Output pkts 512 1023 bytes 0 Output pkts 1024 1518 bytes 0 Output pkts 1519 Max bytes 0 21895707 21870499 25195 Output good pkts Output unicast pkts Output multicast pkts Output broadcast pkts 13 Output drop underrun 0 Output drop abort 0 Output drop other 0 Output errorother 0 X The Internal Path Troubleshooting NP Forwarding 1 Identify interface in questions with problme 2 Identify the mapping from interface to NPU 3 Examine NP counters 4 Look for rate counter that match lost traffic rate f none of the coutner match the
30. L4 1 1 4 CISCO
31. N RSP 0 1 Side to back airflow 10 RU cl hr ELO Tn integrated a d IL switch fabric BAE NM System fan trays ji M a 5 Line Card 2x KENE EE 0 3 4 7 Line Card System fan trays 0 3 2x RSP 0 1 integrated Air draw switch fabric Power shelf for modular AC DC PS 21RU 2 power shelves for modular AC DC PS CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 6 AM lr s uus ML MD UNES o UL LAN ASR 9001 Compact Chassis Side to Sideairlow Front to back air flow with air flow 2RU baffles 4RU require V2 fan Sub slot 0 with MPA Sub slot 1 with MPA No H i H Supported MPAs I 1 preparer EOBC Fixed 4x106 20x1GE 1 Power Supplies 2x10GE cluster SFP ports i Field Replaceable 4x10GE 1 1x40GE Fan Tray Field Replaceable CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 7 P Ms o Ah MC T s ASR 9001 5 Compact Chassis Supported MPAs Pay As You Grow 20x1GE Low entry cost 2x10GE SW License upgradable to full 9001 4x10GE 1x40GE Sub slot 0 with MPA Sub slot 1 with MPA ASK MPA 20X1GE STATUS Z vas 39 LXOZ VdW M6V o xS be 4 RE lt WW elel b 60G bandwidth are disabled by software SW license to enable it CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 8 PAM PES O EE ASR 9
32. Socket receive buffer states SB_DEL_WAKEUP Socket send buffer states SB_DEL_WAKEUP Socket receive buffer Low High watermark 1 32768 Socket send buffer Low High watermark 2048 24576 Notify threshold 0 PDU information PDU s in buffer 0 FIB Lookup Cache IFH 0x134e0 PD ctx size 8 data 0x0 0xb1494a74 Num Labels 0 Label Stack M Ir 1m 1 A ill t s D JEN I P Za 0 0 MO 1 lll O IN Monitor Interface See interface stats in almost real time RP O RSPO CPUO rasr9000 2w b Zmoni tor interface tenGigE 0 1 1 1 rasr9000 2w b Monitor Time 00 00 22 SysUptime 501 59 18 TenGigEO 1 1 1 1s up line protocol is up Encapsulation ARPA Traffic Stats 2 second rates Delta Input Packets 2495245669613 14890408 Input pps 7441113 Input Bytes 164703177204108 982758522 Input Kbps Crate 3928857 C 39 Output Packets 3017277633655 13261227 Output pps 6626897 Output Bytes 205177835436607 901762428 Output Kbps Crate 3605031 C 36 Errors Stats Input Total Input CRC Input Frame Input Overrun Output Total Output Underrun Quit q Freeze f Thaw t Clear c Interface i Next n Prev p Brief b Detail d Protocol IPv4 IPv6 r CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 83 PES l NES N oo o The Physical Checking on port physical SFP XFP levels RP O RSPO CPUO rasr9000 2w b zshow controllers TenGigE 0 0 0 0 phy
33. allowed 172 16 1 98 interface MgmtEthO RSP1 CPUO 0 ssh configured peer v4 allowed 172 16 1 0 24 snmp configured peer v4 allowed 172 16 1 98 allow SNMP peer address ipv4 172 16 1 98 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public LM ZA l N ee COE Management Traffic In band If OOB is not available RP O RSPO CPUO ras r9k ly show running config control plane management p lane inband Tue Dec 11 23 05 11 597 UTC control plane management plane 1nband interface TenGi 702 allow SSH peer Pannas 1pv4 192 168 1 0 24 RP O RSPO CPUO ras r9k 1yfshow mgmt p lane wed Dec 5 00 46 26 162 UTC Management Plane Protection 1nband interfaces interface TenGigEO 0 0 2 ssh configured peer v4 allowed 192 168 1 0 24 outband interfaces interface MgmtEthO RSPO CPUO 0 ssh configured peer v4 allowed 172 16 1 0 24 snmp configured peer v4 allowed 172 16 1 98 interface MgmtEthO RSP1 CPUO 0 ssh configured peer v4 allowed 172 16 1 0 24 snmp configured peer v4 allowed 172 16 1 98 CSC ASR9000 O 2015 Cisco and or its affiliates All rights reserved Cisco Public M Ir 1m 1 A ill t s D JEN I PM A OOo OMM oo o Background Diagnostics RSP default diagnostics RP O RSPO CPUO rasr9000 2w a admin show diagnostic content location O RSPO CPUO wed Dec 11 19 44 32 957 EST RP O RSPO CPUO Diagnostics test suite attributes
34. and or its affiliates All rights reserved Cisco Public 66 P wu c U h RE UNES Et oo Uo NN For Us Frame Path From ingress NP to RP CPU or LC CPU Natio IP INPUT process switching Inside LC CPU SPP rx Interupt handler LC CPU Internal I O process Interrupt switching process CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 67 ES O O OO ee Control Plane Protection LPTS flow type policers RP O RSPO CPUO rasr9k ly show Ipts pifib hardware police location 0 0 CPUO Sun Dec 2 06 07 36 931 UTC Node 0 0 Established session Burst 100ms for all fl packets clear controller np counters all location FlowType unconfigured default Static 2500 Fragment Local 0 0SPF mc known Static 2000 OSPF mc default Local 0 OSPF uc known Static 2000 OSPF uc defa 2 ISIS known ISIS defawtt BGP known Static 2500 2500 4070 BGP cfg peer Static 2000 2000 17 BGP default Local 400000 1500 138918630 3848639925 a oo OOOON OO O PIM mcast defau PIM mcast known Static BGP packets from PIM ucast Static unknown IGMP Static 000 OOOO CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 68 P ES M N M EE GM MM O HEN Management Management Plane Protocols Simple Network Management Protocol SNMP Telnet SSH e SFTP FTP TFTP e Secure Copy Protocol SCP TACACS RADIUS NetFlow also used by
35. ategory lt Connection Type XML over Telnet 4 2 3 C5Cud29892 1 0 0 4 2 3 C5Cuc17410 1 0 0 li 4 2 3 C5Cud07536 1 0 0 2j Conformance Report Clear CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 41 L E A N NS ISU Am Turboboot A fresh start Previous disk data is wiped e A clean re Image as a new router e Potential recovery mechanism Not an upgrade method CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 42 Rommonl gt unset BOOT Rommon2 gt confreg 0x102 Rommon3 gt sync Rommon4 gt reset Rommonl gt IP ADDRESS lt a b c d gt Rommon2 gt IP_SUBNET_MASK lt mas k gt Rommon3 gt TFTP_SERVER lt a b c d gt Rommon4 gt DEFAULT GATEWAY lt a b c d gt Rommon5 gt TFTP_RETRY_COUNT 4 Rommon6 gt TFTP TIMEOUT 60 Rommon7 TFTP CHECKSUM 1 Rommon8 gt priv Rommon9 gt diswd Rommon10 gt unset BOOT Rommon11 gt TURBOBOOT on di sk0 format Rommoni2 sync Rommon13 gt boot tftp a b c d path asr9k mini px vm 4 2 3 LAL SN iE SSE PIE Installation Concepts PIE install used once system is operational w XR vm files can be used if booting from rommon is required LADA Packages can be added or upgraded m 9 Install from Exec or Admin Mode Q 3 phase install Add Copy package and unpack Activate Restart processes nodes with new code Commi
36. ation commit changes last 5 Mon Jan 5 00 36 17 813 EST Building configuration 105 XR Configuration 5 1 3 interface GigabitEthernet0 1 0 4 Ed address 10 6 7 6 255 255 255 0 RP 0 RSP1 CPUO vi king 1 show config sessions Current Configuration Session Line User Date Lock 00000051 004c4 104 00000000 conO RSP1 ww Tue Jul 21 16 58 22 2009 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 51 ES lc NERE CAM MM oo o EE RP 0 0 CPU0 P103 show running config router bgp Mon Jan 5 15 06 29 774 EST router bgp 65001 bgp router id 10 100 103 1 bgp cluster id 10 100 101 1 bgp graceful restart address fami ly 1pv4 unicast address family vpnv4 unicast address fami1y 1pv6 unicast address family l2vpn vpls vpws neighbor group 1BGP remote as 65001 keychain CISCO update source LoopbackO address family ipv4 unicast route reflector client address family vpnv4 unicast route reflector client address family ipv6 unicast route reflector client A O n o UE c Unicast Transit Frame Path Physical gt NP gt FIA gt Fabric gt FIA gt gt Physical M A9K 24X10GE A9K 2X100GE CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 53 Unicast Two Stage Forwarding By ingress NP and egress NP First stage lookup on ingress NPU gt Second stage lookup on egress NPU gt Egress NPU or SFP switch fabric po
37. ce ToD 1pps 10Mhz 2x Mgmt Eth 2x 1G nV Edge EOBC DO p 24 4 4 1 7 Console amp Aux Status LEDs gt C 00 UJ nV Edge oync CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 21 A d SS RSP nne ohn Internal communication between RPs and Line Cards u u u uu OU Arbitration F Arbiter VO FPGA CPU Complex Switch fabric CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 22 ASR 9000 Switch Fabric Overview Separated fabric card Fabric is integrated on RSP 6 1 redundancy 1 1 redundancy RSP880 805G 805G slot RSP440 385G 385G slot mame h nehe nen i I a 9001 2RU 120G uz mri Ja cac can 9922 9006 9010 RSP880 460G 460G slot RSP440 220G 220G slot SFC2 1 381 230G Slot SFC1 660G 110G slot CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 23 P ES M NOM MEE MM CONES Ee VZS EN Fabric Super framing Mechanism e Multiple unicast frames from to same destinations aggregated into one super frame e Super frame is created if there are frames waiting in the queue up to 32 frames or when min threshold met can be aggregated into one super frame Super frame only apply to unicast not multicast e Super framing significantly improves total fabric throughput No super framin
38. e pact PP 0000 00 11 Ob 00 61 92 00 00 0 0010 00 ec 00 00 00 00 40 3d a8 A 0020 06 5d 00 00 00 00 00 00 00 P 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0000 0040 10 f3 11 05 00 00 00 00 00 v 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 J 0060 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0000 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0080 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0000 0090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 96 oPP packet captures nnn n mann mn muna nn mnn min eee n mnu un u nn maa S 5 EEE OOo RP 0 RSP0 CPU0OHrun attach 0 0 CPUO attach Starting session 1 to node 0 0 CPU0 spp Ul Spp ul gt spp ui gt trace filter node client punt Node client punt set for trace filtering Inde spp ul gt trace filter set 52 4 0xD400000 Modified filter for offset 52 successfully spp ui gt trace filter set 56 4 OxD4000002 Modified filter for offset 56 successfully C CHEMIN E a umuuuuuuuuEEHEEHHEEHHHEEHEHHEHEHEHHNHEHEHEHHEHHHEHEEHNHEHEHEHEHEHEHEHHEREEHEHREHEEHEHEHERHHMUENES 9 RP O RSPO CPUO A9K BNG Zpacket trace spp platform protocol arp start capture count 5 location 0 0 cpuO Wed Mar 12 16 28 30 176 EDT Sending command trace filtei Trace filter
39. g Min reached Max reached Jumbo Max Min 0 Empty Super frame Super frame Note that fabric counters are showing super frames not individual packets CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 24 show controller fabric fia Stats loc O X CPUO ES l5 O OU L 151 200 Generation switch fabric compatibility System with 1 Generation Fabric 8x55G 8x23G bi directional bi directional 1nd Generation 440Gbps 184Gbps Fabric RSP 3 m 8x23G bi directional i EM A Dual FIA EM RN 8xNPs 1st gen Linecard 1 gt IRE BEBE ttt E mm ttt Single F IA 4xNPs 1st gen n u a 9 A P 3 Linecard i 4x2 3G Tan 1 5 B HH 4 2111 bi directional 92Gbps CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 25 PM A WES o oo Uo c 151 200 Generation switch fabric compatibility System With 2 d Generation Fabric ingress Linecard 8x23G bi directional 2 Generation x 184Gbps Fabric RSP440 8x55G bi directional Egress Linecard 440Gbps NM PC abri DOB SA Linecard M E 4 3 d e 1 E n e e P k E EIER TEE m L yy e M e a 0 0 0 0 0 000000000000000000000000000000000n0c00000 EE 7 1 SL 3 A 1 8 m 2nd ge
40. gE0 4 0 19 TenGigE0 4 0 20 TenGigEO 4 0 21 TenGigE0 4 0 22 TenGigE0 4 0 23 2015 Cisco and or its affiliates All rights reserved Cisco Public 61 Map the port to NP and FIA L3 Unicast Packet Journey raxa 10 40 100 Typhoon The egress interface identifier Laaa RP O RSPO CPUO rasr9k 1y Zshow controllers pm interface tenGigE 0 4 0 20 6 Fri Feb 22 16 45 22 404 UTC Ifname 1 TenGigEO 4 0 20 6 ifh 0xc001340 Get internal iftype 0x19 identifiers egress uidb index Oxid 1ngress uidb index Ox1d port_num UXES a Interface handle unique to subslot num 0x0 l phy_port_num 0x14 logical sub interface channel id 0x6 channel map 0x0 lag id 0x0 virtual port id 0x0 i switch fabric port 0x136 abric port shared between all port Hg i 0 sub interfaces The fabric destination 1n qos drop base 0x0 out tm qid f1d0 0x0 0x0 0x0 out tm qid fidi 0x0 0x0 0x0 out qos drop base 0x0 bandwidth 10000000 kbps CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 62 PLM PES iE SEE EE oo o o L3 Unicast Packet Journey Ingress NP FIB RP O RSPO CPUO rasr9k ly show cef ipv4 192 6 1 2 hardware ingress location 0 0 CPUO Fri Feb 22 17 40 35 887 UTC 192 6 1 0 24 version 364 attached connected internal 0xc0000c1 ptr 0x8856b534 1 0 0x873dde50 0x0 0x0 Updated Feb 22 16 09 42 862 remote adjacency to TenGigE0 4 0 20 6 Prefix Le
41. ire reload Mechanism for delivery of critical bug fixes without the need to wait for next maintenance release IOS XR Version SMU is named by release waCkage and bugid Examples asr9k px 4 2 3 CSCud37351 1 0 0 e asr9k px 4 2 0 CSCtx28089 1 0 0 Defect ID CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 40 PM A O O O B l EE l a Uo o Cisco Software Manager Available on CCO in the Downloads Section for ASR9000 aS TT E n Y NN D r e Co eee eee T F i la A IOS XR Releases X lt i 4 b E Products amp Services Support CISCO PP The SMU meta File where the SMU information is originating from is created on 04 11 2013 Type here to search Total 35 SMUs C Not Installed 29 Installed 5 C Not Applicable 1 Filter Optimal fl Suggest 3X fe ST DDTS Type Description Impact Functional Areas SMU ID SMU Name D Own Oa d S oftwa re lg A CSCudi6470 Optional OSPFv3 reserved field not zero RFC 5340 hitless OSPFV3 AA06838 asr9k px 4 2 3 C5Cud1647 A CSCud29892 Optional bundle replay not processed for a subset of interfaces hitless BUNDLE 4406806 asr9k px 4 2 3 C5Cud2989 Downloads Home gt Products gt Routers gt Service Provider Edge Ro A CSCud37351 Recommended 423 SMU Pack2 for ASR9k needs reboot INFRASTRUCTURE 4406812 asr9k px 4 2 3 C5Cud3735 A C5Cud39254 Recommended NP search memory management failure
42. isk0 asr9k k9s ec supp 5 1 3 diskO asr9k doc px 5 1 3 disk0 asr9K doc supp 5 1 3 disk0 asr9k fpd px 5 1 3 disk0 asr9k fpd 5 1 3 disk0 asr9k mini px 5 1 3 disk0 asr9k scfclient 5 1 3 disk0 asr9k os mb1 5 1 3 diskO0 asr9k cpp 5 1 3 disk0 asr9k ce 5 1 3 disk0 1osxr ce 5 1 3 disk0 asr9k diags supp 5 1 3 diskO disko diskO diskO diskO diskO install active disko disko Node 0 1 CPUO Boot Device Boot Image 1c vm disko CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 39 1osxr diags 5 1 3 asr9k fwding 5 10sxr fwding 5 1osxr routing 5 1osxr infra 5 1 asr9k base 5 1 3 P 1 3 3 1 3 3 disk0 asr9k mcast px 5 1 3 asr9k mcast supp 5 1 3 1osxr mcast 5 1 3 LC SDR Owner mem disk0O asr9k os mbi 5 1 3 1 c mbiasr9k Active Packages disk0 asr9k mpls px 5 1 3 disko diskO asr9k opti c px 5 1 3 disko disk0 asr9k mini px 5 1 3 071510 disko 01510 071510 10SXr Ce 5 1 3 01510 disko 10sxr mp s 5 1 3 asr9k optics supp 5 1 3 asr9k scfclient 5 1 3 asr9k os mb1 5 1 3 asr9k cpp 5 1 3 asr9k ce 5 1 3 asr9k diags supp 5 1 3 1osxr diags 5 1 3 PAM AA INES SG ee EE Um E Software Maintenance Updates SMUs Allows for software package installation removal leveraging on Modularity and Process restart Redundant processors are not mandatory unlike ISSU and in many cases is non service impacting and may not requ
43. llers fabric RP O RSPO CPUO rasr9000 2w b show controllers fabric fia fia instance 0 stats location 0 0 CPUO instance 0 drops ingress location 0 0 CPU0 Tue Dec 10 14 49 58 704 EST Tue Dec 10 15 33 37 655 EST MM WWW FIA O Zey ne ne e Se S TUN FIA O Xe y S 8 8v 8 8v 8 8 8 Category 1n_drop 0 Category count 0 From Spaui Drop 0 0 From Unicast Xbar 0 733461306331 accpt tbl 0 0 From Unicast Xbar 1 733460650405 ctl len 0 0 From Unicast Xbar 2 0 short pkt 0 0 From Unicast Xbar 3 0 max pkt len 0 0 From Multicast xbar 0 233068 min pkt len 0 0 From Multicast xbar 1 0 sem Spaui Drop 1 0 From MultiCast xbar 2 accpt tbl 1 0 From MultiCast Xbar 3 E ee ct len 1 0 To Unicast Xbar 0 ww C p peee rom egress NP short pkt 1 0 To Unicast Xbar 1 DES max pkt len 1 0 To Unicast Xbar 2 in pkt len 1 0 To Unicast Xbar 3 ww m Tail drp 125787328841 To Multicast xbar 0 vqi drp 0 To Multicast xbar 1 latins Header parsing drp 0 To Multicast Xbar 2 Typhoon pw to ni drp 0 To Multicast Xbar 3 ni from pw drp 0 To Line Interface 0 sta i sp0 crc err 0 To Line Interface 1 457138023968 sp0 bad align 0 From Line Interface 0 11117127781061 sp0 bad code 0 From Line Interface 1 489302108080 spo align fail 3 Ingress drop 97191712670 sp0 prot err 0 Egress drop 0 spl crc err 0 Total drop 97191712670 spl bad align 0 CSC ASR9000 2015 Cisco and or its affiliates All ights reserved Cisco Public 89 PLM A jjj
44. n 24 traffic index 0 precedence routine 0 priority 0 via TenGigE0 4 0 20 6 2 dependencies weight 0 class O flags 0x8 path idx 0 0x8a60a7bc 0x0 RX H W Result on NP 1 Adj ptr 0x3a BE Raw Data0 221000000 00000136 0c001340 0 adj resolve control byteO match 1 valid 1 1ptunl adj 0 remote rack 0 adj resolve control bytel adj down O mgscp en O rx lag hash en O rx lag adj O remote adjacency LEAF HAL pd context sub type IPV4 ecd marked 0 has collapsed 1d1 0 collapse bwalk required 0 ecdv2 marked 0 Leaf H W Result adj resolve control byte2 rx lag adj O rx adj null0 0 rp destined O rx punt O rx drop O sfp vqi 0x136 1f handle 0xc001340 Physical Result 0x11dd0600 LE Raw Data0 0x91ad1000 00000001 360c0013 40000000 Raw Datal 0x00000000 00000136 00180000 00000000 CSC ASR9000 O 2015 Cisco and or its affiliates All rights reserved Cisco Public PES 0l N M SEE ee MM ee EN L3 Unicast Packet Journey Egress NP FIB RP O RSPO CPUO rasr9k ly show cef ipv4 192 6 1 2 hardware egress location 4 0 Fri Feb 22 17 55 28 494 UTC 192 6 1 2 32 version 0 internal 0x4080001 ptr Ox8efc2704 1 Ox0 0x8e01T2210 OxO 0x0 Updated Feb 22 16 13 35 351 local adjacency 192 6 1 2 Prefix Len 32 traffic index 0 Adjacency prefix precedence routine 0 priority 0 via 192 6 1 2 TenGigE0 4 0 20 6 3 dependencies weight 0 class 0 flags 0x0 path idx 0 Ox9la2cef8 0x0
45. n Line Card Dual FIA za i m m m E m m m m LL m m m LL m m m 2 00000000000000000000000000000000000000000000000000000000000000000000000000 Single F IA Wh y 4xNPs 1stgen Sis 3 inm JU Linecard ATA B 211110101010108 bi directional 92Gbps CSC ASR9000 O 2015 Cisco and or its affiliates All rights reserved Cisco Public 26 MZ PAS NL VER OE WR o UD Am ASR9006 9010 RSP440 Switch Fabric Architecture 3 Stage Fabric Stage 1 Stage2 Stage 3 _ Fabric frame format S u Super frame Fabric load balancing m m m n Egress Linecard Fabric bandwidth 8x55Gbps 440Gbps slot with dual RSP RSP1 4x55 Gbps 220Gbps slot with single RSP CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 27 MZ AS i hi W REB VER WR W oo Uo ASR 9000 Line Card Architecture Overview Trident and Typhoon CPU BO guzan BT jj l l I I I 3 OE gj Typhoon gt 3x10GE SFP SFP 4b Switch ak pide SFP dM n gs E ps ds E 3x10GE gt oce sp PR Jj NP7 S E ml Typhoon LC example A9K 24x10G CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 28 un Module Cards MOD8O MPA Bay 0 dg Switch 2 HH Fabric CHE MPA Bay 1 CSC ASR9000
46. needs reboot INFRASTRUCTURE 4406844 asr9k px 4 2 3 C5Cud3925 A CSCud40419 Optional Multicast packets destined to 239 x are getting FIB looked up in 4 2 1 hitless MCAST 4406828 asr9k px 4 2 3 C5Cud4041 Select a Software Type A CSCud41972 Optional Radius Challenge not working hitless AAA 4406890 asr9k px 4 2 3 C5Cud4197 A CSCud54093 Recommended r423 RO V2 Fan Tray SMU issu reload INFRASTRUCTURE AA06883 asr9k px 4 2 3 C5Cud5409 A CSCud65815 Optional qos ea is blocked by prm server ty after QoS in place modification needs reboot QOS 4406911 asr9k px 4 2 3 C5Cud6581 d IOS XR Software 4 CSCud73764 Optional ASR9000 SIP 700 Multiple processes blocked on cpp_driverO process needs reboot FORWARDING AAD7177 asr9k px 4 2 3 CS5Cud7376 R n Maintenance Upgrades SMU A J 4406909 BEC dir LM IOS XR Saftware Manaae 35 new SMU entries have been discovered from Cisco com y Device on Tuesday April 16 2013 1 32 34 PM PDT a 7 IOS XR in Info Login Info Us aa Ti aad p Add New Device Group Ea DEVICE SPECIFIED BELOW arch Total 6 SMUs Display Critera All Active Packages SMUs Only Superseded SMS 2 sj20lab as1 Siva baj 172 27 150 58 ER 172 27 144 174 bj 172 27 148 20 Node IP Address E3 sj20lab as1 Deepak 1839 si20lab as1 Satish E3 sj20lab as1 Naveen A sj20lab as1 Other 172 27 147 20 j sj20lab as1 Swami ackages 4 2 3 C5Cud98419 1 0 0 Connection C
47. nostic content location 0 0 CPUO wed Dec 11 20 32 08 842 EST A9K 24x10GE SE 0 0 CPUO Diagnostics test suite attributes M C Minimal bootup level test Complete bootup level test NA Basic ondemand test not Ondemand test NA Per port test Per device test NA Disruptive test Non disruptive test NA Only applicable to standby unit NA Not a health monitoring test NA Fixed monitoring interval test NA Always enabled monitoring test NA Monitoring is active Monitoring 1s inactive Test Interval Thre Test Name Attributes Cday hh mm ss ms shold CPUCtrlScratchRegister PHYCtrlScratchRegister PortctrlScratchRegister FIAScratchRegister LcEobcHeartbeat NPULoopback A A 12 A wo lt v a n lt A A A 12 A 12 eno 0 a Be gt CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 76 P V l ko Background Diagnostics Errors and clears Set threshold exceeded Path to LC 2 NP 0 failed in this example Clear test previously failing now passed Indication of transient fault Keep watching show pfm location al shows platform errors reported RP O RSPO CPUO Feb 5 05 05 44 051 pfm node rp 354 6PLATFORM DIAGS 3 PUNT FABRIC DATA PATH FAILED Setlonline diag rsp 237686 System Punt Fabric data Path Test 0x2000004 failure threshold is 3 slot NP failed 0 2 CPUO 0 RP O RSPO CPUO Feb 5 05 05 46 051
48. on Key Concepts Concurrent config sessions 2 exclusive P 7 Use config exclusive mode to block other users from committing interface gig LA ipv4 address 9 9 9 9 24 router ospf 100 area 0 interface gig 0 3 0 0 area 1 interface gig 0 4 0 0 One or more commits have occurred from other configuration sessions since this session started or since the last commit was made from this session You can use the show configuration commit changes command to browse the changes Do you wish to proceed with this commit anyway no Second to Commit First to Commit Normal Commit only first user s changes CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 50 XR Configuration Key Concepts Monitoring Configuration commits changes sessions RP O RSPO CPUO rasr9000 2w b s how running config Mon Jan 5 00 35 19 951 EST Building configuration TOS XR Configuration 5 1 3 Last configuration change at Tue Dec 2 22 19 25 2014 by cisco service unsupported transceiver hostname rasr9000 2w b clock timezone EST 5 RP O RSPO CPUO rasr9000 2w b show configuration commit list Mon Jan 5 00 35 34 747 EST SNO Label ID User Line 1 1000000033 cisco conO RSPO CPUO 22 19 25 2014 1000000032 cisco conO RSPO CPUO Tue Dec 22 15 54 2014 3 1000000031 cisco conO RSPO CPUO Tue Dec 22 14 18 2014 Client Time Stamp RP O RSPO CPUO rasr9000 2w b show configur
49. rt Egress port and rewrite information Qa 3x 10G Typhoon dn 3x 10G FIA 5 Fabric header and super framing CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 54 4 The NP FIB From RP control plane to data plane NP RSP CPU LC NPU LC CPU AIB Adjacency Information Base RIB Routing Information Base FIB Forwarding Information Base LSD Label Switch Database CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 55 A Ms A RANK ee The NP FIB RIB info example RSP CPU RP O RSPO CPUO asr sh route 222 0 0 6 31 Routing entry for 222 0 0 6 31 Known via 1s1s 1s1s1 distance 115 metric 20 type level 1 Installed Mar 2 17 58 12 251 for 00 00 47 Routing Descriptor Blocks 222 0 0 2 from 222 2 2 1 via TenGigE0 1 0 3 Route metric is 20 NO advertising protos FIB Forwarding Information Base LSD Label Switch Database CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 56 M pk a OS OEE EEE Ee NEN The NP FIB Line card adjacency RP O RSPO CPUO asr show adjacency summary location 0 1 CPUO Adjacency table version 26 has 19 adjacencies 11 complete adjacencies 8 incomplete adjacencies O deleted adjacencies in quarantine list 8 adjacencies of type IPv4 8 complete adjacencies of type IPv4 O0 incomplete adjacencies of type IPv
50. s cpu location 0 0 CPUO exclude 0 RSP and LC CPU s 0 0 wed Nov 28 01 28 52 281 UTC CPU utilization for one minute 46 five minutes 48 fifteen minutes 39 PID 1Min 5Min 15Min Process 45085 22 23 22 spp 180316 23 23 23 netio RP O RSPO CPUO ASR9010 1Zshow process distribution netio Mon Jul 27 06 22 43 321 UTC 3 processes found NODE PID JID THR TYPE PROGRAM O RSPO CPUO 532616 333 16 RP netio O RSP1 CPUO 532613 333 16 RP netio 0 6 CPUO 364639 274 8 LC netio CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 35 X Demonstrating Process Restart Same Job ID New Process ID RP 0 RSPO CPUO rasr9000 2w a show processes bgp wed Jan 15 17 58 34 050 EST Job Id PID Executable path 1048 287056 disk0 1osxr routing 4 2 3 CSCuh52959 1 0 0 0x100305 bin bgp Instance 1 Version ID Respawn Respawn count Max spawns per minute Last started Process state Package state Started on config Feature name default Tag Process group core Max core Placement Startup_path Ready Available Process cpu time 24 379 total JID TID CPU Stack pri state HR MM SS MSEC NAME 1048 1 2 384K 10 Receive CSC ASR9000 2015 Cisco and or its affiliates All rights reserved 00 00 0000 ON 1 12 Thu Jan 2 09 11 18 2014 Run Norma default ON v4 routing MAINMEM 0 Placeable pkg startup bgp startup 0 700s 8
51. set for protocol ARP Sending command trace start 5 Started capture for 5 packets LC CPU _ S22 Sse Wrote ASCII trace to tmp spp Sending command trace print Packet serial 3 client inject length 110 phys_int_index 1 next_ctx Oxdeadbeef time 16 28 30 512 00 0065 7a 00 00 00 00 70 7200 00 0200 5e 00 00 10 80 00 00 00 00 00 Of 8c 40 c1 Oc c8 50 00 00 00 20 00 00 Od 34 3f ff f2 90 20 04 fe 03 0104 00 05 30 00 00 00 00 5e 00 00 00 00 00 00 00 00 04 00 02 40 40 00 10 34 ff ff ff ff ff ff 66 66 44 44 22 22 y P LLL LLLLLILILILLLLLLLLLLLLL eg ta u u a u u u u HI E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E E BE E BE BEE EBE E BB SE m m E xu u u u u u u u u u u u EEE EU EU U EEE EEE EU U UE EEE EE EU UE UE EEE E Es II II II E SI SI SI RRR E II RRR RRR RRR SI SI II ZI RRR RRR II II EI II II E B8 Decoder https scripts cisco com ui use xr spp ui to pcap CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public CISCO 0 I1 1 i i m 8 1 Vw 1 l U 4 i 4 ES 1 1 4 6 i n 1 0 2o a 4 9 1 Y A vi i 45 i 1 i t 1 E U 1 LI 1 i Thank you a Lj 4 wx E mo ADAE Li uM P A o NL pH ZMV vanam vd na d pd
52. t Lock activated packages through reset CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 43 MZ PAS Lk W oo Uo Am Cards FPD Verify upgrade FPD version RP O RSPO CPUO rasr9000 2w b admin show hw module fpd location all Existing Field Programmable Devices Hw Current SW Upg Location Card Type Version Type Subtype Inst Version Dng O RSPO CPUO A9K RSP440 SE rommon No good No m m e n n gt DaD28 xaxzxm m change needed O RSPO CPUO ASR 9006 FAN 1 0 Tc 2 5 02 NO 0 0 CPUO A9K 24x10GE SE 1 0 Ic cbc 0 19 10 NO lc fpga2 0 1 02 NO 1c 533 0 1 01 NO Ic fpga4 0 1 05 No Ic rommon 0 1 28 No 0 1 CPUO A9K MOD80 SE 1 0 cbc 0 20 116 NO fpga2 0 1 01 NO fpga4 0 1 05 NO If LC1 needs rommon 0 1 28 NO upgrade RP O RSPO CPUO rasr9000 2w a admin upgrade hw module fpd all location 0 1 CPUO CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 44 P MZ AAS i hi W BER EEUU RI W Do Am Cards FPD Verify upgrade FPD version RP O RSPO CPUO rasr9000 2w a admin show running config fpd auto upgrade Auto FPD upgrade RP O RSPO CPUO rasr9000 2w a admin upgrade hw module fpd all location a11 configuration wed Jan 15 18 57 04 683 EST UPGRADE WARNING MESSAGE This upgrade operation has a maximum timout of 160 minutes If you are executing the cmd for one specific location and card in that location
53. ts affiliates All rights reserved Cisco Public 87 MT AAS i hi W BER VER WR UD Am Typhoon Counters and Rates NP drops rate and direction RP 0 RSPO CPUO rasr9000 2w b show controllers NP counters npO location 0 0 CPUO Tue Dec 10 14 18 39 195 EST Node 0 0 CPUO Show global stats counters for NPO revision v2 Read 59 non zero NP counters offset Counter Framevalue Rate pps To egress 16 MDF TX LC CPU 11004363 9 17 MDF TX WIRE 8712222364719 29761820 21 MDF_TX_FABRIC 11063035007386 27714366 29 PARSE FAB RECEIVE CNT 8712222113330 29761820 33 PARSE INTR RECEIVE CNT 9401470 9 37 _ PARSE INJ RECEIVE CNT 832185 1 45 PARSE TM LOOP RECEIVE CNT 8437075 359 PARSE MAC NOTIFY RCVD FAST LOW PRIORITY DROP JE From interface PARSE_FAST_DI SCARD_LOW_PRIORITY_DROP_1 106210662138 883856 PARSE_FAST_DI SCARD_LOW_PRIORITY_DROP_2 106211061617 883943 PARSE FAST DISCARD LOW PRIORITY DROP 3 106211474043 883922 Duc Ree EP TET 3707021673 NP catching up 0 PUNT NO MATCH 4746 PUNT NO MATCH EXCD 464963896 PUNT ADJ EXCD 273406 PUNT_ACL_DENY 1479378 PUNT ACL DENY EXCD 1163570900 CSC ASR9000 2015 Cisco and or its affiliates All rights reserved Cisco Public 88 X AES o jjj B l OS oo o Em FIA Counters httos supportforums cisco com document 12135016 asr9000xr l l understanding and troubleshooting fabric issues a9k FIA counts drops and direction RP O RSPO CPUO rasr9000 2w b show contro
Download Pdf Manuals
Related Search