VI3 Networking: Advanced Configuration and Troubleshooting
Contents
1. ss ACTUA nr emmener eur ae CR ORC RC C 100 a a Ud i we n PA A A 1 AR IA a a aa ia a dd aa true on LAN supported cacao nose da E true Wake on LAN enabled true a AP ce n Rho ml anat Rc tee cos false tHardware Capabilities WET MESA A ea ET AS ee true pa MEMO DI a a a true 255 caw ca aude ARA das shit Corus true fan TED Segmentation OTT LOAG anos asas nenas false Ps TX ole eee ane a QR RENE ARR TE aoe ele true Supported Speeds and Duplex PI DA auto auto aaa ide ae E RS 10 half bon Or OA a aa ee ra a a 10 fu11 MED COU AO AAA AA 100 half reu ih A 2S 100 fu11 Supported POMO AAA aa daa 1000 half rad PP URS 1000 full PCI Device aa D RE ee 0x01 EE 30 fc 0x04 Loi OMe ca Gand eee ke we 0x00 1028 a ana TUTO Re 0x14e4 are CUT 16 7 ELLLU mul pP eec Dep 0x0e11 Lee Di uu 256 aa cra ERR RR RUE ee 0x0O0cb asa NADO uera B rena ews ae cea awe cece eae es Broadcom Corporation Pa abl NO nc apn NC7781 Gigabit Server Adapter PCI X 10 100 1000 T 25 ICE CEAS S dos QR ER anew Rd Ioa UR de Rub SCR 512 IssszPIE A CURE Aa Ra ee er ee en 3 fa 30PW1082. TER 1 5515 PP Packets TSO Tx Ok N DNS TSD TX UR ra T a T3U PE da eee Packets SW TSO Dropped SW TSO Packets Zero Copy Tx Ok t Packets Rx 113655 Ec AAA 10153132 Dropped Ricard Ix Dronped Tal RE 222222 Packets SW TSO Dropped SW TSO Rx a AECI eal ale ee ea T Uplink Rx Packets issue Y oa sca ae Dropped Tx Due to Page Absent 0 Dropped Rx Due to Page Absent 0 Information about VMkernel Port CREAR EET ERA RV S 33554435 Ori LAIA 2 aa MI aa ee wae vmnic4 E OS en ae eae ee 00 00 00 00 00 00 au AE A A AA A o ee AER TR Stats CROCS TX DE is a eee A PERAS Gases 2 222 Packets TSO Tx Ok DOTES Tou TE UR uui oae nM A DIO T3013 ets Packets SW TSO Tx faasa propped T30 bos Ta ACA C 2 Packets Zero Copy Tx E l swePRECEBES Ex AOS PER A AAA RE eae NE ou vas an wA V UN XX DFODDOO TS0 Packets SW TSO bs Droppad 3M T30 e een Rn Lent 4l A LOO eee one ae a CLUB 1 524 Een 0 EE AI dds Qa REA 0
3. Step 2 NIC Teaming The two VMs could be using different uplinks These two NICs should be in the same NICs in a team should broadcast domain be connected to the same broadcast domain gt Look at the Network Hint 8 vmware vmware com go networking Step 2 NIC Teaming VI Physical Nic EGER L demeure T vmnic Mun E 1 esxcfg info pes e a c DE IL ene ae 4 as PLENA I NS SAT 8 gt Search for Eden A qo mI 00 11 85 13 79 9a TET Virtual MAC ADdresS oio 08 585 65227598 Network Hint in DAS A AO O f the output a s 0 19 17 40 00 255 255 254 00 Getting Started Surman VirtualMachines Resource Allocation Performance Configuration Users amp Groups Events Permissions Hardware Network Adapters Health Status I 1 4d NC7761 Gigabit Server Adapter PCI X 10 100 1000 T EA vmnic 100 Ful Negotiate Sat no 10 17 40 1 10 17 43 254 Memory EA vmnict 100 Full Megotiate y 10 17 40 1 10 17 43 254 Storage 8254NXX Gigabit Ethernet Controller Networking EA vmnicz 100 Ful Negotiate Storage Adapters EtherExpress PRO 100 5 Server Adapter Network Adapters Ea vmnic3 100 Ful Negotiate EA vmnic4 100 Full Negotiate Processors 10 17 40 1 10 17 45 4 10 17 40 1 10 17 43 4 10 12 40 1 10 14 43 4 vmware vmware com go networking Step 3 VLAN Co
4. Dropped Tx Due to Page Absent 0 Dropped Rx Due to Page Absent 0 Information about Uplink Port E vmware vmware com go networking Summary Getting information about the vSwitch ESX Server esxcfg vswitch App App Service Console Operating Operating System System esxtop resxtop Hardware Physical Switches vmware com go networking Service Console wee m m mo VMKernel NIC VMKernel Hardware Physical Switches Virtual NICs What to look for Does the device show up esxcfg vswif gt Is the driver loaded esxcfg vmknic Physical properties of the link Guest specific utilities Link State Linux ifconfig gt MTU settings lspci Windows m Device Manager Is the vNIC connected to the correct gt Portgroup using the correct uplink vmx file esxcfg info gt Portgroup with the correct security properties Is the NIC working Guest specific utilities gt Linux gt Does the NIC have an IP address m ifconfig gt Isthe NIC transmitting and receiving packets gt Windows Network Connections esxtop resxtop esxcfg info gt Isthe NIC dropping any packets E vmware vmware com go networking Getting information about the vNIC VI Virtual Machine Properties 7 un2 w2k3 Isi Virtual Machine Properties
5. Physical switch port should be a statically trunked Physical switch should be configured to expect frames with the specific VLAN IDs on the port Physical switch port trunk encapsulation should be set to 802 1q Portgroup VLAN ID set to 4095 Ph ysical Se Switch 81 vmware vmware com go networking Step 4 Check VLAN Configuration Native VLAN VM connected to Don t use native VLAN for regular gt Default native VLAN is often VLAN 1 side If you have to use default native vSwitch wont deliver VSwitch untagged VLAN for regular data traffic do one of the following packets to the VM VLAN 1 Frames not tagged gt Force tagging of native VLAN frames Might need to change native Physical Switch with VLAN behavior on all Native VLAN ID 1 neighboring switches 81 vmware Hardware gt Change the native VLAN on the physical switch vmware com go networking Problem Some of the VMs on a vSwitch have network connectivity other don t E vmware vmware com go networking Step 1 Round up the Usual Suspects Check the vNIC on the VM gt Check if the vNIC is connected to the correct portgroup gt Check if VM to VM traffic on the same portgroup works Check if the physical NIC is connected to the right port switch Use CDP 15 vmware vmware com go networking _
6. Virtual Machine Version 4 Device Status Connected 1 Hardware Options Resources Summary M Memory 1024 MB CPUS 1 Connect at power on B Floppy Drive 1 Client Device CDIDVD Drive 1 Adapter Type ES Netw pter 1 VM Network panes lid Current adapter Flexible SCSI Controller O LSI Logic Hard Disk 1 Virtual Disk MAC Address Automatic C Manual vmx file ethernet8 present true 00 50 56 a7 55 48 ethernet8 allowGuestConnectionControl false ethernet networkName VM Network ethernet8 addressType vfx Ene NES ethernet0 generatedAddresg 00 50 56 a7 55 48 Network label ym Network VM s Connection Information Add Remove Help OK Cancel E vmware vmware com go networking Getting information about the vNIC esxcfg vswif Aninterface to configure Service Console NIC esxcfg vmknic Aninterface to configure VMkernel NIC Output of esxcfg vswif l root osdc sust005 root esxcfg vswif 1 Name Port Group IP Address Netmask Broadcast Enabled DHCP vswif0 Service Console 10 17 42 111 255 255 252 0 10 17 43 255 true false vswiflg cosP6 ae 16 17 40 156 255 255 252 0 10 17 43 255 true true Output of esxcfg vmknic l root osdc sust 05 root esxcfg vmknic 1 Interface Port Group IP Address Netmask Broadcast MAC Address MTU TSO MSS Enabled vink vmkPG 10
7. 10 17 41 vmnic4 vSwitc 1 18 1 20 6 00 0 00 81 vmware vmware com go networking Getting information about the vSwitch esxcfg info esxcfg info provides information in greater detail Configuration information Output of esxcfg info Virtual Switch a ee ee aa ii gi 1 5 4 1 3 TOtal a D Configured 5 64 chee see se sm a DM NE Beacon Enabled false Beacon LIEB Vio 222 2222 oe ee 1 1 Required V LE TA pgm ee co ccr deu aue listen A A E S A nm 500 3 ee ere a etherswitch E vmware vmware com go networking _ Getting information about the vSwitch esxcfg info esxcfg info provides information in greater detail Cumulative traffic information for each port on the vSwitch Port Rs 33554438 1 MAMA AAA vmk tcpip 10 17 41 72 DEVICE 00 50 56 7e 31 61 as a A aus Ps A Portgroup Stats PREKGES TE UK ccc ek es TX OR oat et eee
8. 1506 E vmware vmware com go networking Just follow the cable OR Use CDP and Network Hints pa 47 y y 257 eo d d La 507 LEE yr o s PLN HS TI r NC up e ari Cisco Discovery Protocol Periodic exchange of Information gt Physical switch port a vmnic is connected to gt vSwitch a physical switch port is connected to gt Duplex and speed settings Cisco Discowery Protocol Properties version Timeout Time to live Samples 11290 Device Id cs eth netcorel mwar Address 172 17 1 3 Port Id GigabitEthe rnetO les Software Version Cisco 105 Software C3560 Hardware Platform cisco WS C3560G z4T5 IP Prefix LL CI IP Prefix Length LAN Full Duplex MITO System Name Swstem Old Management Address Location CDP Device Capability Router Transparent Bridge Source Route Bridge Network Switch Host Enabled Repeater vmware vmware com go networking Cisco Discovery Protocol CDP is enabled by default in listening mode On ESX Server 3 5 it is possible to configure CDP also in advertising mode gt Enabled disabled only via command line with esxcfg vswitch B state lt vSwitch gt States o Listen o Advertise o Both o Down gt Verify the setting with esxcfg vswitch b lt vSwitch gt 15 vmware vmware com go networkinc Getting informatio
9. Physical switch is responsible for the tagging and stripping Physical _ Switch 81 vmware vmware com go networking Step 4 Check VLAN Configuration VST VM on VLAN 105 H on VLAN 106 E VM on VLAN 107 Check the portgroup VLAN N RS ID App App Check the physical switch port configuration Physical switch port should be configured as a trunk port Trunking should be static and Hi wan unconditional No Dynamic Trunking vSwitch supports Make sure the Protocol DTP only 802 1q NH portgroup VLAN Physical switch port trunk encapsulation IDs are correct encapsulation should be set JE to 802 1q No ISL LANE etc The switch port sees packets with multiple VLAN IDs 81 vmware vmware com go networking Step 4 Check VLAN Configuration VST Check if the physical switch is configured to trunk all the VLANs on the vSwitch gt Manually specify all the VLANS to be trunked gt No VLAN Trunking Protocol VTP AO e ASE A Ee AAA III L M e MI db Nado Semi RM VLAN 105 VLAN 106 VLAN 107 444 vswitch rel Configure the 2 physical switch to trunk VLAN IDs 105 106 and 107 81 vmware vmware com go networking Step 4 Check VLAN Configuration VGT Check if the portgroup VLAN ld is set to 4095 Check physical switch configuration
10. T50 Tx Ok 7 0 the esxcfg info Packets SW TSO output Packets Zero Copy TAOK 9 Packets Rx 113655 Bytes Rx 0 10153132 vmware com go networking Summary Getting information about the vNIC esxtop resxtop VSwitch Hardware Physical Switches vmware com go networking Sniffing For Trouble Sniff for packets at different layers for isolation Service Physical Switch Port Level EIE gt vSwitch Level gt VM Level Look for VSwitch gt Lost Packets Large number of packet ea retransmissions gt Anomalies reported by protocol analyzers like Wireshark etc Look for patterns Are packets of a certain type causing Physical Mirrored problems Switch Are packets of a certain size causing problems Port Capture packet traces inside the VM Capture packet traces on the vSwitch 8 vmware vmware com go networking Collecting Network Traces on the vSwitch VM A on VLAN 106 Server Run tcpdump vswifX tcpdump vmnicO won t work Console is M eee ie Set the VLAN ID of th Service Console portgroup to 4095 Enable promiscuous mode for the Service Console portgroup 8 vmware vmware com go networking Collecting Network Traces on the vSwitch ESX VM A on VLAN 106 S
11. w2k3 lIsi Service Console Port Service Console vewiF 10 17 42 111 Subnet Mask D e Service Console Default Gateway virtual Switch vSwibchi Remove Properties Service Console Port Physical Adapters cosPG ES vmnic 100 Ful vewiFz 192 166 100 101 i Ga vmnic3 100 Full Cancel Help 15 vmware vmware com go networking Getting information about the vSwitch esxcfg vswitch esxcfg vswitch gt An interface for adding removing and modifying virtual switches and their settings Output of esxcfg vswitch 1 root osdc sust005 root esxcfg vswitch 1 Switch Name Num Ports Used Ports Configured Ports MTU Uplinks vSwitch 64 4 64 1500 vmnic PortGroup Name VLAN ID Used Ports Uplinks VM Network 9 8 vmnicd Service Console 9 1 vmnic Switch Name Num Ports Used Ports Configured Ports MTU Uplinks vSwitchl 64 4 64 1500 vmnic4 vmnic3 PortGroup Name VLAN ID Used Ports Uplinks cosPG 9 8 vmnic3 vmnic4 E vmware vmware co Getting information about the vSwitch esxtop esxtop provides system wide real time traffic information gt For ESXi use resxtop utility provided in the RCLI Type n to switch to the network utilization screen PORT ID USED BY TEAM PNIC 16777217 vmnic 16777218 8 NCP 16777219 8 CDP 16777220 O vswif vmnic 33554433 vmnic3 33554434 8 NCP 33554435 vmnic4 33554436 Q CDP 33554437 O vsw
12. 17 41 72 255 255 252 0 10 17 43 255 608 50 56 7e 31 61 1500 40968 true 15 vmware vmware com go networkinc Getting information about the vNIC Output of esxtop 11 45 05pm up 5 min 63 worlds CPU load average 8 800 0 04 0 00 PORT ID USED BY TEAM PNIC DNAME PKTTX S MbTX s PKTRX s MbRX s XDRPTX 16777217 vmnice vSwitch 1 98 0 00 15 05 8 01 0 00 86 00 16777218 vSwitcho 0 00 0 00 0 00 9 00 0 00 0 00 16777219 vSwitch 0 00 0 00 0 00 0 00 0 00 0 00 16777220 O vswif0 vmn1c0 vSwitch 1 98 0 00 14 26 9 01 0 00 86 00 33554433 vmn1c3 vSwitchl 0 00 0 00 13 27 0 01 0 00 86 00 33554434 vSwitchl 0 00 0 00 0 00 8 00 0 00 6 00 33554435 vmnic4 vSwitchl 1597 13 1 19 1610 20 1 20 0 00 0 00 33554436 6 CDP vSwitchl 1 96 3780 1 00 9 00 0 00 86 00 3554437 9 vswifl8 vmnic3 vSwitchl 9 01 0 00 80 00 3554438 O vmk tcpip 10 17 41 vmnic4 vSwitchl 20 8 08 0 00 us Output of esxcfg info Id concen a assa a 33554438 World Leader f 9 DD information forthe X l Blocked OT eee ee ee eee false VNIC you are rtgpeeff vmkPG interested in PERAS o 84489 ARIAS 8281172 Cumulative Traffic Search for the port Packets TSO Tx 0 0 Information Real time traffic information p 18 17 41 ID of the vNIC in l Bytes
13. 66112677 635 2 Mb TX bytes 202118997 192 7 Mb vmnicl thernet HWaddr 90 E 85 UP BROADCAST UNNENG MULLICAS 1156 1 RX packets 8989025 errors 9 O overruns 0 frame 0 TX packets 8 errors 8 dropped 8 overruns 8 carrier collisions 8 txqueuelen 1000 RX bytes 604831816 576 8 Mb TX bytes 09 0 0 b Interrupt 161 13 79 9B Getting information about the physical NICs On ESX Server 3 5 running ifconfig inside Service Console provides information valuable for troubleshooting E vmware vmware com go networking Getting information about the physical NICs esxcfg info provides detailed information about the System gt Use esxcfg info n for network information gt Redirect the output of esxcfg info to a file gt Look for the Physical Nic section root osdc sust005 root esxcfg info gt info root osdc sust005 root vi info root osdc sust005 root 15 vmware vmware com go networking _ Getting information about the Physical Nic physical NICs ES A A vmnic 165 PA ET 1 denda EG PA E aa oe aa 4 PA ope ane fae aa AA AA PAIO MAL AIT E RE XR WE 00 11 85 13 79 9a Ca O LI Ts wa RA a AO RR dA eee 00 50 56 53 79 9a A AA 1 0 PPP Term tg3 MINE SI sa wane nx ORA daa RATE Ra RR RR 0 10 17 40 00 255 255 254 00 SES eer eT 150 RUTA DAA arica ia a
14. Console IRU ces sees on Aw Ra RN RU weal 38 PRESS Tu EE ea a ee ek M anb d e eti e d 52 153 Output of esxcfg info 15 vmware vmware co Getting information about the physical NICs Search for vmnicX in the output of esxcfg info Virtual Switch O O ak ee ee an vSwitch ieri COR PEER SR RE PEER vmnic uos A SERRE RR EET REPE T C 64 DONT TEM qa ER dus on RE a CAR NOR 64 sum POPE PRA RR AE IR ARR ERE C E dA 4 sss ONE ERSTER ee ee ra toners false a DRAGON INTENSE 1 DOMO INFRA 1 BEACON Raduired OV a 220505254256 EA ae a a ok listen 11 PA US TONI RS eee 00 ILL gis eae ee 222222222202 2256 see eee etherswitch Unclaimed Ports Port a AA AA E 16777217 E IRA ATA 0 ra a vmnic a E A A a ee a 00 00 00 00 00 00 Blocked false Treo EPC eee 410963 ee Perr E 202209073 T30 UX Wi cacena arar TA Ih sae 9 s sPackets SW IX im ie ae s 0 lssssDropped IM ESO cack ack sou ae 12 E 0 Packets Zero Copy Tx Ok 0 PERES REX UK laa as 9242292 La dE A ETT 666574263 Nranned Rv a Output of esxcfg info Summary Getting information about the physical NICs ESX Server Serv
15. VI3 Networking Advanced Troubleshooting Physical NICs Virtual Switch Virtual NICs VM s Virtual NIC Flexible Enhanced Virtual E1000 Vswif for the Service Console VMkernel uses vmknic VMkernel TCP IP Stack ESX Server Service Console mm m m mo A oom 1 ced VSwitch VMKernel NIC VMKernel Hardware Physical Switches Agenda Basic Troubleshooting gt How to isolate problems gt What tools are available for troubleshooting Troubleshooting Scenarios gt Step by step guide on how to troubleshoot some specific networking problems 15 vmware vmware com go networking _ Basic Troubleshooting Techniques Isolate the problem Troubleshoot one component at a time Physical NICs Virtual Switch Virtual NICs Physical Network Tools for troubleshooting gt VI gt Command Line Utilities gt Third party tools Ping and traceroute m Traffic sniffers and Protocol Analyzers o Wireshark gt Logs vmware com go networking ESX Server Service Console e VMKernel NIC VMKernel Physical Switches Physical NICs What to look for Does the device show up gt Is the driver loaded Physical proper
16. able to communicate with another VM on the same portgroup If not Look at the receive and transmit byte counters in the VMs to see what is going on a Look at esxtop esxcfg info for any dropped packets on the ports a Check firewall settings in the guest VSwitch vmware vmware com go networking Step 3 Check the physical NIC Check if the uplinks connected to vSwitch and the portgroup are correct gt Use VI or esxcig vswitch l Check if the physical NIC is receiving and transmitting data gt Check the RX and TX counter using ifconfig esxcfg info or esxtop gt Check if Tx Rx error counters are incrementing gt Check the VMkernel logs for any errors Check if the physical NICs are connected to the correct physical switch ports Use CDP or Network Hints ta vmware vmware com go networking Step 4 Check VLAN Configuration Check who is tagging and stripping the VLAN IDs External Switch Tagging Only the physical switch tags and strips VLAN IDs Virtual Switch Tagging m Only the vSwitch tags and strips VLAN IDs Virtual Guest Tagging m Only the guest tags and strips VLAN IDs 15 vmware vmware com go networkinc Step 4 Check VLAN Configuration EST VLAN tagging and stripping is done by the physical switch Make sure the vSwitch is not configured to tag or strip VLAN IDs Check your physical network configuration Untagged frames
17. eck Portgroup Security Policies Promiscuous Mode gt f allowed guest receives all frames on the vSwitch gt Some applications need promiscuous mode m Network sniffers m Intrusion detection systems MAC Address Change f allowed guest can change its MAC address Implication Malicious guests can spoof MAC addresses Forged Transmits gt f allowed guest can send packets with different source MAC Implication Malicious guests can spoof MAC addresses or cause MAC Flooding Security settings should reflect application requirements vmware vmware com go networking Example Microsoft Network Load Balancing In Unicast Mode All cluster hosts are assigned the same MAC address gt Thus incoming packets are received by all cluster hosts Uses forged MAC addresses to hide the cluster MAC address from the switch Prevents the switch from learning the cluster s actual MAC address gt Incoming packets for the cluster are delivered to all switch ports Portgroup configurations Allow MAC address changes gt Allow Forged Transmits Do not Notify Switch KB Article 1556 gt http kb vmware com kb 1556 Recommendation Use NLB in Multicast Mode vmware vmware com go networking For more information VMware Networking Technology VMware Networking Blog
18. erver Run Wireshark in the VM Create a portgroup Set the VLAN ID of the portgroup to 4095 Enable promiscuous mode for the portgroup is 3 J VSwitch Hardware 8 vmware vmware com go networking Logs on ESX VMkernel logs var log vmkernel for ESX var log messages for ESXI VM logs vmware log file in the VM directory Service console logs gt var log messages tor ESX Also check the guest OS logs for any errors Guest OS Logs VM Logs VMkernel Logs VMkernel Logs Service Console Logs 8 vmware vmware com go networking Troubleshooting Scenarios Signs of trouble Basic connectivity problems gt No network connectivity on some or all of the VMs on a vSwitch Flaky network connection Connection timeouts gt Intermittent loss of connectivity 15 vmware vmware co Problem None of the VMs on my ESX box have network connectivity E vmware vmware com go networking Step 1 Check inside the VM Has the guest OS detected the vNIC Use OS specific utilities to check Windows Device Manager Linux Ispci ifconfig gt f a network interface for the vNIC does not show up m Check the VM configuration using VI or by looking into the vmx file Check the log file vmware log for any obvious problems m Check the gue
19. go networking Problem VMs lose network connectivity upon teaming fallover fallback E vmware vmware com go networking Step 1 Round up the Usual Suspects Check physical switch side VLAN configurations gt Should be identical for all the NICs in a team Check physical NIC connections NICs in a team must be in the same broadcast domain 15 vmware vmware co Step 2 Spanning Tree Protocol The switch drops packets on a newly active port till the port is in forwarding state if SIP is enabled STP Stales of a newl active port The switch is Blocking dropping Listening packets on the port till the port is in Forwarding Learning State Forwarding This interferes with fallbacks Physical Switch vmware vmware com go networking Step 2 Spanning Tree Protocol Packets coming up one vSwitches uplink are not cannot be transmitted out connected another internally Loops are not possible inside ESX 187 vmware vmware com go networking Step 2 Spanning Tree Protocol To avoid the dropped packets do one of the following gt Enable PortFast mode for the physical switch ports feeding the ESX Server gt Configure the physical switch ports feeding the ESX Server as Edge Ports when using Rapid Spanning Tree Protocol gt Disable STP for the physical switch ports feeding the ESX Server This is not a recommendation t
20. ice Console VI Client esxcfg nics esxtop resxtop ifconfig Hardwe esxcfg info Physical Switches CDP vmware com go networking Service Console Physical Switches Virtual Switch What to look for vSwitch and Portgroup Configuration gt Uplinks gt VLAN Setting esxcig vswitch esxcfg info gt Layer 2 Security Policies VI Client NIC Teaming Configuration Is the traffic flowing through the esxtop resxtop vSwitch esxcfg info s the vSwitch dropping any packets 15 vmware vmware co Getting information about the vSwitch VI Getting Started Summary Health Status Processors Memory Storage Networking Storage Adapters Network Adapters Licensed Features Time Configuration DNS and Routing Virtual Machine Startup Shutdown Virtual Machine Swapfile Location Security Profile System Resource Allocation Advanced Settings Virtual Machines Vi Virtual Switch Configuration Resource Allocation VI Portgroup Properties Performance service Console Properties Configuration TTE Networking General Security Traffic Shaping NIC Teaming Port Properties Remove Properti Physical Adapters ES vmnico 100 Full Network Label VLAN ID Optional service Console T irtual machines YLAM ID Use the following IP settings IP Address lun2
21. if10 vmnic3 33554438 0 vmk tcpip 10 17 41 vmnic4 Output of esxtop 11 45 05pm up 5 min 63 worlds CPU load average 0 06 0 04 0 00 DNAME vSwitch9 vSwitch8 vSwitch vSwitch9 vSwitchl vSwitch vswitchl vSwitdhl vSwitc vSwitch PKITX S 1 98 0 00 1597 13 8 E Real Time Traffic Information PRIRA S MDRA S ADRPIA ADRPR 1609 41 8 0 00 0 00 6 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00 0 00 8 08 0 00 0 00 0 00 0 00 YOO 0 00 0 00 0 00 vmware vmware com go networking Getting information about the vSwitch esxtop ESX Server System Running Flood Ping to the vmknic VMkernel Service Console Ss VMKernel Hardware Output of esxtop 11 45 05pm up 5 min 63 worlds CPU load averages 0 00 0 04 PORT ID USED BY TEAM PNIC ONAME TX s MbIX s PKTRX s MbRX s DRPTX DRPRX 16777217 vmnic vgwitch8 1 38 0 00 15 05 0 01 6 00 0 00 16777218 witch 0 00 0 00 0 00 0 00 6 00 0 00 16777219 Switch 0 00 0 00 0 00 0 00 0 00 0 00 16777220 O vswif0 fmnice vSwitch8 1 98 0 00 0 01 0 00 6 00 33554433 vmnic3 vSwitchl jet 0 00 0 01 6 00 0 00 33554434 8 NCP vSwitchl 06 0 00 0 00 6 00 0 00 335544 mnic4 ECH 13 1 19 1 20 0 00 0 00 33554436 0 0 00 0 00 0 00 0 00 33554437 0 vswif10 vmnic3 vSwitc 0 00 0 01 6 00 0 00 33554438 0 vmk tcpip
22. l NICs esxcfg nics allows you to set or get physical NIC settings via the command line Ends options N S speed speed Set the speed of this NIC to one of 10 100 1000 10000 Requires a NIC parameter Set the duplex of this NIC to one of full or half Requires a NIC parameter Set speed and duplexity automatically Requires a NIC parameter Print the list of NICs and their settings Restore the nics configured speed duplex settings INTERNAL ONLY Display this message d duplex duplex a auto 1 list r restore h help 15 vmware vmware com go networking root osdc sust805 root esx viinicl 01 05 00 tes vmnic2 07 02 00 610 vmnicd 0b 02 00 6100 vmnici 0b 01 00 6100 vmnic 01 04 00 tg3 rootBosdc sust005 root Getting information about the physical NICs The l option lists the nics in the system and their settings gt Link State gt Speed gt Duplex gt MTU e nics 1 vmicl PCI Driver Duplex TU Link Speed description rdadcom Corporation NC7781 Gigabit Server Adapter PCI X 10 100 1900 T Int D Corporation 8254NXX Gigabit Ethernet Controller 09 Intel Corporation EtherExpress PRO 100 5 Server Adapter Up 100Mbps Full 1599 Intgl Corporation EtherExpress PRO 100 5 Server Adapter Up 100Mbps Full 1599 Brgadcom Corporation NC7781 Gigabit Server Adapter PCI X 10 100 1000 T Down 8Mps Half
23. n about the physical NICs esxtop provides system wide real time traffic information gt For ESXi use resxtop utility provided in the RCLI nn to switch to the network utilization screen Output of esxtop 11 45 05pm up 5 min 63 worlds CPU load average 0 06 0 04 0 00 PORT USED BY TEAM PNIC DNAME PKTTX s PKTRX s MbRX s DRPTX DRPRX 16777217 vmnica vSwitchd 1 98 0 00 15 05 0 01 6 00 0 00 16777218 vSwitch 0 00 9 00 0 00 0 08 6 00 0 00 16777219 CDP vSwitch 0 00 0 00 0 00 0 00 6 00 0 00 16777220 O vswif vmnnic vSwitch 1 98 0 00 14 26 0 01 0 00 0 00 33554433 vSwitchl 0 00 0 00 13 27 0 01 0 00 80 00 v5witchnl O j OE 2212 re 234226 33554435 vmnica vSwitchl 1597 13 1 19 1610 20 1 20 0 00 0 00 335 h A AA 82 25 Jut 7 00 9 060 33554437 0 vswif10 vmnic3 vSwitchl 9 00 0 00 12 28 0 01 6 00 0 06 33554438 0 vmk tcpip 10 17 41 vmnic4 vSwitchl 1597 13 1 19 1609 41 1 28 0 00 6 00 vmware vmware com go networking Output of ifconfig root osdc sust005 root ifconfig lo Link encap Local Loopback inet addr 127 0 0 1 Mask 255 0 0 0 UP LOOPBACK RUNNING 16436 1 RX packets 764267 errors 0 dropped 80 overruns 8 frame 0 TX packets 764267 errors 80 dropped 8 overruns 8 carrier 68 collisions 8 txqueuelen 0 RX bytes 559614933 533 6 Mb TX bytes 559614933 533 6 Mb vmnic collisions Exqueuel n i 1000 RX bytes 6
24. nfiguration The two VMs could be using different uplinks VLAN configuration on physical switch ports connected to NICs in a VLAN configuration for these physical switch ports should team should be be A identical rs A EAT 7 81 vmware vmware com go networking Step 3 VLAN Configuration Manually configure the switch port to expect all the VLAN IDs in use VLAN 105 VLAN 106 VLAN 107 A A VSwitch Configure the physical switch port to trunk VLAN IDs 105 106 and 107 Kernel Qware vmware com go networking Problem VMs have intermittent network connection vmware com go networking Step 1 Round up the Usual Suspects Check the vNIC on the VM gt Check if VM to VM traffic on the same portgroup works without intermittent problems Check VLAN configuration dentical VLAN configuration on physical switch ports that are in a team Make sure the NICs in a team are in the same layer 2 broadcast domain Checkif the physical NIC is connected to the right port switch E vmware vmware com go networking Step 2 NIC Teaming vSwitch expects Lernen for VM A L on this Port Id or MAC based load balancing on ESX Hardware Don t enable Link Aggregation on the physical switch 81 vmware vmware com go networking Step 2 NIC Teaming IP based load balancing
25. o disable STP in the entire network vmware vmware com go networking Problem VMs lose network connectivity after VMotion E vmware vmware com go networking These NICs shoul be in the same broadcast domain RENE pl lt has ts lee ee Hardware These physical switch ports should have identical Physical Switch VLAN configuration ESX Server VSwitch Hardware MAC A MAC B MAC B Physical Switch ESX Server VSwitch MAC B MAC B Physical Switch Notify Switch 2 VLAN 106 Portgroup Properties N otify SWItC h IS ena b Traffic Shaping NIC Teaming by d efa u It Policy Exceptions Load Balancing Route based on the originating virtual port 1D Network Falover Detection m Status only Notify Switches M ves Settings should reflect application requirements Rolling Failover Falower Order Owenide vSwitch failover order Select active and standby adapters for this port group In falover situation standby adapters activate in the order specified below TUN Active Adapters 1000 Ful 10 17 152 1 10 17 152 24 Move Down Standby Adapters Unused Adapters vmware vmware com go networking Problem Network connectivity is fine on the VMs but my application does not work E vmware vmware com go networking Step 1 Ch
26. on ESX Configure Link a VSwitch Aggregation on prez the physical Pol switch ports S ER E Enable Link Aggregation on the physical switch gt Static Link Aggregation No LACP or PAgP vmware com go networking Active Standby won t work with IP based load balancing Because of the static Link Aggregation the physical switch will want to deliver packets on the standby NIC Be careful when configuring IP Hash based teaming with other load balancing configurations on portgroups of the same vSwitch vmware com go networking Step 2 NIC Teaming Multicast traffic Don t use MAC Address Based Load balancing gt Use Port ld based load balancing instead 15 vmware vmware com go networkin Step 3 Jumbo Frames Network devices drop frames larger than MTU How to detect such problems gt Run ping with large packet size e g 20000 m ping s packet size gt Check for packet drops on the vNICs and the physical NICs MTU 9000 MTU 1500 This interface will drop packets larger than 1500 vmware vmware com go networking Step 3 Jumbo Frames MTU should be the same end to end Set vNIC MTU in the guest gt Use esxcfg vswitch to set the MTU of the physical NIC esxcfg vswitch m MTU vSwitch m Use RCLI for ESXi 3 5 MTU should be consistent vmware vmware com
27. st OS log files for any obvious problems o ls appropriate driver for the vNIC installed and loaded a Install VMware tools inside the guest vmware vmware com go networking Step 1 Check inside the VM Is the network interface in the guest up and does it have an IP address gt Use OS specific utilities to check Windows Network connections ipconfig Linux ifconfig gt Use static IP addresses during troubleshooting 15 vmware vmware co Step 2 Check the vNIC connection Check if the vNIC is connected to the correct portgroup gt Use VI or look into the vmx file gt Make sure the Connected box is checked VI Virtual Machine Properties lun w k3 Isi Virtual Machine Properties Ea tx Is the vNIC Virtual Machine Version 4 connected Hardware Options Resources Hardware Summary vice Status M Memory 1024 ME Connected a CPUs 1 Connect at power on al Floppy Drive 1 Client Device Adapter Type PS Current adapter Flexible LST Logic EL CD DVD Drive 1 Hard Disk 1 Virtual Disk MAC Address 00 50 56 7 55 48 vNIC connects to this Automatic Manual Network P b Network label Network portgroup vmware com go networking Step 2 Check the vNIC connection Check connectivity between VMs on the same portgroup gt Atthis point you should be
28. ties of the link sans ld ifconfig inside gt Link State Service Console gt Link Speed Duplex Setting gt settings VI Client Is the NIC ted to wh tit Network Hints s the connected to where you want i to be connected Protocol ODP Is the NIC working ifconfig inside gt Is the NIC transmitting and receiving packets Service Console gt Is the NIC dropping any packets esxtop resxtop esxcfg info 15 vmware vmware com go networking Getting information about the physical NICs VI Client provides basic information about the physical NICs Getting Started Summary VirtualMachines Resource Allocation 8 Configuration Users Groups Events FPermissions Device 5 vSwitch Observed IP ranges Wake on LAN Supported NC7781 Gigabit Server Adapter PCI X 10 100 1000 T ME ER vmnicn 100 Full Negotiate wSwitchO 10 17 40 1 10 17 43 254 Yes Memory vmnicl 100 Full Negotiate None 10 17 40 1 10 17 43 44 Yes storage 8254NXX Gigabit Ethernet Controller Networking Ea vmnicz 100 Full Negotiate Mane 10 17 40 1 10 17 43 254 Yes Storage Adapters EtherExpress PRO 100 5 Server Adapter Network Adapters ERA vmnic3 100 Full Megotiate Mane 10 17 40 1 10 17 43 254 Yes ERR vmnic4 100 Full Negotiate None 10 17 40 1 10 17 43 254 Ye Type of NIC Link Status Network Hint vmware vmware com go networking Getting information about the physica
Download Pdf Manuals
Related Search