Cisco Switching/Routing :: High Utilization On 3750x Switch Stack?
Feb 25, 2013
i am seeing very high utilization on a random basis on the stack. and the logs indicate me that there is a pattern where there is a stack power cable shows inserted (which was never unplugged) followed by sudden spike in the utilization.
001018: *Mar 6 16:21:22.138: %PLATFORM_STACKPOWER-6-CABLE_EVENT: Switch 4 stack power cable 1 inserted
001019: *Mar 6 18:18:37.982: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU
WS-C3750G-24TS-S1U switch stack with high CPU utilization. 3 switches are stacked and using PBR on that. I am attaching the show cpu process as an attachment.The current template is "desktop routing" template.The selected template optimizes the resources in the switch to support this level of features for 8 routed interfaces and 1024 VLANs. [code]
We are facing high CPU Utilization on Cisco 3750X-48P-L without any traffic on it. find the attached log files for 2 separate 3750's stack, we have upgraded the IOS of SW2 from "c3750e-universalk9-mz.122-55.SE3.bin" to "c3750e-universalk9-mz.122-55.SE4.bin" but still we found the same issue with CPU utilization.
We have just purchased Cisco 3750X 24 S switches (QTY 2), last week we put them in prodcution in simple Layer 2 mode. No Core, just act as Access switch in order to only check the performace and availibility of switches.
But strange thing I have noticed the highest cpu utilization, cpu sits on 13 to 14% and from historical logs it hit above 60%. I am confused what is happening. Remember to terminate copper connection we have inserted Copper SFP Modules on both switches.
Both switches connected on Layer 2 mode via trunk, in LAN environment we have here 7 3Com 2824 Management switches which are terminated on Copper SFP modules at Cisco 3750X 24 S. All 3Comm Switches uplink are terminated on Cisco 3750 Switch 1, another switch is idle. Whole setup is running on VLAN1 .
Also refer no port in TCP and UDP packets in show ip traffic. any abnormal condition you predict..basically, In near days we plan to make these switches as Core layer and run intervlan routing, HSRP/VRRP and OSPF. But in this cpu usage how we can go ahead until this resolved..
We had a stack of 4 qty 3750g running IP base on ver 12.2.32, then installed a 3750x to the stack and upgraded the whole stack to 15.0.2 SE3. In doing so, we noticed that the memory utilization jumped from 60-70% to 83-84%.
We had the same issue occur when upgrading to 15.0.2 SE3 on another stack that was 6 qty 3750g running ip-services, but this one jumped to 90%. On the 6 qty stack, we downgraded to 12.2.55 and the memory util went back down to 60-70%.
On the mixed stack, we replaced the 3750x with another 3750g and downgraded the whole stack to 12.2.55, however, the memory utilization did not drop down. As far as I can tell, no config changes have changed from the original IOS.
Seeing very high CPU on one of our 3750X stacks. Usally its around 30% but recently its 70, 80, 90 or maxed at 100% during the main day.IOS version c3750e-universalk9-mz.122-55.SE1.bin.Has a ten gig uplink connected to a nexus 7k and another ten gig connected to another 7k. Running Layer 3 and EIGRP on the 3750X.Is this normal for the CPU?
#sh processes cpu history 5555555554444455555555555555588888666669999888885555577777 8888000001111111111222227777755555666662222222229999977777 100 90 ***** **** 80 ***** ********* *****
I have a new cisco 3750 stack comprised of 8 members (6 x 3750G-48PS and 2 x 3750V2-48PS) running 'c3750-ipservicesk9-mz.122-58.SE2.bin'. I am seeing high memory utilisation, it seems to sit fairly stable and I do not see an increase but this has only been running a few days. No errors or performance issues. Should this be a cause for concern?
We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high. This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure. Below I provided some outputs about how to diagnose it.
In Cisco 3750 facing high CPU utilization for specific period. During this period traffic response times across the switch degrades. Steps to identify interface potentially generating traffic. I have attached 'sh proc cpu history' , ' sh ip traffic', 'sh proc cpu sorted' during troubled period .
I am a new network engineer on a retail company and I am having a problem on the High utilization of my 3-stack switch 2960 only during Peak Hours of the Store Sales.
Note: on Peak hours, it is peaking at 90-95 % here is the utilization after Peak hours: 4444333334444433333333333333333333333333333333333333333333
I have been facing High CPU Utilization issue with few of my Cisco 4006 Switches together from last one month. Out of which 1 switch issue sorted out auto after 2 days however the problem is still exists with rest 3 switches.They are 6-7 year old and having one SUP engine and other are switch port modules.
We had a core switch(30 vlans) in our environment and it's noticed that CPU utilization of the core switch is showing high during recent days. I have checked logs and processes, but couldn't find the root cause. The issue found only in the office hourly only(after that the cpu utilization is idle and normal). I have already referred the following link to troubleshoot the issue " [URL]
see the following outputs from the core switch
CPU utilization for five seconds: 99%/0%; one minute: 99%; five minutes: 99% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 30 6687557041432420936 466 47.52% 47.10% 45.98% 0 Cat4k Mgmt LoPri 55 30667074884269560256 0 45.36% 45.50% 45.85% 0 IP Input 29 28552856922870089254 0 3.59% 3.50% 3.57% 0 Cat4k Mgmt HiPri
[code]....
Note: Each Invalid source mac entry in each day from same port (above is the output after clearing logs before 3 days)
My queries regarding the issues are following
1) How can we find root cause regarding the high cpu utilization?
2) Is a single invalid mac address makes the cpu highly utilized for suppressing it?
We have a problem of igh CPU Utilization in Cisco 4510R-with dual SUP V-10G modules.
Cisco 4510R switch is the CORE switch and have 30 no's of VLans. It was running PVST/PVST+ previously. But Now we have migrated to MST. But after upgradation the CPU utilization reached alomst 98%.
We have also tried Loopguard feature enabled on all ports: but after some period same problem is repeated.
version information is below: Cisco IOS Software, ME340x Software (ME340x-METROIPACCESSK9-M), Version 12.2(25)SEG3, RELEASE SOFTWARE (fc2) Copyright (c) 1986-2007 by Cisco Systems, Inc. Compiled Wed 25-Jul-07 22:56 by amvarma
In my network we use all cisco 2960 switches, problem is when someone copying 4gb data or high from one switch to another switch, by that time rto (Request time out) is coming.
router | | |
[Code]....
1. when user 1 copy data from server ,at that time who is in switch2 behind like user2 ,he is getting problem like when ping to default-gateway,or rto is coming and network is very slow .
2. when i open sw2,sw1,sw3,trunk ports utilization is very high except sw4 to sw1 trunk ports,who behind sw4 like user4 ,he is not getting problem.
3.all switches trunkport in my network is faster ethernet and i have no option to connect trunkport to gigaehternet and ethernet channel.
I have a 3750X 24 port switch (with NM-1G network module) running IOS 15.0(1). Is there any benefit or reason to plug in the included Stack Wise cable and loop it back to itself in a single switch installation?
I don't see any recommendation in the documentation. The data sheet indicates a single switch is a non-blocking device so I'd think there's no bandwidth advantage like there is when connecting an actual multi-switch stack and needing to close the loop for the full 32 Gbps stack bandwidth.
I upgraded the newest IOS 15.0(1)SE for our SW C2960-24-TT-L, the process was succeseful. However, we found SW memory utilization raised to 82% this morning in normal situation. (Momery: Total 21341260, Used17471692) Did you guys meet the same problem after upgrading to 15.0(1)SE? I also would like to know what the normal memory utilization is? and what is the impact of memory utilization highly?
I upgrade the IOS of my switch 3560 from C3560-IPBASE-M), Version 12.2(25)SEB4, To C3560-IPBASEK9-M), Version 12.2(55)SE5 after that the utilizatio of the memory increase to 80% I attached the output of show memory statistics history
What are the options avilable to add a cat3560 g switch to a stack of 3750x switches.?is there a connector avilable ?or is it possible to trunk via fiber ? cat 3560 has 4 sfps and 224 10/100/1000 ports with poe. cat 3750 stack has a 10 gb up link . What are the possible options?
We are having 3750 Stack switch as our edge switch. Here we are having some issues as low memory & itermediate High CPU utilization.For memory when we checked its shwoing maximum memory is allocated to DHCPD receive & ARP Input as follows
Processor Pool Total: 70829380 Used: 56809532 Free: 14019848 I/O Pool Total: 12582912 Used: 8554920 Free: 4027992 Driver te Pool Total: 1048576 Used: 40 Free: 1048536
[code].....
i want to understand why this 2 proceses (DHCPD & ARP input) taking more memory?High CPU: We also facing intermediate high CPU utilization (above 95%). When CPU is high there were 2 processes consuming more CPU are 'Spanning Tree' (about 20%) & ARP Input (about 66%). we also checked the ARP entries, there were 1500 ARP entries & 2 incomplete ARP (out of 6000 ARP supported)
I have 3 switches in my 3750 X stack. I am getting the following error in the logs: %PLATFORM_STACKPOWER-4-PRIO_CONFLICT: Switch 1's power stack has conflicting power priorities. Not sure what I should do next. Below is my Stack-power configuration:
Power stack name: Powerstack-1 Stack mode: Power sharing Stack topology: Ring Switch 1: Power budget: 735 Low port priority value: 20 High port priority value: 10 Switch priority value: 2 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: c464.1308.7900 Neighbor on port 2: e8b7.4827.e680 Switch 3: Power budget: 729 Low port priority value: 22 High port priority value: 13 Switch priority value: 4 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: 2894.0fd9.9f00 Neighbor on port 2: 2894.0fd8.e200 Switch 2: Power budget: 690 Low port priority value: 21 High port priority value: 12 Switch priority value: 3 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: 2894.0fd8.e200 Neighbor on port 2: c464.1308.7900
Each switch has its own 715W power supply in it and all check out OK.
i have two cisco 3750 in stack firts, master switch have all swports busy second have only 5 how can i see cpu utilizations of the second switch, and its reasonable to move somme devices from first switch to second for deacreases of cpu and memory utilisatio ns of the master? the stack tehnologies use both cpu as one? or its only for simple management ?
We have a Cisco 3845 router configured as a voice gateway with multi SIP trunks. But when it reachs 200 calls traffic, the CPU increase to 60-70% and caused by CCSIP_SPI_CONTROL process.
CPU utilization for five seconds: 46%/30%; one minute: 54%; five minutes: 58% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 377 400729448 171017979 2343 6.31% 10.71% 12.44% 0 CCSIP_SPI_CONTRO
I've been looking at reported problems with our Vdeio Conferencing kit attched to a stack of 3750's (which I think is down to QoS) but this got me looking at the logs. We get a lot of high CPU utilization warnings mainly for SNMP (315), Hulc running con (95), Virtual exec (289). I understand the last two are normal, and the SNMP one is probably Cisco Works polling as it happens every 4 hours.
However I've got an odd one: Apr 25 07:34:58: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU Utilization(Total/Intr): 93%/0%, Top 3 processes(Pid/Util): 296/85%, 144/0%, 154/0%
From couple of weeks we have observed the cpu utilization of cisco 6509 with SUP 720 is high. During daytime from 9:00 to 21:00 it keeps increasing & reaches 98% & after 21:00 becomes normal.
I have a 2 cisco core (cisco WS-C6509-E (R7000) processor) and been working for quite sometime.they are conneted with HSRP with active standby config with a 10 g module for redundancy just today I see that the cpu utilization went to about 50% and its the same on both cores.
I have some events where the CPU utilization in a cluster switches of WS-3750 is going to 100%, the process with the major utilization of CPU is the "hulc running con".
We have seen high CPU utilization on some Cisco switches of type 2960S. Also we got info, that applications are running with poor performance or with interruption.Following IOS is loaded: C2960s-universalk9-mz.122.55.SE