Cisco Switching/Routing :: Can TCAM Memory Cause High CPU On 3750 Stack
Sep 12, 2012
We have a 3750 stack with a mix of 3750G and 3750X switches. The current active template on the switch is desktop default and we are running EIGRP on the switch with large routing table so we get the TCAM error that a specific prefix cannot be programmed in TCAM memory so it will be software forwarded.%PLATFORM_UCAST-4-PREFIX: One or more, more specific prefixes could not be programmed into TCAM and are being covered by a less specific prefix, and the packets may be software forwarded
This error is quite frequent on a daily basis. My question is that will this error create a high CPU situation and affect traffic processing on the stack causing ESX Hosts to become unresponsive?
We are having 3750 Stack switch as our edge switch. Here we are having some issues as low memory & itermediate High CPU utilization.For memory when we checked its shwoing maximum memory is allocated to DHCPD receive & ARP Input as follows
Processor Pool Total: 70829380 Used: 56809532 Free: 14019848 I/O Pool Total: 12582912 Used: 8554920 Free: 4027992 Driver te Pool Total: 1048576 Used: 40 Free: 1048536
[code].....
i want to understand why this 2 proceses (DHCPD & ARP input) taking more memory?High CPU: We also facing intermediate high CPU utilization (above 95%). When CPU is high there were 2 processes consuming more CPU are 'Spanning Tree' (about 20%) & ARP Input (about 66%). we also checked the ARP entries, there were 1500 ARP entries & 2 incomplete ARP (out of 6000 ARP supported)
I have a new cisco 3750 stack comprised of 8 members (6 x 3750G-48PS and 2 x 3750V2-48PS) running 'c3750-ipservicesk9-mz.122-58.SE2.bin'. I am seeing high memory utilisation, it seems to sit fairly stable and I do not see an increase but this has only been running a few days. No errors or performance issues. Should this be a cause for concern?
I have a Switch WS-C3750E-48PD-SF with IOS 12.2(58)SE2 which reports more than 80% in utilization of memory I don't know what is causing the high memory utilization.
We added Site02 for redundancy and DR. Also added new SAN and ESX hosts. The CPU on device Site01Server01 is not very happy when files are being transferred between the sites. Since the setup is the same at both sites, why is the problem only at site01?
Site02 is newer and we have two 3750X-24 with IOS 12.2(55)SE3 on ipservices, for site02server01; no problem. Site01server01 is a stack of two 3750G-24PS with IOS 12.2(58)SE on ipservices.
WS-C3750G-24TS-S1U switch stack with high CPU utilization. 3 switches are stacked and using PBR on that. I am attaching the show cpu process as an attachment.The current template is "desktop routing" template.The selected template optimizes the resources in the switch to support this level of features for 8 routed interfaces and 1024 VLANs. [code]
I have a stack of 3750x switches running 15.0 (2) SE2 IOS. When I reload the switch stack, I am seeing the following message in the logs: IPv6 user port trust TCAM write failed.
I noticed on the 2960 switches we have deployed that are running the latest IOS, 12.2(58)SE2, memory utilization is really high (almost 80 percent). I have not noticed any side effects but I wanted to verify this is acceptable. My question is does the high memory utilization matter? I see this may be related to bug CSCtw83946 but no resolution is mentioned.
I did some testing various IOS revisions and below is what I have found using a WS-C2960-48TC-L with default configuration and only my laptop connected to a switchport in vlan1. You will notice memory utilization will grows with each version but jumps drastically with 58. One difference with 58 I needed to use a different command to retrieve memory utilization. The output was gathered by pasting the output of the show command into the Cisco Output Interpreter on their website.
IOS Show Command Output c2960-lanbasek9-mz.122-35.SE5.bin show memory [Code]....
I am facing high memory utilization in Cisco 2960 switch having IOS version 12.2(55)SE3.
The error we are getting is:
A "LiveHealthAlarm" event has occurred, from SwCiscoIOS device, named Switch2960. eHealth Alarm Start Time - Fri 09 Nov,2012 - 03:02:48 eHealth. Switch2960-RH-MemoryPool-Processor-Processor-1.Memory utilization high-Threshold set at 70%SPECTRUM ALARM ID|22233284 I have attached the logs also.
We had a stack of 4 qty 3750g running IP base on ver 12.2.32, then installed a 3750x to the stack and upgraded the whole stack to 15.0.2 SE3. In doing so, we noticed that the memory utilization jumped from 60-70% to 83-84%.
We had the same issue occur when upgrading to 15.0.2 SE3 on another stack that was 6 qty 3750g running ip-services, but this one jumped to 90%. On the 6 qty stack, we downgraded to 12.2.55 and the memory util went back down to 60-70%.
On the mixed stack, we replaced the 3750x with another 3750g and downgraded the whole stack to 12.2.55, however, the memory utilization did not drop down. As far as I can tell, no config changes have changed from the original IOS.
I upgraded the newest IOS 15.0(1)SE for our SW C2960-24-TT-L, the process was succeseful. However, we found SW memory utilization raised to 82% this morning in normal situation. (Momery: Total 21341260, Used17471692) Did you guys meet the same problem after upgrading to 15.0(1)SE? I also would like to know what the normal memory utilization is? and what is the impact of memory utilization highly?
I upgrade the IOS of my switch 3560 from C3560-IPBASE-M), Version 12.2(25)SEB4, To C3560-IPBASEK9-M), Version 12.2(55)SE5 after that the utilizatio of the memory increase to 80% I attached the output of show memory statistics history
I am writing with regard to a high memory utilization that we have on a pair of line card WS-X6748-GE-TX and WS-X6724-SFP for a VSS 6500. I am enclosing a little part of the "show tech"of this VSS 6500 where is possible to see the high memory utilization of the line cards 1/1, 1/2, 2/1, and 2/2, in despite of having some ports in state connected. In addition of this, the IOS installed on VSS 6500 is s72033-ipservicesk9_wan-vz.122-33.SXI6.bin for checking if there are some bugs affecting the behaviour of the Switch for this case.
System Resources PFC operating mode: PFC3C Supervisor redundancy mode: administratively sso, operationally sso Switching resources: Sw/Mod Part number Series CEF mode 1/1 WS-X6748-GE-TX CEF720 CEF 1/2 WS-X6724-SFP CEF720 CEF
I have been seeing high CPU on a 3750 stack we use for our phone system. I followed the documentation here:
[URL]
This documentation pointed out that the interrupt was very high and so I started looking at the CPU queues to debug. The icmp queue was dropping TONS of traffic.
The debug was full of these:
ICMP-Q:Dropped Not a candidate: Remote Port Blocked L3If:Vlan248 L2If:GigabitEthernet1/0/17 DI:0xB4, LT:7, Vlan:248 SrcGPN:17, SrcGID:17, ACLLogIdx:0x0, MacDA:001a.a1c4.1cd2, MacSA: 0013.192c.bb80 IP_SA:5.1.1.10
Today, one of our Cisco 3750 got unmanaged from NOC, we were able to ping the switch, also, traffic was flowing fine but not able to telnet or local login.On trying to login through console following messages were coming:
%% Low on memory; try again later %% Low on memory; try again later %% Low on memory; try again later %% Low on memory; try again later %% Low on memory; try again later %% Low on memory; try again later
[code].....
We given power on reset, after which we were able to login switch again. I wanted to know the actual reason behind it and if there is any other way to recover switch other than power reset.?
Seeing very high CPU on one of our 3750X stacks. Usally its around 30% but recently its 70, 80, 90 or maxed at 100% during the main day.IOS version c3750e-universalk9-mz.122-55.SE1.bin.Has a ten gig uplink connected to a nexus 7k and another ten gig connected to another 7k. Running Layer 3 and EIGRP on the 3750X.Is this normal for the CPU?
#sh processes cpu history 5555555554444455555555555555588888666669999888885555577777 8888000001111111111222227777755555666662222222229999977777 100 90 ***** **** 80 ***** ********* *****
have 3 Catalyst 3750 in same stack, the IOS version is 12.2(53)SE2. Today we can not telnet/ssh to this switch, but ping is ok, and switch function is ok. I try to access the console port, it show "low on memory, try again later". After I reboot the master switch in the stack, the master switch change to another switch, then I can telnet/ssh to this switch. I check the Ciscoworks server syslog report, there are many MAC address flapping error message, and I beleive the MAC address flapping occured before several weeks. ( the G2/0/15 & G3/0/15 is connect to a VMware ESX server and the EtherChannel config mismatch with this Catalyst 3750 switch ) How to mention the root cause of the "low on memory" problem and what is the abnormal memory usage ( free memory percentage below ?% )?
I have a customer with a stack of two switches C2960S-24TS-L that are running 12.2(58)SE2 universal K9, we see that the CPU load increase over time, to 95% and stays there reload solves the problem.the process that akes a lot of CPU is also the SNMP ENGINE, I see that it is running 30 minutes on 95% and then 10 minutes on 35%, this is the only stack were we see this problem. Is there also a SNMP bug in this version ?
We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high. This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure. Below I provided some outputs about how to diagnose it.
i am seeing very high utilization on a random basis on the stack. and the logs indicate me that there is a pattern where there is a stack power cable shows inserted (which was never unplugged) followed by sudden spike in the utilization.
001018: *Mar 6 16:21:22.138: %PLATFORM_STACKPOWER-6-CABLE_EVENT: Switch 4 stack power cable 1 inserted 001019: *Mar 6 18:18:37.982: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU
I have two 3750s stacked and one 3750 standalone all in one data closet. The both have the same versions. I want to combine them to make one stack. How do I force the standalone to be the master? sw 1 priority XX(Higher then the existing stack)? Both the stack and the standalone have management addresses. Would it be ok to delete the stack ip address? That way, the standalone(master's address will be the only management address)?How should I connect the standalone 3750 to the stack? At present, the 3750 stack is connected via a cascade cable going from the stack 1 port of the top switch to the stack 2 port of the bottom switch.
The stack cable connected to Switch 1 Port 1 and Switch 4 Port 2 will not come back online. The logs show that there was a Stack line change. I have replaced the 1 meter Stack cable from Switch 1 to Switch 4 three times and it still does not come back online. This is the part that is interesting.. I have disconnected Port 1 Switch 4 and connected it to Port 2 Switch 4 and then Switch 4 came back online. This made me think Port 2 on Switch 4 was working correctly. Then I disconnected Port 2 Switch 1 and connected it to Port 1 Switch 1 and then Switch 1 came back online.
i have two cisco 3750 in stack firts, master switch have all swports busy second have only 5 how can i see cpu utilizations of the second switch, and its reasonable to move somme devices from first switch to second for deacreases of cpu and memory utilisatio ns of the master? the stack tehnologies use both cpu as one? or its only for simple management ?
have a cable i think is bad, is it possiable to switch the cable out without causing any downtime to the switch or connected devices?
HQ-1st-Flr-Stack#show switch stack-ports summary Switch#/ Stack Neighbor Cable Link Link Sync # In Port# Port Length OK Active OK Changes Loopback Status To LinkOK
I just need a little refreshing on upgrading a stack of 3750's. This stack only has 2 switches: [code]
1.) If I remember correctly I simply tftp the IOS to the flash of each switch and then reload the master only? 2.) Can I safely assume these are the 2 flash locations:
i want to remove an access layer 3750 48 POE master switch and replace with a new 3750 switch in the stack. i want to copy the same configuration to new switch since the old switch is having POE issue and I got replacement of the malfunctioned switch. we have VTP domain is configured in the network...
I have been given 2 3750 switches and need to put a config onto it wuld is for 2 3750's in a stack, how should I put this on the 2 switches? Is it bested to install it onto 1 switch first then physically attach the 2nd after?
I'm setting up a web cache using the wccp protocol on a Catalyst 3750 stack.
Probably missing something real simple here but when I from the global configuration mode are trying to enter the ip wccp command it just says "invalid input" from wccp. There is no such command.. should be supported on my device from IOS 12.2(37)
