Cisco WAN :: High Memory Utilization In 7206 Router
Jul 29, 2012
We have a 7206 router which acts as a MPLS Hub router for around 100+ remote locations. Bandwidh at mpls hub(terminated on this router) is 50 Mbps.
We have noticed that Memory utilization in this router gradually increases and when it reaches 100% this router hangs. It happence in frequesncy of 10 days and we have to restart the router when memory is 100%.
CPU utilization is normal i.e below 20%, WAN bandwidth will never cross 30mbps.
We had two PIXes in our environment and working as a active-failover mode. Its noted in now a days the active PIX memory utilization is 98% and for standby PIX it is 96%. And also in some times we were experiencing packet loss to the ip of active PIX and which reflects in the inside servers access also. During that time the active pix was not accessible via ssh as well as ASDM. We have tried reloading the PIX and changing failover state of the PIX, but it results only a temporary solution. Current memory installed is 128 MB (maximum upgraded), so a upgrade is also not possible. Please see the show command outputs from the PIX. Current Software version is 7.2(4)
sh memory output (PIX 1 - active) Free memory: 4850944 bytes ( 4%) Used memory: 129366784 bytes (96%)
[code]....
1) How we can pin point the root cause of this high memory utilization?
2) What might be the reason for the high memory utilization for the standby pix (96%), still the PIX is in idle state?
3) Is it a hardware issue or a memory leak issue, then how can we find out?
4) Is a software upgrade to new version resolves the memory issue?
The switches see very few traffic (under 40MB on all interfaces, summed, so far), however, I/O memory utilization is about 80% as can be seen from the show memory command:
The memory allocated is almost all Packet Data, by init, "sho memory io dead" returns zero, the memory usage seems constant, there are no errors on the log, the switches operate correctly, no packet has ever been dropped, CPU usage is about 4%.
Here I showed info for one switch, the other is in the same situation. I just want to know if this behavior is expected, I don't want to find out problems when the switches will be in production whit real traffic.
I have the problem that our ciscoworks server gets out of memory after few days. The memory utilization is always getting higher an higher (above 95%). Sometimes it is only after 3 days and sometimes it is after 1 week. So it happens not regularly. I have made an screenshot from the services which use a lot of memory. And at this time the memory utilization is getting higher and higher again....I think there is a problem with tomcat or dbsrv10.exe, there are also a lot of cwjava.exe running.
We recently added about 400 users to our network for a total of 1000. Looking at the ASDM we are holding very tight to 75% utilization and we have 256mbs. This is also running IOS 8.2(1). Our firewall recently crashed after a major download was forced through it. This was after only being booted up for about a week. We had reloaded it a week prior after having ran it for about a year without issue. We havent made any changes in the last month other than adding more users to our network.
I have a Switch WS-C3750E-48PD-SF with IOS 12.2(58)SE2 which reports more than 80% in utilization of memory I don't know what is causing the high memory utilization.
I noticed on the 2960 switches we have deployed that are running the latest IOS, 12.2(58)SE2, memory utilization is really high (almost 80 percent). I have not noticed any side effects but I wanted to verify this is acceptable. My question is does the high memory utilization matter? I see this may be related to bug CSCtw83946 but no resolution is mentioned.
I did some testing various IOS revisions and below is what I have found using a WS-C2960-48TC-L with default configuration and only my laptop connected to a switchport in vlan1. You will notice memory utilization will grows with each version but jumps drastically with 58. One difference with 58 I needed to use a different command to retrieve memory utilization. The output was gathered by pasting the output of the show command into the Cisco Output Interpreter on their website.
IOS Show Command Output c2960-lanbasek9-mz.122-35.SE5.bin show memory [Code]....
I am facing high memory utilization in Cisco 2960 switch having IOS version 12.2(55)SE3.
The error we are getting is:
A "LiveHealthAlarm" event has occurred, from SwCiscoIOS device, named Switch2960. eHealth Alarm Start Time - Fri 09 Nov,2012 - 03:02:48 eHealth. Switch2960-RH-MemoryPool-Processor-Processor-1.Memory utilization high-Threshold set at 70%SPECTRUM ALARM ID|22233284 I have attached the logs also.
I have a new cisco 3750 stack comprised of 8 members (6 x 3750G-48PS and 2 x 3750V2-48PS) running 'c3750-ipservicesk9-mz.122-58.SE2.bin'. I am seeing high memory utilisation, it seems to sit fairly stable and I do not see an increase but this has only been running a few days. No errors or performance issues. Should this be a cause for concern?
We had a stack of 4 qty 3750g running IP base on ver 12.2.32, then installed a 3750x to the stack and upgraded the whole stack to 15.0.2 SE3. In doing so, we noticed that the memory utilization jumped from 60-70% to 83-84%.
We had the same issue occur when upgrading to 15.0.2 SE3 on another stack that was 6 qty 3750g running ip-services, but this one jumped to 90%. On the 6 qty stack, we downgraded to 12.2.55 and the memory util went back down to 60-70%.
On the mixed stack, we replaced the 3750x with another 3750g and downgraded the whole stack to 12.2.55, however, the memory utilization did not drop down. As far as I can tell, no config changes have changed from the original IOS.
I upgraded the newest IOS 15.0(1)SE for our SW C2960-24-TT-L, the process was succeseful. However, we found SW memory utilization raised to 82% this morning in normal situation. (Momery: Total 21341260, Used17471692) Did you guys meet the same problem after upgrading to 15.0(1)SE? I also would like to know what the normal memory utilization is? and what is the impact of memory utilization highly?
I upgrade the IOS of my switch 3560 from C3560-IPBASE-M), Version 12.2(25)SEB4, To C3560-IPBASEK9-M), Version 12.2(55)SE5 after that the utilizatio of the memory increase to 80% I attached the output of show memory statistics history
I am writing with regard to a high memory utilization that we have on a pair of line card WS-X6748-GE-TX and WS-X6724-SFP for a VSS 6500. I am enclosing a little part of the "show tech"of this VSS 6500 where is possible to see the high memory utilization of the line cards 1/1, 1/2, 2/1, and 2/2, in despite of having some ports in state connected. In addition of this, the IOS installed on VSS 6500 is s72033-ipservicesk9_wan-vz.122-33.SXI6.bin for checking if there are some bugs affecting the behaviour of the Switch for this case.
System Resources PFC operating mode: PFC3C Supervisor redundancy mode: administratively sso, operationally sso Switching resources: Sw/Mod Part number Series CEF mode 1/1 WS-X6748-GE-TX CEF720 CEF 1/2 WS-X6724-SFP CEF720 CEF
In Cisco 7206 VXR (NPE-G2) router , the CPU utilization is at an 80-90% always , but none of the process is consuming not more than 1%. In the show stacks output we are observing network interface interrupt is called very frequently. so what does network interface interrupt is about. Logs for the reference: show process CPU sorted
CPU utilization for five seconds: 88%/88%; one minute: 89%; five minutes: 89% PID Runtime(uS) Invoked u Secs 5Sec 1Min 5Min TTY Process 1 0 72 0 0.00% 0.00% 0.00% 0 Chunk Manager 2 20020000 17159 1166 0.00% 0.02% 0.01% 0 Load Meter [Code]...
I have a Router 2821 with c2800nm-advipservicesk9-mz.124-24.T1.bin and with a Cisco Integrated Service Engine(s) Cisco Unity Express 7.1.1 in slot 1 , this router shows a high cpu utilization.I think is a bug with the IOS , because there is no voicemail configured on the CUE, there is no traffic to the CUE , just traffic from:
- voice calls - ospf
The ospf is not the cause of the high cpu , because the high cpu utilization appears before I put the ospf proccess on the router.
I have problems with the Router 2801.When i give the command show processes cpu, the command show me that the router is working in 98%.
I have vlans like voice vlan and others, I have one 20 Mb Wan Link and I redirect all traffic from my lan to this link and when i browse in internet or i do downloads the router goes to 98%, when i don't make it the router processes goes down.
I thought be problem with hardware, but i exchange to another router and the same problem happened.Before this situation, I had one link with 12 Mb and nothing happened, when i exchange this to the 20 mb link the problems starting.
there is no logging in the access-list (there is only one inbound access list).Using QoS or not, doesn't seem to make a differenceAll route-caching features are ON. (CEF, Flow, Policy, Fast)Yet the minimum CPU utilisation I have seen is 25%/25%... On average it's 40% during the day, but once traffic picks up to around 6000 packets per second, the router is gone...I have a 50/50 Mbps connection, but I can use only 6 for VoIP ?
Show interfaces: GigabitEthernet0/0 is up, line protocol is up Hardware is MV96340 Ethernet, address is 0014.1c26.7c30 (bia 0014.1c26.7c30) Description: $ETH-LAN$$FW_INSIDE$ MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec, reliability 255/255, txload 6/255, rxload 7/255
I have on 7200 series router with NPE-G1 module which is facing high CPU utilization. I have not found any particular process causing this high CPU utilization as it is caused due to interrupts. I have already enabled fast switching by "ip cef" command. Please suggest how to normalize the utilization as it is impacting the network and causing slowness. Please find below the output of show process cpu and also find attached the show tech of the device. Also let me know if any other output is required. [CODE]...
When i start a download the processes of the router cpu stay in 99%/97%. When i'm not doing a download the processes stay in 3%/0%. I have one 20 mb link to Wan.
I did the troubleshooting seeing the this document :
I have a lot of cisco 7206 vxr deviceses. I have a high cpu problem.I have a 7206 vxr g2. I used to use ebgp for three upstream carrier. I used to bgp full route table method. I have about 800 Mbps active traffics and behing the router about 1600 active customers.
How can I trouble shoot this high cpu problem?
#sh int gigabitEthernet 0/1 GigabitEthernet0/1 is up, line protocol is up Hardware is MV64460 Internal MAC, address is 000c.cf1d.d01b (bia 000c.cf1d.d01b) Description: ***** GW Interface ***** [Code]....
We've got Cisco 2821 for our 90mb/s Internet Access. Its CPU usage is around 80%. Show process cpu does not show any cpu proccess with high utilization. But we have got plenty of policing configured for our clients using policy maps. Can this policing affect cpu usage?
I've came across a very odd topology to deal with where everything is connected to everything, without proper utilization of VLANs.
- I've an L3 SW and a 3745 RTR at core - Both are carrying same subnet to an L2 distribution switch that connects server farm within the same subnet (i.e. 1.1.3.x subnet) - The L2 switch works as a passive switch, hence another network say, 1.1.2.x has been plugged into it as well. - This L2 switch extends to other switches without configuration of any VLANs or STP and distributes 1.1.3.x network.
Periodically and unexpectedly, the router starts hanging and utilization goes beyond 80%, and there's nothing at all that is observed in "sh proc cpu" to be eating router resources. Its quite difficult to observe the pattern, as its random.
I've deployed many Cisco PIX 501 v6.3.3 either as normal firewalling feature and/or with VPN features enabled. I noticed in all my deployments, regardless if it's during peak hours or after office hours, the memory utilization is always consistent 11MB utilized over the total of 16MB(memory default size).
Cisco 3845 router (256RAM / 64Flash), increases the cpu utilization upto 70~80 percent, during the time of high utilization, I am unable to run show command on router.The configuration is simple, this is connected with two internet links (24Mbps and 8Mbps) and its about 600~700 users are using internet.show version, show memory and show process cpu outputs are attached here.
I was looking at my CISCO ASA 5520 and i found something really strange
ciscoasa/VPN-context# sh mem detail Used memory: 4259249568 bytes (793%) ------------- ---------------- Total memory: 536870912 bytes (100%)
but when I look at the system context this is what I see
ciscoasa# sh mem Free memory: 170829000 bytes (32%) Used memory: 366041912 bytes (68%) ------------- ---------------- Total memory: 536870912 bytes (100%)
As far as I know the ASA is working good.
Info of the device Hardware: ASA5520, 512 MB RAM, CPU Pentium 4 Celeron 2000 MHz Internal ATA Compact Flash, 256MB BIOS Flash M50FW080 @ 0xffe00000, 1024KB
We have a Cisco SA520 Router (Firmware 2.1.18)We are only using this for about 1 month now. Router seems ok its justI am worried about the Memory utilization which reach to 62% (144/234 MB)Is this something to worry about?How can I utilize this by lowering down the usage?
We have one Catalyst 6506 ( with WS-SUP720-3B, IOS is 12.2(18)SXF14 ) and one Catalyst 6509 ( with WS-SUP720-3B, IOS is 12.2(18)SXF17a ). We used WhatsUP to collect I/O & process memory utilization for both switches. The memory utilization for Catalyst 6509 was ok, but it seems not correct for Catalyst 6506 ( show proc memory displayed the total memory is 512MB, but the WhatsUP displayed only 64MB only )
We have 2 CSACS 1121 with Cisco ACS 5.2.0.26.10 The primary server manages 20000+ authentications per day. Its memory utilization increases everyday. It is now at 83% , there a limit?,What will happen when memory utilization reach this limit?,What can we do to purge memory utilization? (reboot, service restart.
