Cisco Switching/Routing :: Container High Load On 2611XM (MPC860P)
Mar 20, 2013
I have a Cisco 2611XM (MPC860P) that i use at home, purchased it when i enrolled in my CCNA certification.
It never occured to me that i had an issue with this router. I have 10Mbps uplink at home, and sometimes its really slow, when i talked to my ISP, we did a lot of troubleshooting to see why we had high latency, but as it turns out, the issue is My Router.
I only have a few machines inside my local LAN so i never even thought this could happen. When i download a file using the 10Mb/s connection, the CPU load goes in less than 1 minute to 99%.
I thought it might be the IOS version of it, and upgraded it to a newer version, with the same results. Here is an output of it:
router1#show processes cpu sort
CPU utilization for five seconds: 99%/67%; one minute: 45%; five minutes: 13%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
I found cpu load around 90 - 100% on cisco 3845, so I show tech-spec and show log on router and found process "Virtual Exec" use high load. I'm not sure this situation make high latency time on my network.
we have a pair of 7609 routers working in Active Standby mode. The version of routers are :- Cisco IOS Software, c7600rsp72043_rp Software (c7600rsp72043_rp-ADVIPSERVICESK9-M), Version 12.2(33)SRD4, RELEASE SOFTWARE (fc2)
Quiet frequently we are getting High CPU load problems on our router and this load comes down below 10 % automatically.
I am attaching the Show tech support for your kind consideration.
Similar issue was reported yesterday as well for which i have attached SH tech suppot.
We have two core switches in our network (Cisco WS-4503). HSRP is working as Active-Standby mode. Recently it has been found that core 1 (which is in active mode) shown high CPU load (60% - 100%). Also found that the below mentioned process takes more CPU. Our network consist of around 30 Vlans. We have already checked for the solution in Cisco website [URL] but couldn't find exact reason. see the below outputs for core 1 switch.
Core1# sh processes cpu sorted CPU utilization for five seconds: 55%/3%; one minute: 65%; five minutes: 71%PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 30 1606933521086983644 147 24.79% 29.93% 35.85% 0 Cat4k Mgmt LoPri 29
I've set up a simple lab network of two cisco routers 2611XM and to each router I've attached a computer (host). I have set up a dhcp ip addresses for each host. I've set up a correct routing as well on each router. There are 3 networks: 192.168.1.0/24 192.168.2.0/24 192.168.3.0/24 The first network between the first host and first router, second is between two routers and third is between the second router and second host. If I use first host (192.168.1.20) I can ping to any ip address (192.168.1.1 (router 1), 192.168.2.1 (router 1), 192.168.2.2 (router 2), 192.168.3.1 (router 2)) except the second host ip address which is 192.168.3.20. When I sit on the second host (192.168.3.20) i can ping to 192.168.1.1 (router 1), 192.168.2.1 (router 1), 192.168.2.2 (router 2), 192.168.3.1 (router 2) but i can't ping to the first host which is 192.168.1.20. I've even tried with attaching a switch to a router and assign it an ip address of 192.168.1.3 and the ping was echoing to it.
We installed a solution with 2 Cisco 2801, BGP multihomed failover.
1) The router which is currently getting all the traffic gets to 55% to 60% of CPU usage when handling 40 SIP/RTP streams . This equals 10Mbit up/10Mbit down and it showed around 5800 packets TX and around 5800 packets RX, with a majority of them CEF switched. As those figures are way less than the performance figures published by Cisco, we wonder if we made any mistake in setting up our router, or if we can do something to improve the router setup.
2) Does it have an impact on router performance if we increase/decrease RTP packet size, thus increasing or decreasing the pps relative to the consumed bandwidth?
3) If it is not possible to improve router configuration, we also wonder about possible replacement units for those routers. Would a 2901 do a good job? By how much would it rise the capacity? What other models would you recommend if we plan to rise the number of concurrent calls by a factor of 4 or even 8 times of what we have now (so up to 48000 pps and 80Mbit).
Here is what we tried:
- ip route-cache same-interface does not seem to improve anything
- ip flow ingress on or off makes no difference
- disabling the inbound ACL on fa0/0 seems to reduce load by 10%, although I don't understand why - a very high percentage is CPU interrupts, and ACLs are process switched, or not?
- we tried following the Cisco guide for high CPU due to high interrupts, with no success
Here are some usage statistics:
The graphs that we plot via SNMP show a propotional growth/increase of CPU and bandwidth (and thus pps) At the highest loads, we had a bit more than 55% CPU utilization with more than 50% interrupt CPU.
CPU utilization for five seconds: 36%/30%; one minute: 30%; five minutes: 30% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 127 13140 954 13773 2.00% 0.29% 0.07% 194 SSH Process
I am seeing a strange situation on my 6500 switch?By having snmp walk on '1.3.6.1.4.1.9.9.109.1.1.1.1.3' (== cpmCPUTotal5sec), I came to know that there are two processor and the cpu util for switching processor is gone to 88 % and some time creeps to 99 %.
snmpwalk -v2c -c "removes" sw6500 '1.3.6.1.4.1.9.9.109.1.1.1.1.3' SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.3.1 = Gauge32: 12 (--- this is for CPU of Router Processor ) SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.3.3 = Gauge32: 99 (--- this is for CPU of Switching Processor )
but when I do sh process cpu on the console, all looks normal as it shows cpu utilization of RP. why the value is so high on the switching processor ?
Which is the most stable, less processor intensive and VPN supported IOS for 2611xm. Currently I am using 12.4(15)T7 C2600-ADVENTERPRISEK9-M. But this image is causing lot crashes. My router uptime never crossed 4 hrs. It is crashing very frequently. Any issue with this image in 2611."
I have 2 6509-E chassis with SUP-720-VSS and classic line cards :-(. on October 2011 the switch reached 100% CPU on both devices and the entire network went down. Customer restarted the core so we lost all the log files and couldnt find out any root cause on the same. TAC engineer suggested to have some script configured on the system in case of CPU shooting up above 70%, it will create a file in flash and keep appending the logs to the same. Last week i got call from customer saying that the CPU again went high for around a minute on both the cores. Last time i added CoPP also on the switch in order to prevent the CPU reaching 100%. Still it went high and from the captured logs i saw that the process created the high CPU was Port Manager Per and SSH process. Attached the file created by the netdr capture command.
The fans 1 & 2 in Module 1 on the Nexus5K are still experiencing the very high RPM and speed issue.
I have replaced the fan from another operational Nexus5K, and the fans are fine in the other Nexus. The replacement fans also have the same issues, so it is not a fan hardware issue.
There are no threshold alarms. the only log entry that is related to this is as follows:
%NOHMS-2-NOHMS_ENV_ERR_FAN_SPEED: System minor alarm in fan tray 1: fan speed is out of range on fan 1. 7950 to 12500 rpm expected. I have provided the output for both the fan detail and the temperature.
N5K-01# sh environment fan detail Fan: --------------------------------------------------- Module Fan Airflow Speed(%) Speed(RPM) Direction --------------------------------------------------- 1 1
Currently, my Cisco 3750x (2 switches stacking) is having very hight CPU. Below are some of the output :
3750-ANA#sh processes cpu sorted | ex 0.00 CPU utilization for five seconds: 55%/30%; one minute: 55%; five minutes: 55% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
[Code]....
I am not sure what is using CPU to go up like this. I had tried some troubleshooting guide on Cisco web site like "Troubleshooting high CPU Utilization"
I purchased the AE3000 Wireless Adapter for my PC, and has been working fine until now. When I first start my PC, my ping starts anywhere between 20-80, then after I try to access anything on the internet it shoots up between 600-1200. It just started happening about 3 days ago, but now it has gotten worse. I can't play any online games, and websites are slow to load.
My 4500 core always in 60 % cpu utility , and when i run #sh proc cpu sorted i find that 55 29725041543795572214 0 39.43% 41.40% 41.39% 0 Cat4k Mgmt LoPri
Which mean that this process is the top one , and when i run #sh platform health i found that Stub-JobEventSchedul 10.00 15.98 10 64 100 500 20 17 12 29269:55 K2 CpuMan Review 30.00 35.60 30 48 100 500 49 46 32 52390:52
Those two process are the top and they already exceed their maximum rang and when i run #sh platform cpu packet statistics i can find that Packets Received by Packet Queue
We have a Cisco 3845 router configured as a voice gateway with multi SIP trunks. But when it reachs 200 calls traffic, the CPU increase to 60-70% and caused by CCSIP_SPI_CONTROL process.
CPU utilization for five seconds: 46%/30%; one minute: 54%; five minutes: 58% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 377 400729448 171017979 2343 6.31% 10.71% 12.44% 0 CCSIP_SPI_CONTRO
my 3750-E Core Stack is connected to the Provider Router and is the DG for the internal LAN. I saw that the CPU is very high also in the night, but I found not the problem. I use an SVI to connect the provider due to HA reasons. I sniffered the network but saw no ecessive broadcaststorms. There was a PBR configured but I deleted it wihtout any success..
We are facing high CPU Utilization on Cisco 3750X-48P-L without any traffic on it. find the attached log files for 2 separate 3750's stack, we have upgraded the IOS of SW2 from "c3750e-universalk9-mz.122-55.SE3.bin" to "c3750e-universalk9-mz.122-55.SE4.bin" but still we found the same issue with CPU utilization.
I've been looking at reported problems with our Vdeio Conferencing kit attched to a stack of 3750's (which I think is down to QoS) but this got me looking at the logs. We get a lot of high CPU utilization warnings mainly for SNMP (315), Hulc running con (95), Virtual exec (289). I understand the last two are normal, and the SNMP one is probably Cisco Works polling as it happens every 4 hours.
However I've got an odd one: Apr 25 07:34:58: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU Utilization(Total/Intr): 93%/0%, Top 3 processes(Pid/Util): 296/85%, 144/0%, 154/0%
I have a process whick take all the CPU on two differents Stack of WS-C3750G in version 12.2.53(SE2):
XFRPALSN02R#sh proc cpu sorted CPU utilization for five seconds: 97%/3%; one minute: 95%; five minutes: 95% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 307 5450059 4167397 1307 86.74% 83.63% 83.35% 0 hulc nrgyz PD di XFRPALSN02R#sh proc cpu sorted CPU utilization for five seconds: 96%/3%; one minute: 96%; five minutes: 96% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 307 7779608 5947379 1308 86.26% 85.75% 85.30% 0 hulc nrgyz PD di
Seeing very high CPU on one of our 3750X stacks. Usally its around 30% but recently its 70, 80, 90 or maxed at 100% during the main day.IOS version c3750e-universalk9-mz.122-55.SE1.bin.Has a ten gig uplink connected to a nexus 7k and another ten gig connected to another 7k. Running Layer 3 and EIGRP on the 3750X.Is this normal for the CPU?
#sh processes cpu history 5555555554444455555555555555588888666669999888885555577777 8888000001111111111222227777755555666662222222229999977777 100 90 ***** **** 80 ***** ********* *****
From couple of weeks we have observed the cpu utilization of cisco 6509 with SUP 720 is high. During daytime from 9:00 to 21:00 it keeps increasing & reaches 98% & after 21:00 becomes normal.
I am facing a problem on a 2811 router. The CPU is remaining around 60% and the router throughput is reaching at most 18 MB while according to the data sheet the 2811 maximum throughput is 61MB. I have checked the output interpreter in order to try and figure out the cause of the high CPU and to determine if it is affecting throughput but there are not processes consuming more than 10%. I have attached the show tech-support and the show process cpu history outputs.
in both case some times i obtain lowing traffic on interface and highest cpu - to 100% after clear cef linicard i obtain growing traffic and cpu 0%
#sh proc cpu s CPU utilization for five seconds: 87%/83%; one minute: 91%; five minutes: 96% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 7 1711512 87883 19474 4.06% 0.84% 0.89% 0 Check heaps
I have a 2 cisco core (cisco WS-C6509-E (R7000) processor) and been working for quite sometime.they are conneted with HSRP with active standby config with a 10 g module for redundancy just today I see that the cpu utilization went to about 50% and its the same on both cores.
I have some events where the CPU utilization in a cluster switches of WS-3750 is going to 100%, the process with the major utilization of CPU is the "hulc running con".
We have seen high CPU utilization on some Cisco switches of type 2960S. Also we got info, that applications are running with poor performance or with interruption.Following IOS is loaded: C2960s-universalk9-mz.122.55.SE
