Cisco WAN :: 7600 CPU Showed High Utilization For FM Core Process
Nov 14, 2011
We suddenly noticed high CPU utilization on one of our 7600 routers. I output of show process CPU showed high utlization for the FM core process. I looked it up but did not find information on what this process does. [code]
I have an issue with 7600 router where CPU goes up to 60-70% and memory is also high. Both due to BGP Router process. URL We are seeing this issue since ISP has upgraded their router 20 days ago. Router also seen following error.I have not reset the BGP session with ISP yet. Is there any way I can supress BGP updates coming from ISP and see if CPU and memory USAGE reduces. IOS version 12.2(33)SRD and RSP720 with PFC 3cXL
I have an issue with 7600 router where CPU goes up to 60-70% and memory is also high. Both due to BGP Router process. [URL] According to our baseline it should not be more than 40% at any given time. We see high CPU uptp 70% consistently.
CPU utilization for five seconds: 99%/0%; one minute: 57%; five minutes: 55% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 442 66173704 90234125 733 96.86% 46.09% 46.30% 0 BGP Router 7 509291060 26330202 19342 1.17% 3.90% 2.99% 0 Check heaps
Router has 1 eBGP session with ISP from where it downloads whole IPv4 internet routing table and two IBGP session with other two rotuer. When I look at BGP summary table I see many updates received from ISP and sent out to IBGP neighbors. Also did debug BGP updates to confirm it.
We are seeing this issue since ISP has upgraded their router 20 days ago. Router also seen following error.
%BGP-6-BIGCHUNK: Big chunk pool request 628 for community. Replenishing with malloc
I have not reset the BGP session with ISP yet. Is there any way I can supress BGP updates coming from ISP and see if CPU and memory USAGE reduces. IOS version 12.2(33)SRD and RSP720 with PFC 3cXL
in both case some times i obtain lowing traffic on interface and highest cpu - to 100% after clear cef linicard i obtain growing traffic and cpu 0%
#sh proc cpu s CPU utilization for five seconds: 87%/83%; one minute: 91%; five minutes: 96% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 7 1711512 87883 19474 4.06% 0.84% 0.89% 0 Check heaps
Each time I enter show run on my router 2821, it takes ages to display and I have a cpu peak from the ssh process ( I am connected through SSH)
RTR-2821-01#sh proc cpu sorted CPU utilization for five seconds: 96%/21%; one minute: 34%; five minutes: 22% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 55 26948 814 33105 74.96% 16.92% 5.87% 323 SSH Process
We have a 6509 core with the below modules running for a long time and the utilization used to be always 10 to 13 percent checking with the supplier it was told to us that due to the firewall modue we have and its normal Now 2 days back i noticed the utilzation had jumped to 90 % and now it happened again
I see that on runnung proc cpu
16407 56.1% 56.5% 55.9% ios-base
16430 35.3% 35.2% 33.9% iprouting.iosproc
the modules present
Mod Ports Card Type Model Serial No.--- ----- -------------------------------------- ------------------ ----------- 1 6 Firewall Module WS-SVC-FWM-1 SAD140901XA 3 16 16 port 1000mb GBIC ethernet
we are using Cisco 6509-E VSS mode [12.2(33)SXI] ipbase image and facing high cpu utilization. In show process cpu output it is showing some "ios-base" process consuming cpu. I attached show cpu output
We have cisco 4510R+E switch with IOS-XE Software Version 03.01.01.SG RELEASE SOFTWARE (fc1).Our this switch is having two core & one core is always going to about 90% to 98% cpu utilization while other core is showing normal (about 5% to 10%),we check with-This switch is gateway of our LAN.
We had a core switch(30 vlans) in our environment and it's noticed that CPU utilization of the core switch is showing high during recent days. I have checked logs and processes, but couldn't find the root cause. The issue found only in the office hourly only(after that the cpu utilization is idle and normal). I have already referred the following link to troubleshoot the issue " [URL]
see the following outputs from the core switch
CPU utilization for five seconds: 99%/0%; one minute: 99%; five minutes: 99% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 30 6687557041432420936 466 47.52% 47.10% 45.98% 0 Cat4k Mgmt LoPri 55 30667074884269560256 0 45.36% 45.50% 45.85% 0 IP Input 29 28552856922870089254 0 3.59% 3.50% 3.57% 0 Cat4k Mgmt HiPri
[code]....
Note: Each Invalid source mac entry in each day from same port (above is the output after clearing logs before 3 days)
My queries regarding the issues are following
1) How can we find root cause regarding the high cpu utilization?
2) Is a single invalid mac address makes the cpu highly utilized for suppressing it?
we have two 6513 core switches redundant to each other by using HSRP and MST. Currently we have a problem in a CPU as it's high in both cores as appeared in the following logging message:
We are running a stack of 2 WS-C3750X-24S-E's with IOS version 12.2(58)SE2 and we are seeing continuous high processor utilization involving the hl3mm process. The stack is configured for PIM Sparse mode, with 2 upstream Nexus 5596'es acting as both RP candidates and as BSRs. The hl3mm process generally runs at about 19% but can spike up into the 60% range.Symptoms on the 3750X are spiking latency and sluggish CLI perfformance. I thought at first that we might be running into SDM limits, but the "show platform tcam utilization" show that we are far under the limits of the default SDM template. Performing the "show ip pim (vrf name) bsr-router" command freezes the system and takes 20-30 seconds to return results. Similiarly configured WS-C3750G-12S running 12.2(55)SE3 does not exhibit these same issues.
In Cisco 7206 VXR (NPE-G2) router , the CPU utilization is at an 80-90% always , but none of the process is consuming not more than 1%. In the show stacks output we are observing network interface interrupt is called very frequently. so what does network interface interrupt is about. Logs for the reference: show process CPU sorted
CPU utilization for five seconds: 88%/88%; one minute: 89%; five minutes: 89% PID Runtime(uS) Invoked u Secs 5Sec 1Min 5Min TTY Process 1 0 72 0 0.00% 0.00% 0.00% 0 Chunk Manager 2 20020000 17159 1166 0.00% 0.02% 0.01% 0 Load Meter [Code]...
We have a Cisco 886 configured with two WAN's (ATM0 connected to a DSL line and Fa3 connected to a CMTS modem).We're running DMVPN over the Cable network and GetVPN over the DSL line. When the DSL line is down we see a lot of CPU peaks up to 90%.The CPU peaks are caused by the process "DSL state machine". As soon as the DSL line has sync and the ATM0 interface goes UP the CPU peaks disappear. What we'd like to know is if this constant extra CPU load will have an impact on other resources like normal routing & switching or more specific IPSEC handling. Is it for example possible that establishing an IPSEC tunnel will fail because of the CPU peaks?
I have in my router 2801, one link with 20 MB WAN Connection, and it is presenting high cpu utilization with 97% Interrupt Errors when start one download.
I exchanged it to another router the 2811 and it presented the same results. I read the cisco document about Router Performance.
And it speaks about the 2801 supports 46 Mbps using CEF/Fast Switching and 1.5Mbps using only Process Switching, and 2811 supports 61.44 CEF and 1.5Mbps Process Switching.
I need to know if the NAT Process is process switching or CEF Switching. Because if it was process switching the router is working in the max capacity and i will need to exchange the hardware to a better hardware.
I have a process whick take all the CPU on two differents Stack of WS-C3750G in version 12.2.53(SE2):
XFRPALSN02R#sh proc cpu sorted CPU utilization for five seconds: 97%/3%; one minute: 95%; five minutes: 95% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 307 5450059 4167397 1307 86.74% 83.63% 83.35% 0 hulc nrgyz PD di XFRPALSN02R#sh proc cpu sorted CPU utilization for five seconds: 96%/3%; one minute: 96%; five minutes: 96% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 307 7779608 5947379 1308 86.26% 85.75% 85.30% 0 hulc nrgyz PD di
i have cisco 7600 router , here is show run : Gateway7600#sh run Building configuration...
Current configuration : 4787 bytes ! ! Last configuration change at 09:08:04 UTC Sat Apr 20 2013 by xxxx ! version 15.2 service timestamps debug datetime msec [Code]....
I have a router 3845 with c3845-advsecurityk9-mz.124-24.T6.bin software . Frequently we are facing problem in logging to the device .Inorder to resolve we need to reboot the router . Yesterday fortunately i have got the console access for some time so i came to know that TPLUS process is consuming 99.9% percentage cpu.
System returned to ROM by reloadSystem restarted at 00:36:52 UTC Sat Dec 10 2011System image file is "bootflash:cat4000-i9s-mz.122-25.EWA14.bin" cisco WS-C4506 (MPC8245) processor (revision 10) with 262144K bytes of memory.MPC8245 CPU at 266Mhz, Supervisor II+Last reset from Reload1 Virtual Ethernet interface144 FastEthernet interfaces2 Gigabit Ethernet interfaces511K bytes of non-volatile configuration memory.Configuration register is 0x2102
We are experiencing with high CPU input due to ARP input between 20:30 and 22:30 every day At this time we have a lot of backup operations. When I look the netflow report, I can't see anything anormal.
We are changing our backup server's NIC card from 1gig to 10Gig. The backup operation's traffic is high (approx 2Gbps level) but 6509 has to be handle this size of traffic.
We are using two 6509E in VSS mode and our image version is s72033-adventerprisek9_wan-mz.122-33.SXJ.bin
20:00 show ip arp summary -------------- 2588 IP ARP entries, with 166 of them incomplete
I'm facing high CPU utilization issue due to a ssh process on 3750 switch. What is the use of SSH proces in the switch? Can I disable it for troubleshooting?
will there be any impact if I disable it?
#sh processes cpu sorted 5min
CPU utilization for five seconds: 99%/0%; one minute: 66%; five minutes: 46%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 159 1896078 589986 3213 3.96% 10.76% 14.00% 0 Hulc LED Process 165 32871 591 55619 77.42% 33.40% 8.85% 3 SSH Process
I have a Catalyst Switch 6000. Inoticed that after the execution of the job inventory in LMS, and after the snmp queries reached the equipement, the cpu value reached 98-99 % due to the process : PDU DISPATCHER (what’s it ?)
I have also a script running in the switch to observe the differents logs. For exemple, when high cpu is obtained, the message bellow appear :
« %SNMP-3-INPUT_QFULL_ERR: Packet dropped due to input
« %SNMP-3-INPUT_QFULL_ERR: Packet dropped due to input
« %SNMP-3-INPUT_QFULL_ERR: Packet dropped due to input
I am a little stuck trying to troubleshoot unusually high cpu on 7600 Platform.This has been going on for many hours and not been causing a problem, but this doesn't seem replicated in our network and I am concerned about the cause.I have attached some output below, and disabled netflow on interfaces to free some switching CPU. How to track the cause of this? We only have routing protocols and 5 static routes to Null 0, so I cant see how this can be a route loop, but willing to stand corrected. Routes are learned from BGP with OSPF/MPLS internally on the network. This switch also connects to access switches on RIP and EIGRP.
No change has been made to this device when this problem started to occur so I am suspecting something about the traffic has changed or there is a rougue user? [code]
Our Router 7606 is in a problem with high CPU Utilization. We are using one EBGP and one IBGP session. We are also running OSPF with area 0 between two IBGP router to exchange few local networks. When bandwidth cross 100 MB than only CPU use become 100%. when bandwidth consumption is 80MB CPU use become 80% end so on.
Out put is when bandwidth consumption is 34MB
CPU utilization for five seconds: 44%/43%; one minute: 42%; five minutes: 30% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 78 44 9625 4 0.39% 0.03% 0.00% 2 Virtual Exec 13 40 375 106 0.07% 0.00% 0.00% 0 ARP Input 30 116 1098 105 0.07% 0.01% 0.00% 0 IPC Seat Manager
I have a hight CPU utilisation problem in my CISCO7609-S routers. the cpu utilisation can rise 99% et this is usually. In the moment of hight CPU the the process CPU give the following:
I have a 2811 that is really hitting the CPU hard. Nothing shows on CPU processes. It has an IPsec VPN tunnel back to HQ which also has a 2811 that terminates the VPN. The HQ has 2-3 IPsec tunnels to other remote sites. The CPU at the HQ avg 50% utilization during business hrs, peaks at about 80%. The remote one is very high 95% peaks, avg 80%-95% during business hours with bandwidth utilization of only 10-20Mbps. I read somewhere that its possible that fragmentation could be causing this. My question is, if I set the MTU to 1450 on the remote, I am guessing I will need to do all the other routers as well, the HQ and other remote sites? Siince they use the same outside interface to my HQ, is that correct?