We recently configured a stack of four 48 port 3750-x switches . We are noticing high CPU usage. "Hulc LED process" seems pretty high. This has coincided with VMware servers getting slow and non-responsive at times, perhaps a coincidence, not sure. Below I provided some outputs about how to diagnose it.
View 13 RepliesI have a 2 Cisco 3750X stacked working as CORE switches but not in production yet showing a high CPU utilization and I would like to see with you whether you think this is normal or a IOS upgrade/downgrade should be performed.
I have very low traffic coming through as this is not yet in production:
122222333331111122222222222222222222222221111122222222222222 933333999999999922222777772222277777333339999922222111111111 100 90 80 70 60 50 40 ***** 30 ***** ***** ***** 20 ********************************************************** 10
[Code].....
The process "HL3U bkgrd proce" is causing high CPU usage issues in a switch 3750X-24T-L. The IOS is 15.0.2-SE2.
show platform ip unicast failed route and adjacencies displays a lot of entries, I've seen up to 1200.
After restart HL3U bkgrd proce takes around 10 - 20 % CPU, some hours later 99%.
A coupe of times we got logs like this:
%SYS-3-CPUHOG: Task is running for (2136)msecs, more than (2000)msecs (172/73),process = HL3U bkgrd process.
-Traceback= 0x1BE9C3Cz 0x27E103Cz 0x27E0F64z 0x50DCF8z 0x50DE98z 0x503BD0z 0x4F7718z 0x1FF0A18z 0x1F46DECz 0x1F4816Cz 0x1F48698z 0x1F499C8z 0x1FF15D0z 0x2000430z 0x1FF55B4z 0x1FF5FA4z
[Code].....
Seeing very high CPU on one of our 3750X stacks. Usally its around 30% but recently its 70, 80, 90 or maxed at 100% during the main day.IOS version c3750e-universalk9-mz.122-55.SE1.bin.Has a ten gig uplink connected to a nexus 7k and another ten gig connected to another 7k. Running Layer 3 and EIGRP on the 3750X.Is this normal for the CPU?
#sh processes cpu history
5555555554444455555555555555588888666669999888885555577777
8888000001111111111222227777755555666662222222229999977777
100
90 ***** ****
80 ***** ********* *****
[code]....
i am seeing very high utilization on a random basis on the stack. and the logs indicate me that there is a pattern where there is a stack power cable shows inserted (which was never unplugged) followed by sudden spike in the utilization.
001018: *Mar 6 16:21:22.138: %PLATFORM_STACKPOWER-6-CABLE_EVENT: Switch 4 stack power cable 1 inserted
001019: *Mar 6 18:18:37.982: %SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU
[Code]......
I have 3 switches in my 3750 X stack. I am getting the following error in the logs: %PLATFORM_STACKPOWER-4-PRIO_CONFLICT: Switch 1's power stack has conflicting power priorities. Not sure what I should do next. Below is my Stack-power configuration:
Power stack name: Powerstack-1 Stack mode: Power sharing Stack topology: Ring Switch 1: Power budget: 735 Low port priority value: 20 High port priority value: 10 Switch priority value: 2 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: c464.1308.7900 Neighbor on port 2: e8b7.4827.e680
Switch 3: Power budget: 729 Low port priority value: 22 High port priority value: 13 Switch priority value: 4 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: 2894.0fd9.9f00 Neighbor on port 2: 2894.0fd8.e200
Switch 2: Power budget: 690 Low port priority value: 21 High port priority value: 12 Switch priority value: 3 Port 1 status: Connected Port 2 status: Connected Neighbor on port 1: 2894.0fd8.e200 Neighbor on port 2: c464.1308.7900
Each switch has its own 715W power supply in it and all check out OK.
My 4500 core always in 60 % cpu utility , and when i run #sh proc cpu sorted i find that
55 29725041543795572214 0 39.43% 41.40% 41.39% 0 Cat4k Mgmt LoPri
Which mean that this process is the top one , and when i run #sh platform health i found that Stub-JobEventSchedul
10.00 15.98 10 64 100 500 20 17 12 29269:55 K2 CpuMan Review
30.00 35.60 30 48 100 500 49 46 32 52390:52
Those two process are the top and they already exceed their maximum rang and when i run #sh platform cpu packet statistics i can find that Packets Received by Packet Queue
Queue Total 5 sec avg 1 min avg 5 min avg 1 hour avg
---------------------- --------------- --------- --------- --------- ----------
Esmp 5053121950 475 462 340 326
L2/L3Control 244395185 17 8 5 11
Host Learning 67315739 0 0 0 0
L3 Fwd Low 346689615 73 23 14 13
L2 Fwd Low 5336180603 1180 1129 831 804
L3 Rx Low 2287913 0 0 0 0
RPF Failure 7510829 1 0 0 0
i have cisco 7600 router , here is show run : Gateway7600#sh run Building configuration...
Current configuration : 4787 bytes
!
! Last configuration change at 09:08:04 UTC Sat Apr 20 2013 by xxxx
!
version 15.2
service timestamps debug datetime msec
[Code]....
I'm having issue with one stubborn process that is consuming nearly all the CPU on all of my switches. I tried googling it, but had no luck. The process is "hulc nrgyz PD di"
View 4 Replies View RelatedWe have two c6509 budled in VSS. I have noticed randomly high usage of CPU, sometimes up to 99% in peaks. I have found that it can be generated by SNMP engine. So I unconfigure all SNMP things. But situation is the same. I would like to know if this state is OK or not. CPU shows are enclosed in file.
View 1 Replies View RelatedI'm trying to review a QoS setup, and I'd like to make sure I fully understand the current setup before I change anything. I'm seeing output drops on two different queue-thresholds, but not sure how packets are making it to one of the queues.
Switch Version
CORE#show ver
Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 15.0(2)SE, RELEASE SOFTWARE (fc1)
System image file is "flash:/c3750e-universalk9-mz.150-2.SE/c3750e-universalk9-mz.150-2.SE.bin"
cisco WS-C3750X-24 (PowerPC405) processor (revision A0) with 262144K bytes of memory.
Switch Ports Model SW Version(code)
I can find queue4-threshold3 in the mappings, but how are packets getting mapped to queue2-threshold1? The priority queue is disabled for this interface, so I'm not sure how this queue is dropping packets, according to the maps nothing is mapped to 02-01.
I have a one question. I am using Cat3750x-48 switch. Suddenly it has occurred following high CPU log message in Cat3750x-48 switch.
%SYS-1-CPURISINGTHRESHOLD: Threshold: Total CPU Utilization(Total/Intr): 62%/0%, Top 3 processes(Pid/Util): 162/40%, 156/10%, 74/1%
What is meaning of PID 162 ?
This 3750X stack (3 members) has some 100% cpu spikes. Is this bad enough to start tracking down the cause(s) or is this somewhat typical and not a reason for concern? I just took this reading. How can you detemine when the 100% and 80% spikes occurred?
2222233333333332222222222444442222222223333322222222222222
7777733333333338888888888000007777777770000077777888887777
100
[Code].....
I recently created a stack using (2) 3750x switches. I have three vlans on the stack (1,105,241) Vlan 105 is configured on 6509 core switches with multicasting and are connected to the stack via gigabit fiber. It is working well with clients on the Master or SW1, however clients on SW2 do not participate in multicasting Any client pc that is connected to SW2 vlan 105 does not show up in the "sh ip igmp snooping group" command. I can statically assign a client on SW2 to the mcast groups but but they fail to register on their own. I can take the cable connection from SW2 and plug it into an SW1 Vlan 105 port and it immediately becomes a member of the groups. I can then connect it back to the SW2 port and it disappears from the group membership. IGMP and PIM are configured with the defaults.
View 3 Replies View RelatedI have a 3750G and bought a new 3750X. It possible to stack these two together?
View 5 Replies View Relatedway to upgrade the IOS in my stack on 4 3750x switches
View 6 Replies View RelatedI have a stack of three 3750X-24P-S switches. Each switch has two PSU's.If I do a SH INVENT, switch 2 only lists Power Supply 0
If, however I do a SESS 2 onto the second switch in the stack and then do a SH INVENT, it shows both power supplies. Is it anything to be concerned about?
We are facing high CPU Utilization on Cisco 3750X-48P-L without any traffic on it. find the attached log files for 2 separate 3750's stack, we have upgraded the IOS of SW2 from "c3750e-universalk9-mz.122-55.SE3.bin" to "c3750e-universalk9-mz.122-55.SE4.bin" but still we found the same issue with CPU utilization.
View 4 Replies View RelatedI have two WS-C3750X-48PF-S in stack, but every one has just one power supply. In the package of the switches is included one stack power supply cable.does it make sense to use stack power cable if every switch has just one power supply ??
View 6 Replies View RelatedSwitch 2 has an interface configured in RSU Standby.Switch 3 has an interface configured in RSU active. The upgrading sequence is : Switch 2, Switch 1, Switch3.The aim of the test is to prove that there is no loss of IP connectivity throught the RSU process.During the RSU process, there are ping between all the computers.
IOS starting version : 15.0-1.SE3
IOS upgrading version (with OVERWRITE) : 15.0-1.SE3 (same version)
1rst step : Switch 2 reboot and come back master but isolated from original stack (switch 1 and 3)
2nd step : Switch 1 reboot, and come back with switch 2 into the upgrading stack.
Issue : at this step :
- Switch 1 put its interface (IP 192.168.5.254) up :
- Switch 3 has not reboot and still has its interface (IP 192.168.5.254) up
=> we have some OSPF adjencies and mac flapping issues : switch 1 and 3 are trying to mount there OSPF adjencies on the same IP. We loss our IP connectivity since step 3 is not over.
3rd step : Switch 3 reboot and come back up in the upgrading stack. The IP connectivity is back, and the RSU process is done.Is that a normal behaviour ?How can we avoid to loose IP connectivity during RSU process ?
I've a situation where I need to add a new 3750x to a existing stack of 3750. [code] When I tried to stack them together, I get a version mismatch error. Is this because of the difference in SW Image? What are my options next ? My ultimate goal is to make the new switch stack correctly with the exisitng switches.
View 11 Replies View RelatedI am getting a version mismatch when adding the following 3750X to the 3750 stack:
WS-C3750X-48 12.2(55)SE3 C3750E-UNIVERSALK9-M
2 0 WS-C3750-24TS 12.2(25)SEA C3750-I9K91-M
Can I upgrade the 3750's to be able to correct this? Which version does this require?
IOS upgrade tried on the stack of 2XWS-C3750X-24T-S , Upgrade was tried to support WCCP on the platform. Current version is Cisco IOS Software, C3750E Software (C3750E-UNIVERSALK9-M), Version 12.2(58)SE1, Not able find any IP Plus ios in the site ? Only available are IP base and Universal K9 , Tried upgrading to c3750e-universalk9-tar.122-58.SE2.tar by using stack upgrade method as per document [URL]
Upgrade fails with error :
%Error opening flash:update/info (No such file or directory)
ERROR: Image is not a valid IOS image archive.
Why current ios is not supporting WCCP , I hope it is there in the featureset. ( tried "sdm prefer routing" but no success) Does c3750e-universalk9-tar.122-58.SE2.tar will give me wccp support ? What is the issue with my upgrade and how do I do a successfull upgrade ?
if I read the Datasheet of Catalyst 3750X-Series-Switches it is possible to connect a new X-Switch to an existing and old Catalyst 3750-Series Stack.What kind of requirements are needed? Only same IOS-Version in the hole Stack and if possible same Feature-Set? .... like in a normal NOT mixed Stack?
View 4 Replies View Relatedif we can stack the 3750G switch with a 3750X switch ?
View 7 Replies View RelatedOur customer has a stack of 6 3750G switches. They want to add another switch to the stack. I tried to quote another G, but I got a warning that the G series is EOS January 30,2013. Can I add a 3750X to the stack? I know that no matter what switch I get, I will have to upgrade the IOS in the stack, as the stack is running 12.2(25)SEE2.
View 2 Replies View RelatedI have a 3750X 24 port switch (with NM-1G network module) running IOS 15.0(1). Is there any benefit or reason to plug in the included Stack Wise cable and loop it back to itself in a single switch installation?
I don't see any recommendation in the documentation. The data sheet indicates a single switch is a non-blocking device so I'd think there's no bandwidth advantage like there is when connecting an actual multi-switch stack and needing to close the loop for the full 32 Gbps stack bandwidth.
I have a cisco WS-C3750G-24TS with IOS flash :/ c3750-mz.122-ipservicesk9-25.SEB4.bin "
I purchased a new Cisco WS-C3750X-24 with the IOS flash :/ c3750e-universalk9-mz.150-1.SE/c3750e-universalk9-mz.150-1.SE.bin. ( NEW )
When i configured a stack between the two 3750, the new switch restarted due the version mismatch (different IOS´s);
We have two versions:
WS-C3750G-24TS-ipservicesk9 flash :/ c3750-mz.122-25.SEB4.bin "
VS
WS-C3750X-24 flash :/ c3750e-universalk9-mz.150-1.SE/c3750e-universalk9-mz.150-1.SE.bin.
Is that possible to configure a stack between then?
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Tenho um cisco WS-C3750G-24TS com o IOS flash:/c3750-ipservicesk9-mz.1
22-25.SEB4.bin"
Adquiri um novo cisco WS-C3750X-24 com o IOS flash:/c3750e-universalk9-mz.150-1.SE/c3750e-universalk9-mz.150-1.SE.bin.
[code]...
I have two 3750X in a stack. Each 3750X has one 10Gb uplink to primary core1 and one 1Gb uplink to backup core2 configured in 2 etherchannel groups. The member switch has bad ports, so I need to replace it. I have spare 3750X unit. Is it possible to connect the spare unit to the stack and then move the RJ-45 cables from the member with bad ports to the new member? That way I can minimize servers downtime to just a few seconds..If that would work, then the last step would be to move the 10Gb networking module from old member to the new one, as well as the secondary PSU. Is it doable? Also according to the documentation, all I need to add new member is matching IOS version, correct?
View 1 Replies View RelatedI would just like to confirm whether dual stack hsrp is possible or not on 3750X both stack and non-stack.
The following is that I have to take care of this on the stack?
[Catalyst 3750 Software Configuration Guide, Release 12.2(55)SE]
[URL]
%FHRP group not consistent with already configured groups on the switch stack
We have just purchased Cisco 3750X 24 S switches (QTY 2), last week we put them in prodcution in simple Layer 2 mode. No Core, just act as Access switch in order to only check the performace and availibility of switches.
But strange thing I have noticed the highest cpu utilization, cpu sits on 13 to 14% and from historical logs it hit above 60%. I am confused what is happening. Remember to terminate copper connection we have inserted Copper SFP Modules on both switches.
Both switches connected on Layer 2 mode via trunk, in LAN environment we have here 7 3Com 2824 Management switches which are terminated on Copper SFP modules at Cisco 3750X 24 S. All 3Comm Switches uplink are terminated on Cisco 3750 Switch 1, another switch is idle. Whole setup is running on VLAN1 .
Also refer no port in TCP and UDP packets in show ip traffic. any abnormal condition you predict..basically, In near days we plan to make these switches as Core layer and run intervlan routing, HSRP/VRRP and OSPF. But in this cpu usage how we can go ahead until this resolved..
I have two 3750G switches stacked together however it's not in a full ring configuration:
Stack Ring Speed : 16G
Stack Ring Configuration: Half
Stack Ring Protocol : StackWise
And as shown below it's obvious which cable is not working:
show switch neighbors
Switch # Port 1 Port 2
-------- ------ ------
1 2 None
2 None 1
It's not flapping - it's like the cable isn't there at all. I'm going to try reseating the cable in there and perhaps an all out replacement if necessary. My question - is there any threat of a reboot of the switch stack or of partitioning of the switch stack by trying to get the 2nd cable working?
I have a 3750X stack of 6 switches, I have a terminal server console server plugged into the console ports of all 6 switches. I am having a strange issue where I can connect to the master via the console, get a login prompt then I can log in, but when I try and connect to any of the members then I get a prompt "Press RETURN to get started" When I push return, it just loops back to the same prompt again:
switch-6 con0 is now available
Press RETURN to get started.
switch-6 con0 is now available
Press RETURN to get started.
I can connect to the stack via SSH fine etc. I am running 15.0(1)SE2. The stack is configured for TACACS+ auth via Cisco ACS.
Switch# Role Mac Address Priority Version State
----------------------------------------------------------
*1 Master f0f7.55ba.2700 15 1 Ready
2 Member f0f7.5541.da00 14 1 Ready
3 Member a493.4c1e.4b80 13 1 Ready
4 Member f0f7.5585.cb80 12 1 Ready
5 Member a44c.1120.8e80 11 1 Ready
6 Member a493.4cc0.fa80 10 1 Ready