I have a cisco 2821 router in rommon and displaying the message '' softwre forced crash '' and '' checksum error'' .I tried to do rommon tftpdnld but as the image is self decompressing into the ram it again crashes with the same error although i have done it with various valid ios but in vain.
Our switch had a little crash-fest this morning at 2:30 AM. I did find a web page about diagnosing Software Forced Crash Exceptions, but it did not look like ours was one of the more easily-identifiable ones.
It may be worth noting that we've only used this switch for about a month, everything seemed fine until now. When we got the switch it did not have any GigE modules, and this week we put 2 into it and have been using them for 2 servers.
It looks like the switch was crashing repeatedly over a period of 20 minutes, and then it stopped and normalized. In the logs of the router that this switch uplinks into, we could see the ethernet port flapping during the time that the switch wasn't reachable.
Here's the Show Stack on the switch:
Sfld_3550# show stackMinimum process stacks:Free/Size Name4404/6000 vegas_flash init3352/6000 SaveCrashBuffer5716/6000 CDP BLOB8512/9000 IP Background5596/6000 vqpc_shim_create_addr_tbl5584/6000 SPAN Subsystem5552/6000 SASL MAIN4944/6000 vegas IPC process8704/9000 cdp init process5404/6000 RADIUS INITCONFIG4928/6000 Vegas CrashBuffer5664/6000 URPF stats2536/3000 Rom Random Update
I have a WS6509-E which is running on below IOS had a software reset yesterday, however I am not able to identify the exact reason for this to happen.
1 day, 2 hours, 39 minutes Time since xxxxx switched to active is 1 day, 2 hours, 38 minutes System returned to ROM by error - a Software forced crash, PC 0x402D3920 at 13:14:51 AEDST Thu Oct 13 2011 (SP by power-on) System restarted at 13:27:28 AEDST Thu Oct 13 2011 System image file is "sup-bootflash:s72033-jk9s-mz.122-18.SXD7b.bin" 1 day, 2 hours, 39 minutes
Time since xxxxx switched to active is 1 day, 2 hours, 38 minutesSystem returned to ROM by error - a Software forced crash, PC 0x402D3920 at 13:14:51 AEDST Thu Oct 13 2011 (SP by power-on)System restarted at 13:27:28 AEDST Thu Oct 13 2011System image file is "sup-bootflash:s72033-jk9s-mz.122-18.SXD7b.bin"
Our router reloaded yesterday with a Software forced crash . I ant to identify the reason for the crash and also the fix for this problem . Attached is the crash info output .
Our router suddenly reloaded. Below are the crashinfo obtained:
1st crashinfo:
7606_Router#more sup-bootflash:crashinfo_20120604-02260500:00:05: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor 00:00:05: %SYS-3-LOGGER_FLUSHING: System pausing to ensure console debugging output. 00:00:05: %PFREDUN-6-ACTIVE: Initializing as ACTIVE processor 00:00:05: %SYS-3-LOGGER_FLUSHED: System was paused for 00:00:00 to ensure console debugging output.
[code]....
We are running s72033-advipservicesk9_wan-mz.122-18.SXF9
I just upgraded several of my C2960S-48FPD-L from 12.2(55)SE to 12.2(58)SE and now almost every time I try to SSH to it the switch reboots and gives me these trace backs ...
07:58:52 CST Thu Apr 14 2011: Unexpected exception to CPU vector 200, PC = 1EADA28 -Trace back= 0x1EADA28z 0x1CDC324z 0x1EA5520z 0x1CDC35Cz 0x1CDD0E0z 0x1CDF0C4z 0x1CE06CCz 0x1CE07F8z 0x1D67348z 0x1D611BCz
Writing crash info to flash:/crashinfo_ext/crashinfo_ext_3
What this crash means? This is a 6509 with a single Sup720 Cisco IOS Software, s72033_rp Software (s72033_rp-ADVIPSERVICESK9_WAN-M), Version 12.2(33)SXI, RELEASE SOFTWARE (fc2)System returned to ROM by s/w reset at 04:42:07 PST8PDT Mon Jan 2 2012 (SP by bus error at PC 0x40C6681C, address 0x424B).
I have 3560X-24T-S switches with IP Services loaded at remote sites that I have been having troubles with. Originally, they had IOS 12.2(58)SE1 on them. I have up to four diverse paths via point-to-point microwave at the remote sites. The Microwave equipment is by Microwave Networks and is a Prodeus M series which Ethernet support. The original issue manifested itself as hardware loopback errors on some of the ports that were connected to the microwave links.
My experience in the past has been that when a hardware loopback error occurred it is usually a bad switch port. In this case however, if I disconnected all of the microwave Ethernet links and rebooted the switch and then connected the Ethernet connections to the microwave links again, everything works fine. No hardware loopback errors. That is, until the next switch reboot. Then the hardware loopback error would return. Interestingly, it would come back on different ports connected to the microwave links every time. So if a reboot was done without disconnecting the microwave Ethernet links the hardware loopback error would change from one microwave link to another after each reboot.
I then went through and read the lengthy release notes for IOS version 15.0(2)SE and found several fixes that I thought could fix my issue. So I downloaded it and updated a couple of the offending switches (not all of them were having this problem). After going through the second update required to resolve the 'open file error' that happens going between 12.2(58)SE1 and 15.0(2)SE the problem seemed to be resolved on the offending switches. So, I went ahead and updated the IOS on all of the switches with point-to-point microwave connections.
I now have one switch that was updated that is crashing and rebooting continuously when the Ethernet links for the point-to-point microwave are connected. Again, if I disconnect all the microwave links and reboot, it comes up fine ands stays fine when the microwave links are connected back up. It will work fine until the next reboot and then the crash and reboot loop starts over again. Below is a portion of the putty log when the crash occurs:
---------------------------------------------------------------------------------------------------------------------- previous memory block, bp = 0x59BF838, memorypool type is Processor data check, ptr = 0x59BF860 ========= Dump bp = 0x59BF87C ====================== 59BF77C: 0 0 0 FD0110DF AB1234CD FFFE0000 56 383FDB4 59BF79C: 212AC68 59BF838 59BF6F4 80000042 1 0 A504F53 543A2050 59BF7BC: 6F727441 53494320 506F7274 204C6F6F 70626163 6B205465 73747320 3A20456E
We had an "Event" on our process network at the mill yesterday. I connected a new WS-C3560V2-48TS-S to our network and we lost communications with all of the other switches.
The core is a stack of 3 WS-C3750 switches, one is a -24TS-1U and the other two are -12S-S. These connect to 10 WS-C3560G-24TS and 5 Rockwell Stratix 8000 (IE3000) over fiber. I am planning on replaceing two 24 port switches with the new 48 port. I had the switch configured and running at my work bench. It was connected to the network with one sfp module and ran all weekend with no issues. Yesterday afternoon I took it to the network cabinet and installed it. I powered it up and connected two sfp modules to the fiber patch panel and made the connection at the core stack.
Everything looked OK. I had communication link lights working on everything. Within minutes, we lost communication with every switch connected to the core stack. I shut down the new 48 port switch and the network slowly came back up.
The new 48 port is configured with Flex Links for the fiber redundancy protocol and was connected to each of the 3750G-12S-S stack members.
I though it might have been a power issue but the stack is UPS protected and shows it has been up for over 10 weeks. I'm not even sure "Crash" is the best decription for what happened. The new switch has a high enough IP address that it would not take over as a IGMP Querier.
The switch 6500-E is frequently crashing whenever the pm scp process reach 100% .I got it under the command "remote command switch show proce cpu".How to solve the problem. I opened the TAC and the engineer says to upgrade the image12.2(18) sxf.Is there any other work around that would avoid to reimage the switch and reloading.
I got some unexpected System crash, and this happens to 2 different routers on the same network.. (We suffer a Crash and change the router, happens the same to the new router after some time, maybe 40 minutes!!)
Here is the last console report for the new router....
%Software-forced reload
Preparing to dump core... 4w1d: %SYS-2-WATCHDOG: Process aborted on watchdog timeout, process = IP NAT Age
About an hour ago I had the master switch on one of my 3750x (WS-C3750X-48PF-S) stacks crash. The only two items we've found that could have caused this issue are the roughly 1.3 million big buffer misses and several of the following in the syslog
SLT:WARN:No exporter configured for smartlog! I do not have smartlogging turned on, nor is there a netflow exporter configured
sh logging smartlogsmartlog is disabledsmartlog exporter:smartlog pkt length: 64 Total pkts processed: 0Total DHCP Snooping pkts processed: 0Total DAI pkts processed: 0Total IPSG pkts processed: 0Total ACL pkts processed: 0
I did not see any traffic spikes prior to the crash.
This stack has been stable since it's last IOS upgrade from 12.2(58)SE1 to 12.2(58)SE2 back in October 2011 so this has me a little worried.
Our 6500 was reboot by self with crash info and i found it was happened by CPU HOG. The log is below for CPU HOG and you can see many times from attached crash info file.
%SYS-SP-3-CPUHOG: Task is running for (16000)m secs, more than (2000)m secs (15/12),process = RPC pagp_switch_mp2sp. [code]....
I think this process made high CPU & memory issue and then there were internal communication fail.. isn't it? So i need to know what PRC pagp_switch_mp2sp is to prevent next issue.
I am not able to find the exact bug for Cisco 3750E stack - Debug Exception (Could be NULL pointer dereference) Exception (0x2000) error. Closest i can find is CSCsa72400 which only affects ver 12.2(20)SE4.All the stacks (3 switches) are running 12.2(50)SE3, It appears that the switch 1 crashed and reloaded. My hunch is its software but i cant find any related bugs. It could be hardware issue as well ?
Problem I have encountered when upgrading a Cisco 6509 chassis with a new supervisor card from Sup2 to Sup 720b. The 6509 loads and then crashes completely, and when rebooted reloads into rommon.The same upgrade was performed on a similar switch with no apparent problems.
Got a problem with my 1760 router. Bought it from ebay and booted it on today and got this error,It has 180224K/16384K bytes of memory and 2 paritions of 32768K flash.I erased both partitions and put a different version of the IOS on (still 12.4) and there is no difference, still get the errors.These aren't on any of my other 1760 routers so I assume they are linked to the problem.
I have a WS-C3560X-24 and attached to that are some 9 acces switches, for some weeks now my 3560 reboots some time what couse that the other 9 switches are down for some minuts as well and i dont want this of course. the reboot happens at random times and some times one week not and then like yesterday afternoon it rebooted again.
when i check the Flash directory there is no crash file and when i look at the logging its clean and just shows the startup. it's not the powersuply it's redundend and more L3 switches are attached to this power source and they dont reboot.
L3_AIM#sh versionCisco IOS Software, C3560E Software (C3560E-UNIVERSALK9-M), Version 12.2(55)SE3, RELEASE SOFTWARE (fc1)Technical Support: [URL] Copyright (c) 1986-2011 by Cisco Systems,
I have one Catalyst 6509E chassis and two SUP720. The bootup sequence on SUP 720 (standby hot) failed . Messages that appear on SUP 720, on the console port indicate o software crash. I don't have a flash card in SUP720.
This is the bootup process:
System Bootstrap, Version 8.5(3) Copyright (c) 1994-2008 by cisco Systems, Inc. Cat6k-Sup720/SP processor with 1048576 Kbytes of main memory
We've got a cisco 2821 router which periodically stops routing all traffic. It seems to happen about once every 2 weeks, and I can't find anything that could be causing it. There are no entries in the log and the router stays up and running but requires a restart to begin processing traffic again. We're running 12.4(13r)T11.Any thoughts, or troubleshooting steps to track this down?
I start configuring Cisco 2821 router for multicast . First short description and attached sheme explanation. Let we say I have small network with 100 users. One router and Cisco switch 3560. Two VLAN’s, one for data another for multicast. Data from internet works fine but now I want to connect multicast servers (or source of more multicast streams) from another subnet. Router have three interfaces.I expect there should be no problems with multicast configuration, but unfortunately it is not like I expect. What I did ?
First step: enable multicast routing
Second step: on both interfaces (Fe 0/1 and Fe 0/2) - ip pim sparse-mode
Third step: configure switch that users are connected to access port in VLAN 222 (temporary to see if multicast work)
When I start VLC on computer nothing happend. If I try to connect computer on same subnet where is source of multicast streams it works fine.What I am doing wrong ? Is there anything about routing ? All subnets are directly connected. RP is not needed if I have one router or ?
I have just bought myself a Cisco 2821 ISR.At present in my home I have a Cisco 2621XM. Fast Ethernet 0/0 is connected to a 3524XL as a trunk to provide my LAN with inter-vlan routing. it works great. Fast Ethernet 0/1 is connected to my ISP's cable modem and uses the command "Ip address dhcp" to get an IP and all other info from my ISP.FA 0/1 is Ip nat outside and the FA 0/0 and all sub interface like 0/0.1 .24 .168 etc all ip nat inside.I get intervlan routing and access to the internet via this router.I have this 2821 to replace the 2621XM as I plan to run CME on it and want gigabit routing on my vlans as at the moment on the 2621 routing between vlans it at half duplex or seems to be.I have configured the 2821 to ip nat outside on gig 0/0 and ip nat inside on gig 0/1 and all of the sub interfaces (same setup as my 2621 but with gig ethernet)I have no access to the internet at all but I can ping www.google.co.uk and other domain names from the terminal session when I am connected to the 2821 via the console or telnet/SSH. the gig 0/0 has an IP assigned from my ISP too but no other nodes on the network can ping outside.Am I missing something here? the version of IOS is V 15.
My access list goes someting like
access-list 1 permit 10.0.0.0 0.255.255.255 access-list 1 permit 192.168.1.0 0.0.0.255 access-list 100 permit ip 10.0.0.0 0.255.255.255 any access-list 100 permit ip 192.168.1.0 0.0.0.255 any and so on
I have a Cisco 2821 Router. Its ethernet Interface(E1) is connected to an ISP's Gateway.The outside interface IP is 207.x.x.1, The ISP has given 6 public IPs (202.x.x.1- 202.x.x.6) to use in LAN.
I have configured the router`s Internal Interface(E0) with a public IP address. (i.e. 202.x.x.1)
My Internal LAN PCs are in a private range of 192.168.1.0/24 subnet. Now I wanted my PC users to access the Internet while the Routers public IP remains on internal interface. How can I do the same?
According to my boss every 3 to 4 months he has to restart our 2821 with a 16-esw module installed because of a low memory issue dealing with CEF. Here is the exact error message.
%% Low on memory; try again laterJun 8 11:18:51.777: %FIB-2-FIBDOWN: CEF has been disabled due to a low memory condition. It can be re-enabled by configuring "ip cef [distributed]" Jun 8 11:19:51.823: %FIB-2-FIBDOWN: CEF has been disabled due to a low memory condition. It can be re-enabled by configuring "ip cef [distributed]" %%
Low on memory; try again later %% Low on memory; try again later %% Low on memory; try again later
Jun 8 11:20:51.868: %FIB-2-FIBDOWN: CEF has been disabled due to a low memory condition. It can be re-enabled by configuring "ip cef [distributed]" Jun 8 11:21:51.914: %FIB-2-FIBDOWN: CEF has been disabled due to a low memory condition. It can be re-enabled by configuring "ip cef [distributed
I have a 5412zl 10.215.x.x/16 Most of the connections on this switch are on vlan1. B9 is the port which is connected to a Cisco 2821 Router. The port on that end is GE0/1. The port on the cisco side is not a trunk but configure with an ip of 10.215.1.30/24 Its part of a some ip access group. The network that i now sit on is a 172.x.x.x/24 (behind cisco router, about 3 hops to that main 2821)We current have a system on my side that talks to a server on the 10.215. that has no issues. I'm trying to access some switches on the 10.215. and have had no luck reaching them.
Here is the access list that i found that port is configured to use:
permit ip 10.215.0.0 0.0.255.255 172.18.0.0 0.0.255.255 permit ip 10.254.0.0 0.0.255.255 172.18.0.0 0.0.255.255 permit ip 10.215.0.0 0.0.255.255 172.14.0.0 0.0.255.255 permit ip 10.254.0.0 0.0.255.255 172.14.0.0 0.0.255.255 permit ip 10.215.0.0 0.0.255.255 192.168.2.0 0.0.0.255 permit ip 10.254.0.0 0.0.255.255 192.168.2.0 0.0.0.255 permit ip 10.215.0.0 0.0.255.255 192.168.20.0 0.0.0.255 permit ip 10.254.0.0 0.0.255.255 192.168.20.0 0.0.0.255 I would think the first permit would allow me to get through to the 10.215 side but maybe i need to set something up on the hp size to let it know how to get back? I'm very new to this stuff.
I have 2821 router configured with two subinterfaces. This router is connected on cisco 2960 switch. The trunk on 2960 is configured without any prunning of vlans. I noticed that udp broadcast traffic is being forwarded through my router on native vlan 1 (this interaface do not have ip address configured). Below is configuration:
Router:
interface GigabitEthernet0/0 no ip address duplex auto
The MPLS connection is currently down, I'm trying to run a failover Site-to-Site VPN over the internet. All of the examples I've read have both connections involved in the failover coming out of one device. Since I'm not working that way, what is going to be the best way to failover? Do I need to set up some sort of IP SLA in the config? Or can I somehow weight routes in EIGRP in a way that the connection will failover from Internet to MPLS when the MPLS goes down and vice versa when the MPLS connection comes back up?
My 2821 router has an arp table with the wrong ip to Mac mappings. The impact is that I can reach any host in the 10.1.1.1 subnet. I can reach hosts in the 192.168.35.0 just fine. [code] It is as if the 192.168.35.1 device is answering all arp requests as a proxy arp or something. Clear arp-cache nor clear ip arp on my 2821 have any affect.
Yesterday my router was hangs and my services was stuck. I start the router hard booted and it works fine.This was second time i was facing this kind of scenario. The attached are the "show tech support" of the cisco router 2821.