| View previous topic :: View next topic |
| Author |
Message |
coplaniuk
Guru
Joined: 14 Apr 2004
Posts: 461
Location: Philadelphia, USA
|
 Posted: Tue Oct 05, 2004 3:18 am Post subject: Oops & ksymoops message debugging.. |
 |
|
Right...so I finally was able to capture the output of an oops message. And I ran it through ksymoops. According to documentation in the kernel docs tree (oops-tracing.txt), it recommends I send to linux-kernel@vger.kernel.org. However, after reading that document, it seems like that was aimed at developers. I'm not developing anything. The system just crashes with no rhyme or reason. ONe time it was when I was loading a PHP page I had written. Another, it was just sitting there (doing cron stuff, I imagine). This time, the time I captured to oops, it was updating the system via emerge...so it was potentially compiling some things. I'm almost sure that it must be a hardware issue, as this system has failed on more than one kernel (2.4.x, gentoo stables, gentoo default, now 2.6.x). That said, I'm nervous about sending to the linux-kernel address...as I don't really feel that is where I should be sending it.
So...I'm thinking I might post the info here...but then I don't want to offend you guys either. I'm frustrated enough as it is...I don't want to frustrate my tech support arm (and the reason I like linux). Reluctantly, however, I think I'll post it here anyhow. If you disapprove, I'm sorry. But I want to figure out this problem.
So here's the initial oops message:
| Code: |
Bad page state at prep_new_page (in process 'sh', page c10805c0)
flags:0x20001028 mapping:c274fcd8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1058c60)
flags:0x20001028 mapping:c224f178 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10ea7a0)
flags:0x20001028 mapping:c224f178 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1074b00)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1081f40)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1074d40)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c108f020)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1080320)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c108f200)
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1081080)
flags:0x2000102c mapping:c224fad8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c105ed80)
flags:0x2000102c mapping:c224fad8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1081b80)
flags:0x20001028 mapping:c224d218 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c108fd20)
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1090e40)
flags:0x20001028 mapping:c2195758 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c109f180)
flags:0x20001028 mapping:c2195758 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c109f0e0)
flags:0x20001028 mapping:c2195938 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c102bd60)
flags:0x20001028 mapping:c2195cf8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1083620)
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1083600)
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'kjournald', page c10835e0)
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'kjournald', page c10835c0)
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1041720)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1041700)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10896c0)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10387e0)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10387c0)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c108f3c0)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c104f880)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c104f820)
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c1081520)
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10bede0)
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Bad page state at prep_new_page (in process 'sh', page c10b3660)
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
Trying to fix it up, but a reboot is needed
Oops: 0002 [#1]
SMP
Modules linked in: ipt_MASQUERADE ipt_REJECT ipt_pkttype ipt_LOG ipt_TCPMSS ipt_multiport ipt_conntrack ip_nat_irc ip_nat_tftp ip_nat_ftp ip_conntrack_irc ip_conntrack_tftp ip_conntrack_ftp ppp_deflate zlib_deflate zlib_inflate bsd_comp ppp_async crc_ccitt ppp_generic slhc iptable_nat ipt_state ip_conntrack iptable_filter ip_tables 8139too crc32 joydev evdev usbhid uhci_hcd usbcore sd_mod scsi_mod
CPU: 0
EIP: 0060:[<c01372ef>] Tainted: G S
EFLAGS: 00010017 (2.6.8.1)
EIP is at free_pages_bulk+0x9f/0x230
eax: c10bedf8 ebx: c10bedc0 ecx: 00200200 edx: 00100100
esi: 000013db edi: c10bede0 ebp: c030e594 esp: c132bdac
ds: 007b es: 007b ss: 0068
Process cp (pid: 6528, threadinfo=c132a000 task=c6d031f0)
Stack: c030e380 c10bede0 00000001 c030e60c c10bede0 00000001 fffffffe 00000001
00000001 c1020000 c030e588 00000086 c030e380 c10bede0 c030e710 00000282
c01379ba c030e380 00000004 c030e710 00000000 c030e380 00000014 c10bede0
Call Trace:
[<c01379ba>] free_hot_cold_page+0xea/0x110
[<c0134070>] do_generic_mapping_read+0x400/0x4d0
[<c013441e>] __generic_file_aio_read+0x1fe/0x230
[<c0134140>] file_read_actor+0x0/0xe0
[<c01344aa>] generic_file_aio_read+0x5a/0x80
[<c0151364>] do_sync_read+0x84/0xb0
[<c015b607>] sys_fstat64+0x37/0x40
[<c0151448>] vfs_read+0xb8/0x130
[<c01516f1>] sys_read+0x51/0x80
[<c010417f>] syscall_call+0x7/0xb
Code: 89 4a 04 89 11 c7 40 04 00 02 20 00 c7 00 00 01 10 00 2b 7c
|
And here's the ksymoops output:
| Code: |
Error (regular_file): read_ksyms stat /proc/ksyms failed
ksymoops: No such file or directory
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
flags:0x20001028 mapping:c274fcd8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f178 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f178 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224f718 mapcount:0 count:2
Backtrace:
flags:0x2000102c mapping:c224fad8 mapcount:0 count:2
Backtrace:
flags:0x2000102c mapping:c224fad8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224d218 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c2195758 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c2195758 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c2195938 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c2195cf8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c237b198 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c1e8eb78 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
flags:0x20001028 mapping:c224d7b8 mapcount:0 count:2
Backtrace:
Oops: 0002 [#1]
CPU: 0
EIP: 0060:[<c01372ef>] Tainted: G S
Using defaults from ksymoops -t elf32-i386 -a i386
EFLAGS: 00010017 (2.6.8.1)
eax: c10bedf8 ebx: c10bedc0 ecx: 00200200 edx: 00100100
esi: 000013db edi: c10bede0 ebp: c030e594 esp: c132bdac
ds: 007b es: 007b ss: 0068
Stack: c030e380 c10bede0 00000001 c030e60c c10bede0 00000001 fffffffe
00000001
00000001 c1020000 c030e588 00000086 c030e380 c10bede0 c030e710
00000282
c01379ba c030e380 00000004 c030e710 00000000 c030e380 00000014
c10bede0
Call Trace:
[<c01379ba>] free_hot_cold_page+0xea/0x110
[<c0134070>] do_generic_mapping_read+0x400/0x4d0
[<c013441e>] __generic_file_aio_read+0x1fe/0x230
[<c0134140>] file_read_actor+0x0/0xe0
[<c01344aa>] generic_file_aio_read+0x5a/0x80
[<c0151364>] do_sync_read+0x84/0xb0
[<c015b607>] sys_fstat64+0x37/0x40
[<c0151448>] vfs_read+0xb8/0x130
[<c01516f1>] sys_read+0x51/0x80
[<c010417f>] syscall_call+0x7/0xb
Code: 89 4a 04 89 11 c7 40 04 00 02 20 00 c7 00 00 01 10 00 2b 7c
>>EIP; c01372ef <free_pages_bulk+9f/230> <=====
>>eax; c10bedf8 <__crc_idle_cpu+26a13b/307d59>
>>ebx; c10bedc0 <__crc_idle_cpu+26a103/307d59>
>>ecx; 00200200 <__crc_smp_call_function+b422f/4c2795>
>>edx; 00100100 <__crc_rpc_wake_up_next+81d25/cdbf6>
>>edi; c10bede0 <__crc_idle_cpu+26a123/307d59>
>>ebp; c030e594 <contig_page_data+e14/2480>
>>esp; c132bdac <__crc_device_bind_driver+4610c/1afa3f>
Trace; c01379ba <free_hot_cold_page+ea/110>
Trace; c0134070 <do_generic_mapping_read+400/4d0>
Trace; c013441e <__generic_file_aio_read+1fe/230>
Trace; c0134140 <file_read_actor+0/e0>
Trace; c01344aa <generic_file_aio_read+5a/80>
Trace; c0151364 <do_sync_read+84/b0>
Trace; c015b607 <sys_fstat64+37/40>
Trace; c0151448 <vfs_read+b8/130>
Trace; c01516f1 <sys_read+51/80>
Trace; c010417f <syscall_call+7/b>
Code; c01372ef <free_pages_bulk+9f/230>
00000000 <_EIP>:
Code; c01372ef <free_pages_bulk+9f/230> <=====
0: 89 4a 04 mov %ecx,0x4(%edx) <=====
Code; c01372f2 <free_pages_bulk+a2/230>
3: 89 11 mov %edx,(%ecx)
Code; c01372f4 <free_pages_bulk+a4/230>
5: c7 40 04 00 02 20 00 movl $0x200200,0x4(%eax)
Code; c01372fb <free_pages_bulk+ab/230>
c: c7 00 00 01 10 00 movl $0x100100,(%eax)
Code; c0137301 <free_pages_bulk+b1/230>
12: 2b 7c 00 00 sub 0x0(%eax,%eax,1),%edi
1 warning and 1 error issued. Results may not be reliable.
|
I had to reboot the system to run it via ksymoops...I don't know if that causes the unreliable output that I'm warned about. If there's some special way I should be doing this, please let me know. But if you have any ideas as to what caused this oops...please let me know. I really REALLY appreciate it. |
|
| Back to top |
|
 |
hecatomb
Guru
Joined: 02 Sep 2004
Posts: 525
|
| Posted: Tue Oct 05, 2004 12:26 pm Post subject: |
|
|
First let me say I'm new to these! So maybe my guesses are nonsense.
I agree with you that it points to a hardware problem because of various tested kernel versions.
I looked through the Call Trace and I think that the filesystem should be accessed when this was caused.
Searching the kernel source I found that only ext3 and xfs use the call do_sync_read.
My suggestion is to test the filesystem (fsck) and check all plugs in your computer. |
|
| Back to top |
|
|
coplaniuk
Guru
Joined: 14 Apr 2004
Posts: 461
Location: Philadelphia, USA
|
| Posted: Wed Oct 06, 2004 2:41 am Post subject: |
|
|
I ran fsck on my hard disk...it did come up with errors, and maybe that will solve that. In addition, I checked all my connections and everything seems peachy.
I did notice, however, that my fstab might have been slightly messed up:
| Code: |
/dev/hda1 /boot ext3 noatime 1 2
/dev/hda2 none swap sw 0 0
/dev/hda3 / ext3 noatime 0 1
/dev/hdb1 /opt ext3 noatime 0 1
|
I changed the /dev/hdb1 partition so that it was set to 2 for check order. When I did that, I rebooted the system, and it forced a check on the hard drive saying it hadn't been checked in over 100 days or something like that. Do you think that might have had any relation?
I'm running the system again...I'll see if I get any oops now. |
|
| Back to top |
|
|
hecatomb
Guru
Joined: 02 Sep 2004
Posts: 525
|
| Posted: Wed Oct 06, 2004 5:45 am Post subject: |
|
|
fsck came up with errors maybe this was the problem (corrupt filesystem)!
| Quote: | | ... it hadn't been checked in over 100 days ... |
I don't think this is related.
Please report if it helped or not. Hope your system now is running without kernel-oops.  |
|
| Back to top |
|
|
coplaniuk
Guru
Joined: 14 Apr 2004
Posts: 461
Location: Philadelphia, USA
|
| Posted: Fri Oct 08, 2004 3:11 am Post subject: |
|
|
It seemed to have helped a little bit. My machine seemed a bit more stable over the last couple of days.
BUT...
I got what appeared to be an oops log today. It never said oops anywhere, but it was along those lines. I would post it, but it took a really long time to spit out, and it never really finished. I hard-rebooted (bad, I know, but it was 40 minutes later).
Anyhow...the log kept spitting out 'hotplug' references, so I assumed that might have something to do with it. This is a desktop machine, and I don't believe I need hotplug for anything, so I recompiled the kernel without support for hotplug. I'll see how that goes from here.
I'll keep you posted. |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Kernel & Hardware
