Topic: Kernel panic

[eric]

I'm getting a kernel panic ever few days or so, after a reboot the server seems to work fine...till the next kernel panic...

I searched through the messages log to see what I could find. Line after line of blah, I came across this...ending with the reboot of my server

Jan 19 00:39:13 server kernel: Unable to handle kernel paging request at virtual address e1c6001c
Jan 19 00:39:13 server kernel:  printing eip:
Jan 19 00:39:13 server kernel: c012e82c
Jan 19 00:39:13 server kernel: *pde = 00000000
Jan 19 00:39:13 server kernel: Oops: 0000
Jan 19 00:39:13 server kernel: appletalk ipsec 3c59x ipt_MASQUERADE ipt_state ipt_TOS ip_conntrack_pptp ip_na
Jan 19 00:39:13 server kernel: CPU:    0
Jan 19 00:39:13 server squid[14038]: Squid Parent: child process 14040 exited due to signal 11
Jan 19 00:39:13 server kernel: EIP:    0010:[kmem_cache_alloc+140/208]    Tainted: P
Jan 19 00:39:13 server kernel: EIP:    0010:[]    Tainted: P
Jan 19 00:39:13 server kernel: EFLAGS: 00010006
Jan 19 00:39:13 server kernel:
Jan 19 00:39:13 server kernel: EIP is at kmem_cache_alloc [kernel] 0x8c (2.4.18-5)
Jan 19 00:39:13 server kernel: eax: 08000001   ebx: 08000001   ecx: c1c60000   edx: 00000500
Jan 19 00:39:13 server kernel: esi: 00000246   edi: c1276440   ebp: c1c60040   esp: c1fdbee0
Jan 19 00:39:13 server kernel: ds: 0018   es: 0018   ss: 0018
Jan 19 00:39:13 server kernel: Process squid (pid: 14040, stackpage=c1fdb000)
Jan 19 00:39:13 server kernel: Stack: c3894000 c3894000 c6f5d180 c3895fbc c3c56b44 00000000 ffffff9f c3c56b44
Jan 19 00:39:13 server kernel:        c01c5c72 c1276440 000001f0 c3c56b44 ffffff9f c01fecd1 00000002 000001f0
Jan 19 00:39:13 server kernel:        00000001 c3c56b44 00000000 ffffff9f c03646a0 c01c41f7 c3c56b44 00000000
Jan 19 00:39:13 server kernel: Call Trace: [sk_alloc+18/96] sk_alloc [kernel] 0x12
Jan 19 00:39:13 server kernel: Call Trace: [] sk_alloc [kernel] 0x12
Jan 19 00:39:13 server kernel: [inet_create+33/512] inet_create [kernel] 0x21
Jan 19 00:39:13 server kernel: [] inet_create [kernel] 0x21
Jan 19 00:39:13 server kernel: [sock_create+215/256] sock_create [kernel] 0xd7
Jan 19 00:39:13 server kernel: [] sock_create [kernel] 0xd7
Jan 19 00:39:13 server kernel: [sys_getsockopt+58/112] sys_getsockopt [kernel] 0x3a
Jan 19 00:39:13 server kernel: [] sys_getsockopt [kernel] 0x3a
Jan 19 00:39:13 server kernel: [sys_socket+25/80] sys_socket [kernel] 0x19
Jan 19 00:39:13 server kernel: [] sys_socket [kernel] 0x19
Jan 19 00:39:13 server kernel: [sys_socketcall+108/528] sys_socketcall [kernel] 0x6c
Jan 19 00:39:13 server kernel: [] sys_socketcall [kernel] 0x6c
Jan 19 00:39:13 server kernel: [math_state_restore+25/64] math_state_restore [kernel] 0x19
Jan 19 00:39:13 server kernel: [] math_state_restore [kernel] 0x19
Jan 19 00:39:13 server kernel: [system_call+51/64] system_call [kernel] 0x33
Jan 19 00:39:13 server kernel: [] system_call [kernel] 0x33
Jan 19 00:39:13 server kernel:
Jan 19 00:39:13 server kernel:
Jan 19 00:39:13 server kernel: Code: 8b 44 81 18 0f af da 89 41 14 01 eb 40 75 16 8b 41 04 8b 11
Jan 19 00:39:16 server squid[14038]: Squid Parent: child process 14768 started
Jan 19 00:39:18 server kernel:  <1>Unable to handle kernel paging request at virtual address e1c6001c
Jan 19 00:39:18 server kernel:  printing eip:
Jan 19 00:39:18 server kernel: c012e82c
Jan 19 00:39:18 server kernel: *pde = 00000000
Jan 19 00:39:18 server kernel: Oops: 0000
Jan 19 00:39:18 server kernel: appletalk ipsec 3c59x ipt_MASQUERADE ipt_state ipt_TOS ip_conntrack_pptp ip_na
Jan 19 00:39:18 server kernel: CPU:    0
Jan 19 00:39:18 server kernel: EIP:    0010:[kmem_cache_alloc+140/208]    Tainted: P
Jan 19 00:39:18 server kernel: EIP:    0010:[]    Tainted: P
Jan 19 00:39:18 server kernel: EFLAGS: 00010002
Jan 19 00:39:18 server kernel:
Jan 19 00:39:18 server kernel: EIP is at kmem_cache_alloc [kernel] 0x8c (2.4.18-5)
Jan 19 00:39:18 server kernel: eax: 08000001   ebx: 08000001   ecx: c1c60000   edx: 00000500
Jan 19 00:39:18 server squid[14038]: Squid Parent: child process 14768 exited due to signal 11
Jan 19 00:39:18 server kernel: esi: 00000246   edi: c1276440   ebp: c1c60040   esp: c7c8fee0
Jan 19 00:39:18 server kernel: ds: 0018   es: 0018   ss: 0018
Jan 19 00:39:18 server kernel: Process squid (pid: 14768, stackpage=c7c8f000)
Jan 19 00:39:18 server kernel: Stack: 00000fff 00000040 c7c8ff0c c0fe38b0 c63e5e84 00000000 ffffff9f c63e5e84
Jan 19 00:39:19 server kernel:        c01c5c72 c1276440 000001f0 c63e5e84 ffffff9f c01fecd1 00000002 000001f0
Jan 19 00:39:19 server kernel:        00000001 c63e5e84 00000000 ffffff9f c03646a0 c01c41f7 c63e5e84 00000000
Jan 19 00:39:19 server kernel: Call Trace: [sk_alloc+18/96] sk_alloc [kernel] 0x12
Jan 19 00:39:19 server kernel: Call Trace: [] sk_alloc [kernel] 0x12
Jan 19 00:39:19 server kernel: [inet_create+33/512] inet_create [kernel] 0x21
Jan 19 00:39:19 server kernel: [] inet_create [kernel] 0x21
Jan 19 00:39:19 server kernel: [sock_create+215/256] sock_create [kernel] 0xd7
Jan 19 00:39:19 server kernel: [] sock_create [kernel] 0xd7
Jan 19 00:39:19 server kernel: [sys_getsockopt+58/112] sys_getsockopt [kernel] 0x3a
Jan 19 00:39:19 server kernel: [] sys_getsockopt [kernel] 0x3a
Jan 19 00:39:19 server kernel: [sys_socket+25/80] sys_socket [kernel] 0x19
Jan 19 00:39:19 server kernel: [] sys_socket [kernel] 0x19
Jan 19 00:39:19 server kernel: [sys_socketcall+108/528] sys_socketcall [kernel] 0x6c
Jan 19 00:39:20 server kernel: [] sys_socketcall [kernel] 0x6c
Jan 19 00:39:20 server kernel: [do_page_fault+0/1131] do_page_fault [kernel] 0x0
Jan 19 00:39:20 server kernel: [] do_page_fault [kernel] 0x0
Jan 19 00:39:20 server kernel: [error_code+52/64] error_code [kernel] 0x34
Jan 19 00:39:20 server kernel: [] error_code [kernel] 0x34
Jan 19 00:39:20 server kernel: [system_call+51/64] system_call [kernel] 0x33
Jan 19 00:39:20 server kernel: [] system_call [kernel] 0x33
Jan 19 00:39:20 server kernel:
Jan 19 00:39:20 server kernel:
Jan 19 00:39:20 server kernel: Code: 8b 44 81 18 0f af da 89 41 14 01 eb 40 75 16 8b 41 04 8b 11
Jan 19 00:39:21 server squid[14038]: Squid Parent: child process 14776 started
Jan 19 00:39:21 server kernel:  <1>Unable to handle kernel paging request at virtual address e1c6001c
Jan 19 00:39:21 server kernel:  printing eip:
Jan 19 00:39:21 server kernel: c012e82c
Jan 19 00:39:21 server kernel: *pde = 00000000
Jan 19 00:39:21 server kernel: Oops: 0000
Jan 19 00:39:21 server kernel: appletalk ipsec 3c59x ipt_MASQUERADE ipt_state ipt_TOS ip_conntrack_pptp ip_na
Jan 19 00:39:21 server kernel: CPU:    0
Jan 19 00:39:21 server kernel: EIP:    0010:[kmem_cache_alloc+140/208]    Tainted: P
Jan 19 00:39:21 server kernel: EIP:    0010:[]    Tainted: P
Jan 19 00:39:21 server kernel: EFLAGS: 00010006
Jan 19 00:39:21 server kernel:
Jan 19 00:39:21 server kernel: EIP is at kmem_cache_alloc [kernel] 0x8c (2.4.18-5)
Jan 19 00:39:21 server squid[14038]: Squid Parent: child process 14776 exited due to signal 11
Jan 19 00:39:23 server kernel: eax: 08000001   ebx: 08000001   ecx: c1c60000   edx: 00000500
Jan 19 00:39:24 server kernel: esi: 00000246   edi: c1276440   ebp: c1c60040   esp: c40ffee0
Jan 19 00:39:24 server kernel: ds: 0018   es: 0018   ss: 0018
Jan 19 00:39:25 server kernel: Process squid (pid: 14776, stackpage=c40ff000)
Jan 19 00:39:25 server kernel: Stack: c40fff00 00000010 cba45764 c40fff00 c77d85a4 00000000 ffffff9f c77d85a4
Jan 19 00:39:25 server kernel:        c01c5c72 c1276440 000001f0 c77d85a4 ffffff9f c01fecd1 00000002 000001f0
Jan 19 00:39:25 server kernel:        00000001 c77d85a4 00000000 ffffff9f c03646a0 c01c41f7 c77d85a4 00000000
Jan 19 00:39:25 server kernel: Call Trace: [sk_alloc+18/96] sk_alloc [kernel] 0x12
Jan 19 00:39:26 server kernel: Call Trace: [] sk_alloc [kernel] 0x12
Jan 19 00:39:26 server kernel: [inet_create+33/512] inet_create [kernel] 0x21
Jan 19 00:39:26 server kernel: [] inet_create [kernel] 0x21
Jan 19 00:39:26 server kernel: [sock_create+215/256] sock_create [kernel] 0xd7
Jan 19 00:39:26 server kernel: [] sock_create [kernel] 0xd7
Jan 19 00:39:26 server kernel: [inet_setsockopt+37/48] inet_setsockopt [kernel] 0x25
Jan 19 00:39:26 server kernel: [] inet_setsockopt [kernel] 0x25
Jan 19 00:39:26 server kernel: [sys_setsockopt+84/112] sys_setsockopt [kernel] 0x54
Jan 19 00:39:26 server kernel: [] sys_setsockopt [kernel] 0x54
Jan 19 00:39:26 server kernel: [sys_socket+25/80] sys_socket [kernel] 0x19
Jan 19 00:39:27 server kernel: [] sys_socket [kernel] 0x19
Jan 19 00:39:27 server kernel: [sys_socketcall+108/528] sys_socketcall [kernel] 0x6c
Jan 19 00:39:27 server kernel: [] sys_socketcall [kernel] 0x6c
Jan 19 00:39:27 server kernel: [math_state_restore+25/64] math_state_restore [kernel] 0x19
Jan 19 00:39:27 server kernel: [] math_state_restore [kernel] 0x19
Jan 19 00:39:27 server squid[14038]: Squid Parent: child process 14782 started
Jan 19 00:39:27 server kernel: [system_call+51/64] system_call [kernel] 0x33
Jan 19 00:39:27 server squid[14038]: Squid Parent: child process 14782 exited due to signal 11
Jan 19 00:39:27 server kernel: [] system_call [kernel] 0x33
Jan 19 00:39:27 server kernel:
Jan 19 00:39:27 server kernel:
Jan 19 00:39:27 server kernel: Code: 8b 44 81 18 0f af da 89 41 14 01 eb 40 75 16 8b 41 04 8b 11
Jan 19 00:39:27 server kernel:  <1>Unable to handle kernel paging request at virtual address e1c6001c
Jan 19 00:39:27 server kernel:  printing eip:
Jan 19 00:39:27 server kernel: c012e82c
Jan 19 00:39:27 server kernel: *pde = 00000000
Jan 19 00:39:27 server kernel: Oops: 0000
Jan 19 00:39:27 server kernel: appletalk ipsec 3c59x ipt_MASQUERADE ipt_state ipt_TOS ip_conntrack_pptp ip_na
Jan 19 00:39:27 server kernel: CPU:    0
Jan 19 00:39:27 server kernel: EIP:    0010:[kmem_cache_alloc+140/208]    Tainted: P
Jan 19 00:39:27 server kernel: EIP:    0010:[]    Tainted: P
Jan 19 00:39:27 server kernel: EFLAGS: 00010006
Jan 19 00:39:27 server kernel:
Jan 19 00:39:27 server kernel: EIP is at kmem_cache_alloc [kernel] 0x8c (2.4.18-5)
Jan 19 00:39:28 server kernel: eax: 08000001   ebx: 08000001   ecx: c1c60000   edx: 00000500
Jan 19 00:39:28 server kernel: esi: 00000246   edi: c1276440   ebp: c1c60040   esp: c5495ee0
Jan 19 00:39:28 server kernel: ds: 0018   es: 0018   ss: 0018
Jan 19 00:39:29 server kernel: Process squid (pid: 14782, stackpage=c5495000)
Jan 19 00:39:29 server kernel: Stack: c5495f00 00000010 c9ad9b04 c5495f00 ca038d44 00000000 ffffff9f ca038d44
Jan 19 00:39:29 server kernel:        c01c5c72 c1276440 000001f0 ca038d44 ffffff9f c01fecd1 00000002 000001f0
Jan 19 00:39:29 server kernel:        00000001 ca038d44 00000000 ffffff9f c03646a0 c01c41f7 ca038d44 00000000
Jan 19 00:39:29 server kernel: Call Trace: [sk_alloc+18/96] sk_alloc [kernel] 0x12
Jan 19 00:39:29 server kernel: Call Trace: [] sk_alloc [kernel] 0x12
Jan 19 00:39:29 server kernel: [inet_create+33/512] inet_create [kernel] 0x21
Jan 19 00:39:29 server kernel: [] inet_create [kernel] 0x21
Jan 19 00:39:29 server kernel: [sock_create+215/256] sock_create [kernel] 0xd7
Jan 19 00:39:29 server kernel: [] sock_create [kernel] 0xd7
Jan 19 00:39:29 server kernel: [inet_setsockopt+37/48] inet_setsockopt [kernel] 0x25
Jan 19 00:39:29 server kernel: [] inet_setsockopt [kernel] 0x25
Jan 19 00:39:29 server kernel: [sys_setsockopt+84/112] sys_setsockopt [kernel] 0x54
Jan 19 00:39:29 server kernel: [] sys_setsockopt [kernel] 0x54
Jan 19 00:39:29 server kernel: [sys_socket+25/80] sys_socket [kernel] 0x19
Jan 19 00:39:29 server kernel: [] sys_socket [kernel] 0x19
Jan 19 00:39:29 server kernel: [sys_socketcall+108/528] sys_socketcall [kernel] 0x6c
Jan 19 00:39:29 server kernel: [] sys_socketcall [kernel] 0x6c
Jan 19 00:39:29 server kernel: [math_state_restore+25/64] math_state_restore [kernel] 0x19
Jan 19 00:39:29 server kernel: [] math_state_restore [kernel] 0x19
Jan 19 00:39:29 server kernel: [system_call+51/64] system_call [kernel] 0x33
Jan 19 00:39:29 server kernel: [] system_call [kernel] 0x33
Jan 19 00:39:29 server kernel:
Jan 19 00:39:29 server kernel:
Jan 19 00:39:29 server kernel: Code: 8b 44 81 18 0f af da 89 41 14 01 eb 40 75 16 8b 41 04 8b 11
Jan 19 00:39:30 server squid[14038]: Squid Parent: child process 14786 started
Jan 19 00:39:30 server kernel:  <1>Unable to handle kernel paging request at virtual address e1c6001c
Jan 19 00:39:30 server kernel:  printing eip:
Jan 19 00:39:30 server kernel: c012e82c
Jan 19 00:39:30 server kernel: *pde = 00000000
Jan 19 00:39:30 server kernel: Oops: 0000
Jan 19 00:39:30 server kernel: appletalk ipsec 3c59x ipt_MASQUERADE ipt_state ipt_TOS ip_conntrack_pptp ip_na
Jan 19 00:39:30 server kernel: CPU:    0
Jan 19 00:39:30 server kernel: EIP:    0010:[kmem_cache_alloc+140/208]    Tainted: P
Jan 19 00:39:30 server kernel: EIP:    0010:[]    Tainted: P
Jan 19 00:39:30 server kernel: EFLAGS: 00010002
Jan 19 00:39:30 server kernel:
Jan 19 00:39:30 server kernel: EIP is at kmem_cache_alloc [kernel] 0x8c (2.4.18-5)
Jan 19 00:39:30 server squid[14038]: Squid Parent: child process 14786 exited due to signal 11
Jan 19 00:39:32 server kernel: eax: 08000001   ebx: 08000001   ecx: c1c60000   edx: 00000500
Jan 19 00:39:32 server kernel: esi: 00000246   edi: c1276440   ebp: c1c60040   esp: c9a79ee0
Jan 19 00:39:32 server kernel: ds: 0018   es: 0018   ss: 0018
Jan 19 00:39:32 server kernel: Process squid (pid: 14786, stackpage=c9a79000)
Jan 19 00:39:33 server kernel: Stack: c9a79f00 00000010 c15d2704 c9a79f00 c38d7d44 00000000 ffffff9f c38d7d44
Jan 19 00:39:33 server kernel:        c01c5c72 c1276440 000001f0 c38d7d44 ffffff9f c01fecd1 00000002 000001f0
Jan 19 00:39:33 server kernel:        00000001 c38d7d44 00000000 ffffff9f c03646a0 c01c41f7 c38d7d44 00000000
Jan 19 00:39:33 server kernel: Call Trace: [sk_alloc+18/96] sk_alloc [kernel] 0x12
Jan 19 00:39:33 server kernel: Call Trace: [] sk_alloc [kernel] 0x12
Jan 19 00:39:33 server kernel: [inet_create+33/512] inet_create [kernel] 0x21
Jan 19 00:39:33 server kernel: [] inet_create [kernel] 0x21
Jan 19 00:39:33 server kernel: [sock_create+215/256] sock_create [kernel] 0xd7
Jan 19 00:39:34 server kernel: [] sock_create [kernel] 0xd7
Jan 19 00:39:34 server kernel: [inet_setsockopt+37/48] inet_setsockopt [kernel] 0x25
Jan 19 00:42:30 server syslogd 1.4.1: restart.

[Luke]

My guess would be bad hardware.

Try replacing memory and/or the Hard drive to start with and see if that improves matters.

Regards,
Luke