Topic: Server Problem Locksup Every 7 days at about same time.

[wetumka_ok]

Please look at the included log, please let me know if anyone can advise to why this is happening, I have to restart this server every Sunday because, of this.

Dec 16 13:47:40 casinosvr kernel: Free pages:         304kB (0kB HighMem)
Dec 16 13:47:40 casinosvr kernel: Active:12666 inactive:5316 dirty:0 writeback:0 unstable:0 free:76 slab:2267 mapped:18575 pagetables:924
Dec 16 13:47:40 casinosvr kernel: DMA free:52kB min:52kB low:104kB high:156kB active:6260kB inactive:5252kB present:16384kB pages_scanned:55774 all_unreclaimable? yes
Dec 16 13:47:40 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:47:40 casinosvr kernel: Normal free:252kB min:260kB low:520kB high:780kB active:44404kB inactive:16012kB present:81920kB pages_scanned:512559 all_unreclaimable? yes
Dec 16 13:47:40 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:47:40 casinosvr kernel: HighMem free:0kB min:128kB low:256kB high:384kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Dec 16 13:47:40 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:47:40 casinosvr kernel: DMA: 3*4kB 3*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 52kB
Dec 16 13:47:40 casinosvr kernel: Normal: 19*4kB 10*8kB 4*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
Dec 16 13:47:40 casinosvr kernel: HighMem: empty
Dec 16 13:47:40 casinosvr kernel: Swap cache: add 286901, delete 286667, find 177667/208011, race 0+440
Dec 16 13:47:41 casinosvr kernel: 0 bounce buffer pages
Dec 16 13:47:41 casinosvr kernel: Free swap:            0kB
Dec 16 13:47:41 casinosvr kernel: 24576 pages of RAM
Dec 16 13:47:41 casinosvr kernel: 0 pages of HIGHMEM
Dec 16 13:47:41 casinosvr kernel: 1208 reserved pages
Dec 16 13:47:41 casinosvr kernel: 13264 pages shared
Dec 16 13:47:41 casinosvr kernel: 234 pages swap cached
Dec 16 13:47:41 casinosvr kernel: Out of Memory: Killed process 3113 (squid).
Dec 16 13:47:42 casinosvr kernel: oom-killer: gfp_mask=0x1d2
Dec 16 13:47:42 casinosvr kernel: Mem-info:
Dec 16 13:47:42 casinosvr kernel: DMA per-cpu:
Dec 16 13:47:42 casinosvr kernel: cpu 0 hot: low 2, high 6, batch 1
Dec 16 13:47:42 casinosvr kernel: cpu 0 cold: low 0, high 2, batch 1
Dec 16 13:47:42 casinosvr kernel: Normal per-cpu:
Dec 16 13:47:42 casinosvr kernel: cpu 0 hot: low 10, high 30, batch 5
Dec 16 13:47:42 casinosvr kernel: cpu 0 cold: low 0, high 10, batch 5
Dec 16 13:47:42 casinosvr kernel: HighMem per-cpu: empty
Dec 16 13:47:42 casinosvr kernel:
Dec 16 13:47:42 casinosvr kernel: Free pages:         304kB (0kB HighMem)
Dec 16 13:47:42 casinosvr kernel: Active:10036 inactive:9105 dirty:0 writeback:0 unstable:0 free:76 slab:2267 mapped:18575 pagetables:924
Dec 16 13:47:42 casinosvr kernel: DMA free:52kB min:52kB low:104kB high:156kB active:7504kB inactive:4008kB present:16384kB pages_scanned:74815 all_unreclaimable? yes
Dec 16 13:47:42 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:47:42 casinosvr kernel: Normal free:252kB min:260kB low:520kB high:780kB active:32640kB inactive:32412kB present:81920kB pages_scanned:656568 all_unreclaimable? yes
Dec 16 13:47:42 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:47:42 casinosvr kernel: HighMem free:0kB min:128kB low:256kB high:384kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Dec 16 13:48:14 casinosvr kernel: protections[]: 0 0 0
Dec 16 13:48:14 casinosvr kernel: DMA: 3*4kB 3*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 52kB
Dec 16 13:48:15 casinosvr kernel: Normal: 19*4kB 10*8kB 4*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
Dec 16 13:48:38 casinosvr kernel: HighMem: empty
Dec 16 13:48:38 casinosvr kernel: Swap cache: add 286901, delete 286667, find 177667/208011, race 0+440
Dec 16 13:48:38 casinosvr kernel: 0 bounce buffer pages
Dec 16 13:50:03 casinosvr kernel: Free swap:            0kB
Dec 16 13:51:05 casinosvr kernel: 24576 pages of RAM
Dec 16 13:51:21 casinosvr kernel: 0 pages of HIGHMEM
Dec 16 13:51:21 casinosvr kernel: 1208 reserved pages
Dec 16 13:51:32 casinosvr kernel: 12119 pages shared
Dec 16 13:51:43 casinosvr kernel: 234 pages swap cached
Dec 16 13:52:31 casinosvr kernel: Out of Memory: Killed process 2735 (tinydns).
Dec 16 13:52:31 casinosvr kernel: httpd-admin: page allocation failure. order:0, mode:0xd2
Dec 16 13:53:35 casinosvr kernel:  [__alloc_pages+737/759] __alloc_pages+0x2e1/0x2f7
Dec 16 13:53:35 casinosvr kernel:  [<c014c4ad>] __alloc_pages+0x2e1/0x2f7
Dec 16 13:53:35 casinosvr kernel:  [anon_vma_prepare+31/447] anon_vma_prepare+0x1f/0x1bf
Dec 16 13:53:35 casinosvr kernel:  [<c015d03f>] anon_vma_prepare+0x1f/0x1bf
Dec 16 13:53:35 casinosvr kernel:  [do_wp_page+468/1058] do_wp_page+0x1d4/0x422
Dec 16 13:53:35 casinosvr kernel:  [<c0157871>] do_wp_page+0x1d4/0x422
Dec 16 13:53:35 casinosvr kernel:  [handle_mm_fault+289/509] handle_mm_fault+0x121/0x1fd
Dec 16 13:53:35 casinosvr kernel:  [<c0158a86>] handle_mm_fault+0x121/0x1fd
Dec 16 13:53:35 casinosvr kernel:  [do_page_fault+428/1244] do_page_fault+0x1ac/0x4dc
Dec 16 13:53:35 casinosvr kernel:  [<c011a9a5>] do_page_fault+0x1ac/0x4dc
Dec 16 13:53:35 casinosvr kernel:  [sys_rt_sigaction+221/242] sys_rt_sigaction+0xdd/0xf2
Dec 16 13:53:35 casinosvr kernel:  [<c013149d>] sys_rt_sigaction+0xdd/0xf2
Dec 16 13:53:35 casinosvr kernel:  [schedule+1080/1514] schedule+0x438/0x5ea
Dec 16 13:53:41 casinosvr kernel:  [<c030ebe4>] schedule+0x438/0x5ea
Dec 16 13:53:41 casinosvr kernel:  [do_IRQ+562/703] do_IRQ+0x232/0x2bf
Dec 16 13:53:41 casinosvr kernel:  [<c010888f>] do_IRQ+0x232/0x2bf
Dec 16 13:53:41 casinosvr kernel:  [do_page_fault+0/1244] do_page_fault+0x0/0x4dc
Dec 16 13:53:41 casinosvr kernel:  [<c011a7f9>] do_page_fault+0x0/0x4dc
Dec 16 13:53:41 casinosvr kernel:  [error_code+47/56] error_code+0x2f/0x38
Dec 16 13:53:41 casinosvr kernel:  [<c03115c7>] error_code+0x2f/0x38
Dec 16 13:53:41 casinosvr kernel: Mem-info:
Dec 16 13:53:41 casinosvr kernel: DMA per-cpu:
Dec 16 13:53:41 casinosvr kernel: cpu 0 hot: low 2, high 6, batch 1
Dec 16 13:53:41 casinosvr kernel: cpu 0 cold: low 0, high 2, batch 1
Dec 16 13:53:41 casinosvr kernel: Normal per-cpu:
Dec 16 13:53:41 casinosvr kernel: cpu 0 hot: low 10, high 30, batch 5
Dec 16 13:53:41 casinosvr kernel: cpu 0 cold: low 0, high 10, batch 5
Dec 16 13:53:41 casinosvr kernel: HighMem per-cpu: empty
Dec 16 13:53:41 casinosvr kernel:

[raem]

wetumka_ok

Dec 16 13:47:41 casinosvr kernel: Out of Memory: Killed process 3113 (squid).
Dec 16 13:52:31 casinosvr kernel: Out of Memory: Killed process 2735 (tinydns).

What is the system spec, CPU, RAM etc ?

Look at the cron jobs to see what is running every Sunday at the same time in /etc/cron.x
My guess is clamsan, try disabling it temporarily, if it appears to be the issue.

Add more RAM, reduce the number of processes running.

Use these commands to review processes

htop
top -i