php-cgi invoked oom-killer ?

[ozgurerdogan]

I see this in messages log file and all sites are unavaliable and I have to restart server. I guess something is beating all memory. But how can I find what or which site is causing this.

Apr 23 19:18:21 lnx3-4 kernel: Free pages: 29972kB (484kB HighMem)
Apr 23 19:18:21 lnx3-4 kernel: Active:192579 inactive:131966 dirty:0 writeback:756 unstable:0 free:7493 slab:13872 mapped-file:2 mapped-anon:340773 pagetables:14439
Apr 23 19:18:21 lnx3-4 kernel: DMA free:6048kB min:68kB low:84kB high:100kB active:128kB inactive:3700kB present:16384kB pages_scanned:431380 all_unreclaimable? yes
Apr 23 19:18:21 lnx3-4 kernel: lowmem_reserve[]: 0 0 880 1495
Apr 23 19:18:21 lnx3-4 kernel: DMA32 free:0kB min:0kB low:0kB high:0kB active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
Apr 23 19:18:21 lnx3-4 kernel: lowmem_reserve[]: 0 0 880 1495
Apr 23 19:18:21 lnx3-4 kernel: Normal free:23440kB min:3756kB low:4692kB high:5632kB active:470920kB inactive:262300kB present:901120kB pages_scanned:15296820 all_unreclaimable? yes
Apr 23 19:18:21 lnx3-4 kernel: lowmem_reserve[]: 0 0 0 4927
Apr 23 19:18:22 lnx3-4 kernel: HighMem free:484kB min:512kB low:1168kB high:1824kB active:299112kB inactive:261996kB present:630776kB pages_scanned:9474758 all_unreclaimable? yes
Apr 23 19:18:22 lnx3-4 kernel: lowmem_reserve[]: 0 0 0 0
Apr 23 19:18:22 lnx3-4 kernel: DMA: 0*4kB 0*8kB 2*16kB 0*32kB 0*64kB 7*128kB 2*256kB 1*512kB 0*1024kB 0*2048kB 1*4096kB = 6048kB
Apr 23 19:18:22 lnx3-4 kernel: DMA32: empty
Apr 23 19:18:22 lnx3-4 kernel: Normal: 30*4kB 103*8kB 18*16kB 420*32kB 61*64kB 4*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 1*4096kB = 23440kB
Apr 23 19:18:22 lnx3-4 kernel: HighMem: 17*4kB 4*8kB 0*16kB 0*32kB 0*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 484kB
Apr 23 19:18:22 lnx3-4 kernel: 1805 pagecache pages
Apr 23 19:18:22 lnx3-4 kernel: Swap cache: add 2824722, delete 2823877, find 549565/767294, race 53+319
Apr 23 19:18:23 lnx3-4 kernel: Free swap = 0kB
Apr 23 19:18:23 lnx3-4 kernel: Total swap = 4192924kB
Apr 23 19:18:23 lnx3-4 kernel: Free swap: 0kB
Apr 23 19:18:23 lnx3-4 kernel: 387070 pages of RAM
Apr 23 19:18:23 lnx3-4 kernel: 157694 pages of HIGHMEM
Apr 23 19:18:23 lnx3-4 kernel: 4354 reserved pages
Apr 23 19:18:23 lnx3-4 kernel: 115571 pages shared
Apr 23 19:18:23 lnx3-4 kernel: 845 pages swap cached
Apr 23 19:18:24 lnx3-4 kernel: 0 pages dirty
Apr 23 19:18:24 lnx3-4 kernel: 756 pages writeback
Apr 23 19:18:24 lnx3-4 kernel: 2 pages mapped
Apr 23 19:18:24 lnx3-4 kernel: 13872 pages slab
Apr 23 19:18:24 lnx3-4 kernel: 14439 pages pagetables
Apr 23 19:18:24 lnx3-4 kernel: Out of memory: Killed process 3562, UID 101, (httpd).
Apr 23 19:18:24 lnx3-4 kernel: php-cgi invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0
Apr 23 19:18:25 lnx3-4 kernel: [<c045bf47>] out_of_memory+0x72/0x1a3
Apr 23 19:18:25 lnx3-4 kernel: [<c045d4ae>] __alloc_pages+0x24e/0x2cf
Apr 23 19:18:25 lnx3-4 kernel: [<c045e7a7>] __do_page_cache_readahead+0xc4/0x183
Apr 23 19:18:25 lnx3-4 kernel: [<c045b4c2>] filemap_nopage+0x157/0x349
Apr 23 19:18:25 lnx3-4 kernel: [<c0464926>] __handle_mm_fault+0x177/0xaac
Apr 23 19:18:25 lnx3-4 kernel: [<c061f39e>] do_page_fault+0x23a/0x52d
Apr 23 19:18:25 lnx3-4 kernel: [<c061f164>] do_page_fault+0x0/0x52d
Apr 23 19:18:25 lnx3-4 kernel: [<c0405a89>] error_code+0x39/0x40

 

[zEitEr]

Hello,

You might need to enable server-status, install munin, read more logs, or hire somebody to do that for you.

 

[ozgurerdogan]

Ok thank. Servers want more ram, after feeding her, all are fine again