.
问候,其他管理员.我希望能够揭开困扰我公司机器之一的OOM杀戮.我无法决定他们是否是合法的OOM.
问候,其他管理员.我希望能够揭开困扰我公司机器之一的OOM杀戮.我无法决定他们是否是合法的OOM.
它是Centos 6.x,内核为2.6.32-279.1.1.el6.x86_64.
Ram 8 gb,cpu athlon2-x4.
大过程是mysql和vmware player 4,最大分别为2和4 GB的ram不断分配加上一些开销. (Vmware因为它的大小而被杀死了.)
还有除了这两个之外的守护进程,但它们非常小,而且装载非常轻,所以我不明白剩下的1 / 1.5演出的ram会消失在哪里,不计算巨大的交换……
此外,杀戮只发生在夜间运行备份cronjobs时. (这些是带有标准工具的简单shell脚本,可以转储一些数据库并压缩一些Web和邮箱目录.)
例如,在这里,它正在执行一个MysqLdump – 这是第一次在这个特定任务中发生.
它几乎每次都会发生,当你运行一个大目录树的rsyncs或zips(大约100万个小文件)时,也会发生’页面分配失败’.但是我用zfs把所有这些都移到了另一台机器上：在这个操作之后,杀手让我一个人呆了一会儿……
我讨厌在经历了几个月的问题,阅读并重新阅读互联网上的每一个帖子之后,我仍然无法将信息与我的案例联系起来.
有交换,为什么它不交换而不是杀戮？谁拿走了所有的公羊呢？ (一开始有几个合法的内存泄漏,我得到了它们.)也不能分裂,因为失败的请求是零序.
我在实际的kill日志之前粘贴了一些数据：
vm.swappiness = 100 vm.vfs_cache_pressure = 5000 vm.min_free_kbytes = 262144
(这些我加入尝试修复它,它们可能有点极端,但无论如何它都能顺利运行)
我用overcommit_memory = 2也试验了徒劳的尝试.是不应该禁用杀手？
这是系统的正常内存状态.
请注意,由于mmap-ed vmem,vmware的ram计为缓存.
顺便说一句,vmware设置为允许回收/交换vm内存.它永远不会这样做.
total used free shared buffers cached
Mem: 7800792 7400032 400760 0 61100 4449196
-/+ buffers/cache: 2889736 4911056
Swap: 8388600 761588 7627012
SwapCached: 286648 kB
PageTables: 40200 kB
CommitLimit: 15409312 kB
Committed_AS: 8099460 kB
AnonHugePages: 192512 kB
Node 0,zone DMA 4 1 1 3 1 1 0 0 1 1 3
Node 0,zone DMA32 378 1476 2541 1491 328 240 74 28 8 0 0
Node 0,zone Normal 1555 124 956 1825 659 175 54 31 15 0 0
最后,OOM：
Jan 2 21:37:38 : vmware-vmx invoked oom-killer: gfp_mask=0xd0,order=0,oom_adj=0,oom_score_adj=0 Jan 2 21:37:38 : vmware-vmx cpuset=/ mems_allowed=0 Jan 2 21:37:38 : Pid: 19635,comm: vmware-vmx Not tainted 2.6.32-279.1.1.el6.x86_64 #1 Jan 2 21:37:38 : Call Trace: Jan 2 21:37:38 : [] ? cpuset_print_task_mems_allowed+0x91/0xb0 Jan 2 21:37:38 : [] ? dump_header+0x90/0x1b0 Jan 2 21:37:38 : [] ? __delayacct_freepages_end+0x2e/0x30 Jan 2 21:37:38 : [] ? security_real_capable_noaudit+0x3c/0x70 Jan 2 21:37:38 : [] ? oom_kill_process+0x82/0x2a0 Jan 2 21:37:38 : [] ? select_bad_process+0xe1/0x120 Jan 2 21:37:38 : [] ? out_of_memory+0x220/0x3c0 Jan 2 21:37:38 : [] ? __alloc_pages_nodemask+0x89e/0x940 Jan 2 21:37:38 : [] ? alloc_pages_current+0xaa/0x110 Jan 2 21:37:38 : [] ? __get_free_pages+0xe/0x50 Jan 2 21:37:38 : [] ? __pollwait+0xb4/0xf0 Jan 2 21:37:38 : [] ? eventfd_poll+0x7d/0x80 Jan 2 21:37:38 : [] ? do_sys_poll+0x29b/0x520 Jan 2 21:37:38 : [] ? __pollwait+0x0/0xf0 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? pollwake+0x0/0x60 Jan 2 21:37:38 : [] ? read_tsc+0x9/0x20 Jan 2 21:37:38 : [] ? ktime_get_ts+0xa9/0xe0 Jan 2 21:37:38 : [] ? poll_select_set_timeout+0x8d/0xa0 Jan 2 21:37:38 : [] ? sys_ppoll+0x4c/0x180 Jan 2 21:37:38 : [] ? system_call_fastpath+0x16/0x1b Jan 2 21:37:38 : Mem-Info: Jan 2 21:37:38 : Node 0 DMA per-cpu: Jan 2 21:37:38 : cpu 0: hi: 0,btch: 1 usd: 0 Jan 2 21:37:38 : cpu 1: hi: 0,btch: 1 usd: 0 Jan 2 21:37:38 : cpu 2: hi: 0,btch: 1 usd: 0 Jan 2 21:37:38 : cpu 3: hi: 0,btch: 1 usd: 0 Jan 2 21:37:38 : Node 0 DMA32 per-cpu: Jan 2 21:37:38 : cpu 0: hi: 186,btch: 31 usd: 175 Jan 2 21:37:38 : cpu 1: hi: 186,btch: 31 usd: 40 Jan 2 21:37:38 : cpu 2: hi: 186,btch: 31 usd: 180 Jan 2 21:37:38 : cpu 3: hi: 186,btch: 31 usd: 152 Jan 2 21:37:38 : Node 0 Normal per-cpu: Jan 2 21:37:38 : cpu 0: hi: 186,btch: 31 usd: 170 Jan 2 21:37:38 : cpu 1: hi: 186,btch: 31 usd: 67 Jan 2 21:37:38 : cpu 2: hi: 186,btch: 31 usd: 108 Jan 2 21:37:38 : cpu 3: hi: 186,btch: 31 usd: 63 Jan 2 21:37:38 : active_anon:1467089 inactive_anon:263165 isolated_anon:64 Jan 2 21:37:38 : active_file:12404 inactive_file:65792 isolated_file:96 Jan 2 21:37:38 : unevictable:2 dirty:66080 writeback:1 unstable:0 Jan 2 21:37:38 : free:73888 slab_reclaimable:8971 slab_unreclaimable:10661 Jan 2 21:37:38 : mapped:780904 shmem:1035969 pagetables:10566 bounce:0 Jan 2 21:37:38 : Node 0 DMA free:15688kB min:500kB low:624kB high:748kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15284kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Jan 2 21:37:38 : lowmem_reserve[]: 0 3254 7799 7799 Jan 2 21:37:38 : Node 0 DMA32 free:127608kB min:109180kB low:136472kB high:163768kB active_anon:2209600kB inactive_anon:441980kB active_file:35784kB inactive_file:207948kB unevictable:8kB isolated(anon):0kB isolated(file):256kB present:3333024kB mlocked:8kB dirty:211888kB writeback:0kB mapped:955900kB shmem:1376604kB slab_reclaimable:20276kB slab_unreclaimable:6460kB kernel_stack:488kB pagetables:8856kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:580800 all_unreclaimable? no Jan 2 21:37:38 : lowmem_reserve[]: 0 0 4545 4545 Jan 2 21:37:38 : Node 0 Normal free:152256kB min:152456kB low:190568kB high:228684kB active_anon:3658756kB inactive_anon:610680kB active_file:13832kB inactive_file:55220kB unevictable:0kB isolated(anon):256kB isolated(file):128kB present:4654080kB mlocked:0kB dirty:52432kB writeback:4kB mapped:2167716kB shmem:2767272kB slab_reclaimable:15608kB slab_unreclaimable:36184kB kernel_stack:3016kB pagetables:33408kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:410848 all_unreclaimable? no Jan 2 21:37:38 : lowmem_reserve[]: 0 0 0 0 Jan 2 21:37:38 : Node 0 DMA: 4*4kB 1*8kB 1*16kB 3*32kB 1*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15688kB Jan 2 21:37:38 : Node 0 DMA32: 240*4kB 925*8kB 1553*16kB 748*32kB 253*64kB 152*128kB 56*256kB 28*512kB 6*1024kB 0*2048kB 0*4096kB = 127608kB Jan 2 21:37:38 : Node 0 Normal: 1155*4kB 1362*8kB 2962*16kB 860*32kB 330*64kB 113*128kB 23*256kB 18*512kB 9*1024kB 1*2048kB 0*4096kB = 152380kB Jan 2 21:37:38 : 1162322 total pagecache pages Jan 2 21:37:38 : 48040 pages in swap cache Jan 2 21:37:38 : Swap cache stats: add 3148787,delete 3100747,find 1726176/2015458 Jan 2 21:37:38 : Free swap = 7750696kB Jan 2 21:37:38 : Total swap = 8388600kB Jan 2 21:37:38 : 2031600 pages RAM Jan 2 21:37:38 : 81402 pages reserved Jan 2 21:37:38 : 1987047 pages shared Jan 2 21:37:38 : 707527 pages non-shared Jan 2 21:37:38 : [ pid ] uid tgid total_vm RSS cpu oom_adj oom_score_adj name Jan 2 21:37:38 : [ 457] 0 457 2673 90 1 -17 -1000 udevd Jan 2 21:37:38 : [ 1261] 0 1261 62271 293 0 0 0 rsyslogd Jan 2 21:37:38 : [ 1275] 0 1275 1171 91 0 0 0 mdadm Jan 2 21:37:38 : [ 1284] 81 1284 5382 159 1 0 0 dbus-daemon Jan 2 21:37:38 : [ 1295] 70 1295 6946 160 2 0 0 avahi-daemon Jan 2 21:37:38 : [ 1296] 70 1296 6914 27 1 0 0 avahi-daemon Jan 2 21:37:38 : [ 1344] 68 1344 6292 346 0 0 0 hald Jan 2 21:37:38 : [ 1345] 0 1345 4524 152 0 0 0 hald-runner Jan 2 21:37:38 : [ 1391] 0 1391 5053 87 2 0 0 hald-addon-inpu Jan 2 21:37:38 : [ 1406] 0 1406 6014 103 2 0 0 vmware-usbarbit Jan 2 21:37:38 : [ 1420] 0 1420 16028 119 1 -17 -1000 sshd Jan 2 21:37:38 : [ 1439] 38 1439 7539 146 0 0 0 ntpd Jan 2 21:37:38 : [ 1483] 0 1483 29309 135 2 0 0 crond Jan 2 21:37:38 : [ 1494] 0 1494 5362 47 2 0 0 atd Jan 2 21:37:38 : [ 1511] 501 1511 25371 5751 1 0 0 Xvnc Jan 2 21:37:38 : [ 1521] 501 1521 26513 66 0 0 0 sh Jan 2 21:37:38 : [ 1532] 512 1532 21634 461 0 0 0 Xvnc Jan 2 21:37:38 : [ 1541] 501 1541 5006 82 1 0 0 dbus-launch Jan 2 21:37:38 : [ 1542] 501 1542 5382 141 2 0 0 dbus-daemon Jan 2 21:37:38 : [ 1546] 501 1546 5629 283 0 0 0 xfconfd Jan 2 21:37:38 : [ 1551] 501 1551 28034 71 3 0 0 gpg-agent Jan 2 21:37:38 : [ 1561] 501 1561 57668 351 1 0 0 xfce4-session Jan 2 21:37:38 : [ 1565] 501 1565 49604 290 2 0 0 xfsettingsd Jan 2 21:37:38 : [ 1567] 501 1567 55385 549 1 0 0 xfwm4 Jan 2 21:37:38 : [ 1569] 501 1569 59719 1148 2 0 0 xfce4-panel Jan 2 21:37:38 : [ 1571] 501 1571 56642 311 1 0 0 Thunar Jan 2 21:37:38 : [ 1573] 501 1573 81823 695 3 0 0 xfdesktop Jan 2 21:37:38 : [ 1582] 501 1582 56799 339 1 0 0 xfce4-settings- Jan 2 21:37:38 : [ 1584] 0 1584 520550 188 1 0 0 console-kit-dae Jan 2 21:37:38 : [ 1650] 501 1650 55456 487 3 0 0 panel-6-systray Jan 2 21:37:38 : [ 1654] 512 1654 26513 65 0 0 0 sh Jan 2 21:37:38 : [ 1669] 512 1669 5006 68 2 0 0 dbus-launch Jan 2 21:37:38 : [ 1670] 512 1670 5383 135 0 0 0 dbus-daemon Jan 2 21:37:38 : [ 1674] 512 1674 5629 264 3 0 0 xfconfd Jan 2 21:37:38 : [ 1680] 512 1680 28034 70 3 0 0 gpg-agent Jan 2 21:37:38 : [ 1683] 500 1683 27549 6909 2 0 0 Xvnc Jan 2 21:37:38 : [ 1694] 512 1694 57667 346 2 0 0 xfce4-session Jan 2 21:37:38 : [ 1699] 512 1699 55386 461 1 0 0 xfwm4 Jan 2 21:37:38 : [ 1701] 512 1701 66152 1404 2 0 0 xfce4-panel Jan 2 21:37:38 : [ 1703] 512 1703 56617 235 0 0 0 Thunar Jan 2 21:37:38 : [ 1705] 512 1705 85537 529 1 0 0 xfdesktop Jan 2 21:37:38 : [ 1707] 512 1707 49604 285 1 0 0 xfsettingsd Jan 2 21:37:38 : [ 1715] 512 1715 56799 312 0 0 0 xfce4-settings- Jan 2 21:37:38 : [ 1717] 512 1717 55456 438 3 0 0 panel-4-systray Jan 2 21:37:38 : [ 1721] 500 1721 26513 66 0 0 0 sh Jan 2 21:37:38 : [ 1740] 500 1740 5006 68 1 0 0 dbus-launch Jan 2 21:37:38 : [ 1741] 500 1741 5383 167 2 0 0 dbus-daemon Jan 2 21:37:38 : [ 1745] 500 1745 5629 275 1 0 0 xfconfd Jan 2 21:37:38 : [ 1757] 500 1757 28070 139 3 0 0 gpg-agent Jan 2 21:37:38 : [ 1758] 0 1758 1542 83 3 0 0 pptpd Jan 2 21:37:38 : [ 1774] 500 1774 57667 356 0 0 0 xfce4-session Jan 2 21:37:38 : [ 1779] 500 1779 55674 785 2 0 0 xfwm4 Jan 2 21:37:38 : [ 1781] 500 1781 65790 1363 1 0 0 xfce4-panel Jan 2 21:37:38 : [ 1783] 500 1783 82194 451 0 0 0 Thunar Jan 2 21:37:38 : [ 1785] 500 1785 85642 813 2 0 0 xfdesktop Jan 2 21:37:38 : [ 1790] 500 1790 49604 283 2 0 0 xfsettingsd Jan 2 21:37:38 : [ 1800] 500 1800 38863 313 3 0 0 xterm Jan 2 21:37:38 : [ 1807] 500 1807 56798 353 3 0 0 xfce4-settings- Jan 2 21:37:38 : [ 1808] 500 1808 55456 470 1 0 0 panel-6-systray Jan 2 21:37:38 : [ 1811] 500 1811 27074 69 2 0 0 bash Jan 2 21:37:38 : [ 1823] 0 1823 4704 145 0 0 0 smartd Jan 2 21:37:38 : [ 1831] 0 1831 1014 48 2 0 0 mingetty Jan 2 21:37:38 : [ 1833] 0 1833 1014 48 0 0 0 mingetty Jan 2 21:37:38 : [ 1835] 0 1835 1014 48 1 0 0 mingetty Jan 2 21:37:38 : [ 1837] 0 1837 1014 48 2 0 0 mingetty Jan 2 21:37:38 : [ 1839] 0 1839 1014 49 3 0 0 mingetty Jan 2 21:37:38 : [ 1843] 0 1843 1014 48 0 0 0 mingetty Jan 2 21:37:38 : [ 2025] 0 2025 25340 59 2 0 0 vmnet-bridge Jan 2 21:37:38 : [ 2033] 0 2033 25333 15 1 0 0 vmnet-netifup Jan 2 21:37:38 : [ 2058] 0 2058 27069 101 0 0 0 vmnet-natd Jan 2 21:37:38 : [ 2060] 0 2060 25333 15 1 0 0 vmnet-netifup Jan 2 21:37:38 : [ 2097] 0 2097 30105 82 2 0 0 vmware-authdlau Jan 2 21:37:38 : [ 2981] 500 2981 36335 76 0 0 0 su Jan 2 21:37:38 : [ 2984] 0 2984 27074 233 1 0 0 bash Jan 2 21:37:38 : [ 6347] 500 6347 39207 406 2 0 0 xterm Jan 2 21:37:38 : [ 6349] 500 6349 27074 70 0 0 0 bash Jan 2 21:37:38 : [ 6407] 500 6407 36335 77 0 0 0 su Jan 2 21:37:38 : [ 6410] 0 6410 27074 251 0 0 0 bash Jan 2 21:37:38 : [ 6481] 0 6481 57857 154 0 0 0 MysqL Jan 2 21:37:38 : [ 6911] 0 6911 19820 120 1 0 0 master Jan 2 21:37:38 : [ 6914] 89 6914 19889 122 0 0 0 qmgr Jan 2 21:37:38 : [ 6918] 89 6918 19839 141 0 0 0 tlsmgr Jan 2 21:37:38 : [17572] 0 17572 103460 2142 3 0 0 Thunar Jan 2 21:37:38 : [21227] 500 21227 38801 594 0 0 0 xterm Jan 2 21:37:38 : [21229] 500 21229 27074 73 0 0 0 bash Jan 2 21:37:38 : [29713] 500 29713 36870 214 3 0 0 lftp Jan 2 21:37:38 : [32170] 500 32170 38815 184 0 0 0 xterm Jan 2 21:37:38 : [32172] 500 32172 27074 77 1 0 0 bash Jan 2 21:37:38 : [32189] 500 32189 36335 86 1 0 0 su Jan 2 21:37:38 : [32197] 0 32197 27074 93 1 0 0 bash Jan 2 21:37:38 : [16025] 0 16025 2070 89 3 0 0 pptpctrl Jan 2 21:37:38 : [16026] 0 16026 5544 108 1 0 0 pppd Jan 2 21:37:38 : [31174] 0 31174 27073 175 1 0 0 MysqLd_safe Jan 2 21:37:38 : [31909] 27 31909 1143356 587238 1 0 0 MysqLd Jan 2 21:37:38 : [32037] 0 32037 26546 169 0 0 0 MysqLd_safe Jan 2 21:37:38 : [32437] 495 32437 136524 7673 1 0 0 MysqLd Jan 2 21:37:38 : [32449] 0 32449 26546 169 2 0 0 MysqLd_safe Jan 2 21:37:38 : [ 368] 493 368 211813 3831 0 0 0 MysqLd Jan 2 21:37:38 : [ 884] 500 884 27074 310 1 0 0 bash Jan 2 21:37:38 : [ 1065] 501 1065 122130 2881 3 0 0 vmplayer Jan 2 21:37:38 : [ 2031] 500 2031 38570 281 0 0 0 xterm Jan 2 21:37:38 : [ 2034] 500 2034 27074 180 0 0 0 bash Jan 2 21:37:38 : [ 2051] 500 2051 36335 140 0 0 0 su Jan 2 21:37:38 : [ 2055] 0 2055 27074 181 2 0 0 bash Jan 2 21:37:38 : [16591] 501 16591 77851 712 3 0 0 vmware-unity-he Jan 2 21:37:38 : [16803] 0 16803 26883 237 1 0 0 watch Jan 2 21:37:38 : [19635] 501 19635 1693624 793343 1 0 0 vmware-vmx Jan 2 21:37:38 : [ 2186] 0 2186 38139 158 0 0 0 proftpd Jan 2 21:37:38 : [ 5289] 500 5289 38992 979 3 0 0 xterm Jan 2 21:37:38 : [ 5291] 500 5291 27074 188 2 0 0 bash Jan 2 21:37:38 : [ 5344] 500 5344 36335 148 1 0 0 su Jan 2 21:37:38 : [ 5361] 0 5361 27074 350 0 0 0 bash Jan 2 21:37:38 : [18529] 500 18529 26514 227 0 0 0 MysqL-workbench Jan 2 21:37:38 : [18534] 500 18534 26514 226 1 0 0 catchsegv Jan 2 21:37:38 : [18536] 500 18536 26514 77 2 0 0 catchsegv Jan 2 21:37:38 : [18537] 500 18537 227088 7571 2 0 0 MysqL-workbench Jan 2 21:37:38 : [ 409] 0 409 131527 1556 1 0 0 geany Jan 2 21:37:38 : [ 410] 0 410 2054 92 2 0 0 gnome-pty-helpe Jan 2 21:37:38 : [ 411] 0 411 27074 238 1 0 0 bash Jan 2 21:37:38 : [ 5750] 0 5750 2672 92 0 -17 -1000 udevd Jan 2 21:37:38 : [ 5753] 0 5753 2672 87 0 -17 -1000 udevd Jan 2 21:37:38 : [ 5788] 0 5788 10640 594 3 0 0 openvpn Jan 2 21:37:38 : [ 5792] 0 5792 10640 598 3 0 0 openvpn Jan 2 21:37:38 : [ 5800] 99 5800 11135 587 3 0 0 openvpn Jan 2 21:37:38 : [21552] 0 21552 110137 2111 1 0 0 httpd Jan 2 21:37:38 : [21555] 48 21555 139593 7684 3 0 0 httpd Jan 2 21:37:38 : [21558] 48 21558 140002 8513 3 0 0 httpd Jan 2 21:37:38 : [23283] 497 23283 9846 193 1 0 0 dkim-filter Jan 2 21:37:38 : [23284] 497 23284 33979 524 1 0 0 dkim-filter Jan 2 21:37:38 : [ 6819] 0 6819 2070 152 3 0 0 pptpctrl Jan 2 21:37:38 : [ 6820] 0 6820 5544 237 1 0 0 pppd Jan 2 21:37:39 : [17208] 48 17208 112903 4566 0 0 0 httpd Jan 2 21:37:39 : [17209] 48 17209 138359 5895 0 0 0 httpd Jan 2 21:37:39 : [17210] 48 17210 138693 7341 3 0 0 httpd Jan 2 21:37:39 : [ 1255] 0 1255 24571 713 0 0 0 sshd Jan 2 21:37:39 : [ 1278] 0 1278 13874 396 1 0 0 sftp-server Jan 2 21:37:39 : [14064] 48 14064 138202 6622 3 0 0 httpd Jan 2 21:37:39 : [14065] 48 14065 139625 7776 1 0 0 httpd Jan 2 21:37:39 : [16899] 48 16899 138543 7523 3 0 0 httpd Jan 2 21:37:39 : [32639] 89 32639 19924 722 0 0 0 pickup Jan 2 21:37:39 : [ 4973] 48 4973 136179 4973 3 0 0 httpd Jan 2 21:37:39 : [ 4976] 48 4976 138478 7371 0 0 0 httpd Jan 2 21:37:39 : [ 4977] 48 4977 136173 4777 3 0 0 httpd Jan 2 21:37:39 : [ 5662] 0 5662 35030 336 0 0 0 crond Jan 2 21:37:39 : [ 5663] 0 5663 2297 282 2 0 0 sh Jan 2 21:37:39 : [ 5664] 0 5664 2298 302 0 0 0 bash Jan 2 21:37:39 : [ 5665] 0 5665 15910 437 0 0 0 mutt Jan 2 21:37:39 : [ 5947] 0 5947 2298 337 1 0 0 bash Jan 2 21:37:39 : [ 6416] 48 6416 110170 2070 3 0 0 httpd Jan 2 21:37:39 : [ 6625] 48 6625 110170 1895 0 0 0 httpd Jan 2 21:37:39 : [ 6642] 0 6642 32679 1632 2 0 0 MysqLdump Jan 2 21:37:39 : Out of memory: Kill process 19635 (vmware-vmx) score 199 or sacrifice child Jan 2 21:37:39 : Killed process 19635,UID 501,(vmware-vmx) total-vm:6774496kB,anon-RSS:74020kB,file-RSS:3099352kB
解决方法
好吧,我认为你的min_free_kbytes非常高.我有一台16GB的机器,我的分钟是67584kB.
Note that vmware’s ram counts as cache,because of the mmap-ed vmem
那并不总是如此.只有在MAP_SHARED中打开mmapped()文件才是真的.其他脏页是交换支持的.这似乎是你的情况.如果您将输出底部给出的该过程的报告用法相加,并将其转换为页面(4k).它等于该进程的任务转储中报告的RSS.
RSS:74020kB,file-RSS:3099352kB 74020 + 3099352 = 3173372 3173372 / 4 = 793343
等于..
[19635] 501 19635 1693624 793343 1 0 0 vmware-vmx
至于为什么你OOM杀了.嗯,这有点棘手.
当你达到min时,内核想要恢复高水印字节的内存.因此内核有一个检查;如果可以从文件缓存中回收的内存量不足以让你回到该区域的高水位,它就不会费心去掉文件缓存并直接从匿名内存中回收.
我们永远不会从活跃中回收.所以 –
if (file_inactive > zone_high - free_mem) then reclaim (zone_high - free_mem) file inactive pages else reclaim from anonymous pool
在你的情况下,55220不大于228684-152456(76428).
这是OOM-Kill而不是交换的原因是因为当你突破最小水印时内核进入direct_reclaim模式.在此模式下,无法完成IO以释放内存,因为它可能导致死锁.
你当时主持人会进行交换,但是你的主机分配速度比它可以换出的速度快.