[求助]!!!请教关于Apache吃资源的分析

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

1^# zxxz79 发表于 2007-07-15 12:09

[求助]!!!请教关于Apache吃资源的分析

架构是 squid2.6- apache2+php4 -oracle9i
发现web狂吃内存cpu，连swap也不放过

翻了14页的精华帖子又搜索都没找到关于高负载时分析方面的文章遇到高负载的时候可以通过什么途径查到是由什么那个程序页面访问引起的吗？

[Copy to clipboard] [ - ]

CODE:

top - 18:39:20 up 58 days, 18:05,  2 users,  load average: 4.31, 4.09, 3.67
Tasks:  95 total, 3 running,  92 sleeping, 0 stopped, 0 zombie
Cpu0  : 11.6% us, 88.4% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu1  :  1.7% us, 98.3% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu2  :  0.3% us, 99.7% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu3  :  0.0% us, 100.0% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Mem: 4148472k total,  4132636k used, 15836k free,    5336k buffers
Swap:  4192956k total,  4065316k used, 127640k free, 23760k cached

  PID USER    PR  NI  VIRT  RES  SHR S %CPU %MEM TIME+  COMMAND
14365 www 25 0  215m  32m 5208 S  100  0.8 474:13.21 httpd
14529 www 25 0  672m 230m 5220 S  100  5.7 215:39.31 httpd
15016 www 25 0  510m 448m 5240 S  100 11.1  14:47.97 httpd
14525 www 25 0  517m 140m 5220 R 88  3.5 273:02.09 httpd
15028 www 16 0  543m 483m 5220 S 3 11.9 2:11.56 httpd
15403 www 16 0 60840  45m 5200 S 3  1.1 0:06.23 httpd
15009 www 16 0  537m 472m 5224 S 2 11.7 2:07.71 httpd
15239 www 15 0  212m 198m 5216 S 1  4.9 0:39.03 httpd
15301 www 15 0  211m 197m 5244 S 1  4.9 0:37.62 httpd
15402 www 16 0 60232  44m 5184 S 1  1.1 0:06.55 httpd
15401 www 15 0 62372  46m 5180 S 1  1.2 0:06.39 httpd
15256 www 15 0  215m 201m 5220 S 0  5.0 0:38.43 httpd
15462 root    16 0  7724 2556 2080 R 0  0.1 0:00.11 sshd

[root@www3 ~]# ps aux|grep httpd
root    14333  0.0  0.0 19256 3860 ?       Ss 09:30 0:04 /usr/local/apache2/bin/httpd -k start
www 14343  0.1  0.7 220556 30208 ?    S 09:30 0:40 /usr/local/apache2/bin/httpd -k start
www 14349  0.1  0.7 222148 31408 ?    S 09:30 0:41 /usr/local/apache2/bin/httpd -k start
www 14360  0.1  0.7 233928 31968 ?    S 09:30 0:43 /usr/local/apache2/bin/httpd -k start
www 14364  0.1  0.6 214880 28044 ?    S 09:30 0:39 /usr/local/apache2/bin/httpd -k start
www 14365 86.3  0.8 220952 33632 ?    R 09:30 474:44 /usr/local/apache2/bin/httpd -k start
www 14367  0.1  0.7 224352 30812 ?    S 09:30 0:40 /usr/local/apache2/bin/httpd -k start
www 14368  0.1  0.7 229340 31960 ?    S 09:30 0:41 /usr/local/apache2/bin/httpd -k start
www 14376  0.1  0.7 222596 33096 ?    S 09:31 0:41 /usr/local/apache2/bin/httpd -k start
www 14494  0.0  0.8 89384 33964 ?    S 10:21 0:12 /usr/local/apache2/bin/httpd -k start
www 14521  0.0  0.1 25452 6080 ?       S 10:46 0:00 /usr/local/apache2/bin/httpd -k start
www 14523  0.0  0.1 24548 6080 ?       S 10:46 0:00 /usr/local/apache2/bin/httpd -k start
www 14524  0.5  5.3 679100 222900 ?    S 10:46 2:46 /usr/local/apache2/bin/httpd -k start
www 14525 57.7  3.4 529448 141780 ?    S 10:46 273:30 /usr/local/apache2/bin/httpd -k start
www 14527  0.0  0.1 22704 5908 ?       S 10:46 0:00 /usr/local/apache2/bin/httpd -k start
www 14529 45.6  5.6 688508 234832 ?    S 10:46 216:11 /usr/local/apache2/bin/httpd -k start
www 14530  0.0  0.1 23564 5992 ?       S 10:46 0:00 /usr/local/apache2/bin/httpd -k start
www 14554  0.5  5.4 662024 227196 ?    S 10:51 2:45 /usr/local/apache2/bin/httpd -k start
www 14555  0.4  3.1 515564 131148 ?    S 10:54 1:55 /usr/local/apache2/bin/httpd -k start
www 14721  0.1  1.6 196332 69236 ?    S 13:05 0:33 /usr/local/apache2/bin/httpd -k start
www 14924  0.1  1.4 169188 62048 ?    S 14:08 0:31 /usr/local/apache2/bin/httpd -k start
www 14925  0.1  1.4 160372 62092 ?    S 14:13 0:27 /usr/local/apache2/bin/httpd -k start
www 14926  0.1  1.1 141792 48640 ?    S 14:17 0:22 /usr/local/apache2/bin/httpd -k start
www 14984  0.0  0.1 22340 6668 ?       S 15:06 0:00 /usr/local/apache2/bin/httpd -k start
www 15009  1.0 11.6 552888 482968 ?    S 15:20 2:08 /usr/local/apache2/bin/httpd -k start
www 15016  7.6 11.0 522376 458776 ?    S 15:20  15:19 /usr/local/apache2/bin/httpd -k start
www 15028  1.1 11.9 558236 496952 ?    S 15:20 2:11 /usr/local/apache2/bin/httpd -k start
www 15140  0.8  6.5 309592 270540 ?    S 16:28 1:04 /usr/local/apache2/bin/httpd -k start
www 15239  0.8  4.9 220784 206096 ?    S 17:23 0:39 /usr/local/apache2/bin/httpd -k start
www 15251  0.8  4.8 215752 200992 ?    S 17:23 0:38 /usr/local/apache2/bin/httpd -k start
www 15256  0.8  5.0 222456 207888 ?    S 17:23 0:38 /usr/local/apache2/bin/httpd -k start
www 15301  0.8  4.9 218656 204180 ?    S 17:25 0:37 /usr/local/apache2/bin/httpd -k start
www 15401  0.8  1.2 65116 50492 ?    S 18:25 0:06 /usr/local/apache2/bin/httpd -k start
www 15402  0.8  1.1 61280 46728 ?    S 18:26 0:06 /usr/local/apache2/bin/httpd -k start
www 15403  0.8  1.1 62472 47844 ?    S 18:26 0:06 /usr/local/apache2/bin/httpd -k start

系统日志还报了这些错误，杀掉吃cpu跟内存的进程后恢复正常。

Jul 14 18:46:53 www3 kernel: oom-killer: gfp_mask=0xd0
Jul 14 18:46:53 www3 kernel: Mem-info:
Jul 14 18:46:53 www3 kernel: DMA per-cpu:
Jul 14 18:46:53 www3 kernel: cpu 0 hot: low 2, high 6, batch 1
Jul 14 18:46:53 www3 kernel: cpu 0 cold: low 0, high 2, batch 1
Jul 14 18:46:53 www3 kernel: cpu 1 hot: low 2, high 6, batch 1
Jul 14 18:46:53 www3 kernel: cpu 1 cold: low 0, high 2, batch 1
Jul 14 18:46:53 www3 kernel: cpu 2 hot: low 2, high 6, batch 1
Jul 14 18:46:53 www3 kernel: cpu 2 cold: low 0, high 2, batch 1
Jul 14 18:46:53 www3 kernel: cpu 3 hot: low 2, high 6, batch 1
Jul 14 18:46:53 www3 kernel: cpu 3 cold: low 0, high 2, batch 1
Jul 14 18:46:53 www3 kernel: Normal per-cpu:
Jul 14 18:46:53 www3 kernel: cpu 0 hot: low 32, high 96, batch 16
Jul 14 18:47:08 www3 kernel: cpu 0 cold: low 0, high 32, batch 16
Jul 14 18:47:09 www3 kernel: cpu 1 hot: low 32, high 96, batch 16
Jul 14 18:47:09 www3 kernel: cpu 1 cold: low 0, high 32, batch 16
Jul 14 18:47:09 www3 kernel: cpu 2 hot: low 32, high 96, batch 16
Jul 14 18:47:09 www3 kernel: cpu 2 cold: low 0, high 32, batch 16
Jul 14 18:47:09 www3 kernel: cpu 3 hot: low 32, high 96, batch 16
Jul 14 18:47:10 www3 kernel: cpu 3 cold: low 0, high 32, batch 16
Jul 14 18:47:10 www3 kernel: HighMem per-cpu:
Jul 14 18:47:10 www3 kernel: cpu 0 hot: low 32, high 96, batch 16
Jul 14 18:47:10 www3 kernel: cpu 0 cold: low 0, high 32, batch 16
Jul 14 18:47:10 www3 kernel: cpu 1 hot: low 32, high 96, batch 16
Jul 14 18:47:10 www3 kernel: cpu 1 cold: low 0, high 32, batch 16
Jul 14 18:47:10 www3 kernel: cpu 2 hot: low 32, high 96, batch 16
Jul 14 18:47:10 www3 kernel: cpu 2 cold: low 0, high 32, batch 16
Jul 14 18:47:10 www3 kernel: cpu 3 hot: low 32, high 96, batch 16
Jul 14 18:47:10 www3 kernel: cpu 3 cold: low 0, high 32, batch 16
Jul 14 18:47:10 www3 kernel:
Jul 14 18:47:10 www3 kernel: Free pages:    14596kB (1152kB HighMem)
Jul 14 18:47:10 www3 kernel: Active:557488 inactive:459240 dirty:0 writeback:0 unstable:0 free:3649 slab:6753 mapped:1015154 pagetables:5891
Jul 14 18:47:10 www3 kernel: DMA free:12564kB min:16kB low:32kB high:48kB active:0kB inactive:0kB present:16384kB pages_scanned:3068 all_unreclaimable? yes
Jul 14 18:47:10 www3 kernel: protections[]: 0 0 0
Jul 14 18:47:10 www3 kernel: Normal free:880kB min:928kB low:1856kB high:2784kB active:430452kB inactive:383640kB present:901120kB pages_scanned:1165395 all_unreclaimable? yes
Jul 14 18:47:11 www3 kernel: protections[]: 0 0 0
Jul 14 18:47:11 www3 kernel: HighMem free:1152kB min:512kB low:1024kB high:1536kB active:1799500kB inactive:1453320kB present:4063232kB pages_scanned:3828 all_unreclaimable? no
Jul 14 18:47:11 www3 kernel: protections[]: 0 0 0
Jul 14 18:47:11 www3 kernel: DMA: 5*4kB 4*8kB 4*16kB 3*32kB 3*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 2*4096kB = 12564kB
Jul 14 18:47:11 www3 kernel: Normal: 0*4kB 0*8kB 1*16kB 1*32kB 13*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 880kB
Jul 14 18:47:11 www3 kernel: HighMem: 154*4kB 3*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1152kB
Jul 14 18:47:11 www3 kernel: Swap cache: add 4256821, delete 4256082, find 2429623/2648194, race 0+33
Jul 14 18:47:11 www3 kernel: 0 bounce buffer pages
Jul 14 18:47:11 www3 kernel: Free swap:          0kB
Jul 14 18:47:11 www3 kernel: 1245184 pages of RAM
Jul 14 18:47:11 www3 kernel: 818944 pages of HIGHMEM
Jul 14 18:47:11 www3 kernel: 208066 reserved pages
Jul 14 18:47:11 www3 kernel: 65951 pages shared
Jul 14 18:47:11 www3 kernel: 739 pages swap cached
Jul 14 18:47:11 www3 kernel: Out of Memory: Killed process 15140 (httpd).

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

2^# zxxz79 发表于 2007-07-15 16:49

一到下午这个时候就开始了，又来了
补充一下apache的主要配置

[Copy to clipboard] [ - ]

CODE:

Timeout 30
KeepAlive Off
MaxKeepAliveRequests 100
KeepAliveTimeout 10
<IfModule prefork.c>
StartServers       35
MinSpareServers    5
MaxSpareServers    10
ServerLimit       2000
MaxClients       1000
MaxRequestsPerChild 10000
</IfModule>

apache 2.0.52
php 4.3.6
oracle 9.2.0
web异常时oracle数据库负载正常

现在服务器的状况：

[Copy to clipboard] [ - ]

CODE:

[root@www3 test]# free -m
         total    used    free    shared buffers    cached
Mem:       4051    4036       15       0       2       18
-/+ buffers/cache:    4014       36
Swap:       4094    2775    1319
[root@www3 test]# vmstat 2 10
procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
r  b swpd free buff  cache si so bi bo in cs us sy id wa
3  0 2844740  16844 2404  19432 0 1    1 21 1    1  5  3 91  1
2  0 2844740  15948 2404  19432 0 0    0    0 1323 300  2 50 48  0
2  0 2851060  16764 2412  19576 32 3166 32  3216 1115 110  1 50 47  1
2  0 2851060  16188 2428  19560 0 0    0 20 1186 177  1 50 48  0
2  1 2851060  16316 2428  19676 0 0    0    0 1177 166  1 50 48  0
2  0 2851480  16636 2436  19720 0  210    0 244 1116 120  1 50 45  4
2  0 2852596  16988 2444  19640 0  558    0 564 1330 311  3 50 39  8
2  1 2853108  16540 2452  19360 0  256    0 302 1385 356  4 50 44  2
2  0 2853404  16156 2180  19512 0  148    0 148 1291 269  3 50 45  2
2  0 2858000  17100 2184  19404 0 2338    0  2346 1226 214  3 50 45  2
[root@www3 test]# ps -ef|grep httpd|wc -l
35
[root@www3 test]# ps aux|grep httpd
root    6571  0.0  0.1 19268 4564 ?       Ss 09:30 0:00 /usr/local/apache2/bin/httpd -k start
www 6747 46.2  7.4 544780 310872 ?    S 10:34 162:27 /usr/local/apache2/bin/httpd -k start
www 6753  0.5  7.3 541580 303840 ?    S 10:36 2:04 /usr/local/apache2/bin/httpd -k start
www 6858  0.4  4.1 407680 171692 ?    S 11:35 1:25 /usr/local/apache2/bin/httpd -k start
www 6859  0.5  3.9 421216 164816 ?    S 11:35 1:30 /usr/local/apache2/bin/httpd -k start
www 6860  0.4  3.5 405288 146328 ?    S 11:35 1:26 /usr/local/apache2/bin/httpd -k start
www 6862 14.1 11.8 757464 492900 ?    S 11:35  41:06 /usr/local/apache2/bin/httpd -k start
www 6909  0.3  1.0 243696 44324 ?    S 12:28 0:44 /usr/local/apache2/bin/httpd -k start
www 6941  0.2  1.1 159368 47352 ?    S 12:53 0:28 /usr/local/apache2/bin/httpd -k start
www 6942  0.2  1.1 170644 49640 ?    S 12:57 0:28 /usr/local/apache2/bin/httpd -k start
www 7019  0.0  0.1 40364 6348 ?       S 13:46 0:02 /usr/local/apache2/bin/httpd -k start
www 7021  0.0  0.1 31168 6124 ?       S 13:47 0:01 /usr/local/apache2/bin/httpd -k start
www 7022  0.8  4.3 361272 181788 ?    S 13:51 1:15 /usr/local/apache2/bin/httpd -k start
www 7023  0.8  5.2 374920 219492 ?    S 13:51 1:16 /usr/local/apache2/bin/httpd -k start
www 7024  0.0  0.1 24720 6088 ?       S 13:52 0:00 /usr/local/apache2/bin/httpd -k start
www 7025  0.7  4.4 354696 186608 ?    S 13:52 1:10 /usr/local/apache2/bin/httpd -k start
www 7026  0.7  4.8 365060 200164 ?    S 13:52 1:12 /usr/local/apache2/bin/httpd -k start
www 7028  0.7  4.3 348688 182244 ?    S 13:53 1:08 /usr/local/apache2/bin/httpd -k start
www 7029  0.7  4.4 340728 185932 ?    S 13:57 1:06 /usr/local/apache2/bin/httpd -k start
www 7195  0.6  2.8 194620 118156 ?    S 14:48 0:35 /usr/local/apache2/bin/httpd -k start
www 7196  0.5  2.8 195824 119480 ?    S 14:48 0:33 /usr/local/apache2/bin/httpd -k start
www 7264  0.9  2.8 139524 117192 ?    S 15:44 0:22 /usr/local/apache2/bin/httpd -k start
www 7265  0.8  2.5 126260 104196 ?    S 15:48 0:20 /usr/local/apache2/bin/httpd -k start
www 7266  0.0  0.1 22744 5900 ?       S 15:48 0:00 /usr/local/apache2/bin/httpd -k start
www 7267  0.8  2.7 135020 114536 ?    S 15:48 0:19 /usr/local/apache2/bin/httpd -k start
www 7268  0.8  2.4 120948 101664 ?    S 15:49 0:18 /usr/local/apache2/bin/httpd -k start
www 7269  0.0  0.2 27572 8576 ?       S 15:49 0:00 /usr/local/apache2/bin/httpd -k start
www 7270  0.8  2.3 114764 96476 ?    S 15:50 0:17 /usr/local/apache2/bin/httpd -k start
www 7271  0.8  2.3 116128 95916 ?    S 15:50 0:17 /usr/local/apache2/bin/httpd -k start
www 7272  0.8  2.3 116104 97984 ?    S 15:50 0:18 /usr/local/apache2/bin/httpd -k start
www 7273  0.8  2.3 114036 97096 ?    S 15:52 0:16 /usr/local/apache2/bin/httpd -k start
www 7274  0.1  0.4 35880 18892 ?    S 15:56 0:02 /usr/local/apache2/bin/httpd -k start
www 7299  0.8  1.9 95644 80356 ?    S 16:00 0:12 /usr/local/apache2/bin/httpd -k start
www 7302  0.8  1.8 90776 75500 ?    S 16:01 0:12 /usr/local/apache2/bin/httpd -k start

top - 16:47:56 up 59 days, 16:14,  1 user,  load average: 2.11, 2.12, 2.07
Tasks:  90 total, 1 running,  89 sleeping, 0 stopped, 0 zombie
Cpu0  :  9.3% us,  0.0% sy,  0.0% ni, 90.7% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu1  :  2.3% us, 97.7% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu2  :  0.0% us,  0.0% sy,  0.0% ni, 100.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu3  :  2.3% us, 97.7% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Mem: 4148472k total,  4132876k used, 15596k free,    964k buffers
Swap:  4192956k total,  3542928k used, 650028k free, 19924k cached

  PID USER    PR  NI  VIRT  RES  SHR S %CPU %MEM TIME+  COMMAND
6862 www 25 0  739m 444m 5296 S  100 11.0  63:09.50 httpd
6747 www 25 0  532m 270m 5268 S 98  6.7 184:31.14 httpd
6753 www 16 0  528m 264m 5264 S 0  6.5 2:04.53 httpd
7023 www 16 0  366m 171m 5244 S 0  4.2 1:16.35 httpd
7026 www 16 0  356m 171m 5244 S 0  4.2 1:12.39 httpd
7264 www 16 0  204m 167m 5240 S 9  4.1 0:36.02 httpd
7267 www 16 0  201m 167m 5240 S 0  4.1 0:34.01 httpd
7029 www 16 0  332m 159m 5244 S 0  3.9 1:06.91 httpd
7025 www 16 0  346m 158m 5244 S 0  3.9 1:10.95 httpd
7028 www 16 0  340m 156m 5244 S 0  3.9 1:08.90 httpd
7268 www 16 0  188m 155m 5252 S 0  3.9 0:32.30 httpd
7265 www 16 0  188m 155m 5228 S 0  3.8 0:34.45 httpd
7273 www 15 0  184m 155m 5224 S 0  3.8 0:30.48 httpd
7022 www 16 0  352m 154m 5268 S 0  3.8 1:15.30 httpd
7270 www 16 0  183m 152m 5252 S 0  3.8 0:30.89 httpd
7271 www 15 0  179m 145m 5220 S 0  3.6 0:30.94 httpd
7299 www 15 0  163m 137m 5268 S 0  3.4 0:26.44 httpd
6858 www 16 0  398m 130m 5240 S 0  3.2 1:25.79 httpd
7302 www 16 0  159m 130m 5240 S 0  3.2 0:26.22 httpd
6859 www 16 0  411m 127m 5268 S 0  3.2 1:30.68 httpd
6860 www 16 0  395m 113m 5244 S 0  2.8 1:26.52 httpd
7196 www 16 0  191m 105m 5228 S 0  2.6 0:33.63 httpd
7195 www 16 0  190m 104m 5232 S 0  2.6 0:35.49 httpd
7419 www 16 0 67876  51m 5196 S 0  1.3 0:08.34 httpd
6942 www 15 0  166m  15m 5264 S 0  0.4 0:28.74 httpd
7274 www 16 0 35880  14m 5136 S 0  0.4 0:02.08 httpd
6909 www 16 0  237m  14m 5240 S 0  0.4 0:44.50 httpd
6941 www 15 0  155m  14m 5248 S 0  0.3 0:28.86 httpd
7269 www 16 0 27572 8400 4924 S 0  0.2 0:00.62 httpd
7019 www 16 0 40364 6348 5176 S 0  0.2 0:02.92 httpd
7021 www 16 0 31168 6124 4952 S 0  0.1 0:01.14 httpd
7024 www 16 0 24720 6088 4916 S 0  0.1 0:00.43 httpd
7266 www 16 0 22744 5900 4716 S 0  0.1 0:00.13 httpd
6571 root    16 0 19268 4568 2976 S 0  0.1 0:00.01 httpd

等了一天才再次出现状况，大虾指点下把

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

3^# zxxz79 发表于 2007-07-15 16:51

现在可以杀掉吃资源的进程或者重启一下apache就会恢复，但我想查到结果，想知道吃资源的httpd进程对应的php程序

kaka_sun

UID: 8800
帖子: 177
积分: 407
在线时间: 1 天 18 小时

4^# kaka_sun 发表于 2007-07-15 19:16

看你的负载并不高

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

5^# zxxz79 发表于 2007-07-15 21:36

负载确实不算高，但不稳定，而且越运行越慢，id小于50%，sy长期超过50%只能靠手工杀进程增加id。查不到问题根源

top - 21:32:27 up 59 days, 20:58,  1 user,  load average: 2.06, 2.08, 2.05
Tasks:  80 total, 1 running,  79 sleeping, 0 stopped, 0 zombie
Cpu0  :  6.5% us,  0.5% sy,  0.0% ni, 91.7% id,  1.2% wa,  0.1% hi,  0.0% si
Cpu1  :  0.3% us, 99.7% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu2  :  0.3% us, 99.7% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu3  :  0.6% us,  0.3% sy,  0.0% ni, 98.4% id,  0.7% wa,  0.0% hi,  0.0% si
Mem: 4148472k total,  4131396k used, 17076k free,    3008k buffers
Swap:  4192956k total,  2162012k used,  2030944k free, 17320k cached

  PID USER    PR  NI  VIRT  RES  SHR S %CPU %MEM TIME+  COMMAND
7022 www 25 0  722m 476m 5276 S  100 11.8 105:41.09 httpd
7500 www 16 0  424m 382m 5284 S 0  9.4 1:30.10 httpd
7513 www 16 0  432m 378m 5248 S 0  9.3 1:31.61 httpd
6860 www 16 0  611m 327m 5248 S 0  8.1 2:27.09 httpd
6859 www 25 0  612m 228m 5276 S  100  5.6 105:05.53 httpd
7579 www 16 0  259m 208m 5244 S 0  5.1 0:48.01 httpd
6942 www 16 0  368m 202m 5280 S 0  5.0 1:16.85 httpd
7024 www 16 0  238m 189m 5232 S 0  4.7 0:43.32 httpd
7791 www 16 0  263m 166m 5240 S 0  4.1 0:49.96 httpd
7790 www 16 0  269m 165m 5228 S 0  4.1 0:51.81 httpd
7793 www 15 0  253m 163m 5276 S 0  4.0 0:47.96 httpd
7797 www 15 0  249m 163m 5224 S 0  4.0 0:46.69 httpd
7800 www 15 0  241m 162m 5228 D 3  4.0 0:45.86 httpd
7794 www 15 0  256m 162m 5244 S 0  4.0 0:47.27 httpd
7801 www 15 0  244m 162m 5256 S 0  4.0 0:46.21 httpd
7802 www 16 0  236m 156m 5228 S 0  3.9 0:44.79 httpd
7829 www 15 0  218m 146m 5232 S 0  3.6 0:41.35 httpd
7854 www 15 0  147m 105m 5220 S 2  2.6 0:24.89 httpd
7742 www 16 0 91288  50m 5216 S 0  1.2 0:11.93 httpd
7767 www 16 0 78408  27m 5208 S 0  0.7 0:09.02 httpd
7792 www 16 0 28404 6092 4920 S 0  0.1 0:01.06 httpd
7799 www 16 0 26668 6092 4920 S 0  0.1 0:00.71 httpd
7796 www 16 0 26584 6072 4900 S 0  0.1 0:00.78 httpd
7795 www 16 0 26660 5996 4820 S 0  0.1 0:00.74 httpd
6571 root    16 0 19268 4076 2828 S 0  0.1 0:08.16 httpd

TIME+里的时间：105:05.53 表示进程自启动以来所占用的总CPU时间，这个时间是怎么算的？分秒毫秒？

wigeboy

UID: 46043
帖子: 162
积分: 372
在线时间: 1 天 12 小时

6^# wigeboy 发表于 2007-07-15 22:01

6859 www 25 0 612m 228m 5276 S 100 5.6 105:05.53 httpd

TIME+ 进程使用的CPU时间总计，单位1/100秒

我靠～～～，第一次见到。。。。。。。

么型号的内核？

alvis

UID: 1041
帖子: 176
积分: 404
在线时间: 1 天 18 小时

7^# alvis 发表于 2007-07-15 22:18

你的内存太小了，程序吃了太多的 mem，吃完了就用 swap，等于现在你的内存的 i/o 变得太低，连锁反应，越来越慢

vmstat 1 看看

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

8^# zxxz79 发表于 2007-07-15 22:27

procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
r  b swpd free buff  cache si so bi bo in cs us sy id wa
2  0 1853740 1917052 4636  22748 1 1    1 21 1    1  5  3 91  1
2  0 1853740 1916860 4636  22748 0 0    0    0 1059 56  1 50 49  0
2  0 1853740 1916860 4644  22740 0 0    0 12 1013 19  0 50 50  0
2  0 1853740 1916412 4644  22740 0 0    0    0 1206 193  1 50 49  0
2  0 1853740 1916412 4644  22740 0 0    0    0 1006    9  0 50 50  0
2  0 1853740 1916220 4668  22716 0 0    0 144 1086 95  1 50 48  1
2  0 1853740 1916220 4668  22716 0 0    0    0 1004    9  0 50 50  0
2  0 1853740 1916220 4668  22716 0 0    0    0 1054 51  1 50 49  0
2  0 1853740 1916220 4668  22716 0 0    0    0 1004    9  0 50 50  0
2  0 1853740 1916220 4668  22716 0 0    0    0 1009 11  0 50 50  0
2  0 1853740 1916220 4676  22968 0 0    0 56 1006 15  0 50 50  1
2  0 1853740 1916156 4676  22968 0 0    0    0 1081 77  1 50 49  0
2  0 1853740 1916156 4692  22952 0 0    0 28 1009 21  0 50 49  1
2  0 1853740 1915452 4692  22952 0 0    0    0 1174 153  1 50 48  0
2  0 1853740 1915004 4692  22952 0 0    0    0 1347 315  2 50 48  0
2  0 1853740 1914556 4692  22952 0 0    0    0 1226 215  1 50 49  0
2  0 1853740 1914300 4700  22944 0 0    0 96 1076 79  1 50 49  0
2  0 1853740 1914300 4700  22944 0 0    0    0 1009 11  0 50 50  0
2  0 1853740 1913788 4716  22928 0 0    0 28 2534  1461  3 50 46  1
2  0 1853740 1913788 4716  22928 0 0    0    0 1056 55  1 50 49  0
2  0 1853740 1913724 4716  22928 0 0    0    0 1050 49  1 50 49  0
2  0 1853740 1913724 4724  22920 0 0    0 200 1058 39  1 50 49  0
2  0 1853740 1912956 4724  22920 0 0    0    0 1256 233  2 50 48  0
2  0 1853740 1912956 4724  22920 0 0    0    0 1007 13  0 50 50  0
2  0 1853740 1912892 4740  22904 0 0    0 28 1080 81  1 50 48  1
2  0 1853740 1912124 4740  22904 0 0    0    0 1259 233  2 50 49  0
2  0 1853740 1911996 4748  22896 0 0    0 112 1158 143  2 50 48  0
2  0 1853740 1911996 4756  22888 0 0    8    0 1053 41  0 50 50  0
2  0 1853740 1911996 4756  22888 0 0    0    0 1004    9  0 50 50  0
2  0 1853740 1911420 4764  22880 0 0 36    0 1264 243  2 50 48  0
2  0 1853740 1911420 4780  22864 0 0    0 44 1028 35  0 50 49  1
2  0 1853740 1910844 4780  22864 0 0    0    8 1282 261  2 50 48  0

zxxz79

UID: 5219
帖子: 77
积分: 177
在线时间: 8 小时

9^# zxxz79 发表于 2007-07-15 22:27

2.6.9-42.ELsmp #1 SMP Wed Jul 12 23:27:17 EDT 2006 i686 i686 i386 GNU/Linux
配置：
model name : Intel(R) Xeon(R) CPU 5140 @ 2.33GHz 2个
4G内存

wigeboy

UID: 46043
帖子: 162
积分: 372
在线时间: 1 天 12 小时

10^# wigeboy 发表于 2007-07-15 22:52

free不少啊

si在持续的读

io没有动过

换个内核看看