Anyone able to comment on the following VMSTAT, TOP and IOSTAT figures
taken from a stress test we just performed on a 2100 with 2/275MHz CPUs
and 512MB memory running the Progress database?
We seemed to experience a severe degradation in performance and I figure
it is due to a CPU bottleneck. Basically the number of runnable
processes ranged from 9-23 during the slow period and there was no idle
time. The pages-in value and the free memory values tend to indicate
that some swapping was happening however I don't think it was excessive.
The 10:18 time window was when the system was struggling, the 11:15 time
window was when it was running fine.
Wed Nov 5 10:18:19 CST 1997
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow zero react pin pout in sy cs us
sy id
16525 26 47K 117 15K 1M 193K 700K 29K 252K 15K 21 639 617 7
2 92
16525 28 48K 102 15K 3496 186 1388 874 570 45 313 7K 3K 67
33 0
15529 26 48K 73 15K 3008 75 1609 29 173 0 395 7K 4K 71
29 0
9527 27 48K 121 15K 4268 64 2667 18 436 0 412 8K 4K 68
32 0
18518 26 48K 98 15K 2258 77 1328 3 111 0 271 9K 3K 71
29 0
23517 26 48K 77 15K 3106 124 2368 24 207 0 241 8K 3K 69
31 0
17524 27 48K 110 15K 6700 384 4233 19 589 0 326 7K 3K 61
39 0
16532 25 48K 85 15K 4575 283 2536 161 655 0 313 8K 4K 65
35 0
13541 26 48K 85 15K 4756 347 2673 0 606 0 454 11K 5K 66
34 0
22531 25 48K 70 15K 5175 240 3225 191 398 0 362 7K 4K 68
32 0
Wed Nov 5 11:15:26 CST 1997
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow zero react pin pout in sy cs us
sy id
7269 27 52K 224 10K 2M 246K 1M 78K 353K 16K 23 701 638 8
2 90
8268 25 52K 256 10K 2437 136 1140 14 257 0 110 3K 1K 43
20 37
11262 25 52K 191 10K 2714 109 1622 13 386 0 93 3K 1K 51
20 29
9262 25 52K 398 10K 1613 39 900 7 144 0 40 3K 1K 47
15 38
9258 25 52K 469 10K 2484 118 1634 16 271 0 47 3K 1K 44
21 35
8255 26 52K 506 10K 1492 65 894 19 132 0 54 3K 1K 47
16 37
9255 25 52K 277 10K 2696 108 1565 22 305 0 159 3K 1K 50
23 27
10252 25 52K 312 10K 1839 66 900 22 184 0 53 3K 1K 50
16 34
13246 25 52K 413 10K 2482 133 1565 11 285 0 43 3K 1K 45
19 36
8248 25 52K 389 10K 1316 41 853 13 85 0 46 3K 1K 47
16 37
Wed Nov 5 10:18:09 CST 1997
load averages: 24.63, 21.53, 21.67 10:18:24
517 processes: 19 running, 2 waiting, 100 sleeping, 393 idle, 3 stopped
Memory: Real: 193M/497M act/tot Virtual: 399M/2335M use/tot Free: 280K
PID USERNAME PRI NICE SIZE RES STATE TIME CPU COMMAND
9812 waltmm 59 0 176M 14M run 0:23 13.20% _progres
10100 root 0 0 dead 0.00% <dead>
5587 hibbpd 42 0 176M 40M WAIT 27:40 9.40% _progres
8695 crossd 53 0 176M 20M run 0:46 8.90% _progres
10104 root 54 4 3208K 409K run 0:00 8.60% top
8429 newbdl 53 0 179M 13M run 1:13 8.50% _progres
10106 root 55 4 3448K 1769K run 0:01 8.40% ps
9328 feaspb 52 2 176M 14M run 0:26 6.00% _progres
7760 feaspb 52 2 176M 18M sleep 0:36 5.70% _progres
8358 songhj 47 0 176M 41M sleep 0:30 5.60% _progres
6731 crossd 47 0 177M 18M run 0:32 4.90% _progres
7352 brangr 42 0 177M 11M WAIT 0:30 4.80% _progres
6443 waltmm 47 0 177M 11M sleep 0:34 4.60% _progres
8381 songhj 47 0 176M 25M run 0:28 4.50% _progres
8269 songhj 47 0 176M 17M sleep 0:47 4.10% _progres
9046 newbdl 49 0 176M 4161K sleep 0:03 3.90% _progres
10068 waltmm 46 0 176M 9363K sleep 0:01 3.90% _progres
7531 marske 46 0 176M 35M run 1:05 3.70% _progres
7512 waltmm 46 0 176M 2670K sleep 0:02 3.70% _progres
7335 browlk 46 0 176M 24M run 0:27 3.40% _progres
5493 hibbpd 46 0 176M 18M sleep 30:54 3.40% _progres
7268 feaspb 46 0 177M 16M sleep 1:14 3.40% _progres
9663 newbdl 47 0 176M 13M sleep 0:12 3.40% _progres
6843 crossd 47 0 176M 32M run 0:34 3.20% _progres
7449 browlk 46 0 176M 25M sleep 0:24 2.90% _progres
7593 browlk 46 0 176M 22M sleep 0:21 2.80% _progres
5540 hibbpd 45 0 176M 25M sleep 6:07 2.70% _progres
8026 browlk 45 0 176M 34M run 0:35 2.50% _progres
9147 potiv0 48 2 177M 13M run 0:07 2.50% _progres
9130 potiv0 48 2 177M 12M run 0:07 2.50% _progres
9995 root 0 0 dead 0.00% <dead>
6672 potiv0 45 0 176M 13M sleep 1:47 2.40% _progres
9141 nellg0 48 2 176M 18M sleep 0:11 2.40% _progres
9768 nellg0 47 2 176M 14M sleep 0:05 2.30% _progres
8907 potiv0 47 2 177M 15M run 0:09 2.10% _progres
10017 nellg0 47 2 176M 10M sleep 0:01 1.70% _progres
7567 feaspb 47 2 176M 26M sleep 0:49 1.60% _progres
9135 potiv0 47 2 177M 13M run 0:07 1.50% _progres
9153 feaspb 46 2 176M 19M run 0:16 1.20% _progres
9769 waltmm 47 2 176M 16M sleep 0:06 1.10% _progres
10050 root 45 0 1600K 147K sleep 0:00 1.10% iostat
8912 nellg0 46 2 176M 19M run 0:11 1.00% _progres
9131 potiv0 46 2 177M 13M sleep 0:07 0.90% _progres
10096 root 0 0 dead 0.00% <dead>
6800 root 48 4 1920K 163K sleep 0:01 0.30% iostat.ksh
1394 dba 42 0 10M 1220K sleep 0:24 0.10% _mprosrv
8728 nellg0 45 0 178M 9994K sleep 0:06 0.10% _progres
8994 root 44 0 440K 73K sleep 0:00 0.10% advfsstat
9008 root 44 0 440K 73K sleep 0:00 0.10% advfsstat
9013 root 44 0 440K 73K sleep 0:00 0.10% advfsstat
8987 root 44 0 440K 73K sleep 0:00 0.10% advfsstat
8998 root 44 0 440K 73K sleep 0:00 0.10% advfsstat
376 root 42 -1 5032K 1343K sleep 28:08 0.00% advfsd
563 root 44 0 2728K 278K sleep 3:07 0.00% steamd
27 root 47 0 1592K 57K sleep 1:55 0.00% update
366 root 44 0 1720K 122K sleep 0:34 0.00% snmpd
510 root 44 0 3360K 114K sleep 0:31 0.00% atis
1389 dba 42 0 130M 38M sleep 0:30 0.00% _mprosrv
1326 dba 44 0 5256K 516K sleep 0:24 0.00% _mprosrv
1695 dba 44 0 27M 1802K sleep 0:23 0.00% _mprosrv
1401 dba 44 0 13M 1441K sleep 0:23 0.00% _mprosrv
1408 dba 44 0 14M 434K sleep 0:23 0.00% _mprosrv
1415 dba 42 0 15M 720K sleep 0:23 0.00% _mprosrv
1570 dba 44 0 5424K 884K sleep 0:22 0.00% _mprosrv
1548 dba 44 0 4080K 425K sleep 0:22 0.00% _mprosrv
1560 dba 44 0 4080K 172K sleep 0:22 0.00% _mprosrv
1553 dba 44 0 4080K 172K sleep 0:22 0.00% _mprosrv
1575 dba 44 0 6264K 172K sleep 0:22 0.00% _mprosrv
1585 dba 44 0 5576K 417K sleep 0:21 0.00% _mprosrv
1529 dba 44 0 12M 409K sleep 0:21 0.00% _mprosrv
1522 dba 44 0 12M 286K sleep 0:21 0.00% _mprosrv
1508 dba 44 0 6608K 270K sleep 0:21 0.00% _mprosrv
1515 dba 44 0 8120K 253K sleep 0:21 0.00% _mprosrv
1700 dba 44 0 12M 237K sleep 0:21 0.00% _mprosrv
1423 dba 42 0 130M 778K sleep 0:11 0.00% _mprshut
1728 dba 44 0 27M 172K sleep 0:07 0.00% _mprshut
371 root 44 0 2424K 204K sleep 0:06 0.00% os_mibs
156 root 44 0 1648K 90K sleep 0:05 0.00% routed
6802 root 48 4 1920K 188K sleep 0:02 0.00% top.ksh
9852 newbdl 44 0 176M 11M sleep 0:02 0.00% _progres
6098 root 44 0 1696K 49K sleep 0:02 0.00% telnetd
6799 root 48 4 1920K 229K sleep 0:01 0.00% ps-auxw.ksh
6798 root 48 4 1920K 147K sleep 0:01 0.00% ps-ef.ksh
1426 dba 44 0 130M 7094K sleep 0:01 0.00% _mprshut
1429 dba 44 0 130M 6905K sleep 0:01 0.00% _mprshut
1441 dba 44 0 13M 868K sleep 0:01 0.00% _mprshut
1731 dba 44 0 27M 499K sleep 0:01 0.00% _mprshut
6109 root 44 0 1960K 180K sleep 0:01 0.00% ksh
1435 dba 44 0 10M 172K sleep 0:01 0.00% _mprshut
1543 dba 44 0 8144K 131K sleep 0:01 0.00% _mprshut
1734 dba 44 0 8144K 122K sleep 0:01 0.00% _mprshut
1438 dba 44 0 13M 499K sleep 0:00 0.00% _mprshut
1432 dba 44 0 10M 262K sleep 0:00 0.00% _mprshut
9836 root 44 0 1696K 212K sleep 0:00 0.00% telnetd
9004 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
9012 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
8993 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
9007 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
8996 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
8990 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
8997 root 44 0 440K 90K sleep 0:00 0.00% advfsstat
5250 root 44 0 1696K 81K sleep 0:00 0.00% telnetd
9009 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
9011 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
9003 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
9014 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
9001 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
8954 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
9000 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
8992 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
8995 root 44 0 440K 73K sleep 0:00 0.00% advfsstat
8237 root 44 0 1696K 73K sleep 0:00 0.00% telnetd
6297 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
6278 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
6631 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
8981 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
8656 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
6323 root 44 0 1696K 49K sleep 0:00 0.00% telnetd
8634 newbdl 42 0 5424K 1802K sleep 0:00 0.00% _mprosrv
6801 root 42 4 1920K 139K sleep 0:00 0.00% vmstat.ksh
394 root 42 0 1632K 139K sleep 0:00 0.00% cron
The IOSTAT devices are:
rz0 /usr
rz17 /usr
rz18 software
rz32 swap (primary),root (mirrorset on DEC Raid Array 450)
rz19 swap
rz33 database (mirrorset on DEC Raid Array 450)
rz34 database (stripe/mirrorset on DEC Raid Array 450)
rz35 database (stripe/mirrorset on DEC Raid Array 450)
Wed Nov 5 10:18:17 CST 1997
tty rz0 rz16 rz17 rz18 rz19 rz32 rz33
rz34 rz35 cpu
tin tout bps tps bps tps bps tps bps tps bps tps bps tps bps tps
bps tps bps tps us ni sy id
1 431 6 0 3 0 3 0 14 1 3 0 6 0 5 0
28 1 61 1 6 0 2 92
7 2287 92 6 0 0 234 15 27 3 457 31 637 47 4 0
522 23 1124 70 44 17 39 0
1 1100 4 0 0 0 4 0 0 0 355 27 529 40 12 1
67 8 1275 74 41 26 33 0
5 1770 0 0 0 0 4 0 0 0 428 31 341 22 18 2
523 25 1223 69 50 14 37 0
0 1528 59 2 0 0 217 19 59 6 205 19 366 23 8 1
63 8 1371 84 48 18 35 0
0 283 181 12 185 10 135 12 69 7 35 4 243 19 23 2
216 14 856 57 54 12 34 0
6 1192 4 0 0 0 0 0 20 2 107 13 115 14 8 1
87 11 933 74 64 12 24 0
2 2348 0 0 63 1 0 0 0 0 82 10 78 9 4 0
71 9 1465 112 61 12 27 0
1 453 0 0 184 6 0 0 0 0 27 3 47 6 16 2
98 12 1158 83 52 16 33 0
2 517 0 0 0 0 0 0 4 0 28 3 20 2 8 1
59 7 2462 145 68 8 25 0
Wed Nov 5 11:15:11 CST 1997
tty rz0 rz16 rz17 rz18 rz19 rz32 rz33
rz34 rz35 cpu
tin tout bps tps bps tps bps tps bps tps bps tps bps tps bps tps
bps tps bps tps us ni sy id
1 437 7 0 3 0 4 0 14 1 4 0 7 1 5 0
31 1 74 2 7 1 2 90
0 0 0 0 0 0 0 0 0 0 0 0 0 0 4 0
4 0 12 1 25 20 17 38
0 0 0 0 0 0 0 0 0 0 0 0 0 0 4 0
12 1 8 1 30 16 10 45
0 0 187 5 0 0 0 0 0 0 0 0 64 1 8 1
4 0 12 1 26 27 25 22
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 19 15 7 59
0 0 4 0 0 0 0 0 36 4 0 0 4 0 12 1
8 1 72 9 28 18 18 36
1 89 0 0 0 0 186 6 0 0 246 31 270 27 8 1
0 0 0 0 24 27 29 20
2 931 0 0 0 0 0 0 0 0 20 2 16 2 8 1
0 0 4 0 30 17 7 46
1 51 111 7 143 7 210 11 487 27 139 17 222 27 8 1
28 2 52 5 31 23 35 10
0 0 167 10 16 2 80 7 199 17 0 0 72 3 16 2
28 3 36 4 19 21 14 46
TIA
Mark.Schubert_at_faulding.com.au
Received on Wed Nov 05 1997 - 07:47:21 NZDT