Hey all,
Here is the data collected for 24 hrs with 30 mins interval starting from
18:00.
1) Output of vmstat
Wed Sep 3 18:17:10 EDT 2003
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow zero react pin pout in sy cs us sy
id
12 615 38 234K 90K 188K 719M 148M 243M 29M 161M 3M 917 8K 8K 49 15
36
10 572 37 222K 103K 187K 305K 75K 103K 199 74K 0 795 9K 11K 65 22
13
8 568 38 220K 106K 187K 700K 211K 194K 1 190K 0 862 7K 8K 33 14
52
6 565 38 219K 108K 186K 202K 37K 87K 373 50K 0 923 6K 8K 38 13
49
12 570 38 219K 100K 193K 347K 72K 136K 4 86K 0 1K 9K 10K 51 20
29
15 587 41 225K 91K 196K 202K 37K 85K 13 46K 0 896 9K 8K 42 17
41
6 575 38 220K 98K 194K 185K 36K 71K 0 39K 0 808 6K 6K 22 11
67
6 596 38 222K 100K 191K 152K 33K 57K 0 33K 0 852 3K 3K 11 5
84
7 612 39 223K 99K 190K 125K 25K 50K 1 26K 0 960 5K 7K 30 12
58
6 625 39 228K 98K 187K 131K 27K 49K 152 29K 0 1K 4K 5K 18 8
75
8 620 39 227K 92K 193K 252K 63K 88K 28 61K 0 1K 5K 7K 30 12
58
7 601 38 225K 91K 196K 129K 25K 48K 5 27K 0 1K 6K 7K 32 13
55
20 630 39 230K 96K 187K 149K 33K 61K 5 32K 0 658 9K 9K 47 17
35
8 623 39 229K 98K 185K 97K 19K 39K 1 20K 0 587 8K 11K 52 18
30
15 653 39 231K 96K 185K 126K 26K 52K 16 26K 0 545 9K 13K 59 22
20
14 687 38 209K 109K 195K 130K 24K 56K 0 25K 0 500 11K 14K 61 27
13
11 718 39 213K 105K 195K 91K 18K 37K 0 18K 0 547 12K 15K 66 26
8
11 735 39 217K 102K 194K 81K 15K 36K 0 14K 0 551 24K 13K 59 39
2
17 752 38 225K 100K 188K 116K 25K 47K 0 22K 0 518 23K 12K 60 38
2
14 760 38 241K 74K 197K 66K 13K 25K 0 12K 0 598 10K 14K 67 26
7
24 689 39 199K 117K 196K 121K 25K 49K 1 25K 0 485 11K 13K 67 28
5
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow zero react pin pout in sy cs us sy
id
19 668 38 195K 126K 192K 88K 18K 35K 4 18K 0 391 10K 12K 72 24
4
20 684 40 234K 81K 197K 97K 19K 39K 0 18K 0 530 8K 10K 73 22
5
20 748 40 247K 69K 197K 191K 34K 76K 0 44K 0 648 9K 9K 74 22
4
17 717 39 239K 79K 194K 254K 57K 103K 0 65K 0 548 9K 10K 74 22
4
20 713 38 243K 77K 193K 122K 23K 53K 3 25K 0 503 8K 10K 74 19
6
25 761 38 254K 66K 193K 204K 37K 88K 0 44K 0 466 9K 10K 74 19
7
15 889 39 269K 45K 199K 214K 39K 89K 551 47K 0 373 9K 10K 73 19
8
18 970 38 292K 26K 195K 198K 35K 87K 2 37K 0 466 9K 10K 75 19
6
20 1029 38 301K 19K 193K 279K 56K 111K 1 63K 0 512 10K 10K 78
21 2
9 1177 38 318K 6237 188K 391K 80K 156K 1361 82K 0 982 9K 9K 74
18 8
13 1278 38 320K 1106 192K 338K 56K 150K 128K 65K 8135 791 8K 8K 71
17 13
17 1358 38 317K 2193 194K 370K 60K 157K 109K 85K 10K 762 9K 8K 70
17 13
12 1374 38 319K 213 194K 425K 85K 161K 51K 105K 5217 905 32K 8K 62
19 19
10 1333 38 320K 1127 192K 566K 129K 200K 62K 138K 4260 1K135K 9K 56
29 16
8 1347 39 308K 121 205K 598K 109K 261K 189K 140K 42K 1K144K 5K 37
29 34
8 1356 38 269K 42K 201K 1M 269K 321K 229 282K 0 1K143K 8K 46
31 23
7 1342 38 296K 17K 199K 261K 45K 99K 159 67K 0 785126K 4K 24
20 56
7 1379 38 313K 2734 197K 378K 80K 138K 489 92K 0 799147K 6K 37
25 38
7 1419 38 310K 138 202K 366K 72K 142K 102K 86K 7231 1K147K 6K 39
27 34
8 1389 40 313K 185 200K 336K 63K 128K 20K 78K 2137 816149K 7K 39
27 34
14 1370 40 313K 226 200K 213K 36K 90K 39K 50K 3251 725147K 3K 25
21 54
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow zero react pin pout in sy cs us sy
id
7 1353 38 310K 16K 186K 364K 74K 140K 46K 87K 4436 444134K 5K 31
25 44
6 1293 38 309K 16K 187K 343K 79K 122K 5 83K 0 630135K 3K 24
22 53
8 1230 38 296K 15K 202K 450K 91K 168K 84 108K 0 800146K 8K 46
30 24
5 1049 38 287K 30K 195K 514K 109K 190K 1509 127K 0 736 21K 14K 43
23 34
5 818 40 258K 56K 199K 481K 108K 168K 1240 123K 0 3K 9K 13K 38 24
38
8 639 38 234K 84K 194K 557K 138K 185K 27 145K 0 764 7K 6K 23 12
65
2) O/P of vmstat -w:
Wed Sep 3 18:16:15 EDT 2003
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow pin pout in sy cs us sy id
iowait
9 627 38 235K 89K 188K 719M 148M 161M 3M 917 8K 8K 49 15 36 0
7 583 38 223K 102K 188K 343K 88K 84K 0 785 9K 11K 65 22 13 0
6 578 38 220K 105K 187K 675K 205K 183K 0 862 7K 8K 34 14 52 0
13 558 38 219K 108K 186K 226K 43K 56K 0 925 7K 8K 38 13 48 1
10 573 38 219K 100K 193K 347K 72K 86K 0 1K 9K 10K 51 20 29 0
9 604 39 226K 90K 196K 203K 37K 47K 0 926 8K 8K 43 17 39 1
6 577 38 220K 98K 194K 185K 36K 39K 0 816 7K 6K 23 12 65 1
8 600 38 222K 99K 192K 149K 32K 32K 0 820 3K 3K 11 5 84 0
6 618 38 224K 99K 190K 130K 27K 27K 0 954 5K 7K 30 12 58 0
7 626 38 228K 98K 187K 131K 27K 29K 0 1K 4K 5K 17 8 74 0
9 620 39 227K 94K 192K 252K 63K 61K 0 1K 5K 7K 30 12 57 0
8 610 39 227K 90K 196K 127K 25K 26K 0 1K 6K 7K 31 13 55 1
14 639 38 230K 95K 187K 150K 33K 32K 0 651 9K 9K 47 17 36 0
7 638 38 230K 97K 186K 97K 20K 20K 0 592 8K 11K 52 18 30 0
13 652 38 231K 97K 185K 126K 25K 26K 0 546 9K 13K 58 22 20 0
14 685 38 209K 109K 195K 131K 24K 25K 0 501 11K 14K 61 26 13 0
12 715 37 212K 106K 194K 91K 18K 18K 0 546 12K 15K 66 26 8 0
13 734 38 216K 102K 194K 81K 15K 14K 0 553 23K 13K 59 39 2 0
22 746 38 225K 100K 188K 116K 25K 22K 0 514 23K 12K 60 38 2 0
18 761 38 241K 74K 197K 66K 13K 12K 0 600 10K 14K 67 26 7 0
18 682 38 198K 119K 196K 116K 24K 24K 0 486 11K 13K 67 28 6 0
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow pin pout in sy cs us sy id
iowait
15 671 38 195K 126K 192K 93K 18K 19K 0 397 11K 12K 72 24 4 0
17 687 39 234K 81K 197K 96K 19K 18K 0 523 8K 10K 73 22 5 0
16 753 38 247K 69K 197K 191K 34K 44K 0 647 9K 9K 74 22 4 0
16 729 38 240K 78K 195K 244K 56K 62K 0 551 9K 10K 74 23 4 0
15 717 38 242K 77K 193K 133K 25K 28K 0 506 8K 10K 74 19 6 0
16 770 38 254K 66K 193K 202K 37K 43K 0 462 9K 10K 74 19 7 0
18 886 39 269K 45K 199K 215K 39K 48K 0 378 9K 10K 73 19 8 0
21 963 39 291K 27K 195K 197K 35K 37K 0 461 9K 10K 75 19 6 0
21 1026 40 300K 20K 193K 274K 55K 61K 0 519 10K 10K 78 21 1
0
16 1147 38 316K 8822 188K 388K 79K 82K 0 978 9K 9K 74 18 7
0
11 1277 38 318K 2433 192K 344K 57K 66K 8135 796 8K 8K 71 17 12
0
19 1364 39 319K 270 194K 366K 59K 83K 10K 752 9K 8K 69 17 13
0
12 1364 38 318K 1091 194K 424K 85K 106K 5244 881 29K 8K 62 19 19
0
8 1338 38 320K 653 192K 537K 119K 130K 4249 1K135K 9K 56 28 15
0
8 1355 41 308K 212 205K 629K 120K 147K 40K 1K145K 5K 38 29 32
1
11 1359 38 269K 42K 201K 1M 269K 285K 2120 1K143K 8K 46 30 24
0
6 1342 38 295K 18K 199K 249K 44K 65K 0 765126K 4K 25 20 55
0
6 1365 38 309K 6243 197K 362K 74K 88K 0 797147K 6K 37 25 37
0
8 1409 39 310K 654 203K 354K 70K 82K 6562 1K147K 6K 39 27 34
0
7 1374 38 312K 820 200K 357K 69K 85K 2209 845148K 7K 39 27 34
0
6 1379 39 314K 125 199K 231K 39K 53K 2876 726148K 3K 25 21 53
0
Virtual Memory Statistics: (pagesize = 8192)
procs memory pages intr cpu
r w u act free wire fault cow pin pout in sy cs us sy id
iowait
10 1354 38 310K 17K 186K 351K 72K 85K 5408 446134K 5K 31 25 44
1
8 1298 38 307K 18K 187K 350K 80K 84K 0 630134K 3K 24 22 53
0
11 1226 38 294K 17K 202K 407K 79K 98K 0 768145K 8K 45 30 25
0
8 1057 38 285K 32K 196K 497K 102K 120K 0 754 25K 14K 44 23 33
0
13 829 40 259K 54K 199K 545K 128K 140K 0 3K 9K 13K 38 24 37 1
9 670 38 236K 82K 194K 478K 114K 122K 0 816 7K 6K 23 12 64 1
3) O/P of iostat:
Wed Sep 3 18:17:58 EDT 2003
tty fd0 rz8 rz8 rz8 cpu
tin tout bps tps bps tps bps tps bps tps us ni sy id
5 408 0 0 48 5 335 18 237 7 28 20 15 36
3 791 0 0 24 3 25 2 12 1 50 15 21 14
4 1070 0 0 28 4 32 3 18 2 15 18 14 53
6 1472 0 0 31 5 23 2 25 2 19 20 13 48
7 1689 0 0 37 6 35 3 318 31 23 29 20 29
8 1821 0 0 112 9 1814 74 316 30 21 20 17 42
4 941 0 0 70 6 2701 74 47 5 9 12 11 68
3 654 0 0 20 2 50 4 12 1 5 6 5 83
2 626 0 0 18 2 20 2 7 1 12 18 12 58
3 817 0 0 20 3 31 3 10 1 9 8 8 75
3 727 0 0 22 3 116 12 15 2 14 17 12 57
3 712 0 0 58 5 2663 70 35 4 15 17 13 55
1 219 0 0 21 3 37 3 41 2 19 29 18 34
0 15 0 0 16 2 26 3 9 1 21 31 18 30
0 35 0 0 19 3 22 2 12 1 24 35 22 19
0 107 0 0 25 5 223 25 157 18 23 37 26 13
0 21 0 0 18 3 21 1 9 1 24 42 27 7
0 4 0 0 18 2 232 5 12 1 21 38 39 2
0 12 0 0 44 3 223 6 22 1 23 38 37 2
tty fd0 rz8 rz8 rz8 cpu
tin tout bps tps bps tps bps tps bps tps us ni sy id
0 52 0 0 18 2 191 7 6 1 27 40 26 7
0 65 0 0 20 3 331 38 24 2 27 40 28 5
1 172 0 0 19 3 19 2 39 4 30 42 24 4
0 52 0 0 91 6 1727 68 282 27 27 46 22 5
3 661 0 0 66 7 3011 110 57 5 27 48 22 4
3 703 0 0 28 5 344 39 40 4 24 50 22 4
1 278 0 0 21 3 13 1 21 2 24 50 19 7
4 864 0 0 34 5 18 2 39 3 24 50 19 7
3 790 0 0 24 4 14 1 23 2 23 49 19 8
6 1203 0 0 25 4 14 1 42 3 24 51 20 6
12 2330 0 0 32 5 28 2 88 3 29 48 21 2
13 2721 0 0 32 5 43 3 96 4 27 47 18 8
17 3109 0 0 84 9 68 5 38 3 34 36 17 13
17 3331 0 0 112 11 96 7 44 3 29 41 18 12
14 3277 0 0 83 10 69 6 33 3 30 31 19 20
18 3786 0 0 73 9 68 6 37 3 39 16 29 16
16 3229 0 0 282 20 710 21 70 4 28 9 28 35
15 2869 0 0 94 12 97 10 40 4 26 20 31 23
12 2369 0 0 48 6 52 6 21 2 17 8 20 56
tty fd0 rz8 rz8 rz8 cpu
tin tout bps tps bps tps bps tps bps tps us ni sy id
11 2090 0 0 49 7 41 4 28 3 23 15 25 38
15 2805 0 0 79 9 387 44 45 5 25 14 27 34
18 2966 0 0 59 8 53 5 31 3 23 15 27 35
14 3020 0 0 50 6 97 10 23 2 19 6 21 54
11 2704 0 0 65 8 97 10 117 4 20 11 25 44
10 2247 0 0 36 5 35 3 23 2 18 7 22 53
13 2541 0 0 55 7 53 5 28 3 26 20 30 24
14 2947 0 0 58 8 63 6 36 3 24 20 22 34
12 2153 0 0 133 11 2708 91 61 6 22 16 24 38
12 2159 0 0 50 7 143 15 38 3 14 9 12 65
>From the above it looks CPU IDLE is very low at some times.
Man is a heroic bieng with his own happiness as
moral purpose of life, with productive achievement
as the noblest activity & reason as his only absolute
-----Original Message-----
From: Himanshu Khona [mailto:himanshu.khona_at_patni.com]
Sent: Thursday, September 04, 2003 12:16 PM
To: 'Himanshu Khona'; 'tru64-unix-managers_at_ornl.gov'
Cc: 'Stephen. Kurel (E-mail)'; 'Dr Thomas.Blinn_at_HP.com'
Subject: RE: Performance analysis of tru 64 unix system alpha 2000 with
O.S.4.0D ..update.
H
Also attaching the swapon -sv output:
Swap partition /dev/rz8b:
Allocated space: 255891 pages (1999MB)
In-use space: 55717 pages ( 21%)
Free space: 200174 pages ( 78%)
Swap partition /dev/rzb8b:
Allocated space: 259042 pages (2023MB)
In-use space: 54849 pages ( 21%)
Free space: 204193 pages ( 78%)
Swap partition /dev/rzd11b:
Allocated space: 212281 pages (1658MB)
In-use space: 55531 pages ( 26%)
Free space: 156750 pages ( 73%)
Total swap allocation:
Allocated space: 727214 pages (5681MB)
In-use space: 166097 pages ( 22%)
Available space: 561117 pages ( 77%)
The messages file says the swap is configured in lazy mode. Do i need to do
any
modifications to my swap if that would help boost my performance.
At some points pageouts look high & also disk activity looks high.
Unfortunately i had asked the concerned person to get me data with time
stapms which he didn
't. I shall try to get the data with time stamps. And has also asked to run
collect for different subsystems.
FOr now, incase anybody has some comments to make, or wants any additional
information do let me know.
I shall summarize my findings at the end of assessment.
Thanks,
Himanshu
Man is a heroic bieng with his own happiness as
moral purpose of life, with productive achievement
as the noblest activity & reason as his only absolute
-----Original Message-----
From: tru64-unix-managers-owner_at_ornl.gov
[mailto:tru64-unix-managers-owner_at_ornl.gov]On Behalf Of Himanshu Khona
Sent: Wednesday, August 27, 2003 5:04 PM
To: tru64-unix-managers_at_ornl.gov
Cc: 'Stephen. Kurel (E-mail)'; 'Dr Thomas.Blinn_at_HP.com'
Subject: Performance analysis of tru 64 unix system alpha 2000 with
O.S.4.0D ..Some more details.
Hi all,
Thanks to Dr Thomas Blinn for his quick response/inputs.
>From the mail below i realise some lack of details from my end.
Here is what the actual problem is:
appear to have various issues that have a mixed cause and effect.
1) Sometimes batch processing is very slow yet on-line
transactions work fine.
2) Sometimes batch processing is very good yet on-line
transactions are slow.
3) Sometimes everything is poor.
Sometimes the box is low on memory, sometimes it appears to be low
or at least struggling with swapping.
Problems with the tape environment (Legato NSR) always cause sever
performance degradation.
Also it may be true that my approach may be wrong.
Also i don't intend to waste anyone's time. Just that there is some lack of
experience as far as performance analysis is concerned.
I hope the above problem statements help in getting me better response.
Also the enviroment is:
. Baan Version:
Baan IV c4 with SP7, Porting set 6.1c.05.02 on
Live server 6.1c.06 on development
. How they take back of Informix.
Ontape or onbar?
Onbar controlled by legato NSR
. Tru 64 alpha 2000 with 4gb RAM & 4 CPU.
. Informix 7.3.fc5 (database size 118GB ).
So the problem could lie at System, Baan or informix level. So probably it
would be daunting task.
Also the only need of asking the below questions was just to co-relate those
values against time & proccesses which are creating a resource crunch.
Regards
Himanshu
Man is a heroic bieng with his own happiness as
moral purpose of life, with productive achievement
as the noblest activity & reason as his only absolute
-----Original Message-----
From: Dr Thomas.Blinn_at_HP.com [mailto:tpb_at_doctor.zk3.dec.com]
Sent: Wednesday, August 27, 2003 4:23 PM
To: Himanshu Khona
Cc: Stephen. Kurel (E-mail)
Subject: Re: Performance analysis of tru 64 unix system alpha 2000 with
O.S.4.0D
You are going at this all backwards. You seem to be assuming that you
can gather some system statistics and then guess whether there is some
performance problem. You have never once indicated that you have ANY
kind of external indication that there is some problem that you need to
address.
For instance, high load averages at some point in time simply mean you
are presenting more work to the system than you have CPUs and other
resources (mostly CPU) to get done at that instant. That in and of
itself is NOT a problem; a problem is if users are complaining that
during times of high load average, the system is unresponsive, or if
the work that needs to get done in a given time window isn't getting
done because you lack the resources to do it.
Similarly, high swap in numbers don't necessarily point to a problem
that needs to be addressed -- it depends tremendously on the nature of
the workload presented to the system.
Do you have some EXTERNAL evidence that there is some problem with this
system that needs to be addressed? Because without that evidence (which
NONE of these statistics provide), you are off on a wild goose chase and
wasting your time and the time of your respondents.
Putting this another way, what problem are you trying to solve? This is
a system that was built maybe 4 or 5 years ago, it's outmoded technology,
you are running old (and no longer supported by the vendor) system software
and you've offered no hint about what the system is used for, and you are
off trying to figure out from system statistics if the system has some
kind of performance problem?
Tom
> Hi all,
>
> With reference to the above subject we have collected(some information we
> are yet to collect) virtual memory statics, process sub system, I/O
> sub-system.
> The enviroment if Tru 64 ver 4.0d with 4gb RAM & 4 CPU's of 533Mhz
> What i want to know from the list is the thresholds which i should look
for
> which if exxceeded points to performance problem.
>
> The headers are as follows:
>
> System Load:
> 14:46 up - days, 22:28, -- users, load average: a,b,c
>
> What should be the threshold values for the load averages?
>
> Process sub system;
> USER PID %CPU %MEM VSZ RSS TTY S STARTED TIME
> COMMAND
>
> I would like to know what should be the thresholds of above fields which
> would point to the problem(like CPU, memory, SWAP etc)?
>
> Virtual Memory sub system:
>
> procs memory pages intr cpu
> r w u act free wire fault cow zero react pin pout in sy cs us
sy
> id
>
> AS above for this also i would like to know what should be the thresholds
of
> above fields which would point to the problem?
>
> I/O Sub-system:
>
> tty fd0 rz0 rz1 dk3 cpu
> tin tout bps tps bps tps bps tps bps tps us ni sy id
>
> AS above for this also i would like to know what should be the thresholds
of
> above fields which would point to the problem?
>
> Swap:
> Allocated space:
> In-use space:
> Free space:
>
> AS above for this also i would like to know what should be the thresholds
of
> above fields which would point to the problem?
> Thanks in advance. I shall summarize.
>
> Regards
> Himanshu
>
>
> Man is a heroic bieng with his own happiness as
> moral purpose of life, with productive achievement
> as the noblest activity & reason as his only absolute
>
>
> -----Original Message-----
> From: Himanshu Khona [mailto:himanshu.khona_at_patni.com]
> Sent: Wednesday, August 20, 2003 5:03 PM
> To: 'tru64-unix-managers_at_ornl.gov'
> Subject: Summary: Finding out current firmware level?
>
>
> Hi all,
>
> Thanks to so many people for quick response.
>
> The general consensus was:
> 1) consvar -g version.
> 2) grep Firmware /var/adm/messages
>
> Regards
> Himanshu
>
> Man is a heroic bieng with his own happiness as
> moral purpose of life, with productive achievement
> as the noblest activity & reason as his only absolute
>
>
> -----Original Message-----
> From: tru64-unix-managers-owner_at_ornl.gov
> [mailto:tru64-unix-managers-owner_at_ornl.gov]On Behalf Of Himanshu Khona
> Sent: Tuesday, August 19, 2003 5:39 PM
> To: tru64-unix-managers_at_ornl.gov
> Subject: Finding out current firmware level?
>
>
> Hi all,
>
> How can i know the current firmware level from the command prompt?
> Like we have eeprom command in solaris( i am sorry to mention solaris but
> that is what i have worked on till now).
>
> Thanks in advance
> Himanshu
>
> Man is a heroic bieng with his own happiness as
> moral purpose of life, with productive achievement
> as the noblest activity & reason as his only absolute
>
Tom
Dr. Thomas P. Blinn + Tru64 UNIX Software + Hewlett-Packard Company
Internet: tpb_at_zk3.dec.com, thomas.blinn_at_compaq.com, thomas.blinn_at_hp.com
110 Spit Brook Road, MS ZKO3-2/W17 Nashua, New Hampshire 03062-2698
Alpha Hardware Platforms and I/O Phone: (603) 884-0646
ACM Member: tpblinn_at_acm.org PC_at_Home: tom_at_felines.mv.net
Worry kills more people than work because more people worry than work.
Keep your stick on the ice. -- Steve Smith ("Red Green")
My favorite palindrome is: Satan, oscillate my metallic sonatas.
-- Phil Agre, pagre_at_alpha.oac.ucla.edu
Yesterday it worked / Today it is not working / UNIX is like that
-- apologies to Margaret Segall
Opinions expressed herein are my own, and do not necessarily represent
those of my employer or anyone else, living or dead, real or imagined.
Man is a heroic bieng with his own happiness as
moral purpose of life, with productive achievement
as the noblest activity & reason as his only absolute
Received on Fri Sep 05 2003 - 11:57:50 NZST