Method and system for conducting statistical quality analysis of a ...
USOO5655074A
United States Patent [191
[11]
Patent Number:
Rauscher
[45]
Date of Patent:
5,655,074 Aug. 5, 1997
[54] METHOD AND SYSTEM FOR CONDUCTING STATISTICAL QUALITY ANALYSIS OF A COMPLEX SYSTEM
Yan, Performance Tuning with AIMS, Twenty?Seventh
[75] Inventor: Karl Frederick Rauscher, New Tripoli, Pa.
Lai et al.. Total Reliability Management for Telecommuni cations Software. GLOBECOM 93: IEEE Global Telecom
[73] Assignee: Bell Communications Research, Inc..
munications Conference, at 505.
Morristown. NJ.
(1994). at 625.
MacEKG Manual, Micromat Computer Systems (1992).
[21] Appl. No.: 498,958 [22] Filed: Jul. 6, 1995
Primary Examiner-Robert W. Beausoliel, Jr. Assistant Examiner—Norman M. Wright
[51]
Int. Cl.6 ..
[52]
US. Cl. .............................. .. 395/183.14; 395/183.01;
[58]
Field of Search ....................... .. 395/183.01. 184.01,
G06F 11/00; G06F 17/60
364/552; 364/554
395/650, 700, 183.14. 183.02; 364/551.01, 554. 552
[56]
Annual Hawaii International Conference on System Science
References Cited U.S. PATENT DOCUMENTS 4,044,244
8/1977 Foreman et a1. ..................... .. 371/221
5,038,307
8/1991 Krishnakumar et al.
364/578
5,245,638 5,253,331
9/1993 Gustafson ............ .. 10/1993 Lorenzen et a1.
395/l84.01 ........ .. 395/50
5,255,385
10/1993
Kikuchi ........ ..
5,270,957
12/1993
Murray
395/183.01
... . . . . . . . .
. . . . . . . ..
364/554
364/551.01
Attomey, Agent, or Firm—Joseph Giordano
[57]
ABSTRACT
A method and system for providing a software tool that aids on the current state of the art of systems engineering of large software systems. The process begins with the step of gathering data on observations of a large number of char acteristics about a software system (including historical and
planned system adjustments) for each uniquely identi?able software component. Also gathered are historical data regarding faults or problems with each software component. The fault data is statistically mapped to measured charac teristics of the software to establish a risk index. The risk
index can be used as a predictive tool establishing which characteristics of the software are predictive of the soft
5,293,323
3/1994 Doskocil et a1.
5,539,907
7/1996 Sn'vastava et a1. .
5,548,718
8/1996 Siegel et al. ..................... .. 395/183.l4
ware’s performance or. alternatively, the risk index may be
OTHER PUBLICATIONS
used to rank order the components to determine which components need less testing in a effort to save resources.
....... .. 3951700
Hofmann et al., Distributed Performance Monitoring: Meth ods. Tools, and Applications. IEEE Tranas. on Parallel and Distrib. Systems, Jun. 1994. at 585.
13 Claims, 4 Drawing Sheets
w [71] tields.':' delimited. populated with values as described below] FIELD DESCRIPTION
U.S. Patent
Aug. 5, 1997
Sheet 1 of 4
5,655,074
FIG. 1
‘mm-'7.
rm“! 5 T _________ ml
!®+—!~ I : I
i i i:
i
l
l
I
I
l
i
!@j—!-“ 2-2 i
:
L__
l
a
:
i@J=—-—T'* 2-3
i
'
|
1
___:
L“
T10
'
i ___
20
l
:_____
|
E
| ______ "J
\40 T30
FIG. 5 XXX
ML THRESHHOLD—->
l
I
US. Patent
Aug. 5, 1997
Sheet 2 of 4
5,655,074
FIG. 2 /\
MR: '
H. TE
SCMP 1.0:l date] :Pruduct-lzProducl-2rl0ad- :L0ad-2:Load-3zload-4zlbad-5zSA?Gl-l0z SACGL:[lElzSAEGL-OB:SACGL-OY:SACGL-OB:SACGL-OSzSACGL
SACGL:02:SACGL-01:SPC:Lan?uage:TL:NCSL:EL:BL:
USACBLn Calls : LSACGLn Cal Span: SACGLn-LSA
LSAEGL?-l Call Span:0r:U0r:0d:U0d:VzUVzLVS: HFC2HPL :HPV:HPD:HPE:HEPL: : : : : : : : 1 : : : : : : : : : :
M: [Luz [70 fields,“:' delimited. populated with values as described below]
FNIAErlED
FIELD DESCRIPTION
V
0
nes
?
ONES
EVE
FIE
In
E
S
-
US. Patent
Aug. 5, 1997
Sheet 3 of 4
5,655,074
FIG. 3A 5; LOAD1
s1
s3 LOAD?
54
[11
$01
as scz "DB1
as cum
-------------------------------------------------------------------- —
FIG. 3B 91
X11 X
HENTRIES
11
\
X12
91
91
\ \ X\15
X13 X14
______________________ _.
X11
5
_
E
.
5
Xm
91
-------
_/91 9i -------- -- Xns
US. Patent
Aug. 5, 1997
Sheet 4 0f 4
5,655,074
FIG. 4 /\
0 RESIDENT APPLICATIONS '\ 73
S11 311 321
S12
s13
S10
N
FIELDS 72
3n1
8n0
71/
/
FIG. 5 /\
B? FILE 1 " EIJFI11
83 -
\
“f EDN1A ‘
FILE 2
92
United States Patent [191
[11]
Patent Number:
Rauscher
[45]
Date of Patent:
5,655,074 Aug. 5, 1997
[54] METHOD AND SYSTEM FOR CONDUCTING STATISTICAL QUALITY ANALYSIS OF A COMPLEX SYSTEM
Yan, Performance Tuning with AIMS, Twenty?Seventh
[75] Inventor: Karl Frederick Rauscher, New Tripoli, Pa.
Lai et al.. Total Reliability Management for Telecommuni cations Software. GLOBECOM 93: IEEE Global Telecom
[73] Assignee: Bell Communications Research, Inc..
munications Conference, at 505.
Morristown. NJ.
(1994). at 625.
MacEKG Manual, Micromat Computer Systems (1992).
[21] Appl. No.: 498,958 [22] Filed: Jul. 6, 1995
Primary Examiner-Robert W. Beausoliel, Jr. Assistant Examiner—Norman M. Wright
[51]
Int. Cl.6 ..
[52]
US. Cl. .............................. .. 395/183.14; 395/183.01;
[58]
Field of Search ....................... .. 395/183.01. 184.01,
G06F 11/00; G06F 17/60
364/552; 364/554
395/650, 700, 183.14. 183.02; 364/551.01, 554. 552
[56]
Annual Hawaii International Conference on System Science
References Cited U.S. PATENT DOCUMENTS 4,044,244
8/1977 Foreman et a1. ..................... .. 371/221
5,038,307
8/1991 Krishnakumar et al.
364/578
5,245,638 5,253,331
9/1993 Gustafson ............ .. 10/1993 Lorenzen et a1.
395/l84.01 ........ .. 395/50
5,255,385
10/1993
Kikuchi ........ ..
5,270,957
12/1993
Murray
395/183.01
... . . . . . . . .
. . . . . . . ..
364/554
364/551.01
Attomey, Agent, or Firm—Joseph Giordano
[57]
ABSTRACT
A method and system for providing a software tool that aids on the current state of the art of systems engineering of large software systems. The process begins with the step of gathering data on observations of a large number of char acteristics about a software system (including historical and
planned system adjustments) for each uniquely identi?able software component. Also gathered are historical data regarding faults or problems with each software component. The fault data is statistically mapped to measured charac teristics of the software to establish a risk index. The risk
index can be used as a predictive tool establishing which characteristics of the software are predictive of the soft
5,293,323
3/1994 Doskocil et a1.
5,539,907
7/1996 Sn'vastava et a1. .
5,548,718
8/1996 Siegel et al. ..................... .. 395/183.l4
ware’s performance or. alternatively, the risk index may be
OTHER PUBLICATIONS
used to rank order the components to determine which components need less testing in a effort to save resources.
....... .. 3951700
Hofmann et al., Distributed Performance Monitoring: Meth ods. Tools, and Applications. IEEE Tranas. on Parallel and Distrib. Systems, Jun. 1994. at 585.
13 Claims, 4 Drawing Sheets
w [71] tields.':' delimited. populated with values as described below] FIELD DESCRIPTION
U.S. Patent
Aug. 5, 1997
Sheet 1 of 4
5,655,074
FIG. 1
‘mm-'7.
rm“! 5 T _________ ml
!®+—!~ I : I
i i i:
i
l
l
I
I
l
i
!@j—!-“ 2-2 i
:
L__
l
a
:
i@J=—-—T'* 2-3
i
'
|
1
___:
L“
T10
'
i ___
20
l
:_____
|
E
| ______ "J
\40 T30
FIG. 5 XXX
ML THRESHHOLD—->
l
I
US. Patent
Aug. 5, 1997
Sheet 2 of 4
5,655,074
FIG. 2 /\
MR: '
H. TE
SCMP 1.0:l date] :Pruduct-lzProducl-2rl0ad- :L0ad-2:Load-3zload-4zlbad-5zSA?Gl-l0z SACGL:[lElzSAEGL-OB:SACGL-OY:SACGL-OB:SACGL-OSzSACGL
SACGL:02:SACGL-01:SPC:Lan?uage:TL:NCSL:EL:BL:
USACBLn Calls : LSACGLn Cal Span: SACGLn-LSA
LSAEGL?-l Call Span:0r:U0r:0d:U0d:VzUVzLVS: HFC2HPL :HPV:HPD:HPE:HEPL: : : : : : : : 1 : : : : : : : : : :
M: [Luz [70 fields,“:' delimited. populated with values as described below]
FNIAErlED
FIELD DESCRIPTION
V
0
nes
?
ONES
EVE
FIE
In
E
S
-
US. Patent
Aug. 5, 1997
Sheet 3 of 4
5,655,074
FIG. 3A 5; LOAD1
s1
s3 LOAD?
54
[11
$01
as scz "DB1
as cum
-------------------------------------------------------------------- —
FIG. 3B 91
X11 X
HENTRIES
11
\
X12
91
91
\ \ X\15
X13 X14
______________________ _.
X11
5
_
E
.
5
Xm
91
-------
_/91 9i -------- -- Xns
US. Patent
Aug. 5, 1997
Sheet 4 0f 4
5,655,074
FIG. 4 /\
0 RESIDENT APPLICATIONS '\ 73
S11 311 321
S12
s13
S10
N
FIELDS 72
3n1
8n0
71/
/
FIG. 5 /\
B? FILE 1 " EIJFI11
83 -
\
“f EDN1A ‘
FILE 2
92
