System and method for clustering servers for performance and load ...
US006965938B1
(12) United States Patent
(10) Patent N0.: (45) Date of Patent:
Beasley et al. (54) (75)
SYSTEM AND METHOD FOR CLUSTERING SERVERS FOR PERFORMANCE AND LOAD BALANCING
7/2003 6,594,819 7/2003 6,601,084 8/2003 6,606,643 8/2003 6,611,822 10/2003 6,631,402 2/2004 6,687,731 6,725,264 B1* 4/2004 6,760,775 B1* 7/2004 6,801,949 B1 * 10/2004
Inventors: Robert C. Beasley, Durham, NC (US);
Susan B. Cirulli, Endicott, NY (US); Wendy D. Neuberger, Vestal, NY
(US); John J. D’Esposito, Bayside, NJ
(US) (73) (*)
Corporation, Armonk, NY (US) Subject to any disclaimer, the term of this patent is extended or adjusted under 35
......... .. 717/170
Emens et al. ....... .. Beams et al.
. ... .
Devine et al.
718/105 .. 709/224 . . . ..
706/11
709/217
Kavak ......... ..
718/105
Christy ........... ..
709/225
Anerousis et al.
709/238
Bruck et al. .............. .. 709/238
Request for Comments (RFC) 1738; Dec. 1994* Brown et al.; “Mastering Lotus Notes”; pp. 6-15, 486-493; ISBN 0782113028; 1995*
(Continued) Primary Examiner—Marc D. Thompson (74) Attorney, Agent, or Firm—William E. Schiesser; Shelley M Beckstrand
(21) Appl. No.: 09/657,215 (51) (52) (58)
Ciarlante et al.
Bhaskaran et al.
Berners-Lee et al.; “Uniform Resource Locators (URL)”;
U.S.C. 154(b) by 704 days.
(22) Filed:
NOV. 15, 2005
OTHER PUBLICATIONS
Assignee: International Business Machines Notice:
US 6,965,938 B1
Sep. 7, 2000
Int. Cl.7 ............................................. ..
G06F 15/16
ABSTRACT
(57)
US. Cl. ..................................... .. 709/229; 709/248
Field of Search .............................. .. 709/105, 227,
709/202, 250, 201, 205, 248, 229, 235/379, 707/100, 104, 102, 2, 4, 718/101, 105, 106 References Cited
(56)
6/1999 Attanasio et al.
6,104,717
8/2000
*
6,125,363 A * 6,163,805
A
*
6,219,680 B1 * 6,330,575
6,381,644 B2 *
4/2002
6,523,027 B1 * 6,578,068 B1 *
Silva et al.
. . . ..
Moore et al.
370/401
707/100
.....
. . . ..
4/2001 Bernardo et al. 12/2001
6,466,949 B2 * 6,466,980 B1 * 6,516,327 B1 *
709/224
.........
9/2000 BuZZeo et al. .. 12/2000
B1 *
6,401,120 B1 *
Coile et al.
709/227
.. 715/501.1
.......
Munguia et al. . . . .
. . . ..
715/513
. . . .. 709/225
6/2002 Gamache et al.
709/226
10/2002 Yang et al. ....... .. 707/10 10/2002 Lumelsky et al. ........ .. 709/226 2/2003 Zondelvan et al. ....... .. 707/200 2/2003 6/2003
infrastructure including a ?rst network dispatcher and a virtual cluster of Domino.Go servers. The network dis servers in virtual server cluster. Communications from this
2/1998 Stewart .................... .. 395/615
5,918,017 A * A
catalog on the Web. Client browsers are connected to a GWA
patcher sprays out browser requests among con?gured .nsf
U.S. PATENT DOCUMENTS 5,715,453 A
A hybrid Notes/DB2 environment provides a requisition
virtual server cluster are, in turn, dispatched by a second network dispatcher servers in a Domino cluster. External objects, primarily for a GUI, are served in a .dfs and include
graphic ?les, Java ?les, HTML images and net.data macros. The catalog is built from supplier provided ?at ?les. Afront end is provided for business logic and validation, as also is a relation database backend. HTML forms are populated
using relational database agents. A role table is used for controlling access both to Notes code and DB2 data. Large amounts of data are quickly transferred using an intermedi ate agent and window.
Underwood ................. .. 707/4 Bowman-Amuah ....... .. 709/203
CLIENT
19 Claims, 20 Drawing Sheets
100
BROWSER
EXTERNAL NETWORK
OBJECTS
-—108
DISPATCHER
CONFIG FILE
-—110
102
PROXY STATEMENTS
RELATIONAL DATABASE SERVER DATA TABLES l
129
US 6,965,938 B1 Page 2 OTHER PUBLICATIONS
Lotus Development Corp., an IBM Subsidiary. Lotus
TeWari et al.; “High Availability in Clustered Multimedia Servers”; Proceedings of the Twelfth International Confer
Domino: Application Development with Domino Designer; Rel. 5. USA, privately printed, 1998. i-vii, 425-430.
ence on Data Engineering; pp 645-654; Feb. 1996.*
Lotus Development Corp., an IBM Subsidiary. Lotus Domino: Domino Enterprise Integration Guide, Rel. 5.
Cardellini et al.; “Redirection algorthirns for load sharing in distributed Web-server systems”; Proceedings. 19th IEEE International
Conference
on
Distributed
Systems; pp. 528-535; May 1999*
USA, privately printed, 1998. 9-20, 107-122, 444-451.
Computing * cited by eXarniner
U.S. Patent
Nov. 15,2005
Sheet 1 0f 20
US 6,965,938 B1
CLIENT ___10[) BROWSER 104
VIRTUAL
NETWORK
—» 355g;
EXTERNAL “108
OBJECTS
DISPATCHER __>
| 102
CONFIC
51
FILE
-_11o PROXY STATEMENTS
S2
S3
DOMINO
SIESL’QRCEER _‘> CLUSTER .
RELATIONAL
@112 DATABASE
—‘> SERVERS
SERVER
I
_
106
S4 S5 S6
DATA TABLES
1 1
J7
129
APPLICATION SERVER -—114
BACK-END SERVERS
FIG. I
1 16 '—
U.S. Patent
Nov. 15,2005
Sheet 2 0f 20
US 6,965,938 B1
120
STATiC URL
7
W3.IBM.COM/TRANSFORM/REQCAT/i’OPENDATABASE RCCREATE 11o
corms FILE PROXY @TATEMENTS
DOWNO CLUSTER SERVERS
URL 1—> _____ __/*
s4
—~>Q-> _____ .._/* §— 124
126
s5 55
-—112
U.S. Patent
Nov. 15,2005
CLIENT BROWSER
——1
Sheet 3 0f 20
US 6,965,938 B1
00
l NETWORK DISPATCHER
__1Q2
(URL REDIRECT)
J, GWA SHARED ____104 GO CLUSTER
¢
(W3—1.|BM
NETOATA
.COM)
‘ 9P5
l
__118
106 /
NETWORK DISPATCHER
’
391,392” OTHER NOTEs “.119
(PROXY)
DB'S:
V
112
SKILLS MATCH AMNF
/
PAB
T29
DEDICATED "DOA/"N0
v
”
SOURCE DATA
I
DATA ACCEPTED AT ENTERPRISE EDI MAILBOX .
l 310 SUPPLIER EXTRACT AND REFORMAT
I
l 312
PROCESS EDI MAILBOX-PU T
CATALOG FLAT FILE IN ENTERPRISE SPECIFIED FORMAT
DATA IN GDG I
|
l 324
l 314I
PROCESSING LOG 52s
TRANSMIT DATA
To ENTERPRISE CATALOG FLAT
FILE IN @005
316
I
l 328
300 301
DELIVERY COMPONENT SEND DATA TO APPLICATION SERVER
302—
330 —— 303
FIG. I7
U.S. Patent
Nov. 15,2005
Sheet 17 0f 20
US 6,965,938 B1
303
APPLICATION SERvER
_114
DATA BASE SERVER
__D (FT/ELSE}
I
J]
i
3“
340
|
DELIVERY
/506
3/35
> CATALOG_S
\
D
360 337
> PRODUCT_S
\
313
$62
COMPONENT-
PROD_MESSAGE_S
-— RECEIVE FILES
\
JOB SCRIPTS \ \ _345 #347 342
31|5
/ \‘ >PROCEDURE To
_
> vAUDATE
REQ CAT wEB
MASSLOAD: READ
< 339
FLAT FILE AND
_
LOAD STAGING TABLES
(12) United States Patent
(10) Patent N0.: (45) Date of Patent:
Beasley et al. (54) (75)
SYSTEM AND METHOD FOR CLUSTERING SERVERS FOR PERFORMANCE AND LOAD BALANCING
7/2003 6,594,819 7/2003 6,601,084 8/2003 6,606,643 8/2003 6,611,822 10/2003 6,631,402 2/2004 6,687,731 6,725,264 B1* 4/2004 6,760,775 B1* 7/2004 6,801,949 B1 * 10/2004
Inventors: Robert C. Beasley, Durham, NC (US);
Susan B. Cirulli, Endicott, NY (US); Wendy D. Neuberger, Vestal, NY
(US); John J. D’Esposito, Bayside, NJ
(US) (73) (*)
Corporation, Armonk, NY (US) Subject to any disclaimer, the term of this patent is extended or adjusted under 35
......... .. 717/170
Emens et al. ....... .. Beams et al.
. ... .
Devine et al.
718/105 .. 709/224 . . . ..
706/11
709/217
Kavak ......... ..
718/105
Christy ........... ..
709/225
Anerousis et al.
709/238
Bruck et al. .............. .. 709/238
Request for Comments (RFC) 1738; Dec. 1994* Brown et al.; “Mastering Lotus Notes”; pp. 6-15, 486-493; ISBN 0782113028; 1995*
(Continued) Primary Examiner—Marc D. Thompson (74) Attorney, Agent, or Firm—William E. Schiesser; Shelley M Beckstrand
(21) Appl. No.: 09/657,215 (51) (52) (58)
Ciarlante et al.
Bhaskaran et al.
Berners-Lee et al.; “Uniform Resource Locators (URL)”;
U.S.C. 154(b) by 704 days.
(22) Filed:
NOV. 15, 2005
OTHER PUBLICATIONS
Assignee: International Business Machines Notice:
US 6,965,938 B1
Sep. 7, 2000
Int. Cl.7 ............................................. ..
G06F 15/16
ABSTRACT
(57)
US. Cl. ..................................... .. 709/229; 709/248
Field of Search .............................. .. 709/105, 227,
709/202, 250, 201, 205, 248, 229, 235/379, 707/100, 104, 102, 2, 4, 718/101, 105, 106 References Cited
(56)
6/1999 Attanasio et al.
6,104,717
8/2000
*
6,125,363 A * 6,163,805
A
*
6,219,680 B1 * 6,330,575
6,381,644 B2 *
4/2002
6,523,027 B1 * 6,578,068 B1 *
Silva et al.
. . . ..
Moore et al.
370/401
707/100
.....
. . . ..
4/2001 Bernardo et al. 12/2001
6,466,949 B2 * 6,466,980 B1 * 6,516,327 B1 *
709/224
.........
9/2000 BuZZeo et al. .. 12/2000
B1 *
6,401,120 B1 *
Coile et al.
709/227
.. 715/501.1
.......
Munguia et al. . . . .
. . . ..
715/513
. . . .. 709/225
6/2002 Gamache et al.
709/226
10/2002 Yang et al. ....... .. 707/10 10/2002 Lumelsky et al. ........ .. 709/226 2/2003 Zondelvan et al. ....... .. 707/200 2/2003 6/2003
infrastructure including a ?rst network dispatcher and a virtual cluster of Domino.Go servers. The network dis servers in virtual server cluster. Communications from this
2/1998 Stewart .................... .. 395/615
5,918,017 A * A
catalog on the Web. Client browsers are connected to a GWA
patcher sprays out browser requests among con?gured .nsf
U.S. PATENT DOCUMENTS 5,715,453 A
A hybrid Notes/DB2 environment provides a requisition
virtual server cluster are, in turn, dispatched by a second network dispatcher servers in a Domino cluster. External objects, primarily for a GUI, are served in a .dfs and include
graphic ?les, Java ?les, HTML images and net.data macros. The catalog is built from supplier provided ?at ?les. Afront end is provided for business logic and validation, as also is a relation database backend. HTML forms are populated
using relational database agents. A role table is used for controlling access both to Notes code and DB2 data. Large amounts of data are quickly transferred using an intermedi ate agent and window.
Underwood ................. .. 707/4 Bowman-Amuah ....... .. 709/203
CLIENT
19 Claims, 20 Drawing Sheets
100
BROWSER
EXTERNAL NETWORK
OBJECTS
-—108
DISPATCHER
CONFIG FILE
-—110
102
PROXY STATEMENTS
RELATIONAL DATABASE SERVER DATA TABLES l
129
US 6,965,938 B1 Page 2 OTHER PUBLICATIONS
Lotus Development Corp., an IBM Subsidiary. Lotus
TeWari et al.; “High Availability in Clustered Multimedia Servers”; Proceedings of the Twelfth International Confer
Domino: Application Development with Domino Designer; Rel. 5. USA, privately printed, 1998. i-vii, 425-430.
ence on Data Engineering; pp 645-654; Feb. 1996.*
Lotus Development Corp., an IBM Subsidiary. Lotus Domino: Domino Enterprise Integration Guide, Rel. 5.
Cardellini et al.; “Redirection algorthirns for load sharing in distributed Web-server systems”; Proceedings. 19th IEEE International
Conference
on
Distributed
Systems; pp. 528-535; May 1999*
USA, privately printed, 1998. 9-20, 107-122, 444-451.
Computing * cited by eXarniner
U.S. Patent
Nov. 15,2005
Sheet 1 0f 20
US 6,965,938 B1
CLIENT ___10[) BROWSER 104
VIRTUAL
NETWORK
—» 355g;
EXTERNAL “108
OBJECTS
DISPATCHER __>
| 102
CONFIC
51
FILE
-_11o PROXY STATEMENTS
S2
S3
DOMINO
SIESL’QRCEER _‘> CLUSTER .
RELATIONAL
@112 DATABASE
—‘> SERVERS
SERVER
I
_
106
S4 S5 S6
DATA TABLES
1 1
J7
129
APPLICATION SERVER -—114
BACK-END SERVERS
FIG. I
1 16 '—
U.S. Patent
Nov. 15,2005
Sheet 2 0f 20
US 6,965,938 B1
120
STATiC URL
7
W3.IBM.COM/TRANSFORM/REQCAT/i’OPENDATABASE RCCREATE 11o
corms FILE PROXY @TATEMENTS
DOWNO CLUSTER SERVERS
URL 1—> _____ __/*
s4
—~>Q-> _____ .._/* §— 124
126
s5 55
-—112
U.S. Patent
Nov. 15,2005
CLIENT BROWSER
——1
Sheet 3 0f 20
US 6,965,938 B1
00
l NETWORK DISPATCHER
__1Q2
(URL REDIRECT)
J, GWA SHARED ____104 GO CLUSTER
¢
(W3—1.|BM
NETOATA
.COM)
‘ 9P5
l
__118
106 /
NETWORK DISPATCHER
’
391,392” OTHER NOTEs “.119
(PROXY)
DB'S:
V
112
SKILLS MATCH AMNF
/
PAB
T29
DEDICATED "DOA/"N0
v
”
SOURCE DATA
I
DATA ACCEPTED AT ENTERPRISE EDI MAILBOX .
l 310 SUPPLIER EXTRACT AND REFORMAT
I
l 312
PROCESS EDI MAILBOX-PU T
CATALOG FLAT FILE IN ENTERPRISE SPECIFIED FORMAT
DATA IN GDG I
|
l 324
l 314I
PROCESSING LOG 52s
TRANSMIT DATA
To ENTERPRISE CATALOG FLAT
FILE IN @005
316
I
l 328
300 301
DELIVERY COMPONENT SEND DATA TO APPLICATION SERVER
302—
330 —— 303
FIG. I7
U.S. Patent
Nov. 15,2005
Sheet 17 0f 20
US 6,965,938 B1
303
APPLICATION SERvER
_114
DATA BASE SERVER
__D (FT/ELSE}
I
J]
i
3“
340
|
DELIVERY
/506
3/35
> CATALOG_S
\
D
360 337
> PRODUCT_S
\
313
$62
COMPONENT-
PROD_MESSAGE_S
-— RECEIVE FILES
\
JOB SCRIPTS \ \ _345 #347 342
31|5
/ \‘ >PROCEDURE To
_
> vAUDATE
REQ CAT wEB
MASSLOAD: READ
< 339
FLAT FILE AND
_
LOAD STAGING TABLES
