ѧ
JOURNAL OF SOFTWARE
1999ꡡ109ڡVol.10No.91999



һݿϵͳTPC-C*
ڸꡡʡ֣͡Զ
ժҪ½һϵͳܲԱ׼TPC-CݿϵͳFishϵʵ֣ʵӰݿϵͳܵҪؽ֤ͷ.
ؼʡBenchmarkݿϵͳTPC-C.
ͼšTP311
Performance Analysis of an Object-oriented Database System with TPC-C Benchmark
YU Ge WANG,Guo-ren WANG,Xin-hui,ZHENG Huai-yuan
(Department of Computer Science and Engineering Northeastern University Shenyang 110006)
AbstractIn this paper, the authors discuss a known on-line transaction processing testing benchmark TPC-C, and its design and implementation on an object-oriented database management systemFish. Based on the testing results, the evaluation and analysis on the major factors that affect the database system performance are given.
Key wordsBenchmark, OODBMS, TPC-C.
ݿϵͳԱ׼ṩ˺һݿϵͳܵĹ淶ͷԽԽҪ1.ΪһݿϵͳݿϵͳƳӦû,繤(CAD/CAM)ýݴ.Ĵѧ֯ΪݿϵͳЩӦе,ѾһЩĲԱ׼Cattell2ƵOO1Ա׼˹ǴѧƵOO73ݲԱ׼.ݿϵͳObjectStore,O2ѾЩ,ڲԽϵͳĸĽ.ЩԱ׼ģĹӦþṹӡ󡢹ѯµµص㣬ˣͬڴͳӦ.
ݿ⼼ķչݿϵͳҲ֮УŵͼλܵĹվPCռݿϵͳӦԽԽ㷺.֪˶ݿϵͳе.ˣѡTPC-CԱ׼Դ˼Բ.²ָTPC-CԱ׼ݿϵͳFishϵʵ֣ԲԵĽ˷ͱȽϣΪOLTP(online transaction processing)ݿϵͳһЩĽ.еıϵͳFishǺձݴѧһSolaris 2.5/(X86Sparc)Windows NTƽ̨NOW(network of workstation)/NOPC(network of PC)㻷ķֲʽݿϵͳ.FishϵͳֲʽҳʽWAKASHI4ݣODMG 2.05ݱ׼ֳ֧־ûC++INADA/ODMG.ͼ1ΪFishϵͳṹ.WAKASHIΪݿӦṩ˴洢ͻ2PCCallback(ؽ)Э֧(intra-transaction)ݻ棬ϵͳʵϸ(2PL)ȴͼ(WFG)ֲʽ޵ȴ(DWDL)6ݵȷƣ֧ǶͲд.ǲTPC-CԱ׼Fishϵͳ˲:(1) ԲԣҵӦҪĹܡOLTPҪĹܡACIDԵݵ(2) ܲԣOLTPӦԡûܡݿ.

ͼ1FishϵͳҪṹ
ĵ1ڸҪTPC-CԱ׼.2TPC-CFishϵͳϵʵ.3ڶԲԽ˱ȽϺ.4ܽȫ.
1TPC-C
TPC-C7ݲԱ׼TPC(transaction processing performance council)ίԱ1992깫һںϵͳܼܺ۸(performance/cost)ĲԱ׼.TPC-CԱ׼ҪĿ:1 ģ²ֻĶ񣻣2 ģⲻͬʽ(ӦʱϸҪ)ʱʽ(ӦʱҪȽϿ)3 ϸACID(atomicity,consistency,isolation,durability )4 ӵиӵݽṹϵ5 öݷʷʽ6 ģظ´ݿϵĶû.TPC-CԱ׼ʵҵΪģͣģͼ2ʾ.

ͼ2TPC-Cģ
,˾(company)ӵֿ(warehouse)ṩƷ(item)ÿֿṩ10ֵ(district)1 000 000ƷÿֵΪ3 000˿(customer)ṩ۷.TPC-CԱ׼5񣺶(new-order)(payment)(order-status)(delivery)(stock-level).ж3Ϊ񣬶Ϳֻ5ɶѯ˿ͶͲѯɵһҵ.TPC-CУÿֿ105TPC-Cն˲ضTPC-CݿвÿնеTPC-C񶼱һĻϱ.Ҫ涨ʱ(8Сʱ)¼ڴʱɵĶʱ(λmin.)ɵĶ,õTPC-CҪĽָMQTh(maximum qualified throughput)ʾƽÿ˶ٸȻ,MQThֵԽζOLTPԽ.
2TPC-CԵʵ
˰ODMG 2.0׼TPC-CݿеƺTPC-CNOPCµʵ.
2.1TPC-C
TPCίԱṩTPC-C淶,TPC-CݿģԹϵʽģӱ任ֱӽӦõݿȻǲʵ.ˣҪTPC-C淶дͳĹϵģתɷODMG 2.0׼ģͣȻķTPC-Cݿ⣬INADA/ODMGʵһ.ͨԹϵģͺODMG 2.0׼һЩɷֵ໥ӦϵĿ죬ǶӳϵתΪODMG 2.0壬1ʾ.
1ݿⶨӳ

ϵģODMG 2.0ģ
ģʽ

Ԫ
ݳԱ
(short,long,float,char,char,vchar,...)(literal) (d-Short,d-Long,d-Float,d-Char,d-String,...)
ؼֹؼ
ؼϵ(d-Rel-Ref,...)

ոӳ,µĲ轫TPC-CݿĹϵģʽתOOģʽ
(1) 9TPC-C淶涨TPC-Cݿе9Ŷά
(2) ݳԱӦеԣ
(3) ϵϵӦеؼ֣
(4) Ϊÿඨ幹캯
(5) ͨĸ3࣬γɼ̳вΣ
(6) ļ̳вжԻ
(7) ÿķӿ.
ϸɶTPC-CݿOOģʽĶ壬ͼ3ʾODMG 2.0׼ƵTPC-Cݿϵͼ.ǵӰݿϵͳӦõأѡΪԵ. 


ͼ3ϵͼ
(1) û Ϊÿûʼձڻ״̬ʵеû൱ڶû̼(MPL).ڲִе£ͬMPLֵᵼ²̶ͬȵԴͻ(throughput)Ҫ.TPC-CԹ淶ֻ10û1ֿʵУǷֱû110˲ԣĿڿ첻ͬµܱ֣̽NOPC£ݿϵͳΪﵽȡõMPLֵ.
(2) ͬƣ ݿϵͳ(2PL)֤񲢷ִʱĿɴ.2PLܻᵼ,ṩ(deadlock detection,DD)ͽʮֱҪ.ͽƻϵͳӶ⿪,ŻƶϵͳʮҪ.Ϊ첻ͬͽƶݿϵͳܵӰ죬Fishƺʵ3ֲͬͽƣֱΪڳʱ(timeout)8ݡȴͼ(wait for gragh,WFG)8ݺͻڷֲʽ޵ȴ(distributed wait-depth limited,DWDL)6.Timeoutķ򵥵ͽ취.óʱÿʱ.ʱڿͻʵ֣ͻʱãʱ񽫵ȴһʱ䣬ȴʱĳɱTimeout-limit.һĵȴȴʱ䳤ȣͱΪ񽫻ᱻֹ(abort)Խ.ַҲһ⣬ĳЩ£һִʱᳬTimeout-LimitǼ⵽ûʱ򣬳ִʧ.ǵʵдTimeout-LimitΪ20sTimeout-LimitΪ10s.WFGķһȷ취.ݿάһŵȴͼʱӳ֮ȴϵı߽ᱻȴͼԸºĵȴͼ⣬ȷǷ⵽ѡ·ĳΪߡ(victim)ź(signal)֪ͨ.ᡱ(ִʱ̵)ѡΪ.õȴͼķȷģܼ⵽Ĵ.ֲʽ޵ȴ(DWDL)ǸĽĲƷںܸߵMPLֵӵ(data contention).ڻDWDLķУȴȵĲԤķ.ڻWFGķݿάһŵȴͼʱӳ֮ȴϵı߱ȴͼԸºĵȴͼ֮ȴȵļ.ȴȴ1һĲ,ѡȴͼеĳΪߣź֪ͨ.ʱ֮ĵȴǴ1ģ,DWDLܹԤķҲ˵DWDLܹǱڵ.ʵϣȴȴ1ʱܻ˵DWDLܻᵼļ(fake restart).
ǵʵУֱTimeoutWFGDWDL3ַ3ʵ飬ÿһʵû110TPC-C.ΪϵͳܣÿһβǼ¼:MQThֵʣܵɵ֮.
2.2Ի
ʵУʹ̨100M̫ϵAMD K6-233 PC.һ̨ݿһ̨Զն˷ͼ4ʾ.ÿ̨PCΪAMD K6-233CPU64MBڴ棬4.3GBӲ.ԴINADA/ODMG 1.0C++дʹSun Workshop 3.0.1C++.

ͼ4ƽ̨
ʵУTPC-Cݿ⽨ڷֲʽWAKASHIеPCϣһ̨PCеԶն˷ͨtelnetԶ̵¼WAKASHIڵPCݿ.TPC-CҪնX-Windowϵͳxtermģ.ÿxtermʹһûն.ÿһβԳ8Сʱ.ǱдUnix shellű(shell script)ʹеxtermͬһʱУʹalarm()ʹԳ涨ʱ˳.ʵеTPC-CݿСΪ185MB.ʼ״̬ʱݿеĶΪ1ֿ(Warehouse)1 000 000Ʒ(Item)10ֵ(District)3 000˿(Customer)1 000 000(Stock)30 000ʷ¼(History)30 000(Order)283 998ϸ(OrderLine)0¶(New-Order).ֲͬ͵ϱȼĵȴʱ(TPC-C淶涨)2.ǵû(MPL=1)ʱȻ,ûMQThֵ޹صģȡûʱMQThֵMQTh(MPL=1)=1.40ձ2ĻϱȺ͵ȴʱõMQThMPLĺϵ.
MQTh(MPL=i)=MQTh(MPL=1)i.(1)
ɹʽ(1)֪Ϊ0TPC-Cݿֻ1ֿ£1ֿ10նMQThֵΪ14.0tpmC.
2ȴʱͻϱ

ϱȵȴʱ(sec.)
New-Ordern/a30
Payment43.0%15
Delivery4.0%7
Order-Status4.0%12
Stock-Level4.0%7

TPC-CĲԹҪظ4(1) ԤĻϱȣ5TPC-Cѡȡ1.2 Ļʾ˵Ȼһʱ䣬ʱ䰴TPC-C淶Ҫɱkeyingtime.3 ִѡ񣬶ݿӡɾ޸ĵȲ.4 ĻʾִнȻһʱ䣬ʱ䰴TPC-C淶Ҫɱthinkingtime.ǰ53Ǹٲο2ϱȿ֪92%TPC-CǸ.ˣͻķûԽƵ. 
3ͷ
ڸ3ʵĽͼܷ3геĲݣͼ5ʾ.
3Խ

MQThֵ
MPLTimeoutWFGDWDLֵTimeoutWFGDWDL
11.401.401.381.400.000.000.00
22.602.352.552.800.880.000.00
34.104.103.654.200.651.241.16
45.104.655.055.605.240.880.00
53.956.206.157.008.211.810.36
62.757.707.358.4015.941.472.13
70.958.458.509.8021.903.172.63
80.659.7010.1011.2038.543.543.07
90.5510.6510.7512.6059.473.464.50
100.0311.5011.1514.0061.224.646.90
1111.8511.2015.408.408.82
1212.4012.1516.8011.3817.61
1312.5012.3018.2013.9317.59
1413.4513.3519.6017.5119.82
1513.1017.5521.0021.4317.17
1613.1517.2522.4028.1721.62
1718.9515.9523.8026.0224.15
1818.5525.2030.56
1917.3226.6029.21
2012.4028.0051.72


ͼ53Ľ
(1) Timeoutʵ.ͼ5(a)ͱ3֪TimeoutMQThֵΪ5.10СMQThֵΪ0.03MQThֵķֵûΪ4ʱ.ûС4ʱĲִжȼӴ,MQThֵû.ΪÿTPC-C񶼱߹涨keyingtimethinkingtimeʱ䣬ûĲִжȼӴҲŲִжȵ߶.ǵû4MQThֵûݼΪʱи񲢷ִУݵķʳͻӴĴڣȴTimeout-Limitʱ䣬ʱϸߵ񲢷ִжȵºܶڵȴTimeout-LimitʱԾûеõԽԽʱһ.MQThֵȣûС4ʱ,ʵMQThֵMQThֵȽǺ.˵MPLֵС4ʱTimeoutʹϵͳȡúܺõ.ͼ5(b)ԿûӶ.ûС4ʱʽϵͣû59䣬ƽ60%ٶȵ.û4MQThֵ½ԭ.û9ʱʷûкܴӣûΪ9ûΪ10ʽ2%.Ϊʱܴ󲿷ֵûбڴ֮ǰϵͳɹأ󲿷Ѿڳʱ.ȻǿͨӳʱĵȴʱTimeout-LimitϵͳµִӰ죺ûٵ£ĲִжȻܵͣӶ谭MQThֵ.ɼûTimeoutҪһTimeout-Limitȵѡ⣬ʵǺȷģΪӦϵͳ͸ˮƽȷ.
(2) WFGʵ.ͼ5(a)ͱ3֪WFGMQThֵΪ18.95СMQThֵΪ1.40MQThֵķֵûΪ17ʱûС17ʱMQThֵûҲĲִжȼӴԵ.ûΪ17ʱMQThֵﵽֵ.˷ֵ֮ûӣMQThֵʼ½1920û䣬MQThֵ½.ûС6£ʵMQThֵMQThֵǺϵýϺ.ͼ5(b)ԿûС10ʱʷǳͣûС19֮ǰϻû1977%ٶȼ.MQThֵʵı仯ƱWFG൱һMPLΧƽ.ûΪ16ʱʺûΪ19ʱʻͬMQThֵڴﵽ17ûʱķֵ18.95֮ûӶ.ǲڽӱȴͼڵ㣬ͼл·㷨.ʵз֣⸴ӵĺ20ڵĵȴͼǷڻ·ʱ俪Ϊ10-1sҪԶԶСڰkeyingtimethinkingtimeһTPC-Cʮִʱ.ˣû⿪ЩʹMQThֵڹ˷ֵ֮½(MQTh(MPL=17)=18.95MQTh(MPL=20)Ϊ12.40).ԭԴ(CPUڴ桢I/O豸)ӵʱϵͳԴľѾûиԴɹʹãԼϵͳܵĽһߣ18.95ϵͳڱʵNOPCܴﵽMQThֵ.
(3) DWDLʵ.ͼ5(a)ͱ3֪DWDLMQThֵΪ17.55СMQThֵΪ1.40ûС15ʱMQThֵûεûΪ15ʱMQThֵﵽֵ.˷ֵ֮ݳͻļӾ磬ûӣMQThֵ½.MQThֵûС6£ʵMQThֵƽMQThֵ.ͼ5(b)ԿûС10ʱʷǳͣûΪ1012֮ʱ112%ٶȼ.û12֮ʷ,˵˻DWDLϵͳظص²ƽȣҲͺܺõ˵MQThֵû9֮ἱ½.ûΪ17ʱĸʵµ͵MQThֵ.
(4) ܱȽ.MQThֵǶ(ͼ5(a)ͱ3)WFGMQThֵΪ18.95Timeout͵MQThֵΪ5.10WFGTimeout270%.DWDLMQThֵΪ17.55ķֵûΪ15ʱ˵WFGܽϺ.ʽǶ(ͼ5(b)ͱ3)ûΪ10ʱTimeoutķߵ61.22WFGķ͵4.64.TimeoutķȻWFGķ1200%DWDL800%.˵ΪʲôTimeoutWFGDWDLøԭǻTimeoutƲɱص¼Ĵ.TPC-C淶ûΪ10£WFGõMQThֵΪ11.50TimeoutͽΪ0.03DWDLΪ11.15WFG3%.WFGϵͳ֮ƽȵ.
4 
NOPCµݿϵͳFishTPC-Cʵ,TPC-CԱ׼OOơFishϵTPC-CԵʵ֡3ƵܶԱʵ顢ʵܷ.ǵĲԽܷڵMPLֵ£WFGTimeoutDWDLܶ࣬ʵֵֵǺϵýϺ.ڸMPLֵ£WFGDWDLܱTimeoutãTimeoutģԭ̫.DWDLûΪ15ʱֵַWFGķֵûΪ17ʱ˵ظµıWFGҪǿDWDL.
е1ᵽģMQThֵTPC-CһҪĺָ꣬ΪӲƽ̨ԽӰܴһֱϵͳ۸ܱȵָܿ͹۵˵.ǻһ㿼ǣTPCίԱTPC-C淶зһݺӵļ۸ָܱ꣬Ϊϵͳļ۸MQThֵ(Ԫ)۸Ӳ(ϵͳݿϵͳ)裬UPSȵļ۸.ɱ3֪FishϵͳMQThֵӦΪ11.50tpmCƽ̨ļ۸Ϊ2 000Ԫü۸ܱΪ173.91/tpmCڿɱǿļ۸ָܱϼӽ̲ƷĲָ.磬96AlphaCPUCompaq AlphaServer8400ϵOracle8.0ֵļ۸ܱΪ139.49/tpmC.йظ̲ƷTPC-CԽԴhttp://www.tpc.org/new-resultַõ.
ͨTPC-CԣΪҪڶûµؼ֮һͨĽȺͷʹʽ.ڵ̨PCԴԣ֮ԴӾ磬ʹϵͳﵽԴӵ(thrash point)ʱκͼŻĽ㷨ͷ㷨ԻȡŬͽ͵ģʱ,ڲϵͳܼ۸ȵȡýϸߵͱNOPCĲд.,һĹڴNOPCµĲдTPC-Cԣ(1) TPC-CݿTPC-CķֲγĲд;(2) TPC-CĲлγڵĲкݿĲвѯ. 
*оõ6Ӣ𡢽ʦʡȻѧ.
ͨѶϵˣڸ꣬110006,ѧѧ빤ϵ
߼飺ڸ꣬1962ڣʿʦҪоΪݿϵͳ뼼.
ʣ1966ڣҪоΪݿ⼯ɣݿ⣬ݿ⣬ѯ.
ͣ1973ʿҪоΪݿϵͳݿϵͳԣѯ.
֣Զ1931ڣҪоΪݿۺͼ.
ߵλѧѧ빤ϵ  110006E-mail:{yuge,wanggr}@mail.neu.edu.cn
οף
1Jim G. The Benchmark Handbook. 2nd ed., New York: Morgan Kaufmann Publishers, Inc., 1993
2Cattell R, Skeen J. Object operations benchmark. New York: ACM Transactions on Database Systems, 1992,17(1):3249
3Carey N J, DeWitt D J, Naughton J F. The OO7 Benchmark. In: Buneman P, Sushil Jajodia eds. Proceedings of SIGMOD, Washington, D.C: ACM Press, 1993. 1221
4Yu Ge, Kaneko H, Bai Guang-Yi et al. Transaction management for a distributed object storage system WAKASHIdesign, implementation and performance. In: Gray A, Larson Per-Ake eds. Proceedings of the 12th ICDE, Birmingham, U K: IEEE Computer Society Press, 1996. 380389
5Cattell R et al. The Object Database Standard ODMG 2.0. New York: Morgan Kaufmann Publisher, Inc., 1997
6Franaszek P A et al. Distributed Concurrency control based on limited wait-depth. IEEE Transactions on Parallel Distributed Systems, 1993,11(1):12461264
7Transaction Processing Performance Council(TPC). TPC BenchmarkTM C Standard Specification Revision 1.0. New York: Morgan Kaufmann Publishers, Inc., 1992
8Bernstein P A, Hadzilacos V, Goodman G. Concurrency Control and Recovery in Database Systems. Madison: Addison-Wesley Publishing Company, 1987
ոڣ1998-06-02޸ڣ1998-09-25
