о뷢չ
JOURNAL OF COMPUTER RESEARCH AND DEVELOPMENT
1999ꡡ3611ڡVol.36No.111999



InternetϢԴּʵ
̳ɡޡΡС˽Ÿ
ժҪInternetϴʡֲ̬ϢˡϢء.Ϣ£ЧΪûṩInternetԴַѾΪһҪео.沿ֵؽԴֵ⣬ȻЧȴԶʹ.˷ֲЭʽԴֲԣԴַ漰ļؼάĵģ͡WebĵZ39.50ĿԼAgentûӿڵȣӦĽ.ڴ˻ϣйһϵͳԭRDSCCЧInternetԴֵ.
ؼʣԴ֣άĵ壬WebZ39.50Agent
ͼţTP391 TP393
THE TECHNOLOGY AND IMPLEMENTATION OF RESOURCE
DISCOVERY ON INTERNET
WANG Ji-Cheng, ZOU Tao, YANG Xiao-Jiang, PAN Jin-Gui, and ZHANG Fu-Yan
(State Key Laboratory for Novell Software Technology, Nanjing University, Nanjing 210093)
(Department of Computer Science and Technology, Nanjing University, Nanjing 210093)
AbstractA mass of heterogeneous, distributed and dynamic information on Internet has resulted in information overload. With the flood of information, it has become an important research issue to provide users with effective service of resource discovery on Internet. Search engines attempt to solve this problem, yet their effect are far from satisfying. In this paper, a distributed cooperative strategy for resource discovery on Internet is firstly presented. Then, several key technologies involved in resource discovery are studied, including data model, Web document retrieval, bibliographic retrieval based on Z39.50, and agent-based user interface. Finally, a system prototype RDSCC is designed to improve the quality of resource discovery on Internet.
Key wordsresource discovery, multi-dimension document cube, Web, Z39.50, agent
1
ѾϢḻʱ.һ棬ϢԴ㷺WebĵͼףֻϵȣЩ칹ϢֲInternetռУһ棬Ϣ޴.WebĵΪĿǰѾӵ3ҳ棬ÿ46·һٶӣ1.ϢĺǾģ˺ܶʱȴ.£ЧṩInternetԴַ԰ûӴϢԴļҵĲѯصġǡĿԴӼҲͳΪһҪео.
ͳ棬AltaVistaYahooȣͼInternetϵԴ.ǣԴǶȡȡӻάԵ෽ЧԶܹ.⣬ṩWebĵļȱĿ׵ҪϢԴ֧.ڱУInternetԴֵ״˷ֲЭʽԴֲԣͬʱԴַ漰ļؼаάĵģ͡WebĵZ39.50ĿԼAgentûӿڵ.ڴ˻ϣһϵͳԭRDSCCЧInternetԴֵ.
2ԴֵķֲЭ
ע⵽õǵ͵ļзʽͼWebеĵû.ּзʽWebĵһЩصı׶ˣҪڣٸǶޣݹƣκһWebҳ涼ҳ֮һ2ݣάѣݿĸƵޣʧЧ3ݣ̫󣬰Ӳʩ.Ԫ棬MetaCrawlerͨۺ϶Ľһ̶˸Ƕ.ǣԪʹ޷ӸϽ.ϢԴļзʽʹ׶˸Ϊ.һ棬ҪϢԴ޴κһʽԴϵͳ޷ȫһ棬ʽԴϵͳǣظ.ˣΪInternetϵԴӦòȡֲЭĲ.
ԴֵķֲЭԣָĳԭInternetϵϢԴռл֣õɸϢԴӿռ.ÿӿռ䣬ֱһԴϵͳṩӦԴַ.ĿǰֲԼAgentϵͳоѾȡ˷˶ĳɹڼЩơ칹ԴϵͳӶInternetϵЭȺ.ϢԴռĻԭǰѧҲ԰յ.磬ǿΪֲͬרҵĿԱרҵԴϵͳ.ûԸԼҪӦϵͳ.÷ֲЭԴֲԣԴϵͳҪϢԴСԽģάͬʱϵͳ֮ͨ໥Э˸Ƕ.ɼֲԿЧؿ˷зʽĲ㣬Դַ.
3ԴַеĹؼ
ԴϵͳĿһ漰򡢶༼ĸӹ.УģϵͳĺģWebĵĿϵͳҪϢԴûӿڵĺûֱӾϵͳʹЧ.棬Ƕ⼸ؼֱۣӦ.
3.1ģ
͹ϢԴԣݿƽʽļϵͳ.ˣԴϵͳͨĵݿ洢칹ϢԴ.ĵݿڲʵһðṹ߼ģͣⲿ֣ӳûͼ򹹳Դϵͳĸģ.磬淵ظûͨһ˳̶баWebĵı⡢URLժҪ.ָģУûҵĵ˴ľ.صĽĿڶʱǳձ飩Ϊͻ.ûΪйоûϣܹӶǶȹ۲ϢԴڼ򵥵ġ̶б.OLAPݿ⻷еһķߣΪûṩ˹ݵĶάͼ4.ȻWebĵϢԴݿűʵ𣬵ΪOLAPн֮.棬άĵΪԴϵͳһµĸģ.
1. άdָǹ۲ĵĽǶ.磬ĳûϣʱ䡢ȽǶ۲ĵ.ûҲĳĵ.ʱ䡢Ԫݾ͹ĵά.
2. άĵCDocumentָĵDocumentΪģĵԪݣάdiֲĵΧӶɵһ(d1, d2,,dm, Document).
ڶάĵϣԽиֶάƬп顢תꡢȣӶɶĵͼʹûܹӶǶȹ۲ĵԴĸ˽еϢں.磬ûͨƬĵѡĳĵӼ.ڸӼУ飬ͬһڰʱ.ûȿͨ۵ͼ۲ÿԣҲͨչͼ۲ÿÿĵľ.ͼ1ʾ.


ͼ1ĵάıͼ
ܹΪûṩЧĿӻֶ⣬ڶάĵϻԽͳƷӶܹʾĵԴеֲ.磬ǿԱȽϲͬĻڲͬʱйڸĵӶشһЩ޷ش⣬硰ѧͼͼзࣿ.
Ҫ˵ǣάĵͶάĵ뽨üѧϢĵԴԤĻ֮.ĵάԤõԪݣʱ䡢ߡ.
3.2Webĵ
ĿǰWebѾΪǻȡϢҪԴ. Altavistaļ㷨Լ򵥣ޣʹüWebĵԵò֤3.YahooͨWebĵзԷûͲң๤˹ɣӰ䴦ҳĿYahoo! WebĵĸǶԶԶСAlta-vistaȣ.ΪˣһµWebĵģͣϿάʵάRobotʸѵ6ɣͼ2ʾ.ģܹûϢȻԶѼĿWebĵû.


ͼ2Webĵģ
ڸģУǲ˳õռģͣvector space modelVSM5ΪûϢĵıʾ.VSMÿһÿһࣩĵӳΪһ鷶ʸųɵռеһ.ÿûϢδ֪ĵԱʾΪռеһʸ(T1,W1;T2,W2;,Tn,Wn)TiΪWiΪȨֵ.ĵûϢƥԼĵķ඼תΪռеʸƥ䴦.ģ͵ĹΪѵͷ׶.
1 ѵ׶ΣûȽϿ⣬һϢʾĵÿĵһʶ.ʸôʵ⣨ôʵרҵʵ䣩ѵĵʾΪһϵʸ.ѵÿѵĵʸͳƣɴʸ.
2 ڷ׶ΣRobotģȽWebĵռ.ʸصĴĵʾΪһϵʸ.ĵʸѵɵʸƶƥԵõĵķ࣬ƶֵѷĵظû.
ʵñģܹԴWebĵԶٵط6.ʹרҵʵ䣬ྫԸͨĵϵͳϺõر֤˼Webĵû.
3.3Z39.50ĿϢ
ͼǻȡϢһҪԴĿԴϵͳҪɲ.ͼݵĿͳͨTelnetʽṩ.ͼݲWebCGIʽΪĿṩͼλ.ЩʽһҪȱڸͼݵĿ治һ£ûҪÿͼݾͱϤӦĽ.ΪˣISOƶZ39.50Э飬ΪԶͼĿı׼7.Z39.50һTCP/IPЭ֮ϵӦòЭ.涨˿ͻѯԼȡ¼ȹ漰ݽṹݽ򣬴ӶִĿݿӿڵ칹.Ŀǰñ׼ѾͼɣδһͼṩZ39.50Ŀ.һZ39.50Ŀģͣڴ˻ϳɹؿڵһ׻Z39.50ĿϢϵͳ8ݣͼ3ʾ.


ͼ3Z39.50ĿϢģ
ڸģУͼݵĿݿһ򼸸Ŀݿ.Z39.50Լ˿ûInitRequest.ڳɹؽӺZ39.50ͻѯSearchRequestZ39.50յġġZ39.50׼ѯתΪġSQLѯύ̨ݿִУɲѯ.ȻZ39.50ѯִԼֽ.Z39.50ͻԶηȡPresentRequestýеĿ.ΪʹһZ39.50ͻܹͬʱѯͼݵĿڿͻ˲ọ̣̈߳ͶؽӣԲѯкۺϸ̵ĲѯȥظֵĿ.
3.4Agentûӿ
ԴϵͳУûӿûϢԴ֮.ϢԴĴ̬Ժ͸ԣͳ˻ʽԵΪ.AgentûӿڱΪǽ˻һͻƿڣ9.ĿǰAgentоȻʮУ䶨ûͳһĽ.ǴĽǶȳ¶.
3. AgentһֳֶΣȿϵͳܹϵͳû֮Ľ.
4. ûӿAgentûϵͳӿʱʹõһ󻯳󣬿ԼҪرʾΪһԪ(Task, Knowledge, Constrain, Status).УKnowledge֪ʶ⣬ѧϰ֪ʶûϢͰõȣConstrainԼϣûAgentʱƵȣStatusAgent״̬ļϣTaskģ飬֪ʶ⡢Լ״̬Ļ¼.
ûûӿAgentһӦó.һ棬ӵ֪ʶ˽ûͰãܹûܵĳ񣬲ѧϰӦһ棬ûĿ.ûԹ۲Ļ״̬ҲʱԵָͣԵس.ûӿAgentԴϵͳִеǶֶ.ϵͳûȤϢԴʱAgent֪ͨû. AgentҲԸûƫϢԴйˣԻĽ.ɼAgentûӿΪû븴ӡ̬ϢнṩҪֶ.
4InternetԴϵͳԭ
۵Ļ֮ϣǿ˵һԴϵͳԭRDSCCresource discovery system for computer community. RDSCCһѧרҵԴϵͳĿΪоԱṩInternetԴַձרҵȫ桢Ϣ.ϵͳṹͼ4ʾ.


ͼ4InternetԴϵͳԭRDSCC
RDSCC8ģ.УĵݿϵͳṹĵԴ.ΪԣǲWebûṩԴַ.תΪWebĵݿϵͳн飬ԽĵݿתHTMLʽҲ԰ûתɶĵݿϵͳĲ.WebĵռطûϢйؼWebĵԶ.ԪݳȡѷĵгȡĵԪݣĵԪݴ洢WebĵУ.Z39.50ṩZ39.50ĿûͨHTMLύĲѯ󣨰ѯЩͼԼּĿͬʱѯͼݵZ39.50.
ûԽиֶάĵӶǶĶͼĵ.ϵͳAgnetΪûṩãprofileƣûԶĵ.
5
Ϣ£InternetԴַһмǱоûԴӷֲĲͬԴϵͳлȡϢԴ.˷ֲЭʽԴֲԣԴϵͳ漰ģ͡WebĵĿԼûӿڵȹؼоҪһϢϵͳԭRDSCC.ڸֵ֣̽DCOM/CORBA㻷ʵֶԴַ֮ķֲЭHTMLXMLȹ淶WebĵгȡԪݵȵȣЩһҪеĹ.
*õʡ塱Ƽص㹥ĿĿBE96017ͽʡίͼԶĿ.
߼飺̳ɣУ19736ʿоҪоΪ硢Ϣ.
ΣУ197011ʿоҪоΪ硢Ϣ.
СУ19656ʿоҪоΪý塢Ϣ.
˽У19521ڣҪоΪмAgent.
ŸףУ193911ڣʿʦҪоΪý塢CADͼѧϢ.
ߵλϾѧ¼صʵҡѧ뼼ϵϾ210093
ο
1Gudivada V N et al. Information retrieval on the world wide web. IEEE Internet Computing, 1997, 1(5): 5868
2Lawrence S, Giles C L. Searching the world wide web. Science, 1998, 280(5360): 98100
3Lawrence S, Giles C L. Context and page analysis for improved web search. IEEE Internet Computing, 1998, 2(4): 3846
4ɺ. ݲֿ⼼. :ѧ, 1998
(Wang Shan et al. The Technology of Data Warehouse and OLAP(in Chinese). Beijing: Science Press, 1998)
5Salton G et al. A vector space model for automatic indexing. Communications of ACM, 18(5): 613620
6, ̳, Ÿ׵. WebѼϵͳʵ. 鱨ѧ, 18(3): 195201
(Zou Tao, Wang Jicheng, Zhang Fuyan et al. The design and implementation of an information gathering system. Journal of the China Society for Scientific and Technical Information(in Chinese), 18(3): 195201
7ANSI. Information Retrieval(Z39.50): Application Service Definition and Protocol Specification. ANSI/NISO Z39.50-1995. Bethesda, MD: NISO Press, 1995
8, Ÿ׵. Z39.50ṩĿ. ѧ, 10(8): 824828
(Yang Xiaojiang et al. Bibliographic retrieval based on Z39.50. Journal of Software(in Chinese), 10(8): 824828)
9Baecker R et al. Readings in Human-Computer Interaction: Towards the Year 2000. Morgan Kaufmann Publishers, 1995 
ԭյڣ1999-02-12޸ĸյڣ1999-07-01.
