ѧ
JOURNAL OF SOFTWARE
1999 1 No.1 1999



ýAgentչʾģ*
־ 
ժҪݶýص,һֻڡ¼--Agentչʾģ.ģͼݡʱ򡢿ռϵһ,ͨϢչʾ״̬¼ƶչʾɵΪ,֤˶ķװ,ûĽṩ֧,һֶ̬ģ.¼--ݿй㷺õķ,гļ֧.ͨAllenʱϵıʾ,˵ģ͵ı,ͨʵ֤.ָչʾģڶýݿе.
ؼʡAgentģ,չʾ,,ý,ʱϵ,ռϵ.
ͼšTP391
An Agent Model for Integration of Multimedia Object Presentation
GONG Zhi-guo ZHOU Long-xiang
AbstractIn this paper, an agent model for the integration of multimedia object presentation is established by using events-conditions-actions mechanism and considering object-oriented characteristics of multimedia objects. This model is a dynamic model, which integrates contents, temporal relations and spatial relations of multimedia objects and supports user interactions. Because it controls objects by message passing, the encapsulations of objects can be maintained. Events-conditions-actions mechanism is employed in active database intensively and has mature technologies. The expressive ability of this model is described by using it to the temporal relations defined by Allen, and it is also verified with an example. Its contributions to multimedia database systems are also analyzed.
Key wordsAgent model, presentation integration, object-oriented, multimedia objects, temporal relations, spatial relations.
ǰڶýģ͵о,ģձ鱻ΪһֱȽϺʵĶý.16ҪΪеļ̳ԡװԺͿչԷǳʺڶýص:ýĸԶ͸ý֮临ӵϵģͻĿعʹͬ͹صĶýӿͳһ1ݣƶڻڼϵĲѯ뵼ʽֵ֧.Щص㵼ڶרѧ߶ƫ.,ڶýļɣIntegration),ãReference)ԲԿ̻ý֮չʾϵ(Presentation Relation).ý봫ͳ(ֵַ)֮Ҫ,չʾԱ뱻ģͻ.϶ý󲻽ҪӶ֮ϵ(Reference),һָýиӶ֮ʱȹϵͿռ䲼ֹϵ,,ƱӰûԸýݵ.,ý֮չʾϵ뱻ֿ.
ݹ۶ýĸּɷ3,710,ʱϵһͨӷʽͼʽӷʽ̻.ʽͨڶ֮䶨ķʾý֮ʱͬ.7,8ַ,ȽȻ,ͬıʾǳ,ԷӳýʱͬĶ̬仯.,Ӷǻʵ,׳.ӷʽ÷űʾAllen1113ʱϵ.,ý֮ʱͬЩЧʽʾ.3ֱͨʱý,Ȼƻ˶Ƶķװ.ͼʽָüչͼʾý֮ͬϵ.ʱPetriԲСеıʾǳ,Ӷձ.9,10ַصֱ,ʱͬкܺõı.ַһҪȷýչʾʱ.һڿ,ΪûĽϵͳɵı仯̬ܶӰչʾʱ.,ûһĶ(Jitter)ʱ(Latency).,ģһֱʾģ(Represent Model),ʵʱ任ɿɲģ,תҲ൱ӵ.
Agent˹﷢չһͼģͣ12,ͳһĶ.һԿ϶,AgentйܵԼ(Autonomy).Ҳ˵,Agentܹϵظ֪緢Լ״̬ı仯,ӦĶ.AgentߵҪ֪(Cognitive-like Function),Դﵽ߶ܻЧ.Agentص,Agent㷺Ӧڷֲ㻷,Эͬĳ.ǲAgentģͷʽƲЭýչʾΪļ,Կ˷ǰýʱͬ.
ȸAgentģ͵Ļ,˶ýչʾе¼Ͷ,һֿƶýչʾĿԪ(Cell)ṹ,֤.Ļеļ,һAgentģͽṹBNF,˸ģڶýݿϵͳеҪ.
1ý󼯳ɵĻAgent
Agentģ͵Ľṹޱ׼.ף12ݰAgentΪ4(Mental),4ֱܹΪbeliefs,capabilities,choicescommitments.beliefsAgentе֪ʶcapabilitiesAgentеĴchoicesΪAgentĳһִУcommitmentsAgentAgentе.,Ϊʹ4ܹAgent,͹.÷̶ȸ,ʺ˻ϵͳĿ̻,ṹӡʵ,ҲʺڶԶýļ.Ǹݶýչʾɵ,¼(Events)(Conditions)Ͷ(Actions)Agentģͽṹ.似صǣ(1) ýѾ,Ƕ伯ɲֻͨϢݣMessage Passing(2) ý(Audio,Video,Animation)뱻(Text,Image)֮.ܹչʾĽ״̬,ĽֻͨAgent͵ֹϢʵ֣(3) AgentΪ״̬ṹͨѶķװ,ɱûAgentֱã(4) ֧־ֲAgentչʾ,ܹⲿչʾڲչʾ״̬չʾΪ(5) AgentԺϳΪӵAgent,ԱɸӵĶý󼯳ɣ(6) Events-conditions-actionsΪݿ㷺õĻƣ13,гļ.AgentģԴΪ,Ա֤AgentЧ,ʵ.
ýչʾAgentģ͵лͼ1ʾ.AgentϢӿڸ֪ⲿϢʱӱԼչʾ״̬仯Ϣ,˵õϢ,¼״̬и,иֵ,Ȼ,Agent,һִ붯ƥ.Ϊ,ִӦĶ.,ִеݾǴӦչʾ󵽶ʱʱ.ýյAgentϢ,ᰴϢչʾ,Ӧչʾʼ¼.ܹĽ״̬,չʾ״̬ĸıֻAgentĵ.ֶýչʾɻƵصڣ
(1) ģͻevents-conditions-actions,ݿй㷺õĻ,ʹ¼Ϊĵϵͳƽṹ.
(2) AgentͨϢʵֶԶýչʾ,ά˶ķװ,ڶķֲ洢.
(3) չʾ״̬ı仯չʾʼչʾΪǵʱͬ,ɱ֤ýAudio,Video,Animation)չʾ,ȸչʾʱ,ʹýʱͬȻ.Ϊýչʾʱ,ûĽȴͳҪƵ,ƱӰýĲʱ.,ԤȷչʾʱķܲȻ.
(4) ʱӶ.,AgentñText,Imageչʾʱ,ʱӶ󱨾ǿƽչʾ.
(5) Conditionsöýͬ,ߵȴӳ߼ټֹӳ.
(6) ⲿ¼Agentû¼ڲչʾ״̬¼ƶչʾʱ򼯳,ʹûýͬչʾ.,ʱ򼯳ģʽHypermediaгֵ֧.

ͼ1AgentȻ
2¼Ͷ
¼EventsAgentƵȶýչʾĶ,Agent¼.ݿоӦ,ָ¼һΪķ.ǵ¼ڶýͬչʾ,Ϊࣺⲿ¼ڲ¼.
ⲿ¼Agentģ͵ⲿӿ,ûAgentֻͨЩⲿ¼ܼƻAgentĻ.Щⲿ¼Ϊstart-com:Agent;stop-com:AgentĻ״̬;choice1:ûԶ¼1;choice2:ûԶ¼2;...;choicen:ûԶ¼n.
¼start-comAgentĿʼ,ҲAgentһýչʾȵĿʼ.¼stop-comʹAgentչʾȽ.¼choice1,choice2,...,choicenⲿ(ûAgent)AgentչʾȵĿ.
ڲ¼ӳAgentӶչʾ״̬ʱ״̬¼,AgentԸЩڲ¼ƶչʾ.ģеڲ¼Ϊobject.s:objectչʾʼ;object.e:objectչʾ;h.alarmingΪhʱӱ.
һյAgentչʾϢ,̷չʾʼ״̬¼.ڴ֮,յAgentֹչʾ,򷵻ضչʾϢobject.eAgent.ǵĵģ,AgentһʱӶclock,ʱӵʱʽ,AgentƶչʾΪ,ʱӱ¼Ϊh.alarming,hʾӦıòϢ.
ݿ,ConditionsΪݿ״̬ʷ״̬ļ.13ǵģ,ĺָAgent¼ʷļ.¼ʷ״̬AgentչʾƵִУʵʩ.༴,ֻ,AgentӶ󴫵ݿ.ɳַӶչʾ,Ӧϵͳɻͨ״̬Ķ̬仯.
eiʾ¼ڲ¼ⲿ¼,¼νoccur(ei),occur(ei)=TRUE(FALSE)ʾ¼eiѷδ.,߼ġ,š.Conditions¼νʼġ,šݹ鶨õ.
1. 1 eiΪκ¼,occur(ei)Ϊ;2 ޸߼ġ,š޴õ߼ʽΪ.
,e1,e2,e3Ϊ¼,occur(ei)i=1,2,3,occur(e1)occur(e2),occur(e1)occur(e2),occur(e1)(occur(e2)occur(e3)) Ϊ.κζý(MM-Object),ӦչʾSC(start condition)չʾEC(end condition).һչʾSCΪTRUE,AgentչʾϢö,AgentӸöĽECǷΪTRUE,Աֹöչʾ.
(Actions)AgentýչʾƻʱӶı.ʵͨϢݻ,Ᵽ֤ģ͵ķװ.ϢĸʽΪMessage-Name(receiver,para-list).ǵĶýչʾģ,Ҫ¼֣
1 Agentý(audio,video)ƶ
start(receiver,para-list) չʾʼ
fast(receiver,para-list); չʾ
backward(receiver,para-list); 
fastBackward(receiver,para-list); 쵹
stop(receiver); չʾ
2 AgentԱý(image,text)Ŀƶ
start(receiver,para-list) չʾʼ
stop(receiver,para-list); չʾ
3 AgentʱӶĿΪ
setclock(handle,delay); handleΪ,ʱdelay󱨾
cancel(handle); ȡΪhandleı
ִУϢķͣᵼ¶չʾ״̬仯¼,رעչʾ״̬仯¼Ϊչʾʼobj.sչʾobj.e.Startɵ¶objչʾʼ¼obj.sķ,Stopɵ¶¼obj.eķ.ʶչʾ״̬Ľ,Զ¼obj.e.չʾͬһ¼Ϊʱӱhandle.alarming.
3Ԫʱϵıʾ
Agentܿضչʾ¼Ĺϵͼ2ʾ.

ͼ2¼֮Ĺϵ
κζչʾAgentЭ,ÿAgentƽṹдһԪcell.ԪչʾSC,չʾSA,EC,EA.cellʾͼ2ʾĿƽṹ£SCΪx,
1 cell1={SCxSAstart(obj,para-list)ECoccur(obj.e)EAգ}(ձʾ,ͬ).
ÿԪʾAgent⵽xΪ,ݿʼϢobj,objչʾΪֹϢ,Ϊ,ʾֹ.
2 cell2 ={SCxSAstart(obj,para-list),setclock(h,delay)ECoccur(h.alarming)EAstop(obj)}
cell2ʾxΪ,objչʾϢĴ,ͬʱʱΪdelay,Ϊhʱӱ.һʱӱ¼h.alarming,objչʾ.
Allen11ݽʱϵΪ13֣before,meets,overlaps,during,starts,finishes,equalsǰ6ֵϵ.ΪϵΪǱʵ,ʵʽ7ֻϵ.Ϊʡƪ,ǽʱϵıʾ.
1 1 before 2
(1.a) O1,2Ϊʱ,
cell(O1)={SCxSAstart(O1,p1)ECoccur(O1.e)EAգ}
cell()={SCoccur(1.e)SAsetclock(h,)ECoccur(h.alarming)EAգ}
cell(2)={SCoccur(h.alarming)SAstart(2,p2)ECoccur(2.e)EAգ}
(1.b) O1,O2Ϊʱ,
cell(1)={SCxSAstart(1,p1),setclock(h1,d1)ECoccur(h1.alarming)EAstop(1)}
cell()={SCoccur(h1.alarming)SAsetclock(h,d)ECoccur(h.alarming)EAգ}
cell(2)={SCoccur(h.alarming)SAstart(2,p2),setclock(h2,d2)ECoccur(h2.alarming)
EAstop(O2)}
(2) 1 overlaps 2
(2.a) 1,2Ϊʱ,
cell(1)={SCxSAstart(1,p1),setclock(h,)ECoccur(1.e)EAգ}
cell(O2)={SCoccur(h.alarming)SAstart(2,p2)ECoccur(2.e)EAգ}
(2.b) O1,O2Ϊʱ,
cell(1)={SCxSAstart(1,p1),setclock(h1,d1),setclock(h,d)ECoccur(h1.alarming)EAstop(1)}
cell(2)={SCoccur(h.alarming)SAstart(2,p2),setclock(h2,d2)ECoccur(h2.alarming)EAstop(2)}
Ͻcellʾʱϵ,಻׸.ɼ˷Զýͬõ.
4ýչʾĿռ䲼
ýչʾɵһҪǶýչʾĿռ䲼ֽṹ(Spatial Layout Architecture).ڸý,ĿռϵӦȱʡ.һӦΪý󼯳ɵһ.һ,image,video,animationȶ,ڴʱѾʾߴ.,ýΪһĲֿ,չʾʱĴСȷ.Textһ㲻ʾĴС,ڸýб.audioʾ豸Ϊ,ڼֲ迼ǣ(Volume)ƽ(Balance).ʾߴ,ý֮Ŀռ䲼ֱ.
ף14ݰѿռϵ(Spatial Relations)Ϊࣺλùϵ߼λùϵ.λùϵָԵλùϵ,,ϡ,߼λùϵָλùϵ.ýĿռϵָ߼λùϵ,,Ŀռϵָ߼λùϵ.ף14е,ռϵɷΪDJ(),EC(),IS(ں),OL(),CV(),EQ()ͼ3ʾ.DJϵֿϸΪLT(),RT(),AB(),BL()ȷϵ.ýĿռϵͨÿչʾĻ꼰Сȷ.ף15ݶScreen()Frame(֡)Ķ,ʵ޸,У
screen=SCREEN:{frame*|(frame*speaker)*|speaker*},
frame=x-origin,y-origin,width,height,
speaker=volume,balance.

ͼ3ռϵ
ScreenΪʾ豸߼ʾ,һframespeaker.frame˿ӻʾ,λС.speakerΪƵʾ,ƽ.ͼ4̻˸ýһֲ.

ͼ4Ļ
5Agentչʾģͽṹ
Agentģʽ(Pattern) ̻һý֮չʾΪϵ,϶չʾ.Agentģʽ˸϶չʾʽ.ҪظΪ(1) ⲿ¼,AgentûԸ϶չʾ¼;(2) Agentɵÿý;(3) ʱ,ÿһ󼯳ֻһ;(4) Ļ,̻˸ʾλС;(5) ÿֶý͵չʾϢ;(6) ÿֶýչʾ״̬¼ýӦչʾϢ,չʾ״̬ı仯״̬¼;(7) һevents-conditions-actionsչʾԪcell.cellĶһ򼸸ýͬϵ.AgentģʽпԪɵļϿ̻϶չʾΪ.
2. һAgentģʽBNFʽ£
=agent nameset of external eventsset of rolesscreen layoutset of cells,
agent name=string,
set of external events=EXT-EVT:start-comstop-comchoice*,
set of roles=ROLES:role*,
role=object typemessage Liststatusevents,
object type=string,
message List=message*,
message=mes-namereceiverparameter-list,
status=alivedead,
events=start eventsstop events,
screen layout=SCREEN:{frame*|(frame*speeker)*|speaker*},
frame=x-origin,y-origin,width,height,
speaker=volume,balance,
set of cell=CELLS:cell*,
cell=start conditionstart actionsend conditionend actions.
6Ӧþ
ĳϢжýɣ(1) зƵ:City-Video;(2) City-VideoƵע:City-Audio;(3) ŹŽƬ;Image1,Image2;(4) ÿŹŽƬӦһֽ:Chinese-Text1,Chinese-Text2;(5) ÿŹŽƬӢֽ:English-Text1,English-Text2.ϸý󹹳ɶý帴϶City-Scene,City-Sceneи֮չʾϵ:
1 ϶չʾʼCity-Videoʱ,ƵCity-Audioв.ΪCity-Video,City-AudioΪ,չʾ״̬,Ҫ󶼽,ŽԺչʾ.
2 City-Video,City-Audioв,ԶŽƬչʾ,Ƭչʾ˳ΪImage1,Image2.ÿƬʾʱ,ͬʱֽܼӢֽ.ΪƬıΪ,ʱʱ,ÿƬչʾt.һƬչʾ,϶չʾ.
Agentչʾɶ:
City-Scene
{
EXT-EVT:start-com,stop-com;
ROLES:
video:City-Video;
audio:City-Audio;
image:Image1,Image2;
text:Chinese-Text1,Chinese-Text2,English-Text1,English-Text2;
SCREEN:
City-Video-frame=(x1,y1,width1,height1);
City-Audio-speaker=(volume,balance);
Image1-frame=Image2-frame=(x2,y2,width2,height2);
Chinese-Text1-frame=Chinese-Text2-frame=(x3,y3,width3,height3);
English-Text1-frame=English-Text2-frame=(x4,y4,width4,height4);
CELLS:
cell1=
{
SC:occur(start-com)
SA:start(City-Video,City-Video-frame),start(City-Audio,City-Audio-speaker);
EC:occur(City-Video.e)occur(City-Audio.e);
EA::
}
cell2=
{
SC:occur(City-Video.e)occur(City-Audeo.e);
SA:start(Image1,Image1-frame),
start(Chinese-Text1,Chinese-Text1-frame),
start(English-Text1,English-Text1-frame),
setclock(h1,t);
EC:occur(h1.alarming),
EA:stop(Image1),stop(Chinese-Text1),stop(English-Text1);
}
cell3=
{
SC:occur(h1.alarming);
SA:start(Image2,Image2-frame),
start(Chinese-Text2,Chinese-Text2-frame),
start(English-Text2,English-Text2-frame),
setclock(h2,t);
EC:occur(h2.alarming),
EA:stop(Image2),stop(Chinese-Text2),stop(English-Text2);
}
7  
ʱռΪýе.,ýļɲҪݼ,һ뿼ʱ򼯳ռ伯.ͬ,ͬʱ򼯳ɻռ伯ɻвͬӾЧ,ӰԸ϶.
ڶýݿоУ15,һȽһµѡķΪý洢ģʽ.ͨPART-OFϵ帴϶ݹ.,Щ׶ڶý帴еʱϵռϵ۽,û漰.,ף4ݽ֮ĿռϵرʾΪLeft,Right,Above,Below,ʱϵʾΪBefore,After,During,At,ЩϵʵֻӦн.ף3ڶ֮,ӵķʽ帴϶չʾϵ,÷ͬ.һ,ҵݿϵͳ(DB2,Informix,Oracle,Sybase),ͨṩ(Abstract Type)ûԶ庯(User Defined Functions),ýݴ洢ΪBLOBʽ,ʹϵģʽΪ-ϵģʽ.DB2һĵʹ.16ַڹϵݿļ,˾иЧɿʵõص.ڶýļ,ͬһԪ(Tuple)жBLOB(Join)ʵϵļ.ڶ֮ʱռϵûṩЧֶ,Ӧн.
ýļǶýݿϵͳҪɲ.ѾɹĶýݿϵͳCDB/M,Ƕչ6,15,а˶ýչʾɹ.AgentģһֶΪϵļ.ģͼݡʱ򡢿ռϵһ,˸϶Ӷ֮ͨѶϵ.Ķ֮չʾϵ跭,ֱʵ.ģģΪ,ֱ֤˶ķװԼýݿĸЧ.ͬʱ,չʾģͶûĽгֵ֧,һֶ̬ģ.ʹûڶ,ڶչʾΪϵõ.öƽ̨JavaдýݿϵͳCDB/M,Agent绷е.,ͨӳټûQoSԶýչʾɵӰ,о.
оõ863߿ƼĿ.
߽ܣ־,1963,ʿ,ҪоΪֲʽݿϵͳ,ýݿϵͳ
,1938,оԱ,ʿʦ,ҪоΪֲʽݿϵͳ,ýݿϵͳ.
ͨѶϵˣ־, 100080,йѧԺѧо
ߵλ־ йѧԺѧо  10008
ο
1Ishikawa H, Suzuki F et al. The model, language, and implementation of an object-oriented multimedia knowledge base management system. ACM Transactions on Database Systems, 1993,18(1):150
2Ishikawa H et al. A next-generation industry multimedia Database System. In: Stanley Y, Su W eds. Proceedings of the 12th International Conference on Data Engineering. Los Alamitos, CA: IEEE Computer Society Press, 1996. 364371
3Schloss G A, Wynblatt M J. Providing definition and temporal structure for multimedia data. Multimedia Systems, 1995,3(5):264277
4Narashimhalu A. Desai, multimedia databases. Multimedia Systems, 1996,4(5):226249
5Chen C, Roger Y et al. Design of a multimedia object-oriented DBMS. Multimedia Systems, 1995,3(5):217227
6Gong Zhi-guo, Zhou Long-xiang. Analysis and study of multimedia database system. In: Masao Ito, Zhong Xi-chang eds. Proceedings of the International Symposium on Future Software Technology (ISFST-97). Tokyo: Software Engineers Association, 1997. 125132
7ISO. Hypermedia/Time-based structure language: HyTime (ISO 10744). International Standard Organization, 1992
8ISO. Multimedia and hypermedia information coding expert group. ISO/IEC JTC1/SC29/WG12, MHEG Working Draft WD.1.0, Version 1.0, Feb. 1993
9Little T D C, Ghafoor A. Synchronization and storage models for multimedia objects. IEEE Journal on Selected Area in Communications, 1990,8(3):413427
10Diaz M, Senac P.Time stream Petri nets: a model for multimedia streams synchronization. In: Tat-Seng Chua, Tosiyasu L Kunii eds. Multimedia Modeling (MMM'93),the 1st International Conference on MultimediaModeling. Singapore: World Scientific Press, 1993. 257273
11Allen J F. Maintaining knowledge about temporal intervals. Communications of the ACM, 1983,26(11):832843
12Shoham Y. Agent-oriented programming Artificial Intelligence, 1993,60(1):5192
13Fraternali P, Tanca L. A structured approach for the definition of the semantics of active databases. ACM Transactions on Database Systems, 1995,
20(4):414471
14Li J Z et al. Spatial reasoning rules in multimedia management systems. In: Courtial J P ed. Multimedia Modeling (MMM96), the 3rd International Conference on Multimedia Modeling. Singapore: World Scientific Press, 1996. 119133
15,.ֲʽýݿϵͳķֲϵṹ.ѧ,1996,19(7):481491(Zhou Long-xiang, Chai Xing-wu. Hierarchical Architecture of Distributed Multimedia Database Systems. Chinese Journal of Computers, 1996,19(7):481491)
16URL http:WWW.software.ibm.com/data/db2/db2v2.html
1997-11-20յԭ,1998-01-19յ޸ĸ
