Ӧо
APPLICATION RESEARCH OF COMPUTERS
2000Vol.17No.5P.11-14



ͨģָƼо
־ա
ժ  Ҫ  ͨûǿԳԴ澫ȷԣû˻ʹòȷͨ벻ȷϢԶͨûʵֲȷĿѡҪģģʽʶ𷽷һָݲȷϢĿѡ㷨ԲԱø㷨ʵֵĶͨûеԽԡ
ؼ  ͨû  ͨ   Ŀѡ  ģģʽʶ
1  
ͨû(Multimodal user interface)оǿ[1]ͨԲСЭķʽǿԴ澫ȷԼȷϢȷ˻Ƕͨû֮һζſҪľȷԣӶ󽵵û֪ʵȻ˻ȻĿǰĶͨ㷨[1,2]ڴֶκ㷨ʵַôͳľȷʽʹռͷռϴڽϴĲһ¡һģѧ۽ͨûĿָһҪ⣬ͨԲ[]֤ԸõʵֶԲȷϢϡ
2  ͨģĿѡ㷨ʵ
ͨûĿѡʹòָͬƼָƼУʽ(Descriptive)硰Ϊ25Ϊ15ľΡֱָʽ(Deictic)ָĻϵľβ˵(this)ָʽ硰(it)ָᵽľΡǣͳ˻ʹõָƼһһǻھȷʽġ磬Pausch[]ʹáԿռ䡱оʵֲȷĿѡ񡣸÷вͬٺͷΧһûδӹһ顰ԡֵļȨ򲻼Ȩľ룬ѡСΪƥĿꡣַڵǣ(1)ĳ˵һ֡ԡѡΪַܻͨĿ걻ѡУʹûͼԲģСġѡСġΡԭ˵Ȼճ֪ʶδģ(2)ͨԡ(û˵Сġ)ɢֵĿԡ(ĿС)ȴֵʱӦιһԡƺֻԡģԣ䡰ΪȷֵӶݱΪȷƥ䡣
ģѧܹûճ֪ʶӳУ˿֮ͨģƥ⣬еѧ任ĿѡɱԲģʽʶ⡣εģģʽʶ(1)ԭIȷĿX1X2...XnһӽģA(2)ԭIIȷĿXģA1A2...Anеһʶ㷨һ㲽(1)ȡģʽɣ(2)(3)ʶоԭУ(a)ԭ(b)ֵԭ(c)ԭ(b)Ŀ긴ѡ(a)(c)Ŀ굥ѡģģʽʶԭĿѡԭI㷨ûĿġԡΪģӼֱ㽻ĿڸģӼȣѡߡ㷨£
Step 1  ѡȡ   ĿѡɷΪӦ޹صĺӦصӦ޹ص磺(1)ռλã(2)ߴС(3)ƣ(4)λȡӦصɫ״ܶȵȡӦ޹Ϊۣ磺(1)λģ硰ϣ£ңϽǣ롱ȵȣ(2)Сģ硰СеȴСȵȣ(3)ģƱΪȷΨһȻгЩȷеıƴд󣬲ȫдԼȣ(4)λģͳûĿλȷģTabĿ꣬üͷ˵ȻĽӦֶ֧ûʹģʻ硰һһǰġġġб(5)ɫģճгõĸɫֻͨʹ޵ļ֣ڷרҵӦѾ㹻ˣ(6)ֱָģһԵģӼָƻߵͨӳûڽеġȤ(AOI-Area Of Interest)
Step 2  ȷ   ģѧ۹ȵȷжַͳƷ۷ȡԼӦ޹Ϊ˵(1)λãλɲĿĵΪԱķֶκֱǶάάռΡȶԽǰӴзָҳضλ(硰Ͻǡ)ĵ꣬ȻĿĵλõļξ룬ԸþΪԱѡһֱ׼(f(x)=e-k(x-a)2)ԶԶƫλõ(硰½ǡ)Ŀ꣬f(x)=0(2)״Сȷλƣҳձ׼ȷĿʵָñ׼ֵ֮ĺϵ磬ڡġСġģȽϵָǼ(ά)(ά)ڡġġġȽϵָǳȻ߱ȵȵȣ(3)λɢģ硰ġɱʾΪAnear={(-1)/0.9+(1)/0.9 +(-2)/0.7+(2)/0.7+(-3)/0.4+(3)/0.4+(-4)/0.1+(4)/0.1}(-i)ʾǰĵi(i)ʾĵi(4)ɫɫԼ׳ɵģȻÿɫɫͼռһλã˵ӾʵһΧɫڸ÷Χڵı仯˵ӾǵЧġһճֱܷɫĿޡǿCIEɫͼΪ͵ɫѡȡһĵ㣬ȻĿɫ(һRGBɫϵͳ)ĵŷϾ룬ԸþΪԱѡһֱ׼(5)ֱָƻ벻ľȷָ豸ȷƵĻһֻܷӳһΧνȤ(Area Of InterestAOI)ΧĽģġ衰Ȥָһĸʷֲ(Ϊֲ̬)ӳֱָһȤġ
Step 3  ģʽ   ûĿʱϸԣʱδ硰ܡȽϡȡ˸ݡԡɡģʽģ㣬(1)(or)C=ABȡһɣ(2)(and) C=ABͬʱ߱(3)(not)CAcָ߱ԣ(4)ƽC=A2ǿԣ(5)C=A1/2ԡ
Step 4  ָƷΧȷ   Ŀѡеѡ͸ѡ֣Ӳֵͬͬ͵ĿѡΧǣضѡҪ壬ʹáǸ(thethisthat)޶ʣʹá(most)δʣڷضѡڶԣɴѡȡһĿ꼴ɣ۸ѡʹáЩÿС(allthosetheseevery)޶ʡ
Step 5  ʶо㷨  ĿѡĹǸû()ԻָķλģϢȷǰзЩԼϵĿꡣݲͬĽеѡ͸ѡʽǲáԭIĿʶ㷨ӽĿɴĿҳûƥĿꡣ岽裺(1)ûϢѡȡйγĿģʽ(target pattern)ݡԡеݴȷģݳ̶δȷԸģĻı任缯(ƽ)ɢ()ȣӴȷͬģ֮㣬粢()()()ԼѿȣݷΧ޶ȷоΪѡ(single selecting)ѡ(multiple selecting)ûϸԣΪͬԽģӼڲͬ˱ЩģӼĵѿûûἰԺԣ֮ԲԱʶṩԼϢ(2)ĿģʽȺ㽻ÿĿڡԡ漰ģӼȣ(3)ݡԡа߼ϵ(롢򡢷)ͳ̶δ(ܡȽϵ)Ŀȣ(4)ΪĿ긴ѡʹáֵԭоѡȸֵĿꣻ(5)ΪĿ굥ѡۺʹáֵԭ򡱺͡ԭоҪȸֵǰ£ѡĿꡣڵѡ£пܷѡʧܣԭϢ()ҲڲԼԵĿ()
3  ڶͨģĿѡ㷨ʵ
ڶͨûоʵ㷨˿Բ[5]õǸʵһ֡ʵһϷƴͼҵԺͱȽ϶ͨûʹͳĻͼû֮ĽЧʵĲ졣ѡԲʵڿǵԭ򣺢ڵǰֵ͵ĽͨߵҲΪͣĿǰʹΪ㷺Ľ豸֮һʶҲʵãܿڲõĽΪõĽֶΡȻǵ͵ľȷָ豸ĳ̶ֳϾȻԵģԡ
ʵ鱻Թ18Ϊӹϵѧϵо19~23ꡣбɫäɫΪ֣ͨ׼ȷܱʶϵͳȷʶһ㡣Աֳʵ顣ƴͼҵУִĿѡ񣬽ִкƴӶĿСĻΪλΪ1133557799鱻ԿԸַʽ֮һִĿѡ񣺢ٽڴѡĿϣѡĿꣻڽڴѡĿ긽Ӧλãϡ¡󡱡ҡѡĿꡣ鱻ֻѡĿꡣĿѡйصʵ(ݴSSPSWINɣӦʱΪλ)
3.1  ͬͨĿѡӰ
1ͼ1Ϊʽģʽ±ĿѡƽӦʱвͬʽ²ӦʱԲ(PΪ.000)ɴ˿ɼԵЧ
1 ͬʽĿѡӦʱıȽ

t
5.5342.9007.38(P<.000) 

3.2 ͬĿСĿѡӰ
ʵĿС5ȼͳƼ飬СĿȼ(11)4ȼ֮䱻ԸֲЧû(P.05)ǽСȼıԲЧз2ͼ2Ϊ1199ȼĿС£ĿѡƽӦʱڲͬĿС£ʵ֮䱻ԵĲӦʱԲ(PС.05) 
2 ͬĿСĿѡӦʱıȽ

ĿС1199
ʽ
ѡӦʱ18.3204.1092.9852.154
t8.18(P<.000)2.11(P<.05)

3.3 ԶԲͬͨƫ
3ͼ3Ϊ1199ȼĿС£鱻ĿѡʱѡòʽĴڲͬĿС£ƫʹʽ(PС.000)رСĿʱѡʽڴĿ£Ȼƫʹʽ(PΪ.000)СĿȣԽ϶ѡʽ磬СĿ£һѡʽڴĿ£36(ռܲ18%)ʽɴ˿ɼƫʹʽƫܵض(ԴСĿĶλ)Ӱ졣 
3 ͬĿС鱻

ĿС1199
ʽ
ѡ020036164
x2ǳ81.92(P<.000)

3.4 
оʵ֤ͨ˻ʽڵͨ˻ʽڻҪͨûͨˮƽͨйء
νͨˮƽָڽ˻ûʹøͨʱĸɴС˻УûʹòͬͨвͬͨˮƽͨˮƽкܴϵͨԸϢľȷ̶ȣ˻ϷΪȷͷǾȷַʽûھȷʱˮƽϸߣڽзǾȷʱˮƽϵ͡磬ڱʵ궨λλǾȷˮƽϸߣҵЧԽϵ͡СĿ궨λʱΪԣΪ18룬Ϊ4루123ʾ3бԶƫѡݴһ˵ɽϵͣԸѡʽȻڶλĿʱʽĸˮƽԽͣҲ϶ѡʽ(36Σռܲ18%)ڶͨ˻УûڶͨĽʽнѡ񣬲÷Ǿȷ治ҪľȷӶ˻̵帺ˮƽʹ˻̸ΪȻ˻Чʡ 

ͼ1ͬʽĿѡӦʱıȽ

ͼ2ͬĿСĿѡӦʱıȽ

ͼ3ͬĿС鱻ԶԲͬʽƫѡ
νͨ(Complementary)ָڶͨûв֮ͬͨԣͬͨʺִвͬصĽ˻У֮ͨ໥䡣һͨ˵һձԽԡҲ˵ûһͨĲŵġ2ʾڲͬĿС£ԵЧڴĿ£ԵЧСĿʱϺãڲͬĿС£ѡӦʱֵСĿʱΪ14.21룻ĿʱΪ0.83롣˵ڴĿĶλһԽԣСĿĶλԽԣ໥ﵽϣʹЧʴﵽѡڱԵƫѡҲӳ3ʾСĿ£ԶλһѡʽڴĿ£36(ռܲ18%)ʽʵѾ֤ͨڶĿѡԵԽԣǣʶϵͳʶԭ()½ʱΪִ֤񣬱䲻Ըʱʹ汾ɵֱϱϵͳָǶͨʤεģҲ˵ͨԶ߶ͨ˻ЧʵҪá
4 
ڶͨûо˱ĶͨģĿѡ㷨ԲԱʹĿѡ㷨ʹģģʽʶʹϽõطûĽͼʵͷǿԵó½ۣģĿѡ㷨ĶͨûЧڵͨû棬ȷĿѡʽĵͨûи㷺Ӧԡ л ĵõ㽭ѧѧϵΡʿʦڵİڴ˱ʾĸл
ĻùȻѧ
Ļ㽭ʡȻѧ
־(㽭ѧCAD&amp;CGصʵ   310027)
(㽭ѧѧϵ   310028)
ο
1M. Chen, J. Luo & S. H. Dong. Task-Oriented Synergistic Multimodality. In Proc. of the First International Conference on Multimodal Interface (ICMI' 96), Beijing, 1996
2L. Nigay & J. Coutaz. A Generic Platform for Addressing the Multimodao Challenge. In Proc. CHI' 95 Human Factors in Computing System. ACM New York, Denver, 1995
3L Nigay, et al. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The CARE Properties. In: Proc. CHI' 95 Human Factors in Computing System. ACM New York, Denver, 1995
4R. Pausch & R. Gossweiber. Application-Independent Object-Selection from Inaccurate Multimodal Input. In: M. M. Blastner & R. B. Dannenberg. eds. Multimedia Interface Design. Massachusetts Addison-Wisley, 1992
5־, . ͨûĿԲ. ๤Чѧ, 1999, 1
ոڣ1999-12-17
