Ϣ
INFORMATION AND CONTROL
1999 28 2 Vol.28 No.2 1999



˹ܿ㷨о*
Ӧ̶
ժҪ㷨ϵͳ˹ܵĳԣ׼ȷʽϸߵĲϵͳ൱ˮƽרҵЭͬҵп߹ЧʣȫԶ»Ϲ˲Ƿǳ£ϵͳɥʧʹڼֵ෴ϵͳȴܹɫعﵽڱȺרҵˮƽϵͳЧʷҽ˹ܵԽԺͲԣ˽ƶ֪ʶõķѾ֤һ㷨ձȻƻϵͳ㷨ĿԣӦʵֿ㷨ϵͳĹѶȶӣ㷨ֻڿɽ綨ж࣮ʵֻOOP۵ɿɽ綨Ŀ㷨ϵͳʵȷе;Ѿ֤ɿ㷨ļȻǿģͨϵؼ̳кͼܹƽյĿ꣮
ؼʡɽ綨,,㷨
RESEARCH ON TRUSTWORTHINESS AND TRUSTWORTHY
ALGORITHM OF AI
LI Yingtan
(Shenyang Institute of Automation,Chinese Academy of Sciences)
AbstractThis paper prensents the concept of Trustworthiness and Trustworthy algorithm in AI that means an AI system should give an answer before not having trustworthy knowledge about the question. The trustworthy knowledge may not give out any wrong answer.To check the trustworthiness of an algorithm may be easier than to prove a trustworthy one . And it is clear that an algorithm can only be proved a trustworthy one if and only if the classes are delimitible classes.
Key wordsdelimitible classes, trustworthiness, trustworthy algorithm
1
1956˹(AI)42ʷˣЩ˹˼ϵĽչ͹Ŀĵ(̫ԣΪ˹⣺Ժ˹ʶģͣо漰ľ˹ϵͳĿ⣮
Դ1996ҿչ˿㷨оǿչһЩʵоϺʵ϶ȡһЩչľоܽᣮ
Ϊ㷨о˹оͻƵ㣮ΪоµоأѾǰչֳǳӦӦǰҲ϶ϵ˹ʵǰ;ϸо£
2ΪʲôҪо㷨
չ˹ܵҪĿ߿ѧˮƽؼҪ֤ĳϽ㷨Ϳ漰ۣ
ӦĸɿԡɵԡԺͿԣɿӲڶ೤ʱڻᷢϵ⣬ɵǷų˹еĴ⣮ɿԺͿɵûйϵûӲϺûΪǰ㷨һָ꣮һָǿԣ5
Ҫ˹йоĿĸ⣮רϵͳҲãҲãģʽʶҲãûпԣ̸Ͽԣû˹̸ܵ
ģʽʶָʶͺʶоѧһ־ͻһ֣ȻܹаյشӱֽԼʶǸȻֻϵһ֣ȴаյģǿģ຺ʶӲһ㣮㷨ԭ򣬲ʶʶôߣܴﵽ100%׼ȷʣܹʵһĺʶ㷨ֻܴӱֽ ϳ10֣ȴ֤⽫ΰĳɹΪʵĿԺǾп֯С飬Ƶʸߵ2000ַͷ4500ʱܣ2000ֶʵ˿ʶ㷨ôͿԽǼʵһ98%ıĿʶʵϵͳʶռ98%98%ıҪУԣͻʡУԹʵԾͺܺˣ
ȻԵĻΪȻԷǳӣӸӣȻԲ˿ԽģҲǶڿܳ׽ģҪ˳ڶЧĻۺŬôʲôʺڴЭʺڳڶЧĻأֻп㷨ʺڴЭܹЧؼԻۣΪ㷨˴ĴݣҪͺԣûпԵķɢڵΪ
һЩȱԸ˿ƺһϵͳֻҪܹﵽȱ˸ߵܵ׼ȷʣٷֱȣͿɹˣǲΪģٵʵǣһXX%ȷҰοĻϵͳȻԷೣľӣȴֻὫӷһͿĪĽʵϣСŴ󳵣봦ˮƽʵҪԶеϵͳһЦhow do you doӦ÷ΪáĻôпܽHow do you do that workΪǸȻһЦĪĽģȥؽʹɥʧ˹ܵ˹ø
ϵͳʹ˶ٳ̽Եĸ߼㷨ڲ֪Լʱ˱һֲ֪ʱ˵ġ1ݣͨеݹ鴦ֳǿӹ֡ǿӹǷǳͿסģȻнȥġ⡱ӹ󣩶ܱʳȴ󲻷֡û֣ʱֱһͿѹֵģΪڻѵǻȱȫԻĽ֪ⷨʶԼӦ֪ʶֶΣä󳵣Ȼסġܡǲȡģ
רϵͳ롢ģʽʶЩ⣬Ҫҵ㷨ѶȺܴ󣬵ȷʵҪһҵĳɽ綨Ŀ㷨ʹڽĳһϵĿԴﵽרȺ֪ʶˮƽôʵڽһѾﵽ൱ǰˮƽˣͿԼ϶ 
Ϊ㷨˹ܵĸעڻشİϣʵҪôشҪôȷػشĲԣ⽫ʹĴ𰸱һ˸˹һķչʮҪģǰܹʵȺЭЧۣ˹ܶ༯֪ʶܼӦ֪ʶõķֲĿ˹ϵͳһ˾ܹרˮƽ͹ĳЩ⣮˵Ĺ״̬ܵصĸţ״顢ȣȴûЩΪأˣ£Ӧñ˸һЩ(㷨ǿĻ)ɼǶôҪˣɿ㷨оĿɽ綨˹ܵϵͳойӦǰӦо
3ʲôǲ㷨
1㷨 һϵͳûӲϵ£ԼĻشĶԴ֪ûȷյĻôʹõ㷨ǲģ
2ϵͳ һϵͳʹõ㷨ǲģôһϵͳ
Ϊνܵ׼ȷʣʶʡ׼ʵȣ乤ϵͳ۳ܾشĲ֮Բܱ֤100%ȷشʣµĻڲϵͳˣĿǰеȫԶʶȫԶָʶȫԶϵͳ۳ܾʶܾ벿ֺ׼ȷʲ100%ģһؾڲϵͳ
Щϵͳṩջش֮ǰųֻýĴ𰸣ǽԵĴ𰸻һṩûκαϲϵͳûи㶮ġʵϲ׵ϵͳҲûСġ͡̸̸ǵܣʵ̫ˣ
ͺñһѧĿԾûлشĿ֮ԴڴĻѧĻشǲģĻشûгִôѧˡ֪֮Ϊ֪֪֮Ϊ֪شǿģ
ǽûлشĿϵͳϲûаյĲ֣˲ΪԵݣ˵ش߳ϲᲢӰԣӰԣ5)ǻشȴУ
ǲǴһξͲأģΪ㷨ҪϵͳǴӾзչģҲ𲽷ֺ;ģˣһȽʵĹ۵ǣ
3ʵʿϵͳ һϵͳڻش֮кٳڷд֮ͨѧϰܹܿٷҲӶ䷢Ĵ𲽱ֱûдĻϵͳʵʿϵͳ
4жһ㷨Ĳ
ǲȥһ㷨ܸȷĴ𰸣ܵ׼ȷʣרȥǻûа취⡢֡ųƻشеĴؿشĴǷΪ00ûб⡢֡ųƴİ취ش׼ȷʲ100%100%ô㷨ǲģ
Ϊһϵͳġܵ׼ȷʡǡǡΪֲϵͳ㷨ṩһϷĲ֮أνܵ׼ȷٷַһûлشǲ֣𣮶һʦѧеɽϣȡûϵͳʮֲˣʵϣڹΡ̽²⵱𰸣ȻûпԿ̸ģʽʶŵܵ׼ȷʡʶʵȸûаעڶشȷϣʵϣЩϵͳʹܴʡúܸߣشʡúܵͣش׼ȷҲ޷ﵽ100%˵ЩϵͳϲֶԴǲģԭܼ򵥣ڲƵĺȫԶ£⣬ϰ֪ȷġ²ĳɷ֣ˣֵʮͻͼ
ںıķִоУһȵķִ㷨Ľ㷨ЧʽϸߣҲϵͣÿĹ۵죬㷨Ҳǲģ磬ڷӵʱ϶ԼΪȷԼܹ֣ʵǴзֽ
ӡøõļûû
||||û|û
ˣִַ㷨ķִʽΨһģдʶõ϶ִʵĿԣȻصĺо䷨䷨ʧܵĻ⣺硰ǲжԣıǷд䷨Ƿдȣԣֹͣǽʹ¾䷨ܹȷķΪһʼͲִʣϵĵۺԵķɼȵķִ㷨ǲģ㷨Ŀǰȴձʹã4ݣ
о䷨㷨ͻھֲƥ㷨Ҳǲģڡ췹ʯͷᡱľ䣨Ϊʯͷ䣬ʯͷ䣩Խ⣬ǣҲܳʯͷݳԲЩȻȴܽܣڳʯͷ벣䣬ܣ˴
ûĴ䷨㷨ȱзֱǵ˵ʵʹ֣˵ûйɿѭ磬䷨µľӽΪģ



ﶼǺģǴӴ䷨ĽǶֱû֣
5㷨ԭϵͳĳ·
ֲ㷨ϵͳԭǵı⣬ΪǶԵĸԹƲ߲֮ԿȱʶϵͳӦôûȷƣĿ̫ߣй֪ʶֻ̫㣻ʩ˽͵ġǿ͡뵱Ȼֲȷĵ֪ʶٶΪһȷ֪ʶʹй֪ʶùȵȣĹ˽֪ģ˸һСһһǸС뵱ȻƳĸĻ廮ˣСȻȴˡ뵱ȻĴ󣮺˵ǰһϡС򡰴󡱾ͿԹɶ˵ļƣֻʺܹ<N>һֲﾳһ¡־ͶˣΪ¡ָ⣬<N>ﻹһ֣ľֲﾳȻжϴˣͬ˧һǶСԪ˧ͷ˵ļƣ˧գָ˧ҲδвɣȫҪʱﾳ֮ԲΪ˵ضĺԻģǹϵͳʱ⻷ǰᣬͻ᷸뵱ȻĴ
㷨ϵͳֻиˮƽרңЩרҵ֣ſȡЧӦã߹Чʣ
벻ˮƽߵרҵĺȫԶĲ㷨ϵͳԶܳΪ֪ʶõķһ˵ûӦǰģΪӦطչ㷨ϵͳЧƶ֪ʶõķչ
6ʲôǿ㷨
4ϵͳ һϵͳûӲϵ£һܹûаջشľͲشаյĲŻش𡢻ش֤ȷĻôһϵͳ
ϵͳӱ˹ġܡģΪ˹ġġ͡ʹõ㷨Ҳǿ㷨Ϊܹų󣬱֤ȷҪע⣺ܹԼûаյųȡشܾشķǿϵͳ֤ԼشȷԵΨһð취һϵͳܹܾͨش֤شȷԣҲܹʵֿ
ʵκһ̨רõĿģֻҪרŵ£ȥĻǻеģֻӲûֻҪϣͲܳˣûпԵĸֻпɿԵĸҲǻǼӲҲڱ̵ԺձԣЩ˿ʼһЩԼҲŲģģ򣬲ų˿Ե⣬˿ĸ
ע⣺ϵͳȴṩĴ𰸣ҪϲܸߣʵǺܸߵģʵϣЩϵͳڲ̫걸ͳģʽʶϵͳʹܾشﵽ99%ʣµ1%Ȼܱ֤100%ȷ
7жһ㷨Ŀ
һ㷨ǲǿؼҪܲЧųӦûشаյػش⣬ȥܸܲػش⣮Ϊ⼸ҪԭˣǽЧųԭ
жһϵͳǲǲķȽϼ򵥣ΪֻҪһʵܹ֤ͿǲģʵжʵжжԱȽЧΪֻҪҵһʵ㹻ˣȴжԵ÷ǳΪܵʵĿޣǽԶ޷֤ԣ˶ڲöٵ⣬ʵжԶ޷֤һ㷨Ŀԣ
ۿԷ֣һ㷨Ҫ޵Ĳ֮϶ųҪʵܹҪʵн綨ǴĿɽ綨ԣ
5ɽ綨 һǿɽ綨ģڵκһʵܹ޵ļ㲽֮жǲǴһ޼㲽֮ڼжôǲɽ綨ģ֮ǣ
ԭ1㷨ԵĿɽ綨ԭһʩеһ㷨Ҫܹ֤ǿģôǿɽ綨ģ˵κһ㷨Ե࣬ǿɽ綨࣮
˹ܡѴͳġ֪֮Ϊ֪֪֮Ϊ֪֪ҲԭΪԭ򣮲ΪǶ෽ģмذ涨ҲܵҪķ棻
6ʹûڿɽ綨ļ̳С롰ѯõԭеΪЩڿɽ綨ķΧ֮ڵġѾõ֤ˣǿģ
ΪһӣǼ㣬ǽ
ǲɽ綨뵱ȻĹ򡱽еġ뵱ȻԽı߽磮ⲢܣǡҪʮġ塱ǳְһòĹеġ뵱ȻνġǿԽ˹ܲ֡͡ġԽȻʱȷȴдǲģ
ϵͳҪҪųʹԼԭǣûаյʱҪܾشԱ֤ش100%׼ȷʣΪ˻ǻ֪ĶҪ֪Ķһ˻߻һ㣬Ŵﵽˡ֪֮Ϊ֪֪֮Ϊ֪֪ҲĿľ磮
ԭ2Եĳԭһ㷨ܹһɽ綨ÿһʵǳԱھ޲Խ綨֮󣨾ųڱ෶Χ֮ڵʵһʵľԵͳһġΪרϿɵĿĴӶʹ䴦ﵽרˮƽĻô㷨Ϳ֤ǿģǿԵĳԭ
ԭ3㷨ļԭڿɽ綨OOP۵ɿɽ綨Ŀ㷨ǿԼɵģЩ㷨ڸԲȥԤԼĿɽ綨ҲṩĴ𰸣˼ɺϵͳȻǿģͨϵļ̳кͼɣܹƽʵֿϵͳĿ꣮
8ʵֿ㷨
㷨ͿϵͳǴϵģڲ㷨ĻϷչģΪܹвȥͿʵֿ㷨
(1) Ҫһɽ綨࣮ԭ㷨ִôԼǿ޶㷨㹻СķΧ֮ڣֱܹ֤㷨ǿΪֹˣ̣ʵϾǽһ㷨ԵĿɽ綨Ḷ́ն壬綨㷨޲ɣʵϣֻڿɽ綨ôһɽ綨࣮
(2) ѰҽרңרƶĻԵġϸԭ
(3) ЩԵġϸԭӦĴִЩԭ򣮸㷨ҪжʵǲǱܹӦôĶųڱһʵܾش𣬴Ӷų²ԵأȻϸԭͿʵֱĿ⣮
ۣѾʵ˰ƺšλͨŵַж뷭Ŀ㷨ʵϵͳܹĸͨŵַд
ý90Զ
й·16
Ϻ100
ܽ100%ȷطΪӢģΪ˱֤Լ뷭Ŀԣϵͳһݿ¼ͻڵλ֪ʶĿϵͳͨŵַΪϵͳȱ֪ʶ͵ͨŵַϵͳȡܾʾ߲й֪ʶĿоڿ۵ָ£ܿͻ֣ᷢͨŵַķ֪ʶǲЧؽģִܹ֮ΪʹЩͨŵַ˰˸ѡͶԱԼӦ֪ʶͨŵַеĲ֣ͬЩֶÿһǷǳϤԵʣˣֻнɢڸѡͶԱͷеЩ֪ʶȫɵԼݿпܽȷķ⣬ȻпܷΪȷӢģ2ݣ
9
Ѿ˿۵ȫܶʵһͨŵַӢϵͳʵ֤ĿĿԣ߸лйѧԺѧʵ̸Խͬ־֧֣ǶԱķֱ˱ҲлƼ鱨ͬ־ѧԺϵ콭ỪͬѧĹƼ鱨ͬ־ҲԱ
*оõйѧԺѧʵһ⡰ɽ綨˹ģо֧֡
߼飺Ӧ̶58꣬ڣоΪ˹Ȼ뷽о
ߵλйѧԺԶ110015
ο
1Ӧ̶˹ܵĸ.йѧԺԶо棬1998
2Ӧ̶콭ͨŵַģ͵ȡ綨ͷ .йѧԺԶо棬1998
3Ӧ̶λͨŵַӢӢֲᣨ棩,1998
4 ڼ̳еĺӢֱϵͳоʵ.ѧʿѧλ,1997
5Ӧ̶ԺͿ.йѧԺԶо˹ܿ㷨о,1997
1998-05-26ո
