Զѧ
ACTA AUTOMATICA SINICA
2000Vol.26No.1P.43-55



Ӿ
ï̵֡¡
ժ Ҫ عӰѧͼӾеĸ귽Ըַ˷Ƚϡ귽ӦڼӾеص.
ؼ Ӿ꣬ӰѧӾάؽ.
OVERVIEW OF CAMERA CALIBRATION FOR COMPUTER VISION
QIU Maolin
(Beijing Open Lab of Cognitive Sciences, University of Sciences and Technology of China, Beijing 100039)
MA Songde LI Yi
(National Lab of Pattern Recognition, Institute of Automation, Chinese
Academy of Sciences Beijing 100080)
Abstract In this paper the camera calibration methods in photogrammertry and computer vision are reviewed, categorized and compared with. Features of the application of camera calibration methods in computer vision are discussed.
Key words Computer vision, camera calibration, photogrammertry,stereo vision, 3D reconstruction.
1 
ӾĻ֮һǴȡͼϢάռļϢɴؽʶ壬ռĳάλͼжӦ֮໥ϵļģ;ģЩģͲ.ڴЩͨʵܵõ̱Ϊ.ӰѧҲͬ⣬Ѿȡ˺ܶоɹ.ڼӾԣǵۺʵеҪֵѧ10˹㷺оڲͬĳ˼·ȡһϵгɹڲͬⱳǶԵӦüֵ.ΪеĸַܽᡢȽϺͷ࣬Խʾ֮໥ϵһĹ.
꼼ӦӰѧ13.ӰѧʹõķѧķڶͨҪѧԴͼлõݽд.ͨѧֶΣṩרҵϵ.νķָһڲȫδ֪δ֪ԭϲȶ.ڲָĻ(ͼ)ࡢͷ䡢ƫ᾵ͷԼϵͳ.
ڼӾоԣüʵֶάʶһʱCCDǶάؽһֻߣʱ걻ΪʵάŷϿռӾĻֹؼһ˵㷽Ӱѧʹûͬ3.ЩڼӾеõ˽һоΪӾеӰѧеȣͬص㣺
1) ӾϵͳʹCCDΪ۸ķ.δ֪߲ȶӶ³̲ȶCCDֻͼֱʵͣڽϴķԾͷ.
2) ӾһΪΪʹϵͳСɣ֮Ļ߳ȲܺܳӶʹϵͳϴ.
3) ڼӾУάؽҪͼ㣬ʱҪʵʱشݲ.
⣬ͬӦñҲԶ꼼˲ͬҪ.ӾУϵͳʶĳһοϵľԶλԵòرҪҪλõľ.˵һCADʶϵͳУоϵλñ㹻ߵľȣܽЧƥʶ.ϵͳĶλĳһοϵľԶλȾرҪ.磬һϵͳ.ʽƶ˱׼ȷ֪λáռϰλáԼϰ˶Чءȫؽе.CCDصӦҪʹö꼼ȺʵʱԵоԵرҪͬʱҲоɹĶ.
ĳּγģ͵ģģǶԹѧ̵ļ򻯣õģͣоĻģ.ȻܶģͲ׼ȷļιϵڽࡢʱΣ˻ҪԻԵĻ䲹󣬲ܸؿģͳ.Уģͽάؽܵõߵľ.˳ģͺͻ䲹ΪӾоص.
Щݹ˴ͳоҪ.ǣһģ£ضʵ״ߴ֪Ķͼдһϵѧ任ͼ㷽ȡģ͵ڲⲿлڵ֡ͼĻͻڶ֪֡ӦϵӾ.
һҪӦñǣںܶ£ڴھԵҪ󣬶֪ĶҲʵʱҪһֲνԶ귽ΪĿǰоص.ܵе꼼ԹΪࣺͳ귽Զ귽.
2 ͳ귽
Ӽ˼·ĽǶϿͳ귽Էֳ࣬Ż㷨Ķ귽任Ķ귽һǻ䲹ͲøΪģ͵˫ƽ涨귽.ģ4а㷨ص㽫ΪֱӷС()ʽⷽҲʧΪһֺõĻַ.
2.1 Ż㷨귽
һ귽ŵǣԼĹѧģͷǳӣи.Ȼɴ˴ǣ
1) ĽȡĳʼֵʼֵòǡͨŻõȷĶ.
2) Żǳʱ޷ʵʱصõ.
2.1.1 ӰѧеĴͳ
ģ5ݵĶ귽һඨ꼼ĵʹ.еĸأģ.ÿһͼ17άռԼϵǳ.ĲȽ϶࣬ʹרҵ(ȡƬķֱʱͨĹ̬йи4)ͼͶάؽʱȡ˺ܸߵľ.
Faig5ʹõķǻҪἰעһǣõԼģ͵ĹԼ.ʹõķʵһԶ귽.ҪָһԭǣԶ꼼ҲǱĵһҪ.
2.1.2 ֱԱ任(DLT)
ֱԱ任Abdel-AzizKarara1971ģ1.ͨԷ̵ֶξͿģ͵ĲֱԱ任֮.ȻַȫûпеķԻ⣬Ϊ߶꾫ȣŻ㷨Բɱ.KararaԼֱָԱ任ʱǸһԼ̣ʾϵάռϵ֮Ա任ϵûпǳʱκεķԲⲢӦĲԼ.ȻֱԱ任Ľ䵽ܰЩأʹ÷ԵֶʱֱԱ任ȴûиı.˵ֱָԱ任ֺ壬һֱֺͨһԷ̵õйزһֺĹ̲ųʹ÷Ż㷨.
ֱԱ任ǶӰѧеĴͳһּ.ܴӵõֱԱ任ȡڲⲿҲԲ.ӰѧеĴͳȣϼӾӦҪʹõCCDص㣬ΪӰѧļӾ֮.򶼿ʹֱԱ任б궨.ֱԱ任ʹõģ

άռпƵ꣬u,vͼ϶ӦάƵͼ꣬lijֱԱ任Ĵ.
ʧһԣǿl231.֪N(N5)׼ĿƵ
Ӧͼϵ(u,v)11ͿС㷨.
̾ͷķԻʱֱԱ任ԻΪ潫Ҫ۵һඨ귽.ǷԻʱֱԱ任ͼάռпƵĶӦϵ

Ǳ׼ϵĿƵ꣬ңui,viǱ׼ϿƵӦʵͼ.Щͼͼ.Уͼ.
ͼ㣨ui,viľͷУ.
ɴǿԿֱԱ任УԻصǷǳ.
DainisͪJubertsģ6иֱԱ任ĽǵϵͳΪ׼ȷĲ˵˶켣.ϵͳܹʵʱز˵˶켣Ҫ󶨱㷨ϵͳı궨ʵʱ.
2.2 ͸ӱ任귽
ӰѧеĴͳԿ̻άռϵάͼϵϵķһ˵ڲⲿķԷ.ͷķԻ䲢Ұ͸ӱ任еԪΪδ֪һάƵͶӦͼ㣬ͿԷ͸ӱ任еĸԪ.
ϸ˵ģ͵͸ӱ任󷽷ֱԱ任ûбʵ𣬶͸ӱ任ֱԱ任ֻ֮һ.߶Լڲⲿ.
һඨ귽ŵǲŻĲ.Ӷٶȿ죬ܹʵʵʱļ.ȱǣ
1) вͷķԻ䣬꾫ܵӰ죻
2) Էδ֪ĸҪĶģͲĸԷδ֪໥.ֲֹȱǣͼ£Էеδ֪ҲܺܺõķһԷ̣ɴ˷ֽõĲֵȴδʵܺõط.
͸ӱ任귽㷺ӦʵʵϵͳȡĽ710.
Ganapathyģ11ȸһ͸ӱ任ڲⲿķԷֽϸķ.
2.3 
ӰѧеĴͳҪʹŻ㷨δ֪Ľȡڸĳʼֵ.ʼֵʣͺѵõȷĽ.ֱԱ任͸ӱ任󷽷ԷȱûпǾͷķԻ䡢Ȳ.ֱԱ任͸ӱ任󷽷õĲΪʼֵǻأŻ㷨һ߶꾫ȣγν412.
Tsai4ʹõǵ͵.ķУCCDийԪĺ౻Ϊֵ֪ǿṩ.ڲⲿֱǣ
1) fЧࣻ
2) k1,k2ͷ
3) xȷԱӣɨʱģ
4) CxCyͼĻ㣻
5)tάռϵϵ֮תƽ.
Tsai¼۲죬ͼ1.

ͼ1 ƽԼ
1) ͷĻǾģۻα仯ͼĵOiͼ㣨xd,ydķ򱣳ֲ䣬ƽ.ͼ1ʾPozǹϵһ㣬Zϵµֵͬ
2) ЧfxdydͬӰ죬fĴСӰķ
3) ϵxyúƽƣʹÿһȻϵzƽʱxyӰͬӶķ򱣳ֲ䣻
4) ÿһ㴦Լ뾶ʽϵЧࡢάռƽtz޹.һԼȷάռתRάϵϵƽxyȷԱsxǳֵ.
Tsai˵ƽԼԲȷǺ.ΨһȷⲿڲеısxǳֵģҶЩΪ߸Է.
Tsaiķֻ˾䣬ûп.ģ12ͬʱ䣬Ӧ㷨ǶҪչ⣬Ĺ˶꾫ȵķ.
2.4 ˫ƽ涨귽
оԱڴͳоһҲ̽.ѰҸģͣʹ֮ȫ桢ЧرʾCCDʵʳ.Martins˫ƽģͪtwo-plane model13.̵ºκ22,23˫ƽģͱ궨˴о1416.
ַŵԷͿԽйزȱҪδ֪ڹֲ.
˫ƽģģ͵Ļڣ˫ƽģͲģҪͶ䵽ƽϵĹ߱뾭.ƽϵһͼ㣬ܹƽϵӦ㣬ӶȷͶ䵽ƽϲͼĹ.˫ƽģʾͼ2.

ͼ2 ˫ƽģ
ÿһƽ棬һ鶨㽨˴˶Ĳֵʽ.ȻֵʽǿģҪһ㷨ģһֻڴͼ񵽶ƽӳ.ģ13УֲֵԲֵβֵֵ.
ԽʱƽӦʾͼ.㹫ʽΪ
pi=AiL,i=1,2
L=(u,v,1)TͼꣻǵiƽϵӦ㣻Aiһ33Ļع.
ҪȷеĲֵÿһƽӦ֪.֪NN3ʱAiС˼⣬⹫ʽΪ

PL3N׾jзֱpLӦĵj.
һ£Aiܹ18ض.ƽƽXYƽʱعĵоУ0,0Ziʽʴδ֪Ŀ12.
βֵƽж׽ƣ

ǵiƽϵӦ㣻Aiһ36Ļع.
ҪȷеĲֵÿһƽӦ֪6.֪NN6ʱAiͬС˼.
һƣһ£ܹ36.ƽƽXYƽʱعδ֪ĿԼ24.
ʹֵƽʱԽ࣬ƽԽ׼ȷ.ÿһƽʱҪ.ÿڵ㶨һֵƽ.ÿһƲֵƽһ.
̵ºκǵУ2223ݣͨԳ̵ķ˾ͷأʽΪͼƽĻعģͲʵ֤÷ŵȫģͲԷ.
1
3 Զ귽
Сģ£ԶϽ.ڶһ֪£Կռṹκμ裬˶ҲʱĶֻܸͶӰMܴзֽӰµĶ.㹻󣬼ƽͶӰǿԽзµĶ꣬ԶͬΣHomography.ܾȷõ˶ͶӰķֽͿΨһģʱԵõڲԶ.ϸģ17ݣǽĿǰԶоļҪ.
3.1 ñʾͻ귽
ĹѧģΪģͣǻͼϵĶӦϵĻԼϵ.ļԼϵʾ£
(2)
E=TRΪʾRתTƽԪعɵбԳƾϵ֮λùϵ.ʾLonguet-Higginsģ18.
ΪʾֻⲿϢϵ֮˶ϵԸݱʾܹⲿ.νͨӦ˶Ī(Motion frompoint matches).
O.D.FaugerasS.Maybankģ19ϸطMotion from point matchesĽʣ֤˸Ķ.ͨκʹͳӰ;˴ʵ֤.ǱʾΪEEйϵ

ʽõŸζʽ.ŸʽԶģǶ˾EһM.ڸ5ԶӦʱMά510EĽ10.ڸ㹻ԶӦʱEĽ3.
ڲfxfy,u0,v0ͼP1P2ֱ򷽳(3)m1m2Աʾ
(3)(4)


ѷʽ(3)(4)뷽(2)
(5)

(6)
ǻ.
ɼ󲻽ⲿϢҲڲϢ.ûɴ˿Խһڲⲿ.⣬ڻҲȡ⼫߱任Ĳ1921.
3.2 þԶߺ⼫߱任ʵ귽
ף1920ݶþԶߺ⼫߱任ʵ귽оҪ˼£
Kruppạ20ݽ⼫߱任Զߦͼϵ.ȻƽϵĶߣȷڲ.Kruppaṩ˴⼫߱任ȡڲ;Щ⼫߱任˶ϵ.ΪȷԶߦͼأ˶Ρ⼫߱任.
ԶԶƽϵһĶߣռŷʽ.ӰռP3ĵѿϵ£Զߦķ

Զߦڸ˶²ʣʹͼķλ޹.ֻڲA.
λaƶλb,kabĵߣPP˴˶⼫.ʵϣ⼫PkڵһƽϵͶӰ⼫PkڵڶƽϵͶӰ.ǹkһƽ棬ڵһƽ͵ڶƽϵͶӰֱΪll.⼫߱任һӾPֱߵPֱߵһͬ(homography)涨llĶӦϵ.űʾͬζӦ
ƽϵĦͼλ޹أƽ榰ԶߦУƽϵͶӰ11䶼.ɴ˽һǿԵõPеͨ⼫߱任;Pе߶Ӧ.е⼫ӦԼϵǽ⼫߱任ͼϵ.KruppaϵĴʽ.
ڵһƽʹӰ⼫붨ֱy3=0ཻĹϵ԰Ӧ⼫߲.衴p,yΪPyһ⼫ߣһXڡp,yϵҽ(py).X=0.DǶߦصĶżߣDĶ壬p,yеҽϣ
(py)TD(py)=0,(7)
DĶΪ
(8)
ʽһ6ɦȷDʱһ.ҲڣD5ɶ.y3=0(8)ʽ(7)ʽ
(9)

(10)
ͬڶƽϵ⼫ߡp,y䡵ͼԼϵԵõһ(9)ʽƵԼϵ
(11)
ϵļϵʽҲ(1)ʽ.
⼫߱任涨һֱy3=0ֱy3=0һ˫Ա任N.y=y=(y1y20)Tҽy=Ny.=y2y1ӡ=y2y1˫Ա任NɱʾΪ
(12)
֪⼫p,p(öӦȡ⼫ף1921)һӦ
(13)
Է(12)ӦС˼òa,b,c,d.
֪a,b,c,d֮ɷ(9)(11)(12)ɵĹϵ
(14)
(14)еÿһǦӵĶηֻ̣һӣͬĸ.̵ϵ֮ȶӦȣǵõKruppa£
(15)
ÿһ˶ǿԵõ(15)ʽԼϵ.Ӷ˶Լϵ.ԼϵöżD.DڲĹϵ
D=AAT.
3.3 ϵͳض˶Զ귽
̵Ӿϵͳ黥ֱ˶۶ķ2223.
֪ͨ۶ĻԼϵ
(16)
(17)
Rtϵڻеĩ˹ؽڸϵתƽRc1tc1ʾ߻еֵ˶Rp1tp1ûеĩ˹ؽڸʾĻе˶.
еֻƽ˶Rc1=Rp1=Eʽ(17)д
(18)
ֻƽ˶˶ǰͼϵĶӦõཻһ㣬õΪFocus of Expansion(FOE).ңO(FOE)ƽ˶ķ.
3.3.1 ֪ڲתR
淽ƽ˶ǹһ.F1,F2,F3ֱͼӦFOE.OF1,OF2,OF3ֱƽ.Fi(i=1,2,3)ͼ(Ui,Vi)(i=1,2,3)
(19)
Fi(i=1,2,3)Ĺһtci(i=1,2,3)ͨʽ

3.3.2 ȡڲ
ȡڲʱҪеֿ໥ֱķƽ˶.(OFi)T(OFj)=0,(i,j=1,2,3,ij)(19)ʽʽչõ
(20)
(21)
(22)
(20)ֱȥ(21)(22)Եõx,y,zԷ̣
(23)
(24)
Ҫx,y,zеһ໥˶Ӷõ(23)ʽ(24)ʽƵԷ.ڲܹһx,y,zõ.
3.3.3 ƽt
˶Ǵƽƣ(17)ʽƽt.ʽ(17)УRRp1,tp1֪ܽtc1͵Խ.tc1Ĳ£
1)λAʱϵԭΪO1ؽάP.ΪһؽPļϵڻеĩ˹ؽڸϵתR֪ԿϵXƶϵĻ߳ȿɴӾƽ̨Ŀжȡ.ӶO1PԼõ.O1PλA.
2)ƶλBϵԭΪO2ƶRp1tp1ɴӾƽ̨Ŀжȡ.
3)벽һƣȡO2P.
4)ʽtc1

3.4 öͼֱ֮߶Ӧϵ귽
Hartleyһӵľӵľƣоöͼ߶εĶӦϵԶķ2425.ģ24,26NͼеֱؽķҲõо.⣬Shashuaģ2729ͨͼͶӰԼ״α(Trilinear Tensor)ʽԼķʵԶ.ڴἰЩڵоΪЩֵעо̬.
4 ܽ
ǰָģͳһ׼ͼĶӦԼϵȷģ͵Ĳ.Ϊ߼㾫ȣͬʱȷԻУģ͵Ĳ.ǰԴͳ꼼оЧءȷԻУģ͵Ĳ.
Զ꼼ͬڴͳ꼼.ᵽģͳ꼼һ׼Ի׼ȷάϢ.Զ꼼Ҫ֪׼ȷάϢͼôͼеõԼϵģ͵Ĳ.ʹߵءʵʱУ׼ģͲΪ.ȻɴҲ˲.һ൱ֵǣЩԶõĽȲΨһģҲȶ.׼ȷ˵ԼϵõĽһǶģͬʱͼкʹС£õֵҲʵֵкܴĲ.ˣ߽ȶԣһֱԶоԱͼ.
ӾеһԶԹΪһԶʽ.õķǸŻ㷨.ȻŻ㷨Ȳܱ֤ҵȫŽ⣬ֲ˵.ʴڼӾжⷽоԼַⷽ̽ҲһҪķ.
ï 19681993пԺԶģʽʶʵңӾͼͼѧĲʿѧλ.1996йƼѧ֪ѧоʵҴ֪ѧо.Ŀǰɫϣѧ¼Ӿо.
̵ 19461968ҵ廪ѧ1986񷨹ҲʿѧλΪйѧԺԶʿʦIEEE߼Ա.ڴ¼ӾģʽʶͼȷĹ.
 19701996йѧԺԶģʽʶʵңӾͼͼѧĲʿѧλ.ĿǰоȤͼģ͵˶Ŀʶ.
ï(йƼѧ֪ѧоʵ  100039)
̵(йѧԺԶоģʽʶصʵ  100080)
(йѧԺԶоģʽʶصʵ  100080)
ο
1AbdelAziz Y I, Karara H M. Direct linear transformation into objectspace coordinates in closerange photogrammetry. In:Proc. Symp. CloseRangePhotogrammetry.1971.118
2Brown D C. Decentering Distortion of Lenses. Photogrammetric Eng. Remote Sensing. 1966.444462
3Wong K W. Mathematical foundation and digital analysis in closerange photogr ammetry. In:Proc.13th Congress of the Int. Society for Photogrammetry.1976,13551373
4Tsai R Y. An efficient and accurate camera calibration technique for 3D machine vision. In:Proc. CVPR'86.364374
5Faig W. Calibration of closerange photogrammetric systems:mathematical form ulation. photogrammetric eng.Remote sensing,1975.41(12)14791486
6Dainis A, Juberts M. Accurate remote measurement of robot trajectory motion. In:Proc. Int. Conference on Robotics and Automation. 1985.9299
7Yakimovsky Y, Cunningham R. A system for extracting three dimensional measure ments from a stereo pair of TV cameras.Computer Graphics and Image Processing,1978.7195210
8Hall E L, Tio M B K, McPherson C A, Sadjadi F A. Curved surface measurment and recognition for robot vision. In:Proc. IEEE Workshop on Industrial Application
of Machine Vision. 1982
9Itoh A M, Ozawa S. Distance measuring methods using only simple vision constructed for moving robots. In:Proc. ICPR'84.1:192197
10Luh J Y, Klaasen J A. A three dimensional vision by offshelf system with multicameras.IEEE Trans. PAMI,19857(1)
11Ganapathy S. Decomposition of transformation matrices for robot vision. In:Proc. Int. Conference on Robotics and Automation. 1984.130139
12Weng J, Cohen P, Herniou M. Camera calibration with distortion models and accuracy evaluation.IEEE Trans. PAMI,199214(10)965980
13Martins H A, Birk J R, Kelley R B. Camera models based no data from two calibration planes. Computer Graphics and Imaging Processing.198117173180
14Wei G, Ma S. Twoplane calibration:a unified model. In:Proc. CVPR'91. 1991.133138
15Wei G, Ma S. Complete twoplane camera calibration and experimental comparisons. In:Proc. ICCV'93. 439446
16Wei G, Ma S. Implicit and explicit camera calibration:theory and experiments. IEEE Trans. PAMI,199416(5)
17Faugeras O D. Stratification of three dimensional vision:projective, affine,and metric representations. J.Opt. Soc. Am.A. 199512(3)465484
18LonguetHiggins H C. A computer algorithm for reconstructing a scene from two projections. Nature,1981293(10)133135
19Faugeras O D, Maybank S. Motion from point matches:multiplicity of solutions. Intl.J.Computer Vision,19904225246
20Maybank S J, Faugeras O D. A theory of selfcalibration of a moving camera. Intl.J. Computer Vision,19928(2)123151
21Luong Q T, Deriche R, Faugeras O D. On determining the fundamental matrix:an
alysis of different methods and experimental results. INRIA Research Report.1993.No.1894
22Ma S, Wei G. A selfcalibration technique for active vision system. In:Proc. ACCV'95.628631
23Ma S. A selfcalibration technique for active vision system.IEEE Trans. Robotics and Automation,199612114120
24Faugeras O D, Mourrain B. On the geometry and algebra of the point and line correspondences between n images. In:Proc.ICCV95.951956
25Hartley RI. A Linear method for reconstruction from lines and points. In:Proc. ICCV'95.882887
26Heyden A. reconstruction from image sequences by means of relative depths. In:Proc.ICCV'95.10581063
27Shashua A. Trilinear functions for visual recognition.In:Proc.ECCV'94.479484
28Shashua A, Werman M. On the trilinear tensor of three perspective views and its underlying geometry. In:Proc.ICCV'95.
29Shashua A. Algebraic function for recognition.IEEE Trans.PAMI.199517779789
ո1997-08-06 ޸ 1999-03-05
