ѧ
JOURNAL OF SOFTWARE 
1999 10 5 Vol.10 No.5 1999



άģȫ⼫ͼ
־աҡ ѧ
ժҪɷǾȷ˶µͼн3Dģ͵ȫ⼫ͼ񷽷,ʵ ȡʱȷơȱ߽ȷڵָ㷨.÷ƹ㲢 ⼫ͼ񷽷ȫͼ񷽷,˶ֲ㷽еľֲС, мʹ洢ЧʸߡӦǿ㷨³Ժõŵ.Ȼʵά ģ,ڻȫֶλȻ·ȡʵֵͼϳ.
ؼʡ⻯ʵ,⼫ͼ,ȫͼ,˶ڵ,ｨģ. 
ͼšTP391
˶ǽάģ͵Ҫ֮һ.˶зͨʱΧ ͼ֡߼ľ.˶,켣ٱ쳣.⼫ͼe pipolar plane image,EPIķ1ݼ˶㶨,˿ɽ˶ת ΪάEPIϹ켣ߵȡ,ڶ˶Ҫڿ,ʵӦ.Factorizat ionķ2,3ö֡ͼ϶ӦϢ,ֵֽͨķ ˶ͽṹ,ҪͶӰģ,ҳͼ϶Ӧ.Ϊ˴ﵽ 3D,еоԱͨȷ˶˶ƺͶӦ.DilmiaTr eveli4ͨƽ˶ľ,ʱݶϢлòͬϢ, Ҫﵽ0.1mm˶ȣMurry5ͨȷת,ʱͼ ,üķֻһɨϵ3DϢ.
ӿΧ˶/,˶ָһѵ.һ ˶,ȫ3D˶ȼΪ̬.Ŀǰ,Ƚϳɹķǽͼ ˶Ϊƽ任6,ͼ֮伸Ȳ˶ƽ任 ,,ʵǶ˶;Ľ.Sawhneyˣ7ĴӰȵ˶ ģ,˷ֲ׼ӰƽľۺСС ȣMDLԼ.෽ŵȡ,ȱǣ(1) (2) ȱ仯Сļͷֲٵļ費һ(3) ڲС,ܻ ¾ֲСﲻȷĽ.
ѧZhengTsujiˣ8öι۲ɵȫͼʵȫֶλ.Ϊ һ˶ṹ,ȫͼķòͬһ˶׼ķ .ٶ·ƽƽ˶,ֱ˶.ÿͼгȡĳһ һʱȫͼ(panoramic view image,PVI),ͬλϿɲͬȫ ͼ.ͨͬȫͼƥ,ɻȡ2.5Dȫʾ.ȫͼ񷽷ŵ (1) PVIṩ˴Ұ2Dͼ,ȫֻģ.(2) 3DʱͼѹΪ2Dճ ͼʾ,һЧ״ȡıʾʽ.(3) PVIˮƽΪƽͶӰ,ȫֶ λ.䲻Դڵǣ(1) Կ١ɿػȡ.Tsuji˵о ,ƥͻصķδܺõؽһ.(2) ʧһЩҪϢ,, ӵϿɼϢȫͼ϶ʧ,ͼֱʽ˻ʧ.(3)  ĵ·Ҫƽ˶ǲ,ʻлΪ·ƽȶԲѶ ͼ񶶶.
ʵвȷ˶µȫͼɺϢȡ,Ǵо.˽ ϵͳ9,о(1)͵(2)ķ,(3) ĸ10.
1ȫ⼫ͼ
һʵʻģķǾȷ˶ģ,֪ƽ˶δ֪ⶶ (ͼ1(a)ʾ),ᴹֱ˶,Ծ3Dṹκ.ģ ʺƶ˶нȻģ͵ĳ.ͨȶͼ,Чؽ ˶͸3Dֿ9,10.ͼȶ൱ڳƽֱĵ·ƽ ƶ.OXƽڵ,˶ķ,賵ٶ-V(V0 )˶(Ե,еٶVƽ),,ռPĹ켣(x,y,t)ͱ Լƽxɨ.͸ӳɱʾΪ
(1)
(X,Y,Z)ʾPʱt=0ʱά.ͼȶĶάʱս ͼ--ȫͼ(PVI)⼫ͼ(EPI)ʵͼл(ͼ1( a)ʾ).,ǰΪάʱͼƽy-tĽ,Ϊƽx-tĽ.ڱ ĵķ,ÿ˶лȡһPVI,ӦPVIÿˮƽ,һEPI.

ż̶ܹڽγ,ڽƽ̹Ĺ㳡˶廪ѧ¥ͼ, ,ͼΪ128()128()1024(֡),ͼȡƵΪ19֡/s.¥ͼ дԼ1ҵĶ.û˶켣ƽ˶˲ͼȶ,Իý õȫͼ⼫ͼ(ͼ2иͼıԵ).PVI൱y͸ͶӰx ƽͶӰĽ,Ϸӳ˲澰ıԣͼ2(a)ʾ)EPI, ˶γɵķ,ӳ˾(ͼ2(b)ʾ ).ԭͼһp(x,y)EPI϶Ӧһֱ߹켣,б뾰P(X,Y, Z)Dɷ,D=Z=f(V)/(v),v=(dx)/(dt)ֱ߹켣 б.ͼȶе˶˲ֽ⣩һʣ9.
ڴͳEPI,Ҫxtͼϵÿһд,ܴ.ڱ,ֻĳ άPVIϸΪ,ѡطEPI򼴿ɵóϢͼ1(b)ʾ. ַǽȫͼ⼫ͼṩϢۺ,ʳΪȫ⼫ͼ. Ϊ6裺ȿɲͼ㡢෽⡢˶߽綨λڲ塢ڵ ָԼȷֲʾ.ȴȫͼIPVI(y,t),ɼӦȫͼPVI ȿɲͼ
B(y,t)=Gt(y,t) - Gy(y,t),(2)
Gt(y,t),Gy(y,t)ֱΪPVIϸõ㴦ˮƽʹֱݶ.Ϊˮƽ Ĺڿ׾ЧӦ,޷,,ݶȵľ,ɶ Ϊ0,ֱݶȳˮƽݶȵĵ,ɶΪ֮,ˮƽݶȳֱݶֵԽ, Խ.ͼ3ȿɲͼӦͼ2(a)ȫͼ.



(a) ȫͼ


(b) ⼫ͼ
ͼ2


ͼ3ȿɲͼ
ȫ⼫ͼ3DʱͼĴΪ2DͼĴ,нϸߵļЧ. PVIϼȿɲͼB(y,t),ÿһyӦ⼫ͼĻǶ ,ͼдСΪWHߣF֡,Hд,ͬʱH WF⼫ͼĴ.
2෽ʱ
һ󴰿ڷGFOD(Guassain-Fourier orientation detector), EPIʱķ.ʱո˹ڶΪ,Fourier任Ϊ .ʱͼϳԸ˹,һ˶͵γɵĵΪ,ʾΪ
g(x,t)=f(x-vt)w(x,t).(3) 
ƵɵFourier任:

ֱߦ=- (1)/(v),ͨFourierƵͼ϶Ըֱߵļ,ʱķ ,ӶöӦֵ.ʹø˹ں,ĵԽԶԷƵ׵ĹԽС, Ӷչ˵˶߽ľȷλ.ͬʱ,Եͷ򲻺ܽӽĶ෽ķ ⾫ûкܴӰ죻ԷܽӽĶ෽,ԭƵͼԵĶ෽ֱ ֲƽ޲,ĵԽƵ׵Խ,Ӷ ȷļ.
ڶӦPVIÿһֱy⼫ͼIEPI(x,t),ֻPVIӦ xλãһΪx=0,ҳλti,ʹB(y,ti)Tbһȡ2.ѡʵĴ ڴСmm,m=64, 2=(m-1)/(4).GFOD㲻ͬȵķǵ㷨 £
(1) (x,ti)ΪļGauss-Fouier任õG,أ,ΪƵ, ׼Ϊ

ЦնӦxtռ켣ߵķǣ0У,=0()/(2)ʱΪ ֹ,ա()/(2),ʱΪ˶.r1,r2Ϊͨ ˲ĵ͡ƵΧ.巽ֲͼPd(,t)Ϊʱ̷ֱͼPd() ɵͼ.
(3) ֵPd(Ȧ),ӦǦȦ(k=1,...,K)ʾͬͼ˶.K=1ʱ ,ʾû˶߽磨Ȳ.K2ʱ,ʾڴ˶߽.
ͼ4ʾ˶Ӧͼ2ȫͼ1ˮƽߣy=64EPI.ͼе1ΪEPIĴ I(x,t),2ΪӦFourierƵP(,),3ΪӦĵķ ֱֲͼPd(),4ΪӦEPIķֲͼPd(,t),5Ϊ ӦEPIķ(ø߶ͼʾ).ڵ1,úڰֱ߶αʾӦĵ .4зֲͼеİ߱ʾôΪ.


ͼ4ƺȱ߽綨λ
3˶߽綨λ
Ȼʹø˹ͬʱ˷⾫ȺͶλ,Բȫ׼ȷλ,Ϊ˶ ߽ڼⴰʱ,Ϳܲ෽.ڷǸ,ҶݴԵġ ĶԳ,ʲϸ֤Ҷȵʱͬһ,ù켣߸ٵķʧ .,GFODӼ,ظ˶߶ȴڵĻҶ/ݶһ ԵıȽж,ѡһõΪ˴ķ.ֻ˫,෽б ˫б.
֪,12,1Ӧڽ,2ӦԶ,ڰ뾶ΪR Բδ,(x0,t0)Ϊķֱئ1ͦ2,϶ ҶȲһԵķֵCk,RCk,R(k=1,2).
C(k,R)=(1)/(R)R)/(r=1I(r,k)2-2(k,R).(7)
(8)
ӦѡķΪ
.(9)
ԶڵʱѡE(2,R),ɽԶ֣ʱѡE(2,R).
Ϊ˴ͼʱ϶̵,ö߶ȵĴڶҶһԶE(k, Ri),i=1,2,3,...,k=1,2.öͬСRii=1,2,3,ѡҶһԶ֮ ϴRiΪѡĺڰ뾶.ֵ
(10)
p=argmaxi(Di),ô,E(1,Rp)E2,R p),ѡ1;,ѡ2. ѡͬ.
Ϊ˵õܵ˶ȣ,úڲ巽.ɶ Ǧ1,2ʱt1,t2֮ľ,ڲֵ£ȡ,м ڲ壻Ȳ,мڲΪԶ,ΪܿǽڵԶ .ЩͨȫͼϿϢںϼ.
ͼ5ʾ¥ͼеĿ˲ͼ.ͼеͼֱӽǦȵֵ ʽʾ,DԽ,ͼٶvԽ,ȦԽD=f(V)/(v),v=tanȣ. ͼ5(a),PVIϵĺ߱ʾȱ߽磨˶߽磩,Էֶ¥֮, ¥֮ͬнϾȷȱ߽.


(a) ȱ߽ȫͼ


(b) ˲ͼ
ͼ5ȫͼĻҶͼͼ
4ڵָ㷨
PVIֻһӽǵϢ,,ЩӵԭʼͼܿľPVI ϶ʧ.ͨڵϵķ,ʱλõͼϢв.㷨Ϊ( ͼ6ʾ)(1) ҳڵʱȱ߽t0ԶķǦ1,2. (2) ȷָʱվεxλúʱֹts,te֡ڵʱx0, ʱx0,ʱʼts,teȡڷǦ1,2Լڵt֡ҵľķ ڵϵ.ɴ˵õɶp0(x0,t0),ps(x,ts),pe(x,te) ڵ.(3) ȷڵp0pspe.ϸؽ,ڵķܾиӵ ,Ϊ,ĿǰֻΪͣԶڵOCCLUDEDͬһȣͲSI DEȣ,Զڵķȡ1,ķȡ12֮ ڲ.ͼ,ֱء켣ߡܵĻҶһ μʽ7,ɴжϸ,Ӷڵp0һʱͼpsp e.


ͼ6ڵĻָͽֱʵĻָ 
ڽ壨v1ʱ,PVIʧԭͼķֱ,˿ɸͼٶȵ С,xȡӦȵĶ,ָԭͼķֱ.Զ壨v1,PVI ʱʸڵͼĿ,ԱߵʱϢ.ͼ6EPI᲻ ͬϸĺ߱ʾȡϢĳ.
5
Ϊ˴ﵽЧ3Dģ,Ķ˶ļ,µķ,ȡʵʵĽ. ȫͼ⼫ͼĽ,˴󴰿GFODӺͻҶһԱȽ϶, Ӧȡֵ,ԾвȷӦӵṹԵӦ ,㷨ϸ⼫ͼ켣߸١ʱͼСھֲķȫ ͼӦĲ.ֻԴ󲿷Ϣļٵݣȫ⼫ͼ񣩽 ,Ҿв,˿ԸݲͬӦôﵽʵʱ׼ʵʱ.
оõ863߿ƼĿ͹ƼԤл.
־,1964,ʿ,,ҪоΪӾ,ͼ,ʵ, .
,1940,, ʿʦ,Ҫ оΪӾ,ֲʽý,˻.
ѧԡ,1940,, ҪоΪӾ,ģʽʶ,ܻ.
ͨѶϵˣ־, 100084,廪ѧѧ뼼ϵ
ߵλ廪ѧѧ뼼ϵ100084
           E-mail: zhuzhg@mail.tsinghua.edu.cn
ο
[1]Baker H H, Bolles R C. Generalizing epipolar-plane image analy sis on the spatio-temporoal surface. In: Rosenfeld A, Ahuja N, Huang T eds. Pro ceedings of IEEE Computer Vision and Pattern Recognition. Los Alamitos, CA: IEEE Computer Society Press, 1988. 29
[2]Costeira J, Kanade T. A multi-body factorization method for motion a nalysis. In: Weiner B ed. Proceedings of IEEE the 5th International Conference o n Computer Vision. Los Alamitos, CA: IEEE Computer Society Press, 1995. 1071107 6
[3]Tomasi C, Kanade T. Shape and motion from image streams under orthogr aphy: a factorization method. International Journal of Computer Vision, 1992,9(2 ):137154
[4]Dalmia A K, Trivedi M. High speed extraction of 3D structure of selec table quality using a translating camera. Computer Vision and Image Understandin g, 1996,64(1):97110
[5]Murray D W. Recovering range using virtual multicamera stereo. Comput er Vision and Image Understanding, 1995,61(2):285291
[6]Wang J, Adelson E H. Representation moving images with layers. IEEE T ransactions on Image Processing, 1994,3(5):625638
[7]Sawhney H S, Ayer S. Compact representation of videos through d ominant and multiple motion estimation. IEEE Transactions on Pattern Analysis an d Machine Intelligence, 1996,18(8):814830
[8]Zheng J Y, Barth M, Tsuji S. Qualitative route scene description usin g autonomous landmark detection. In: Tsuji S, Kak A, Eklundh J eds. Proceedings of IEEE the 3rd International Conference on Computer Vision. Osaka, Japan: IEEE Computer Society Press, 1990. 558562
[9]־.Ӿлģо۲ʿѧλģ.:廪ѧ ϵ,1997
(Zhu Zhi-gang. Environment modeling for visual navigation Ph.D. Thesis. Bei jing: Tsinghua University, 1997)
[10]궫,ꡡ,־.2.5ά֡˶Ʒ ,廪ѧѧ(Ȼѧ),1997,37(9):7881
(Yang Yu-dong, Xu Guang-you, Zhu Zhi-gang. 2.5 D inter-frame motion estimati on method. Journal of Tsinghua University, 1997,37(9):7881)
1997-11-24յԭ,1998-05-08յ޸ĸ
