ѧ
JOURNAL OF SOFTWARE
2000Vol.11No.4P.502-506




һֻƬعάģ͵ķ
ޡʯӢ
ժҪδʵлȡʵеάģһֱǼͼѧеһѵ.ĸһִʵƬؽάģ͵㷨.㷨ڿռϡֲĲͬӵ㴦ʵƬɫһﵽƬʵ̶ȵάģ,ʵ縴ʵάģ͵Ľ.
ؼʡƬģ,άģ,һ.
ͼšTP391
A 3D Model Reconstruction Algorithm Based on the Texture of Photos
YANG Meng-zhouSHI Jiao-ying
State Key Laboratory of CAD & CGZhejiang UniversityHangzhou310027
AbstractIn computer graphics, it's difficult to acquire realistic 3D scenes from the real world. In this paper, a novel 3D scene model reconstruction algorithm is presented to deal with this problem. This method reconstructs photo-realistic scene models according to the color and texture of basic input photos, which are distributed in the environment. This method can be used to reconstruct photo-realistic 3D model of complex real objects.
Key wordsPhoto-Based modeling, 3D model, consistency.
 ڼαʵһֱǼͼѧоеѵȵ.ĿǰҪ3෽ڼ͡ͼԼΡͼϵķ.
ڼ͵ķͨóֹģ.ַ,ȷ,ЧҲ.ͼƵķ1,2ͨóһͼ񼯺Ϻ֮Ӧӳﳡģ.ͼƵҪŵǣṩһֶԽͼÿֻҪ̶,볡Ӷ޹صĻƷ,ڴģҪܶƬ,ʹ洢Ϊƿ,,ϵͳṩĳֶ,ںܶӦҪ.ѼͺͻͼƽһַǳЧķ,ӳӦ.
ܴʵֱӻȡģͣ󽵵˹ģĹ,ͬʱ߻Ƶı.ܶѧ߶ַо.Debevec3ݸһִӽƬȡйϢؽάģ͵ķ,÷ûָɹ֮໥ϵԼһЩƬеĶӦ,ݽĹԼ໥ԼĲ͹λáߴ,ȡӦ,ɾƬʵȵĽάģ.DebevecƬģ㷨ֻԾйԺ໥ϵȷĽೡЧ,״ĳΪ.⣬кܶѧ߶δһ鳡Ƭкϳɸóӵͼо,Ӿƥ4ݡԪɫֵ5ݵȷ.SeitzԪɫֵģؽݳڿռϡֲӵ㴦Ƭɫ֮ؽģ.SeitzȽģռɢԪ,ƬһƬλγһռ͹,ģһ㶼λ͹֮,򽫵ؽ㷨ʧܣƬ,ÿԪƬϵͶӰǵ֮ԸЩԪɫֵ,ЩɫԪʾάģ.Seitzģؽ㷨ŵǣģεĸӳ̶û,ͬʱؽ̲Ҫ˹룻ȱǶλ,ĳģֻһϢ,ʹģֻܴ޵ĽǶȥ۲,ͬʱԪʾģ˼еĸӶ.
ĸģؽ㷨SeitzԪɫֵصģ,֮ͬڣ㷨λûκ,Ԫɫֵ֮,ͬʱģؽеĳ֮ڵ,Ƭʾģ,ʹΪ.
1Ƭάģؽ
ģؽ㷨Ӧԭ5.
(1) Ƭ걸.ؽõάģͶӰ,Ӧܾȷزͼ,ұͼɫԼطֱͼͬ.
(2) ӵ㸲ǷΧ.ģһΧڵӵ㴦ͶӰӦþȷ.Ҫͼӵڻϡֲ.
άռ3ֲ3ƽϵƽƽָ.㷨ҪǸЩƽϷָɵƬɫֵ,ʹöһͼ̶ȵƬ걸,ͬӵ㴦ƳͼӦԭʼͼ񾡿ܵؽӽ.
1.1űʾ
ٶ͹նǾֹ,ҳıʲ.,ÿһķȶиͬ,Ϳɫõķ.
һ͸ɫƬ޼Sʾά,FʾռɻֵõƬļ,Iʾһͼصļ.ͬʱǼƬС.
崦ͬһƽϵƬΪһƬFs,һƽڸƬƽΪοƽs,οƽӦλؽռ,Ƭķָòοƽ.fsľΪfs,
Fds={ffs=d}.
ؽռƬɼF,

ɳռƬF.
1.2
1. 걸.SһӵVͼI,һƬfS,fVɼ,fͶӰIϵõp:f=S(p).pIɫΪcolor(p,I),ƬfɫΪcolor(f,S).һͼI1,I2,...,InеÿһͼIkIkÿһp,һƬfS,ʹf=S(p),Ǿ˵Sͼ걸.
2. һ.һ걸ĳS,

Ǿ˵SͼI1,I2,...,Inһ.
ģؽǶһͼI1,I2,...,In,ȡһƬʾάģ:

fpΪͼһµƬ.
Ϊȷؽһµ,ؽÿһͼһ,벻ȫƬһ.
3. Ƭһ.һƬͶӰÿһͼصȫһ,Ǿ˵ͼһ.ȷе˵,һƬSеÿһƬfS,ͼI1,I2,...,InϵصpIi,qIj,Ƭf=S(p)=S(q),
color(p,Ii)=color(q,Ij)=color(f,S),
ôSͼI1,I2,...,Inһ.
ˣƬ˵,һƬһԾ.
1. SһԳ,ÿһfS,fοƽsľΪd,{f}SdsһƬ.
2. ٶS걸,ҶÿһfS,fοƽsľΪd,{f}SdsһƬ,SһԳ.
1.3ڵĴ
ĳһӵɼһֳ,ӵתƺܻᱻһֳڵ,Ϊɼ.άģؽ,жϳǷڵؽɹҪ.ͼ1(a)ʾ,ΪƬfķ,V1,V2Ϊӵ,FΪƬfеƬfӵV1пܿɼƬfӵV2ɼ.һƬһͼ񲻿ɼ,ؽƬʱǸͼ.

ٲοƽS;ڳ
Fig.1 PLrocessing of occlusion
ͼ1ڵĴ
ʱ,ͼ1(b)ʾ,P,QӵVλһֱ,P,QӵVܿɼ.|PV|>|QV|,˶V˵Pɼ,ʱ,Ǿ˵QڵסP,ؽƬPʱӵVͼ,ؽƬQʱҪԸͼͶӰ.
1.4ģؽ
ؽ㷨ݹɷ𲽵ؼģ:

Fk=f|fFdks{f}Fk-1ͶӰfͶӰͼصֲһ£1kr
(1)
FkFk-1-F䣬1kr(2)
Fresult={f|fFr,FrͶӰfͶӰͼصһ}
Ϊĳģ.
֤:ǶF'''iFdksFi1krF1һ.
һ,һ1FiFi1F'''iһ.ʽ(1)(2)֪
ɹɷɵ:Frһ,
˲FresultһƬ.,ؽнȥFͼһµƬ,Fresult걸,һ2֪,FresultһԳ,

2㷨
ڸ˴һͼI1,I2,...,Inؽάģ͵㷨.һڣǼٶάؽռ(ռ)3ֲ3ƽϵƽƽ滮,ЩƽϿԵõһƬFdi1si,...,Fdirsi,di1<di2<...<dir,1i6.һƬfͼIjûбȫڵ,ͶӰIjϵһ,ЩһǿռϦj.û,һ³SеƬfͶӰõһͬɫؼ.ǵӰ,Ҫؼ1,2,...,j֮жһ.ɸؼRGBƽֵķ,ԽС,Խǿ,֮Ȼ.
2.1ؽ
ؽռƬɼS1,ȡؽռĳһΪοƽ,ȶԾοƽƬؽ,S1޳ƬͼһµƬ,ȻԾοƽνƬؽ,S1޳ƬͼһµƬ.ζƽڲοƽƬؽ,޳S1ͼһµƬ.ȡؽռһΪοƽ,S1֮ƽеƬؽ,õƬS2.ͬأνؽռ4Ϊοƽ,վοƽɽԶĴƬؽ,޳ƬͼһµƬ,õƬS6.S6ÿͼͶӰ,ȥжͼ񶼲ɼƬ,õάģ.
2.2ؽ㷨
ڸؽ㷨ṹ:
S1=F
for k=1,...,6
for i=1,...,r do
for every fFdkisk do
project to I1,I2,...,In, compute 
if ˡthresh then S1=S1-{f}
S=0
for k=1,...,6
for i=1,...,r do
for every fFdkiskS1 do
project to I1,I2,...,In, compute 
if ˣthresh then SSȣf
Ϊ1,2,...,jķ,thresh.threshԽС,Խȷ,ҲԽ걸֮,threshԽ,Խȷ,ҲԽ걸.ؽڵļͨԶοƽؽ,f2f1ڵ,f1ضȱؽ.嵽,ȶÿһͼϵÿһñ־Ϊ0,ʾûһƬͶӰ.ƬfͶӰЦ<thresh,ͶӰͼϵصֵñ־Ϊ1,ԺƬͶӰʱ,Ϊ߱ڵ.
3ʵ
ʵͼ3D MAXڲͬλöһάϬţģͼȾ,趨18λ,18ͼ.λ÷ڿռϡֲԭ.ȻЩͼؽ,ͬʱӦλú,ʼؽ.ǵʵƬλòܾܺȷػ,Tsai6ݵλУʵƬУλΪ3%,ؽʱͼλü˴Լ3%ŶģʵƬ.ؽһɫƬʾάģ.ͼ2ؽʵ,(a)ԭʼͼеһ,(b)Ϊ(a)ͬһӵؽģͻƵͼ,(c)ΪؽģӵƵͼ.
㷨P350ݻʵ,ΪWindows 95,VC++5.0.


Fig.2The experimental results of rhinoceros model
ͼ2Ϭţģʵ
4 
ĸһµĻƬάؽ㷨,ݲͬƬгɫﵽƬʵ̶ȵάģ.㷨ͻԪɫֵλõ,ʹÿԶʵȫλƬؽȫϢάģ,ؽг֮ڵ,ƬԪʾģ,ʹΪ.㷨ڽʵ縴ʵάģ.
ޣ㽭ѧCAD&CGصʵҡݡ310027
ʯӢ㽭ѧCAD&CGصʵҡݡ310027
ο
1Levoy M, Hanrahan P. Light field rendering. In: Rushmeier H ed. Computer Graphics Proceedings, Annual Conference Series. New York: ACM SIGGRAPH, 1996. 3142
2Gortler S J, Grzeszczuk R, Szeliski R et al. The lumigraph. In: Rushmeier H ed. Computer Graphics Proceedings, Annual Conference Series. New York: ACM SIGGRAPH, 1996. 4354
3Debevec P E, Taylor C J, Jitendra Malik. Modeling and rendering architecture from photographs: a hybrid geometry-and image-based approach. In: Rushmeier H ed. Computer Graphics Proceedings Annual Conference Series. New York: ACM SIGGRAPH, 1996. 1120
4Maximilian Ott, Lewis J P, Ingernar Cox. Teleconferencing eye contact using a virtual camera. 1993, ftp://ftp.nj.nec.com/pub/ingemar/papers/interchi.ps.Z
5Setiz S M, Dyer C R. Photo realistic Scene Reconstruction by Voxel Coloring. 1997, http://www.cs.wisc.edu/computer-vision/cvpr97-seitz.ps
6Tsai R Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf cameras and lenses. IEEE Transactions on Robotics and Automation, 1987,3(4):323344


