12.3.4.1.3 Image to 3-D Surface Matching, 2-D to 3-D Matching

Horn, B.K.P., and Bachman, B.L.[Brett L.],
Using Synthetic Images to Register Real Surfaces with Surface Models,
CACM(21), No. 11, November 1978, pp. 914-924. BibRef 7811
Earlier: DARPAO77(75-95). BibRef
Earlier: MIT AI Memo- 437, August 1977. Matching is easy, realistic shading is the goal. BibRef

Horn, B.K.P., and Bachman, B.L.[Brett L.],
Registering Real Images Using Synthetic Images,
AI-MIT79(129-159). BibRef 7900

Viola, P.A.[Paul A.], Wells, III, W.M.[William M.],
Alignment by Maximization of Mutual Information,
IJCV(24), No. 2, September 1997, pp. 137-154.
WWW Version. 9710

Postscript Version. BibRef
Earlier: ICCV95(16-23).
IEEE DOI Link
WWW Version. BibRef
Earlier: A1 only: MIT AI-TR-1548, March 1995. BibRef Ph.D.Thesis, MIT, 1995.
WWW Version. Or:
Postscript Version. When standard assumptions fail (lighting). The idea is that 2 points that are similar in the model should be similar in the image (i.e. similar surface orientations lead to similar pixel values). A similar formulation could be arrived at through a maximum likelihood approach. BibRef

Wells, III, W.M., Halle, M., Kikinis, R., Viola, P.A.,
Alignment and Tracking Using Graphics Hardware,
ARPA96(837-842). BibRef 9600

Viola, P.A.[Paul A.],
Complex Feature Recognition: A Bayesian Approach for Learning to Recognize Objects,
MIT AI Memo-1591, 1995.
WWW Version. Or:
Postscript Version. BibRef 9500

Boshra, M.[Michael], Ismail, M.A.,
Recognition of occluded polyhedra from range images,
PR(33), No. 8, August 2000, pp. 1351-1367.
WWW Version. 0005
BibRef

El-Sonbaty, Y.[Yasser], Ismail, M.A.,
Matching Occluded Objects Invariant to Rotations, Translations, Reflections, and Scale Changes,
SCIA03(836-843).
WWW Version. 0310
BibRef

Guest, E.[Elizabeth], Berry, E.[Elizabeth], Baldock, R.A.[Richard A.], Fidrich, M.[Marta], Smith, M.A.[Mike A.],
Robust Point Correspondence Applied to Two- and Three-Dimensional Image Registration,
PAMI(23), No. 2, February 2001, pp. 165-179.
IEEE Abstract. IEEE Top Reference.
WWW Version. 0102
Medical problems. Based on sensitivity to movement, if a point moves there should not be a large change in the correspondence. BibRef

Guest, E., Berry, E., Morris, D.,
Using the CSM Correspondence Calculation Algorithm to Quantify Differences between Surfaces,
BMVC00(xx-yy).
PDF Version. 0009
BibRef

Guest, E., Fidrich, M., Kelly, S., Berry, E.,
Robust surface matching for registration,
3DIM99(169-177).
IEEE DOI Link 9910
BibRef

Clarkson, M.J.[Matthew J.], Rueckert, D.[Daniel], Hill, D.L.G.[Derek L.G.], Hawkes, D.J.[David J.],
Using Photo-Consistency to Register 2D Optical Images of the Human Face to a 3D Surface Model,
PAMI(23), No. 11, November 2001, pp. 1266-1280.
IEEE Abstract. IEEE Top Reference.
WWW Version. 0112
Face Recognition. How consistent the optical image in each view is with the lighting model. Apply to face images. BibRef

Lee, D.W.[Dae-Won], Hofmann, M.[Matthias], Steinke, F.[Florian], Altun, Y.[Yasemin], Cahill, N.D.[Nathan D.], Scholkopf, B.[Bernhard],
Learning similarity measure for multi-modal 3D image registration,
CVPR09(186-193).
IEEE DOI Link 0906
BibRef

Cahill, N.D.[Nathan D.], Noble, J.A.[J. Alison], Hawkes, D.J.[David J.],
Fourier Methods for Nonparametric Image Registration,
Fusion07(1-8).
IEEE DOI Link 0706
BibRef

Shan, J.[Jie], Yoon, J.S.[Jong-Suk], Lee, D.S.[D. Scott], Kirk, R.L.[Randolph L.], Neumann, G.A.[Gregory A.], Acton, C.H.[Charles H.],
Photogrammetric Analysis of the Mars Global Surveyor Mapping Data,
PhEngRS(71), No. 1, January 2005, pp. 97. Mars Orbiter Laser Altimeter (MOLA) Profiles are registered with stereo Mars Orbiter Camera images at a nearly constant uncertainty of one MOLA ground spacing distance along the flight direction.
WWW Version. 0509
BibRef

Habib, A.[Ayman], Ghanma, M.[Mwafag], Morgan, M.[Michel], Al-Ruzouq, R.[Rami],
Photogrammetric and Lidar Data Registration Using Linear Features,
PhEngRS(71), No. 6, June 2005, pp. 699-708. Different methodologies for registering photogrammetric and lidar datasets to a common reference frame using straight lines.
WWW Version. 0509
BibRef

Aouadi, S.[Souha], Sarry, L.[Laurent],
Accurate and precise 2D-3D registration based on X-ray intensity,
CVIU(110), No. 1, April 2008, pp. 134-151.
WWW Version. 0804
BibRef
Earlier:
An Accurate Mutual Information-based Registration of Digitized,
WACV07(54-54).
IEEE DOI Link 0702
2D-3D registration; Object pose; Mutual information; Digital radiography; Computed tomography; Stochastic clustering 3D pose from digitized X-Ray data. BibRef

Fleck, S.[Sven], Busch, F.[Florian], Biber, P.[Peter], Strasser, W.[Wolfgang],
Graph Cut based Panoramic 3D Modeling and Ground Truth Comparison with a Mobile Platform: The Wagele,
IVC(27), No. 1-2, January 2009, pp. 141-152.
WWW Version. 0811
BibRef
Earlier: CRV06(19-19).
IEEE DOI Link 0607
Graph cut; 3D model acquisition; 3DTV BibRef

Biber, P.[Peter], Fleck, S.[Sven], Duckett, T.,
3D Modeling of Indoor Environments for a Robotic Security Guard,
SafeSecur05(III: 124-124).
IEEE DOI Link 0507
BibRef

Biber, P.[Peter], Fleck, S.[Sven], Strasser, W.[Wolfgang],
A Probabilistic Framework for Robust and Accurate Matching of Point Clouds,
DAGM04(480-487).
WWW Version. 0505
BibRef

Wong, A., Orchard, J.,
Efficient FFT-Accelerated Approach to Invariant Optical-LIDAR Registration,
GeoRS(46), No. 11, November 2008, pp. 3917-3925.
IEEE DOI Link 0812
BibRef

González Aguilera, D.[Diego], Rodríguez Gonzálvez, P.[Pablo], Gómez Lahoz, J.[Javier],
An automatic procedure for co-registration of terrestrial laser scanners and digital cameras,
PandRS(64), No. 3, May 2009, pp. 308-316.
Elsevier DOI Link
WWW Version. 0905
BibRef
Earlier:
Automatic Co-Registration of Terrestrial Laser Scanner and Digital Camera for the Generation of Hybrids Models,
Laser07(162).
PDF Version. 0709
Image analysis; Laserscanning; Close-range photogrammetry; Sensor fusion; Software development BibRef

Groher, M., Zikic, D., Navab, N.,
Deformable 2D-3D Registration of Vascular Structures in a One View Scenario,
MedImg(28), No. 6, June 2009, pp. 847-860.
IEEE DOI Link 0906
BibRef

Detry, R.[Renaud], Pugeault, N.[Nicolas], Piater, J.H.[Justus H.],
A Probabilistic Framework for 3D Visual Object Representation,
PAMI(31), No. 10, October 2009, pp. 1790-1803.
IEEE DOI Link 0909
BibRef
Earlier:
Probabilistic Pose Recovery Using Learned Hierarchical Object Models,
CogVis08(107-120).
Springer DOI Link 0805
3D features and probabilitistic relations. BibRef

Jensen, L.B.W.[Lars B. W.], Baseski, E.[Emre], Kalkan, S.[Sinan], Pugeault, N.[Nicolas], Wörgötter, F.[Florentin], Krüger, N.[Norbert],
Semantic Reasoning for Scene Interpretation,
CogVis08(121-134).
Springer DOI Link 0805
Representation by labelled graphs. BibRef

Wang, M.[Mi], Hu, F.[Fen], Li, J.[Jonathan], Pan, J.[Jun],
A Fast Approach to Best Scanline Search of Airborne Linear Pushbroom Images,
PhEngRS(75), No. 9, September 2009, pp. 1059-1068.
WWW Version. 0910
A fast method for best scanline search of airborne linear pushbroom images based on the object-space geometric constraints. BibRef

Wang, M.[Mi], Hu, F.[Fen],
A Fast Object-to-Image Best Scanline Search Algorithm for Airborne Linear Pushbroom Image Processing,
ISPRS08(B3b: 73 ff).
PDF Version. 0807
BibRef

Walli, K.C., Rhody, H.,
Automated image registration to 3-D scene models,
AIPR08(1-8).
IEEE DOI Link 0810
BibRef
Earlier: A1, Only:
Automated multisensor image registration,
AIPR03(103-107).
IEEE DOI Link 0310
BibRef

Salah, M.[Mahmoud], Trinder, J.[John], Shaker, A.[Ahmed], Hamed, M.[Mahmoud], Elsagheer, A.[Ali],
Aerial Images and Lidar Data Fusion for Automatic Feature Extraction using the Self-Organizing Map (SOM) Classifier,
Laser09(317). 0909
BibRef

Overett, G.[Gary], Petersson, L.[Lars],
Fast features for time constrained object detection,
FeatureSpace09(23-30).
IEEE DOI Link 0906
Learn feature points by matching to model. BibRef

Liu, C.[Ce], Yuen, J.[Jenny], Torralba, A.[Antonio],
Nonparametric scene parsing: Label transfer via dense scene alignment,
CVPR09(1972-1979).
IEEE DOI Link 0906
Best alignment of image with database for recognition. Recognition by matching with labeled database rather than by learning. See also SIFT Flow: Dense Correspondence across Different Scenes. BibRef

Zhu, J.J.[Jie-Jie], Liao, M.[Miao], Yang, R.G.[Rui-Gang], Pan, Z.G.[Zhi-Geng],
Joint depth and alpha matte optimization via fusion of stereo and time-of-flight sensor,
CVPR09(453-460).
IEEE DOI Link 0906
Depth map and object boundaries. BibRef

Lin, Z.[Zhe], Hua, G.[Gang], Davis, L.S.[Larry S.],
Multiple instance fFeature for robust part-based object detection,
CVPR09(405-412).
IEEE DOI Link 0906
Deal with features that are not always detected. Initial guess at object, then find features. BibRef

Sandhu, R.[Romeil], Dambreville, S.[Samuel], Yezzi, A.J.[Anthony J.], Tannenbaum, A.[Allen],
Non-rigid 2D-3D pose estimation and 2D image segmentation,
CVPR09(786-793).
IEEE DOI Link 0906
BibRef

Mastin, A.[Andrew], Kepner, J.[Jeremy], Fisher, J.[John],
Automatic registration of LIDAR and optical images of urban scenes,
CVPR09(2639-2646).
IEEE DOI Link 0906
BibRef

Kaminsky, R.S.[Ryan S.], Snavely, N.[Noah], Seitz, S.M.[Steven M.], Szeliski, R.S.[Richard S.],
Alignment of 3D point clouds to overhead images,
InterNet09(63-70).
IEEE DOI Link 0906
See also Modeling the World from Internet Photo Collections. BibRef

Wang, L.[Lu], Neumann, U.[Ulrich],
A robust approach for automatic registration of aerial images with untextured aerial LiDAR data,
CVPR09(2623-2630).
IEEE DOI Link 0906
BibRef

Wang, L.[Lu], You, S.[Suya], Neumann, U.[Ulrich],
Semiautomatic registration between ground-level panoramas and an orthorectified aerial image for building modeling,
VRML07(1-8).
IEEE DOI Link 0710
See also Generating and Updating Textures for a Large-Scale Environment. BibRef

Khoshelham, K., Gorte, B.,
Registering point clouds of polyhedral buildings to 2D maps,
3DARCH09(xx-yy).
PDF Version. 0902
BibRef

von Hansen, W.[Wolfgang], Gross, H.[Hermann], Thoennessen, U.[Ulrich],
Line-Based Registration of Terrestrial and Airborne LIDAR Data,
ISPRS08(B3a: 161 ff).
PDF Version. 0807
BibRef

McCarthy, T.[Timothy], Zheng, J.H.[Jiang-Hua], Fotheringham, A.S.[A. Stewart],
Integration of dynamic LiDAR and image sensor data for route corridor mapping,
ISPRS08(B5: 1125 ff).
PDF Version. 0807
BibRef

Bienert, A.[Anne], Maas, H.G.[Hans-Gerd],
Methods for the automatic geometric registration of terrestrial laser scanner point clouds in forest stands,
Laser09(93). 0909
See also Tree Detection and Diameter Estimations by Analysis of Forest Terrestrial Laserscanner Point Clouds. BibRef

Meierhold, N.[Nadine], Schmich, A.[Armin],
Referencing of images to laser scanner data using linear features extracted from digital images and range images,
Laser09(164). 0909
BibRef

Meierhold, N.[Nadine], Bienert, A., Schmich, A.[Armin],
Line-Based Referencing between Images and Laser Scanner Data for Image-Based Point Cloud Interpretation in a CAD-Environment,
ISPRS08(B5: 437 ff).
PDF Version. 0807
BibRef

Kang, Z.Z.[Zhi-Zhong],
Automatic Registration of Terrestrial Point Cloud Using Panoramic Reflectance Images,
ISPRS08(B5: 431 ff).
PDF Version. 0807
BibRef

Sotoodeh, S., Gruen, A., Hanusch, T.,
Integration of Structured Light and Digital Camera Image Data for the 3D Reconstruction of an Ancient Globe,
ISPRS08(B5: 367 ff).
PDF Version. 0807
BibRef

Novák, D.[David],
Semi-Automatic Orientation of Images With Respect to a Point Cloud System,
ISPRS08(B3b: 295 ff).
PDF Version. 0807
BibRef

Rönnholm, P.[Petri], Honkavaara, E.[Eija], Erving, A.[Anna], Nuikka, M.[Milka], Haggrén, H.[Henrik], Kaasalainen, S.[Sanna], Hyyppä, H.[Hannu], Hyyppä, J.[Juha],
Registration of Airborne Laser Scanning Point Clouds with Aerial Images through Terrestrial Image Blocks,
ISPRS08(B1: 473 ff).
PDF Version. 0807
BibRef

Deng, F.[Fei], Hu, M.J.[Min-Jie], Guan, H.Y.[Hai-Yan],
Automatic Registration Between LIDAR and Digital Images,
ISPRS08(B1: 487 ff).
PDF Version. 0807
BibRef

Sandhu, R.[Romeil], Dambreville, S.[Samuel], Tannenbaum, A.[Allen],
Particle filtering for registration of 2D and 3D point sets with stochastic dynamics,
CVPR08(1-8).
IEEE DOI Link 0806
BibRef

Ding, M.[Min], Lyngbaek, K.[Kristian], Zakhor, A.[Avideh],
Automatic registration of aerial imagery with untextured 3D LiDAR models,
CVPR08(1-8).
IEEE DOI Link 0806
BibRef

Beder, C.[Christian], Schiller, I.[Ingo], Koch, R.[Reinhard],
Photoconsistent Relative Pose Estimation between a PMD 2D3D-Camera and Multiple Intensity Cameras,
DAGM08(xx-yy).
Springer DOI Link 0806
BibRef

Yan, P.K.[Ping-Kun], Khan, S.M.[Saad M.], Shah, M.[Mubarak],
3D Model based Object Class Detection in An Arbitrary View,
ICCV07(1-6).
IEEE DOI Link 0710
Match 2D image to 3D model. BibRef

Grest, D.[Daniel], Petersen, T.[Thomas], Krüger, V.[Volker],
A Comparison of Iterative 2D-3D Pose Estimation Methods for Real-Time Applications,
SCIA09(706-715).
Springer DOI Link 0906
BibRef

Pilz, F.[Florian], Shi, Y.[Yan], Grest, D.[Daniel], Pugeault, N.[Nicolas], Kalkan, S.[Sinan], Krüger, N.[Norbert],
Utilizing Semantic Interpretation of Junctions for 3D-2D Pose Estimation,
ISVC07(I: 692-701).
Springer DOI Link 0711
See also Scene Representation Based on Multi-Modal 2D and 3D Features, A. BibRef

Franz, M.O.[Matthias O.], Stamminger, M.[Marc],
2D-3D-Registration in Computer Tomography without an initial pose,
VMV06(229-236).
WWW Version. BibRef 0600

Ryberg, A., Christiansson, A.K., Eriksson, K.,
Accuracy Investigation of a Vision Based System for Pose Measurements,
ICARCV06(1-6).
IEEE DOI Link 0612
BibRef

Decker, P.[Peter], Paulus, D.[Dietrich], Feldmann, T.[Tobias],
Dealing with degeneracy in essential matrix estimation,
ICIP08(1964-1967).
IEEE DOI Link 0810
BibRef

Kubias, A.[Alexander], Deinzer, F.[Frank], Feldmann, T.[Tobias], Paulus, D.[Dietrich],
Extended Global Optimization Strategy for Rigid 2D/3D Image Registration,
CAIP07(759-767).
Springer DOI Link 0708
BibRef

Barrois, B.[Bjorn], Wohler, C.[Christian],
3D Pose Estimation Based on Multiple Monocular Cues,
BenCOS07(1-8).
IEEE DOI Link 0706
Compare image to synthetic image from CAD model. BibRef

Di, H.[Huijun], Iqbal, R.N.[Rao Naveed], Xu, G.Y.[Guang-You], Tao, L.M.[Lin-Mi],
Groupwise Shape Registration on Raw Edge Sequence via A Spatio-Temporal Generative Model,
CVPR07(1-8).
IEEE DOI Link 0706
BibRef

Liebelt, J.[Joerg], Schmid, C.[Cordelia], Schertler, K.[Klaus],
Viewpoint-independent object class detection using 3D Feature Maps,
CVPR08(1-8).
IEEE DOI Link 0806
BibRef

Liebelt, J.[Joerg], Schertler, K.[Klaus],
Precise Registration of 3D Models To Images by Swarming Particles,
CVPR07(1-8).
IEEE DOI Link 0706
BibRef

Hong, H.[Helen], Kim, K.[Kyehyun], Park, S.J.[Seong-Jin],
Fast 2D-3D Point-Based Registration Using GPU-Based Preprocessing for Image-Guided Surgery,
CIARP06(218-226).
Springer DOI Link 0611
BibRef

Al-Manasir, K., Fraser, C.S.,
Automatic registration of terrestrial laserscanner data via imagery,
IEVM06(xx-yy).
PDF Version. 0609
BibRef

Hassner, T.[Tal], Basri, R.[Ronen],
Example Based 3D Reconstruction from Single 2D Images,
BP06(15).
IEEE DOI Link 0609
From database, match to patches, use model to predict. BibRef

Pong, H.K.[Hon-Keat], Cham, T.J.[Tat-Jen],
Optimal Cascade Construction for Detection using 3D Models,
ICPR06(I: 808-811).
WWW Version. 0609
BibRef
Earlier:
Object Detection Using a Cascade of 3D Models,
ACCV06(II:284-293).
Springer DOI Link 0601
Alignment for detection. Hierarchy of models. BibRef

Pong, H.K.[Hon-Keat], Cham, T.J.[Tat-Jen],
Alignment of 3D Models to Images Using Region-Based Mutual Information and Neighborhood Extended Gaussian Images,
ACCV06(I:60-69).
Springer DOI Link 0601
BibRef

Lipikorn, R.[Rajalida], Shimizu, A.[Akinobu], Kobatake, H.[Hidefumi],
Three-Dimensional Object Recognition Using a Modified Exoskeleton and Extended Hausdorff Distance Matching Algorithm,
ICIAR04(I: 697-704).
WWW Version. 0409
BibRef

Janko, Z., Chetverikov, D.,
Photo-consistency based registration of an uncalibrated image pair to a 3D surface model using genetic algorithm,
3DPVT04(616-622).
IEEE Abstract. IEEE Top Reference. 0412
BibRef
And:
Registration of an uncalibrated image pair to a 3d surface model,
ICPR04(II: 208-211).
IEEE DOI Link 0409
See also Pre-registration of arbitrarily oriented 3D surfaces using a genetic algorithm. BibRef

Liu, Q., Lou, J., Hu, W., Tan, T.,
Pose Evaluation Based on Bayesian classification Error,
BMVC03(xx-yy).
HTML Version. 0409
BibRef

Morris, R.D.[Robin D.], Smelyanskiy, V.N.[Vadim N.], Cheeseman, P.C.[Peter C.],
Matching Images to Models: Camera Calibration for 3-D Surface Reconstruction,
EMMCVPR01(105-117).
Springer DOI Link 0205
BibRef

Schultz, H., Woo, D., Stolle, F.R., Riseman, E.M.,
Error Detection and DEM Fusion using Self-Consistency,
ICCV99(1174-1181).
IEEE DOI Link BibRef 9900

Leventon, M.E., Wells, III, W.M., Grimson, W.E.L.,
Multiple View 2D-3D Mutual Information Registration,
DARPA97(625-630). BibRef 9700

Ferrell, C.,
Orientation Behavior Using Registered Topographic Maps,
DARPA97(1367-1372). BibRef 9700

Connolly, C.I., Mundy, J.L., Stenstrom, J.R., and Thompson, D.W.,
Matching from 3-D Range Models into 2-D Intensity Scenes,
ICCV87(65-72). The model is a range scene, the image is the intensity image. See also Constructing Object Models from Multiple Images. BibRef 8700

Thompson, D.W., Mundy, J.L.,
Three Dimensional Model Matching from an Unconstrained Viewpoint,
CRA87(208-220). BibRef 8700

Quan, L.[Long], Mohr, R., Thirion, E.,
Generating the initial hypothesis using perspective invariants for a 2D image and 3D model matching,
ICPR88(II: 872-874).
IEEE DOI Link 8811
BibRef

Little, J.J.,
Automatic Registration of Landsat MSS Images to Digital Elevation Models,
CVWS82(178-184). BibRef 8200

Chapter on Registration, Matching and Recognition Using Points, Lines, Regions, Areas, Surfaces continues in
Range Data Matching -- Accumulation Methods .