• Aucun résultat trouvé

3D Computer Vision Syllabus

N/A
N/A
Protected

Academic year: 2022

Partager "3D Computer Vision Syllabus"

Copied!
9
0
0

Texte intégral

(1)

3D Computer Vision Syllabus

Pascal Monasse pascal.monasse@enpc.fr

IMAGINE, École des Ponts ParisTech

This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

(2)

Structure from Motion

We will cover the rst part of this Stereo pipeline, MVG, and rst part of MVS but only with two views.

I Output of MVG: point cloud and camera positions and orientations

I Output of MVS: a mesh surface with colors

(3)

Bundle Adjustment

I Observed points in images are central projections of unknown 3D points.

I Each image provides abundle of half-lines containing the 3D points.

I We must orient the bundles so that the lines intersect.

Source: Manolis Lourakis

(4)

One equation to rule them all

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2.

I xij: point numberj (amongn) in viewi (amongm), pixel coordinates.

I ij ∈ {0,1}: visibility of pointj in viewi. I d: Euclidean distance in image.

I Πi: 2D projection operator in viewi from 3D.

Unknowns:

I Xj: 3D point in a xed coordinate frame.

I Ri: rotation matrix of coordinate frame wrt viewi. I Ti: position of origin O of coordinate frame wrt viewi.

(5)

Session 1

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2.

I Expression of projection model Πi (i.e.,camera model) I Casem=2,TL=TR =0 or allXj on a single plane:

∀i ∈ {L,R},∀j, d(xiji(RiXj +0)) =0. Then xRj =HΠR,RR(xLj), and the homographyH can be determined from four pairs {xLj,xRj}. Application: panorama.

I Casem=1, 6 (or more) pairs (xj,Xj), recover all info about the camera (camera calibration from 3D rig):

arg min

Π,R,T

X

j

d(xij,Π(RXj +T))2.

I Casem≥3, single camera Π, 4 (or more) pairs(xj,Xj), all Xj

on a common plane (camera calibration from 2D rig):

arg min

Π,{Ri},{Ti}

X

ij

d(xij,Π(RiXj +Ti))2.

(6)

Session 2

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2. Casem=2 views.

I From j ≥5 pairs{xLj,xRj} and knownΠLR, deduce a bilinear constraint ∀j,ERR,TR(xLj,xRj) =0 (essential matrix).

Recover (RR,TR) fromE. arg min

{Ri},{Ti},{Xj}

X

i∈{L,R},j

ij d(xiji(RiXj +Ti))2.

I From j ≥7 pairs{xLj,xRj} and unknownΠLR, deduce a bilinear constraint ∀j,F(xLj,xRj) =0 (fundamental matrix).

I From n pairs{xLj,xRj}, maximize the number of matching pairs up to tolerance τ ≥0 (RANSAC algorithm)

max X

i∈{L,R},j

ij

s.t. ∃ΠLR,{Ri},{Ti},{Xj},d(xiji(RiXj +Ti))≤τ.

(7)

Sessions 3&4

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2.

Casem=2 views,RL=RR =I,TL=0,TR =Be1 (rectied pair).

I Go from generic poses to rectied pair with fundamental matrix F.

I For all xLj,j ∈ {pixels of left image}, nd corresponding pixel xRj, hence Xj by triangulation.

(8)

Session 5

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2.

Casem=2 views, ndinterest points{pLk} and{pRk0}. Deduce pairsj = (k,k0) of matching points(xLj,xRj) with xLj =pLk and xRj =pRk0.

(9)

Session 6

arg min

{Ri},{Ti},{Xj}

X

i,j

ij d(xiji(RiXj +Ti))2.

Casem≥3, multi-view stereovision.

I For m=3, trilinear constraints T(x1j,x2j,x3j) =0. Recovery of tensor T.

I Recover Rm+1 andTm+1 from known pairs (xm+1j,Xj) (resection,PnP Perspective from n Points):

arg min

Rm+1,Tm+1

X

j

m+1j d(xijm+1(Rm+1Xj +Tm+1))2.

⇒ incremental multi-view pipeline.

I Special caseTi =Biv withv a xed vector and known Bi: arg min

{Ri},{Xj}

X

i,j

ij d(xiji(RiXj +Biv))2.

⇒ Light eld imagery, epipolar plane imagery

Références

Documents relatifs

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International

Because air mass factors (AMFs) vary significantly with wavelength as a result of significant vari- ation of O 3 absorption, the wavelength- and surface-albedo- dependent AMF, which

(10) include a smoothing error component and should not be used to calculate the error budget because the data user might not be aware of related problems and might, when

Copyright: This work is licensed under the Creative Commons Attribution-NoDerivatives 4.0 International License. To view a copy of this license, visit

Here we report (1) a systematic proteomic study of the CSF with a thorough characterization of the synaptic composition (discovery), (2) development of Tier 2 SRM assays for a set

This image is licensed under the Creative Commons Attribution ShareAlike 2.0 Generic license. Image 4, Copper

In the GPA strain map, recorded in the out-of-plane direction (Fig. 5d), the lm and substrate have large lattice difference resulting in splitting of diffraction spots compared to

The result of this effort was the Open Data Commons Public Domain Dedication and License [11], itself a fusion of ideas from the Talis Community License, an initial