
Project 1:
Hybrid Images
|
Project
2: Image Quilting
|
Project
3: Gradient Domain Fusion
|
Project 4:
Image-based Lighting
|
Project 5:
Video Stitching
|
Final Project
|
Class Schedule
|
Week |
Date |
Topic |
Link |
Reading/Notes |
|
1 |
Aug 26 |
Introduction |
||
|
|
|
Basics of
Working with Images |
|
|
|
1 |
Aug 28 |
Pixels and image filters |
S3.2 (linear filtering) S3.3 (non-linear filtering) |
|
|
2 |
Sep 2 |
Thinking in frequency |
S3.4 (fourier transforms) S2.3.3 (compression) |
|
|
2 |
Sep 4 |
Templates and image pyramids |
S3.5.2 (image pyramids) S8.1.1 (pyramid alignment) Other reading: |
|
|
3 |
Sep 9 |
Light and color |
S2.2 (light), S2.3.2 (color) or Forsyth and Ponce Ch 3 |
|
|
3 |
Sep 11 |
Histograms and color adjustment |
S3.1 (histograms and color adjustment) |
|
|
|
Sep 17
(Wed) |
Project 1
(Hybrid images) due |
|
|
|
|
The Digital
Canvas: Coloring, Blending, Cutting, Synthesizing, and Warping Images |
|
|
|
|
4 |
Sep 16 |
Growing: Texture synthesis and hole filling |
Texture
Synthesis – Efros Leung (1999) Image
Quilting – Efros Freeman (2001) |
|
|
4 |
Sep 18 |
Cutting: Intelligent Scissors and Graph Cuts |
||
|
5 |
Sep 23 |
Pasting: Compositing and blending |
Poisson
Image Editing – Perez et al. (2003) Burt
and Adelson, A multiresolution spline with
application to image mosaics, ACM ToG (1983) |
|
|
5 |
Sep 25 |
Image warping (translation, rotation, scale, etc.) |
S3.6 (warping) |
|
|
|
Oct 1 (Wed) |
Project 2 (Image quilting) due |
|
|
|
6 |
Sep 30 |
Image morphing |
||
|
|
|
Modeling the
Physical World |
|
|
|
6 |
Oct 2 |
The Pinhole Camera |
S2.1.5 (3D to 2D projection) |
|
|
7 |
Oct 7 |
Single-view Metrology + Camera Model continued |
||
|
7 |
Oct 9 |
Single-view 3D Reconstruction |
Tour into the picture (Horry et
al. 1997) |
|
|
8 |
Oct 13 – Oct 19 |
Midterm
Exam (on PrarieLearn) |
|
|
|
9 |
Oct 21 |
Image-based Lighting: ray tracing, environment maps, light
probes |
Reading (do read this): |
|
|
9 |
Oct 23 |
Image-based Lighting cont.: HDR light probes, relighting |
Optional
Reading: Debevec & Malik, “Recovering High Dynamic Range
Radiance Maps from Photographs”, SIGGRAPH 1997 Debevec, Rendering Synthetic Objects in Real Scenes, 1998 |
|
|
|
Oct 29 (Wed) |
Project 3
(Gradient domain fusion) due |
|
|
|
10 |
Oct 28 |
The image as a virtual stage |
Rendering
Synthetic Objects (Karsch et al. 2011) |
|
|
|
Correspondence
and Recognition |
|
|
|
|
10 |
Oct 30 |
Matching and alignment with interest points |
Grauman/Leibe Draft Chapter on
Local Features Optional: Lowe - SIFT paper |
|
|
|
Oct 31 (Fri) |
Final
Project Proposal due |
|
|
|
11 |
Nov 4 |
Automatic Photo Stitching and RANSAC |
Brown Lowe 2007 ; S9 (stitching); slides |
|
|
11 |
Nov 6 |
Object recognition, retrieval, and augmented reality |
||
|
|
Nov 12
(Wed) |
Project 4
(Image-based lighting) due |
|
|
|
12 |
Nov 11 |
Opportunities of scale: texture synthesis, multi-view
reconstruction, im2gps, tiny images, etc. |
Reading: Hays & Efros,
Scene Completion Using Millions of Photographs |
|
|
|
|
More Topics
of Interest |
|
|
|
12 |
Nov 13 |
Generating and detecting fakes |
||
|
13 |
Nov 18 |
How the Kinect works |
||
|
13 |
Nov 20 |
Computational approaches to cameras |
Adelson
& Bergen, The Plenoptic Function and the Elements
of Early Vision (1991) Ng
et al., Light Field Photography with a
Hand-held Plenoptic Camera (2005) Levin
et al., Image and Depth with a Coded Aperture (2007) |
|
|
14 |
Nov 22 – Nov 30 |
Fall Break |
|
|
|
|
Dec 3
(Wed) |
Project 5
(Video stitching) due |
|
|
|
15 |
Dec 2 |
Understanding Faces |
|
|
|
15 |
Dec 4 |
Video Magnification |
|
|
|
|
|
|
|
|
|
16 |
Dec 9 |
Last day – cutting edge and wrap up |
|
|
|
Dec 14 (Sun) |
Final
Project due (cannot be late) |
|
|
|
|
16-17 |
Dec 12 – Dec 18 |
Final Exam
(on PrairieLearn) |
|