Computer Vision: (An Introduction)

COMPUTER VISION
(an introduction)
Dr Faisal Mufti ECE 7259 Advanced Computer Vision Spring 2012
ECE 7259 Advanced Computer Vision
About the course

Classes 7:30-9:00 (Tue) 6:00-7:30 (Thu) Room 2 ground floor (opp. library) Books
Computer Vision, A modern approach, David A. Forsyth, Jean Ponce Multiple View Geometry in Computer Vision, Cambridge University
Press, R. Hartley and A. Zisserman An invitation to 3D vision, Y. Ma, S. Soatto, J. Kosecka, and. S.S. Sastry, Springer-Verlag. Lecture notes
Web resources, Journals/Conferences
IEEE Trans Pattern Analysis and Machine Intelligence CVPR, ICIP
About the course

Course eGroup address: http://groups.yahoo.com/group/CASE_CV_SP_12 CASE_CV_SP_12-subscribe@yahoogroups.com Office hours: request meeting by email Contact: faisal@case.edu.pk or faisal_mufti@yahoo.com You contact me by email I contact you by email or via eGroup: All announcement, home assignments, and guidelines will be distributed by email. Course TA Zakirullah zakirmohmand@yahoo.com
You must send an email by Jan 31 from your active address with the subject CV course contact.
Those who do not send their contact address on time will not be added to the contact list!!!
About the course

Home assignments
Penalties
25% (3x assignments) 25% 25%

5% 5% 7.5% 7.5%
Midterm Project
Synopsis Mid review Final presentation
Project report
Final Exam-
25%
About the course

Home assignments
Penalties
25% (3x assignments) 25% 25%
Midterm Project
Synopsis Mid review
Attitude = 100%
Final presentation
Project report
5% 5% 7.5% 7.5%
Final Exam-
25%
Pre-requisites
- Everyone should have access to MATLAB
Scope of ECE 7259

Advance graduate course on image/video analysis Prerequisites:
ECE 6258 Digital Image Processing (desirable not mandatory) Not assuming you have much exposure on image processing at
undergraduate level Understanding of vectors and spaces and geometry is desirable. Everyone should have access to MATLAB
Emphasis on fundamental concepts

Provide theoretical foundations on multi-dimensional Image and Computer
Vision Coupled with assignments and projects for hands-on experience and reinforcement of the concepts
Follow-up courses
Machine Vision, Pattern recognition, Machine learning Multimedia communications and Visual Computing
What is Computer Vision?

Vision is the act of knowing what is where by looking. --Aristotle
Vision is the primary sense by which humans perceive the world. Understanding is much more than simply seeing, e.g. the 3D magic eye illusions that appear nonsensical at first. Computer vision aims to bestow this perceptive ability on computers, via intelligent interpretation of visual data.
10
3D Magic Eye
11
3D Magic Eye
12
Perception and vision

How much of a humans understanding of the world through vision is perceptual and how much is physical.
13
Perception and colour

How much of a humans understanding of the world through vision is perceptual and how much is physical.
14
What makes it hard?

What are the challenges:
Image resolution Noise Projection (no depth)
Complexity of environment
Base level human vision is too
good and it is backed by a perceptual engine that cannot be matched in an engineered system.
15
Blind-Spot Experiment
Draw an image similar to that below on a piece of paper (the dot and cross are about 6 inches apart)
Close your right eye and focus on the cross with your left eye Hold the image about 20 inches away from your face and move it slowly towards you The dot should disappear!
16

It is related to, but not equivalent to:
Photogrammetry Image Processing Artificial Intelligence
17

Computer vision combines elements of:
Image processing: manipulation of images
Geometry: modeling of shape

Engineering: signal processing, filtering, tracking, robotics Computer Science: Algorithmic efficiency,
Interpretation: AI, statistical decision tools.
To achieve this we require:

Visual information (signals) that can be input to a computer,
digital images are ideal for this. 2D image processing techniques for analysing these signals. 3D projective geometry for building a 3D model of the world from our data. Statistical tools to make decisions with confidence bounds. Algorithms to put it all together.
18
Why study Computer Vision?

Images and movies are everywhere Fast-growing collection of useful applications
building representations of the 3D world from pictures automated surveillance (whos doing what) movie post-processing face finding
Various deep and attractive scientific mysteries

how does object recognition work?
Greater understanding of human vision
19
Goal and objectives

Introduce the fundamental problems of computer vision. Introduce the main concepts and techniques used to solve those problems. Enable students to implement vision algorithms Enable students to make sense of the vision literature
20
Course Topics will try to cover

Filtering and Smoothing Resolution and Scale Space Eigen Analysis and Blob Fitting Feature Extraction Color and Light / Skin Color Segmentation /Active Shape Models Camera Models / Planar Mappings Mosaicing and Stabilization Stereo Vision Camera Motion Video Change Detection Video Tracking
21
Filtering and Smoothing
Linear operators Convolution Smoothing
22
Sharpening
An image can be sharpened
23
Masked Blur
Using masks you can specify which part of an image to operate on. Eg blurring the background (using a simple linear filter)
24
Gradient of an Image
This gives the 'embossed' effect in Photoshop
25
Resolution Pyramids / Scale Space
Image Resolution Sampling Theory Gaussian/Laplacian Pyramids Scale Space Theory
26
Eigen Analysis and Blob Fitting
Scatter Matrix Eigenvectors/Eigenvalues Ellipses/Quadratic Forms Center of Mass, Major/Minor Axes
27
Edge Detection
Detecting edge features in images.
This example uses Canny's method
28
Feature Extraction
Edges
Corner
Invariant Features
29
An Image in Frequency Domain
The Log-magnitude and phase of an image in the frequency domain.
30
Color and Light
Radiance / Reflection Illumination / Shading Chromaticity Color Constancy
31
Skin Color
Human Skin Color Distribution Finding Skin Identifying Adult Content
32
Segmentation
Region Segmentation Active Contours Intelligent Scissors
33
Colour Segmentation
An example of skin detection using a skin chrominance model
34
Active Shape Models
Statistical Shape Analysis Active Shape Models Active Appearance Models
35
Removing Periodic Noise
Periodic noise can be easily identified and attenuated in the frequency domain.
36
Reconstruction of 3D structure
Projective geometry is used to reconstruct the 3D structure of a scene from 2 or more views.
camera models, epipolar geometry
Fundamental matrix
3D reconstruction of a scene texture morphing
37
Pin hole camera
38
Pinhole Camera Model

We'll look at this in 3D,
39
Camera Projection Models
Projection Models Intrinsic (lens) Paramters Extrinsic (pose) Parameters Camera Calibration
40
Plane to Plane Mappings
Rigid, Similarity, Affine, & Projective Mappings Homography Estimation Image Warping
41
Mosaicing and Stabilization
Camera Rotation Homography Mosaicing Video Stabilization
42
Stereo Vision
Stereo Camera Setups Stereo Disparity / Parallax Epipolar Geometry Correspondence Matching Triangulation / Depth Recovery
43
Stereo Cameras
and consider stereo cameras.
44
3D reconstructions done from multiple views

Apply this to reconstructing an object from 2 views, using point correspondences.
45
and generate a 3D model.
46
Texture may be added to the model.
47
These four views allow this object to be fully reconstructed.
48
Building Rome in a Day: Colosseum
49
50
San Marco Square
51
52
3D reconstruction from Single Image
53
Image into 3D model
54
Camera Motion
Motion Field vs Optic Flow Flow Estimation Egomotion Estimation Structure from Motion
55
Video Change Detection
Video Sequences Background Modeling Change Detection
56
Video Tracking
Appearance-Based Tracking Sample Tracking Algorithms (e.g. Mean-Shift, Lucas-Kanade)
SOME VISION APPLICATIONS
58
Automated Video Surveillance
59
Face Detection
60
Face Recognition
61
3D Model Generation
62
Articulated Body Fitting
63
Sample Application: Assisted Living
64
Camera Servoing
65
Camera Servoing Application
66
Acquisition of Multi-View Video
Approach: control pan, tilt and zoom of multiple cameras to acquire centered, synchronized video views of a moving person.
67
Eyevision: Adding Master-Slave Control

CAMERA CALIBRATION!
68
Eyevision : SuperBowl XXXV
69
EyeVision Examples
70
Appearance-Based Tracking Framework
71
Vehicle Tracking
72
Robot Perception
Autonomous Navigation Obstacle Avoidance
73
Steering Angle Estimation
74
75
Detecting Other Moving Objects
76
Augmented Reality
77
Augmented Reality

Computer Vision: (An Introduction)

Загружено:

Сведения о документе

Исходное описание:

Оригинальное название

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

Computer Vision: (An Introduction)

Загружено:

Авторское право:

Доступные форматы

COMPUTER VISION

ECE 7259 Advanced Computer Vision

About the course

ECE 7259 Advanced Computer Vision

About the course

ECE 7259 Advanced Computer Vision

About the course

25% (3x assignments) 25% 25%

ECE 7259 Advanced Computer Vision

About the course

25% (3x assignments) 25% 25%

ECE 7259 Advanced Computer Vision

- Everyone should have access to MATLAB

ECE 7259 Advanced Computer Vision

Scope of ECE 7259

Emphasis on fundamental concepts

ECE 7259 Advanced Computer Vision

What is Computer Vision?

ECE 7259 Advanced Computer Vision

What is Computer Vision?

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

Perception and vision

ECE 7259 Advanced Computer Vision

Perception and colour

ECE 7259 Advanced Computer Vision

What makes it hard?

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

What is Computer Vision?

ECE 7259 Advanced Computer Vision

What is Computer Vision?

Geometry: modeling of shape

Interpretation: AI, statistical decision tools.

To achieve this we require:

ECE 7259 Advanced Computer Vision

Why study Computer Vision?

Various deep and attractive scientific mysteries

Greater understanding of human vision

ECE 7259 Advanced Computer Vision

Goal and objectives

ECE 7259 Advanced Computer Vision

Course Topics will try to cover

ECE 7259 Advanced Computer Vision

Filtering and Smoothing

Linear operators Convolution Smoothing

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

Resolution Pyramids / Scale Space

Image Resolution Sampling Theory Gaussian/Laplacian Pyramids Scale Space Theory

ECE 7259 Advanced Computer Vision

Eigen Analysis and Blob Fitting

Scatter Matrix Eigenvectors/Eigenvalues Ellipses/Quadratic Forms Center of Mass, Major/Minor Axes

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

ECE 7259 Advanced Computer Vision

An Image in Frequency Domain

The Log-magnitude and phase of an image in the frequency domain.

ECE 7259 Advanced Computer Vision