Digital Image Processing

introduction

About Digital Images

This course is about digital images and what can be done to digital images. A digital image is simply an image that can be stored in a computer, i.e. a discrete function of position (in 2D or 3D space, time and spectral band) and greylevel. For example, in the 2D case the image data contains information of the graylevel at each position in the image. A magnification of the rats nose.

A digital image of a rat.

Digital Images
A digital image can be thought of as a matrix of graylevels, or intensity values.
94 100 104 119 125 136 143 153 157 158 103 104 106 98 103 119 141 155 159 160 95 78 117 149 155 160 78 97 151 161 158 78 101 185 188 161 85 134 216 209 172

109 136 136 123

110 130 144 149 129 109 137 178 167 119 100 143 167 134 87

104 123 166 161 155 160 205 229 218 181 125 131 172 179 180 208 238 237 228 200 131 148 172 175 188 228 239 238 228 206 161 169 162 163 193 228 230 237 220 199

The magnification of the rats nose.

Intensity values of the rats nose.

Images
column

Sample
f(x, y) Quantize y row

Why put the image into a computer ?

What are computers good at compared to people?
Human + identify objects + describe relationships + interpret images using experience - difficulties with normalizing intensity - subjective Computer + measure absolute values + perform complicated calculations + does not get tired / cheaper + fast + objective

Digital Images: Applications

Environmental

and agricultural applications

Multi spectral satellite image

Aerial image of a forest

Microscopy image of wood

Digital Images: Applications

Hydrography and weather

Multi spectral aerial image of the Stockholm archipelago

Satellite image

Medical applications
Diagnosis

X-ray image

MR (Magnetic Resonance)

PET (Positron Emission Tomography)

Medical Applications
Research

and Development

AIDS-virus particles (Electron microscopy)

cultured and stained celles

stained cell nuclei in cancer tumor

(Fluorescence microscopy)

{
{

Other applications

Quality control Biometry (face recognition, fingerprint) Handwriting recognition Automatic surveillance Forensics Astronomy

Course Contents
Some

of the topics dicussed during the course

Filtering in the spatial domain The Fourier transform and its use in image analysis Image restoration Color Segmentation Binary image operations, morphology and feature extraction Classification and decision etc

DIP: Course Logistics

http://faculty.petra.ac.id/resmana

The Fundamental Steps in Digital Image Processing

Problem

Solution

Image acquisition

Recognition and interpretation

Preprocessing

Segmentation

Representation and description

Fundamental Steps*

Preprocessing

Segmentation

Representation & Description

Problem Domain

Image Acquisition

Knowledge Base

Recognition & Interpretation

Result

*Rafael C. Gonzalez and Richard E. Woods, Digital Image Processing, Addison-Wesley, 1992

DIP: Details
Digital Image Processing

Digital Image Characteristics

Spatial

Spectral

Gray-level

Histogram Pre-Processing

DFT

DCT

Enhancement

Restoration

Point Processing

Masking

Filtering

Degradation Models Compression

Inverse Filtering

Wiener Filtering

Information Theory

Lossless

Lossy

LZW (gif)

Transform-based (jpeg)

Segmentation

Edge Detection Description

Shape Descriptors

Texture

Morphology

The Fourier transform

Original image

The power spectra after Fourier transformation

Image after reverse transform of filtered power spectra.

Filtering in the spatial domain

Lena with noice

After median filtering

Edge detection

Image restoration
Restoration

motion etc.

of images degraded by bad focusing,

Blur caused by motion

After restoration

Color
Color

representation and use

RGB-space

CIEs chromaticity diagram

Segmentation
Segmentation

means to divide an image into objects and background. This is a necessary step prior to feature extraction.

Gray level image

Gray level image with binary overlay

Binary image operations, morphology and feature extraction

Gray scale image the same image after segmentation. after morphological closing... after skeletonization...

Classification and decision

Classification can either be made on the object level (based on object features such as size and shape) or on the pixel level (based on intensity in spectral or texture information)

Original image

Result of classification

What do you need to do Image Processing?

Mathematics Physics Statistics Computer

Science Artificial intelligence area knowledge

Image Analysis (bildanalys) vs Image Processing ( bildbehandling)

world
Imaging Visualisation Image Processing Image Analysis

data

Computer Graphics

image

knowledge

Image understanding Computer vision

Course goals
After the course you will know a bunch of algorithms as well as ...
how a digital image works. when image analysis is a possible solution. when image analysis is not a possible solution. what the requirements on the equipment are. what the requirements on the image are. how to do some image processing and analysis yourself. what is true and false about imaging and analysis systems. that some images tell lies..

Digital images
A 2D grayscale image f(x,y) the value of f(x,y) is the greylevel or intensity at position (x,y)

A digital image must be sampled (digitized): in space (x,y): image sampling in amplitude f(x,y): grey-level quantization

Image sampling (x,y)

Image sampling (x,y)

32 64 128 256 512

Methods for image sampling (in space)

Uniform - same sampling frequency everywhere Adaptive - higher sampling frequency in areas with greater detail (not very common)

The discrete sample is called a pixel (from picture element) in 2D and voxel (from volume element) in 3D and is usually square (cubic), but can also have other shapes.

Grey-level quantization
256 8 32 2

16

Methods for quantization (in amplitude)

Uniform (linear) - intensity of object is lineary mapped to gray-levels of image Logarithmic - higher intensity resolution in darker areas (the human eye is logarithmic)
image intensity image intensity

object intensity

object intensity

Common quantization levels

f(x,y) is given integer values [0-max], max=2n-1
n=1 n=5 n=8 n=16 n=24 [0 1] [0 31] [0 255] [0 65535] [0 16.2*106] binary image maximum the human eye can resolve (locally) 1 byte, very common common in research common in color images (i.e. 3*8 for RGB)

Choice of sampling
What will the image be used for? What are the limitations in memory and speed? Will we only use the image for visual interpretation or do we want to do any image analysis? What information is relevant for the analysis (i.e. color, spatial and/or graylevel resolution)?