MATRICES AND VECTORS SPACE

MATRICES AND MATRIX OPERATIONS SYSTEM OF LINEAR EQUATIONS DETERMINANTS VECTORS IN 2-SPACE AND 3-SPACE GENERAL VECTOR SPACES INNER PRODUCT SPACES EIGENVALUES, EIGENVECTORS LINEAR TRANSFORMATIONS DIFFERENTIAL EQUATIONS SYSTEM

WEEK
1 2 3 4 5 6 7
August 7, 2008

CONTENTS (MID EXAM)

- Matrix and Matrixs Operations - Elementary Row Operations - System of linear equations - Gauss-Jordan Elimination - Homogenous system - Inverse matrix - Determinant - Cofactor expansion, Row Reduction Methods - Crammer Method - Least square Method - Dot Product, orthogonal projection - Cross product - Space and subspace
Matrices and Matrix Operations 2

WEEK
8

CONTENTS (FINAL EXAM)

- Linear independence - Linear Combination - Basis and Dimension - Basis of Subspace - Basis of Column space, Row space - Inner Product Space : Norm, angle and distance - Orthogonal and orthonormal set, projection - Gramm-Schimdt method - Linear Transformation - Transformation matrix - Kernel and Range of T - Eigen Value, Eigen Vector - Diagonalization - System of Differential equations
Matrices and Matrix Operations 3

9 10

11 12 13 14
August 7, 2008

MATRICES
Matrix Notation
Definition A matrix is a rectangular array of numbers. The numbers in the array are called entries in the matrix. The entry in row i and column j is denoted by the symbol aij Size of matrix is described as in terms of the number of rows and columns it contains a11 a12 K a1n a a22 K a2 n A General m x n matrix is written as 21 M M M M am1 am 2 K amn
August 7, 2008 Matrices and Matrix Operations 4

MATRICES
Matrix Notation
a11 a 21 am1 a12 a22 am 2 a1n a2 n amn
Row 1

Entry row m and column j

Column 2

August 7, 2008

Matrices and Matrix Operations

MATRICES
Square Matrix of order n
a matrix with n rows and n columns main diagonal : a11,a22,,ann
Order 2 Order 3

1 3 A= 2 4

1 2 5 B = 2 1 4 3 3 3

Main diagonal
August 7, 2008 Matrices and Matrix Operations 6

MATRICES
Identity Matrices
A Square matrix with 1s on the main diagonal and 0s off the main diagonal. Identity matrix is denoted by I

I 2x2

1 0 = 0 1

I 3x 3

Zero Matrices

1 0 0 = 0 1 0 0 0 1

A matrix all of whose entries are zero

0 0 0 0 0 0 0 0 0 0 [0 0 0]
August 7, 2008 Matrices and Matrix Operations 7

MATRICES
Triangular Matrices
A Square matrix in which all the entries above the main diagonal are zero (lower triangular) A Square matrix in which all the entries below the main diagonal are zero (upper triangular)
lower triangular 4x4
a11 a 21 a31 a41 0 a22 a32 a42 0 0 a33 a43 0 0 0 a44

upper triangular 4x4

a11 0 0 0 a12 a22 0 0 a13 a23 a33 0 a14 a24 a31 a44

August 7, 2008

Matrices and Matrix Operations

MATRICES
Reduced row-echelon form Matrices
Properties of Reduced row-echelon form 1. If a row does not consist entirely of zeros, then the first non-zero number in the row is 1. We call this (number 1) a leading 1 2. If there are any row that consist entirely of zeros (not-null row), then they grouped together at the bottom of the matrix 3. In any two successive not-null row, the leading 1 in the lower row occurs farther to the right than the leading 1in the higher row 4. Each column that contain leading 1 has zeros everywhere else We will solve a system of linear equations (next chapter) easier when the augmented matrices in reduced row echelon form. Matrix has only properties 1,2 and 3 is called has row-echelon form
August 7, 2008 Matrices and Matrix Operations 9

MATRICES
Reduced row-echelon form Matrices
Example of reduced row-echelon matrices

1 0 2 0 1 3

1 0 3 2 0 1 1 2

1 0 2 1 0 1 1 2 0 0 0 0
Properties 4

Example of matrices not in reduced row-echelon form

1 0 2 0 2 3

1 1 3 2 0 1 1 2
Properties 1

0 1 2 1 1 0 1 2 0 0 0 0

Properties 3

August 7, 2008

Matrices and Matrix Operations

10

Operations on Matrices
Addition and Subtraction matrix Scalar Multiples Multiplying Matrices Transpose of a Matrix Trace of a Matrix Elementary Row Operations

August 7, 2008

Matrices and Matrix Operations

11

Operations on Matrices
Addition and Subtraction
Definition If A and B are matrices of the same size, then the sum A+B is the matrix obtained by adding entries of B corresponding entries of A matrix and the difference AB is the matrix obtained by subtracting entries of B corresponding entries of A matrix . Example : addition

1 3 3 5 1 + 3 3 + 5 2 4 + 4 6 = 2 + 4 4 + 6

4 8 = 6 10

Example : subtraction
August 7, 2008

1 3 3 5 1 3 3 5 2 2 2 4 4 6 = = 2 2 2 4 4 6
Matrices and Matrix Operations 12

Operations on Matrices
Scalar Multiples
Definition If A is any matrix and k is any scalar, then the product kA is the matrix obtained by multiplying each entry of the matrix A by k Example : scalar multiples

1 2 3 3 4 5 6

3 .1 3 .2 3 .3 = 3 .4 3 .5 3 .6

3 6 9 = 12 15 18

August 7, 2008

Matrices and Matrix Operations

13

Operations on Matrices
Multiplying Matrices
Definition If A is m x r matrix and B is r x n matrix, then the product A x B is the m x n whose entries are determined as follows. The entry in row i and column j of AB given by formula (AB)ij = ai1b1j+ ai2b2j++ airbrj Example : multiplying matrices

1 2 3 4 5 6

1 2 1.1 + 2.2 + 3.1 1.2 + 2.3 + 3.4 8 20 2 3 = 4.1 + 5.2 + 6.1 4.2 + 5.3 + 6.4 = 20 47 1 4
Matrices and Matrix Operations 14

August 7, 2008

Operations on Matrices
Transpose of a Matrix
Definition If A is any m x n matrix, then the transpose of A, denoted by AT, is defined to be the n x m matrix that the results from interchanging the rows and columns of A Example : transpose of a matrix

1 2 3 A= 4 5 6

1 4 AT = 2 5 3 6
Matrices and Matrix Operations 15

August 7, 2008

Operations on Matrices
Trace of a Matrix
Definition If A is n x n square matrix, then the trace of A, denoted by tr(A), is defined to be the sum of the entries on the main diagonal of A, or given by formula tr(A) = a11+a22++ann Example : trace of a matrix

1 4 7 A = 2 5 8 3 6 9
August 7, 2008

tr(A) = 1+5+9=15

Matrices and Matrix Operations

16

Operations on Matrices
Elementary Row Operations (ERO)
Elementary row operations are operations to eliminate matrix to be reduced row-echelon form. When we have the (augmented matrix) reduced row-echelon form, we will get solutions of system of linear equations easier. We will discuss this more at the next chapter There are three types of operations 1. Multiply a row through by a nonzero constant 2. Interchange two rows 3. Add a multiple of one row to another row

August 7, 2008

Matrices and Matrix Operations

17

Operations on Matrices
Steps in elimination
(Create reduced row-echelon form) We have matrix Amxn Go to first row, Change entry a11 to be 1 (choose the simplest operation) Change entries a21, a31,..,am1 to be 0 Go to first next row, Change entry a22 to be 1 (we pass this step when a22=0 and go to the next entry a2k) Change entries a1k, a3k,..,amk to be 0 Repeat step 3 and 4 until the last row (we will get reduced rowechelon form)
Matrices and Matrix Operations 18

August 7, 2008

Operations on Matrices
Example elimination using ERO
3 1 1 8 A = 1 1 0 3 2 1 1 7

Reduced row echelon form ? Leading 1

1 1 1 0 1 1 3 3 r1 + r 2 8 ~ 7 1 0 2 1 2 1 0 1 1 3 1 7

a11 not leading 1

3 A = 1 2 1 1 1 1 0 1 8 3 7
r1 r 2 1 3 ~ 2

not zero Interchange row 1 and row 2 * Add -3 x row 1 to the second row *

* we also can choose another operation

August 7, 2008 Matrices and Matrix Operations 19

Operations on Matrices
Example elimination using ERO (2)
1 0 2 1 2 1 0 1 1 3 1 2 r1 + r 3 1 0 ~ 7 0 1 2 1 0 1 1 3 1 1 1 3r 3 + r 2 0 ~ 0

Leading 1
1 1 1 0 2 1 3 4 1

Add -2 x row 1 to the third row

r 2 + r1 1 0 ~ 0

Add -3 x row 3 to the second row

0 1 0 2 2 1 7 4 3

0 1 1

2 2 1

7 4 1

r 2 + r 3 1 0 ~ 0

r3 ~

1 0 0

0 1 0

2 2 1

7 4 3

Add -1 x row 2 to the first row

Multiple row 3 by -1

Add 1 x row 2 to the third row

August 7, 2008 Matrices and Matrix Operations 20

Operations on Matrices
Example elimination using ERO (3)
1 0 0 0 1 0 2 2 1 7 4 3
2r3 + r 2 ~

1 0 0

0 1 0

2 0 1

7 2 3

2r 3 + r1 1 0 ~ 0

0 1 0

0 0 1

1 2 3

Leading 1

Add -2 x row 3 to the first row Reduced row echelon form

Add 2 x row 3 to the second row Notes

1. All ERO notations above is given to help students in understanding this material. We dont have to write this notations at the next chapter 2.August can also group some ERO notations to make shortly We 7, 2008 Matrices and Matrix Operations
21

Operation in Matrices
Properties of Matrix Operations
a. A+B=B+A b. A+(B+C)=(A+B)+C c. A(BC)=(AB)C d. A(B+C)=AB+AC e. k(AB)=(kA)B ; k : skalar f. (AT)T=A g. (AB)T=BTAT

August 7, 2008

Matrices and Matrix Operations

22

Exercises
Consider these matrices
1 2 1 1 2 A = 2 3 1 B = 2 1 3 4 1 1 2

2 2 1 C= 3 1 2

1 3 D= 2 4

2 E = 3 1

1. Compute the following a. BC d. CB b. A BC e. D CB c. CE f. EET A

2. Which matrices below are in reduced row echelon form ?

1 a . 0 0 0 1 0 2 2 0 7 1 4 b. 0 0 0 0 0 1 1 c. 0 0 1 1 0 0 0 1 1 d . 0 0 2 0 0 0 1 0 0 0 1
23

August 7, 2008

Matrices and Matrix Operations

Exercises
3. Reduced matrices below to reduced row echelon form
1 a . 0 2 1 1 2 0 2 2 3 4 10 3 b. 1 2 2 3 1

1 c. 2 3

1 2 3

1 1 0

1 1 0

1 2 1

1 d . 2 3

2 4 6

3 6 9

August 7, 2008

Matrices and Matrix Operations

24