Академический Документы
Профессиональный Документы
Культура Документы
Structure
Introduction
Objectives
Quadratic Forms
Quadratic Form as Matrix Product
Transformation of a Quadratic Form Under a Change of Basis
Rank of a Quadratic Form
Orthogonal Canonical Reduction
Normal Canonical Form
Summary
Solutions/Answers
14.1 INTRODUCTION
S o far you have studied various kinds of matrices and inner products. In this unit we shall
discuss a particular kind of inner product, which is closely connected to symmetric matrices.
This is called a quadratic form. It can also be thought of as a particular kind of second
degree polynomial, which is the way we shall first define it. We will discuss the geometric
aspect of a particular case of quadratic forms in the next unit.
Quadratic forms are encountered in various mathematical and physical problems. For
example, in physics, expressions for moment of inertia, energy, rate of generation of heat
and stress ellipsoid in the theory of elasticity involve quadratic forms. Quadratic forms also
appear while studying chemistry, the life sciences, and of course, many branches of
mathematics.
In this unit we shall always assume that the underlying field is R.
Before going further make sure that you are familiar with Units 12 and 13.
Objectives
After reading this unit, you should be able to
identify a real quadratic form;
find the symmetric matrix associated to a quadratic form;
calculate the rank of a quadratic form;
obtain the orthogonal canonical reduction of a quadratic form;
find the normal canonical reduction of a quadratic form;
calculate the signature of a quadratic form.
I A polynomial is called
homogeneous if each of i t 9 a quadratic form over R of order n. where the all'sare real constants and x,. x?, . . . . . , xn are
terms has the same degree real variables.
Note: These expressions are called quadratic, since they are of second degree. They are
called forms, since every term in them has the same degree.
We are now ready to make a formal definition.
Definition: A homogeneous polynomial of degree two is called a quadratic form. Its order
is the number of variables that occur in it.
For example. x2- 3y2+ 4xz is a quadratic form of order 3.
A quadratic form is real,if its variables can only take real values and the coefficients are real
numbers. We have already stated. in the unit introduction, that all spaces considered in this
unit shall be over R. Therefore, by a quadratic form we shall always mean a real
quadratic form.
From the definition of a quadratic form it is clear that a real valued function will be a
quadratic form if and only if it satisfies each of the following conditions:
a ) it is a polynomial.
b) it is homogeneous. and
C) it is of degree two.
Let us look at some examples now.
Example 1: Which of the following are quadratic forms? In the case of quadratic foims.
find the order.
g ) x' + logx.
Solutions: (c) is an equation, and not a polynomial. (a) and (e) are polynomials, but they are
not homogeneous. (0is a polynomial which is homogeneous, but its degree is three and not
two. (g) is not a polynomial. Only (b) and (d) represent quadratic forms. (b) involves three
variables, and hence, its order is three. (d) involves two variables, and thus, has order two.
Try the following exercises now.
E I ) Give an example of a function that is
a) a non-homogeneous polynomial of degree 2.
b) a homogeneous polynomial. but not of degree 2.
E 2) Which of the following represent quadratic forms?
3
a ) x--xy
b ) xI +x2
C) x;
Real ~urdroticForm
d) x3 - xY2 I
e) sin (x2 + 2y2)
f ) x:-Jzx;=o
E 3) Find the values of the.integer k for which the following will represent quadratic forms.
a) x2 -zy2 kxy2-
b) xk +2y2
c) x: + 2x,x2 - x:
E 4) Let Q, and Q, be two quadratic forms, both of order n; in the n variables x,, x,, .... ,x,,.
Which of the following will be a quadratic fonn?
QI + 4,. aQ1 + bQ2,Q1 - Qy Q1Q2~Q1/Qr
Let us now see how to represent a quadratic form as a product of matrices. In fact, you will
see how a quadratic form can be written as an inner product.
The question now is whether we can replace the matrix A by another matrix without
' changing the quadratic iorm Q. In fact, you can check that
Q = X'CX, where C =
[: -;I.
Thus, we see that if we replace A by B or C in (I), the qua4ratic form is not changed. This
shows us that the choice of the matrix A in (1) is not unique. In this section we shall find the
reason for this, and also investigate the general matrix which can replace A in (1).
Note that wk can also write Q = {AX, X), where {Y,2)=Z'Y for any Y,Z E V, (R). So, as
you go along, remember that we are simultaneously discussing the representation of Q as a
matrix product, as well as an inner product.
Look carefully at the matrices A, B and C, given above. Do they have a common fGture?
You must have noticed that the diagonal elements of all these matrices are the same, i.e.,
A, B and C have the same diagonal. Now, what about the off-diagonal (i.e.+nondiagonal)
entries? Have you noticed that the sum of the offdiagonal entries in all these matrices is 2?
Note that the coefficient ofthe term xy, of the given quadratic form, is also 2.
E 5) Change one of the diagonal entriesof A and verify that this will change the quadratic
form.
Inner Products and
Quadratic Forms In fact, any matrix P = [i l] ,with a + b = 2, can replace A without changing the quadratic
Observe that you could have obtained the quadratic form simply by applying the rule (2) as
follows:
Comparing the given matrix A with the matrix in (2) gives
coef. of xZ= 1, coef. of yZ= 1. (112) coef. of xy = -1.
Therefore, the required quadratic form is x2- 2xy + y2.
The above discussion involved matrices and quadratic forms of order two. It can be
extended to matrices and quadratic forms of higher orders. Let us look at the case of
quadratic forms of order 3.
Let us consider a general 3 x 3 matrix
1
1 1 ...... ( 5 )
A'= - coef. of x I x 3 coef. of X; - coef. of x2x3
If
- coef. of x,x3
I
2
We sum up the above discussion as follows:
2
- coef of x2X3 coef. of x i
Given a quadratic form of order 3, there are infinitely many matrices of order 3 which will
generate it. However, a symmetric matrix that will generate a quadratic form of order three
is unique. This symmetric matrix is called the matrix associated to the quadratic form, or
simply, the matrix of the quadratic form.
Just as in the case of order 2 forms, there is a one-to-one correspondence between the set of
all symmetric matrices of order three and the set of all quadratic forms of order three. The
next few examples will illustrate the above discussion.
Example 5: Find the quadratic form Q corresponding to the symmetric matrix
But, a quicker way is to use the rule (5). Comparing the entries of A' in (5) with those of A
above we can obtain all the coefficients of the quadratic form as follows:
1-: -;9]
2 1 -3
Example 7.: Find the quadratic form associated with the zero matrix of order three.
Solution: All the entries of a zero matrix are zero. Therefore. using ( 5 ) , we get all the
coefficients to be zero. The associated quadratic form is, then,
OX; + O X $+OX: +Ox,x2 +Ox,x, +OxZx3,
0 -I
Can we extend the comments about quadratic forms of order two and three to a quadratic
form of any finite order n? Yes. You.know that a general quadratic form of order n is given
by
n
Q= a i j x i x j , where aij = aji+i, j = I ,..., n.
1*j=I
4 0 0 2
0 0 0 4
Find the symmetric matrix A' such that X'AX = X'A'X.
Before going further, we would like to remind you that the quadratic form of order n, XtAX,
is simply the inner product (AX, X) in Vn(R).
Let us now see what happens to the matrix of a quadratic form if we change the basis of the
underlying vector space.
You have seen, in Unit 7, that P is invertible. Note that the columns of P are the components
of the vectors of the new basis B', expressed in terms of the original basis B.
Now, if X' = [x, ,..., xn]and Y' = [y, ,..., yn]denote the coordinates of a vector in Rn with
respect to B and B', respectively, then
- - - -
xi = x a i j Y j v i = I, 2 ....,n.
j=l
This is equivalent to the matrix equation
i.e., X = PY., ,
~.
.
~ .~
This equation is the coordinate transformation correspond;lng to the change of basis from B Real Quadratic Forms
to B'. The change of basis will convert the quadratic form X'AX into
(PY)' A(PY) = Yt(P'AP)Y
= Y'CY, where C = P'AP.
But, is C symmetric? Well, C' = (P'AP)' = P'AP = C.
:. , C is symmetric.
The above discussion shows that, under a change of basis given by the invertible matrix P,
the coordinate transformation is given by X = PY, and the quadratic form X'AX gets
transformed into another quadratic form YtCY, where C = P'AP. This leads us to the
following definitions.
Definitions: Two real symmetric matrices A and B are called congruent if there exists an
invertible real matrix P such that B = PtAP.
Two quadratic forms X'AX and Y'BY are called equivalent if their matrices, A and B, are
congruent.
In particular, if the matrices A and B are orthogonally similar (see Unit 13) then the
corresponding quadratic forms, XtAX and Y'BY are called orthogonally equivalent.
So, under a change of basis, a quadratic form gets transformed to an equivalent quadratic
form. They may or may not be orthogonally equivalent. Let us look at an example.
Example 9: Consider the change of basis of R2 from the standard basis B, = {(I,O), (0.1))
to B, = ((1, O), (1,2) 1. Let (x,, x2)and (y ,, y,) represent coordinates with respect to B, and
B,, respect&ely.
a) Find the coordinate transformation that expresses x,, x, in terms of y ,,y,.
b) Let Q(X) = x: - 2x,x2 +4x$. Find the expression of Q in terms of y, and y,.
d
Solution: a) The change of basis from B, to B, is given by the coordinate transformation.
i.e.. x, = y, + y,
X2 = 2y2,
which is the required coordinate transformation.
Thus, under the change of basis given by X = PY, the given quadratic form transforms
into (4).
The following exercises will give you some more practice in dealing with quadratic forms
u- ..k a. change of basis.
Inner Products and
Quadratic Forms
Real Quadratic Forms
where [x,, x,, x,] are the coordinates of X with respect to the standard basis of R3.
a) Find the expression of Q with respect to the basis
x = / $ -'
6 f i
'
3
I Y = P Y (say)
The change of coordinates given by X = PY will convert X'AX into Yt(PAP)Y, where
, .,2.
Q ( Y ) = ~ Y+Y:.
?
wHich is the required quadratic form.
Note that P ig & orthogonal matrix. :.Q(X) and Q(Y) are orthogonally equivalent.
' d '
Now, as we have seen, under a change of basis a quadratic form gets transformed to an
equivalent quadratic form. We will show that all quadratic forms can be divided into
equivalence classes based on the relationship between their matrices. Recall from Unit I that
a relation is an equivalence relation if and only if it is reflexive, symmetric and transitive.
E E16) Recall the definition of congruent and orthogonally similar matrices. Show that the
relations of congruence and orthogonal similarity between matrices are equivalence
relations.
because of (1).
Thus X'AX is orthogonally equivalent to the diagonal form in (3) whose coefficients are the
eigenvalues of A. The form in (3) is called an orthogonal canonical reduction of X'AX.
We say that the orthogonal transformation (2) has reduced the quadratic form X'AX into
its orthogonal canonical form, given by (3). The form in (3) is orthogonal since the
transformation used to convert X'AX into it is orthogonal. It is called canonical as the
reduced form is the simplest orthogonal reduction of X'AX. The elements of the basis which
diagonalise the quadratic form (in this case they are U, ..... U,) are called the principal axes
of the quadratic form. In Unit 15 you will realise why they are called axes.
We can summarise the above discussion in the form of a theorem.
Theorem 4: A real quadratic form X'AX can always be reduced to the diagonal form
h l Y ?+...+ h n Y i
by an orthogonal change of basis, where A,, . . . . . . Anarethe eigenvalues of A. The new
ordered basis is an orthonormal set of eigenvectors corresponding to the eigenvalues
h, ....... A".
Now, if the matrix of a quadratic form is orthogonally similar.to diag ( h,, . . . . . . h,), it is
also orthogonally similar to diag (A,, h, . . . . . . . A,). Thus, the orthogonal canonical form to
which a quadratic form is orthogonally equivalent is unique except for the order of the
coefficients. If we insist that the non-zero eigenvalues be written in decreasing order
followed by the zero eigenvalues, if any, then we can obtain a unique orthogonal canonical
form.
So, we can state the following result.
Theorem 5: A quadratic form of rank r is orthogonally equivalent to a unique orthogonal Real Quadratic Forms
canonical form ily? + ... + i r ywhere .
f , A, , . . . . . hrare the non-zero eigenvalues of the
matrix of the quadratic form, such that A, 2 A2 2 . . . . 2 Ar.
Proof: Let X'AX be a quadratic form of rank r. Then rank (A) = r. Therefore, A has r non-
zero eigenvalues. We write them as A, , . . . . . , Ar, in decreasing order. Now, by Theorem 4
we get the required result.
So far we have spoken about the orthogonal canonical form in an abstract way. Let us now
i look at a practical method of reducing a quadratic form to its orthogonal canonical form.
t Step by step procedure for orthogonal canonical reduction: We will now give the
sequence of operations which are needed to reduce a given quadratic form to its orthogonal
canonical form, and to obtain the required coordinate transformations or the new basis.
I ) Construct the symmetric matrix A associated to the given quadratic form x a i j x i x j .
i.j=l
2) Form the characteristic equation
I det (A - XI) = 0
.
and find the eigenvalues of A. Let A,, . . . . . Ar be the non-zero eigenvalues arranged in
decreasing order, i.e., A, 2 A, 2 . . . . 2 hr.
3) An orthogonal canonical reduction of the given quadratic form is
The normalised eigenvectors corresponding to the eigenvalues 8 and 2 are U, and U,, where
u, = [ - l f h/ ] h and U2 = [ l lf h/ ] f i
Inner Productsand Quadratic Thus, the newmthonormal basis is (U,, U,], which is the canonical basis. U, and U, are the
Forms
principal axes of the given form.
The associated coordinate transformation will be
Now we look at an example in which the associated matrix has repeated eigenvalues.
Example 12: Consider the quadratic form
x2+ y2+ z2+ 2xy + 2xz + 2yz ...... (1)
Find its orthogonal canonical reduction and the corresponding new basis.
Solution: The matrix of (I) is
i i]
The eigenvalues of A are 3,O. 0. Thus, the orthogonal canonical reduction of (1) is
Here we can choose any two mutually orthogonal normalised vectors satisfying (3). Let us
choose
- b
which is the canonical basis. Its elements are the principal axes of (I). The change of basis
needed to convert ( I ) into (2) is given by
We again observe that the canonical basis, principal axes and the coordinate transformation
needed for reduction are not uniquely determined. We could have chosen any two mutually
orthogonal orthonormal eigenvectors of 0.
The next few exercises will give you some practice in applying the procedure of reduction.
E El81 Find the orthogonal canonical forms to which the following quadratic forms can be
reduced by means of an orthogonal change of basis. Also obtain a set of principal
axes for them.
a) x2 + 4xy + y2
b) 8x2- 4xy + 5y2
i
Inner Products and Quadratic
-
0, if a = O
This is a non-singular transformation which will convert (2) into
sign(& )z: +. .....+ sign (h, ) z i ..... (4)
i.e., sign ( h , ) z ?
For example, x' - y' is a normal canonical form, but 2x2+ y2 is not.
The procedure involved in transforming ( 1 ) to (4) is described as reducinga quadratic
form to its normal canonical form.
E21) The transformation (3) is not, in general, an orthogonal transformation. Under what
conditions will i! become orthogonal?
E E22) Reduce the following quadratic forms to their normal canonical forms.
E E23) Show that the rank of a normal canonical form is the number of non-zero terms in its
expression.
E E24) Show that a quadratic form ~ ~ its
n dnormal c;~noli~~..lI
r c ~ l ~ c t i ohave
n the same rank. Kcol Qurdrntir Fcms
But is a normal canonical reduction ot'a qu;~rlraticI'orm unique? In other words. is the
number of positive terms in a normill cinonical reduction ol'n quadratic form uniquely
r question in the fcdlowing tlicorcni. due to the English
determined? W e ~ n s w e this
mathematician J.J. Sylvester ( l X 14-1 897 ).
I n
where Y = x y , v l .
!
i
1=I
Thus. ( I ) and (2) are both normal canonical reductions of Q, in which the number of positive
terms are p and p'. respectively. T o prove the theorem we have to prove that p = p'. Let U
and V be the subspaces of R" generated by { u ,. . . . . . . . up) and ( v ~ , + .~., . . . . v n ) ,
1 respectively.
Thus. dim U = p and dim V = n - p'. W e will show that U n V = ( 0 )
Suppose U nV # ( 0 ) .Let O # u E U n V.
Now. since u E U and u * 0. we have
u = a , u , + . . . . . + al,ul,.a, E R ++i. where a, # 0 for some i
Thcrcforc, from (1)
Q ( u ) = a f + . . . . + a 2I' > O ...... (3)
Al\o. 4lnce u E V. we havc
~ ~ = b l , ~ A i+~. .l .,.r. + b, , , v , , . b , E P ~ Ib ,. t O for \ome i.
:. . fro111 ( 2 ) we get Q ( u ) = -b' ,,+,- . . . . . - b : < O ...... (4)
( 3 ) and ( 4 ) bring u\ t o a contrad~ction.:. .our suppos~tionmust b e wrong.
:. u n v = (01.
At t h ~ \tage.
\ recall from Unit 3 that
dl111 11 + d u n V - d i m (U nV) = dlm (U + V )
Theretore.
f
Inner Products and 'PIP' ...... (5)
1 Quadratic Forms
Interchanging the roksof p and p' in the above argument, we get
P'IP ...... ( 6 )
(5) and (6) show that p = p', which proves the theorem.
By Theorem 1 and Sylvester's theorem the rank r and number p remain unchanged under a
change of basis, i.e., under a non-singular transformation. Hence. the number 2p - r also
remainsunchanged.
Definition: The signature of a quadratic form is defined to be
(the number of positive terms) - (the number of negative terms) appearing in its normal
canonical reduction. It is denoted by the letter s.
Thus, s = p - (r - p) = 2p - r.
For example, for the form in Example 13, we have p = 2, r = 2 and s 2.
For the form in
Example 14, p = 1, r = 3, s = -1.
E25) Find the rank and signature of the quadratic forms given in E 22.
The rank and the signature completely determine the normal canonical reduction. Also, any
two quadratic forms having the same normal canonical reduction will be equivalent. We can,
therefore, state the following result.
Theorem 8: Two quadratic forms are equivalent if and only if they have the same rank and
signature.
In Section 14.3 we said that there is a one-to-one correspondence between the set of all
symmetric matrices of order n and the set of quadratic forms of order n. So we can expect
Sylvester's theorem to have a matrix interpretation. This is as follows:
A symmetric matrix of order n and rank r is equivalent to a unique diagonal matrix of the
tY Pe
And now we end the unit by briefly recalling what we have done in it.
14.8 SUMMARY
In this unit all the spaces considered are over the field R. In it we have covered the
following points.
1) A homogeneous polynomial of degree two is called a quadratic form. Its order is the
number of variables occurring in its expression.
2) Each quadratic form can be uniquely expressed as X'AX, where A is a unique symmetric'
matrix and is called the matrix of the quadratic form.
3) There is a one-to-one correspondence between the set of real symmetric n x n, matrices
and the set of real quadratic forms of order n.
4) Two quadratic forms are called equivalent (respectively, orthogonally equivalent) if their
matrices are congruent (respectively, orthogonally similar). Two equivalent
Real Quadratic Forms
(respectively, orthogonally equivalent) quadratic forms corlvert into each other by a
suitable change of basis.
5) The rank of a quadratic form is defined to be the rank of its matrix.
6) A quadratic form X'AX of rank r is orthogonally equivalent to a unique diagonal form
A,y:+ ..... +Ary:, A 1 2 A 2 2..... >Ar,
called its orthogonal canonical reduction, where A, , . . . . . , hr are the non-zero
eigenvalues of A.
E4) The first three will be quadratic forms, if they are non-zero. QlQ2will be of degree 4.
Ql/Q2will also not be quadratic; in fact, it may not even be a polynomial.
the matrix p = L2
The coordinate transformation corresponding to the change from B, to B, is given by
1 -2
I], :., the matrix of the form will now be
with respect to the bases B and B', respectively. Then the coordinate transformation is
given by
-2 3 6
Congruence is
i) reflexive :A = I'AI
ii) symmetric: If A = P'BP, then B = (PI)'
A (P-I).
iii) transitive: If A = P'BP and B = RtCR for some invertible matrices P and R, then
A = (RP)' C(RP), and RP is an invertible matrix.
:. , congruence is an equivalence relation,
Real Quadratic Forms
Orthogonal similarity is
i) reflexive: A = I'AI, and I is an orthogonal matrix.
ii) symmetric: If P is an orthogonal matrix such that A = P'BP, then
B = (P-')' A(P-I) , and F'is also an orthogonal matrix.
iii) transitive: A = P'BP and B = R'CR* A = (RP)'C(RP).
Also P orthogonal and R orthogonal * RP orthogonal.
.: orthogonal similarity is an equivalence relation
E 17) The required transformation is X = PY, where P = [-U, -U,],
vL
E 18) a) The matrix of the form is A = [:f]. Its eigenvalues are 3 and -1. .: ,the given
I:],
form is equivalent to 3xt - t.~ormalisedeigenvectors corresponding to 3
r ~ i
and -1 are [1 / 4 3]
lid? and respectively. . , they form a set of principal
axes of the form. Remember that the principal axes are not unique.
b) Its orthogonal canonical form is 9 ~ +
: 4y :.
A set of principal axes is
]:;:r[( [::$I.
c) Its orth~gvllalcanonical reduction is 4 f + 4 y: - 2 i.
[:-:
0 2
I:- [i]*2x-y-z=o.
Eigenvectors corresponding to the eigenvalue 4 are given by
2 x
[ 1
-I/&
I, /qaS
be obtained by putting x = 0 and y = 0 respectively, in this equation. So we gel
['
2/&
the required vectors.
E19) Any two forms are orthogonally equivalent iff they have the same orthogonal
canonical forms as given in Theorem 5. :. , their matrices should have the same
eigenvalues (including repetitions).
Now. the eigenvalues of the matrices in (a) and (c) are 12, 12 and -6. :. , the forms
in (a) and (c) are orthogonally equivalent. The matrix of the form in (b) has
.
eigenvalues 9,9, -9. :. it is not orthogonally equivalent to the others.
Inner Products and E20) Both the forms have the same diagonal form, as given in Theorem 5 , namely
Quadratic Forms x'* + yt2- 2 ~ ' ~If.