Convex Analysis And Optimization

Convex Analysis And Optimization

Chap.1 Basic Convexity Concepts Section1.4 Relative Interior, Closure, and Continuity

Naoki Ito

July 8, 2012

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of Proposition 1.4.1

Proposition 1.4.1 C : Nonempty convex set
a

(Line Segment Principle) x ri(C), x cl(C) x + (1 ) ri(C) for (0, 1] x

Proof) (i)The case in x C Let x = x + (1 ) x ( (0, 1]) Since x ri(C), > 0 s.t. B(x, ) a(C) C The each point of B(x , ) a(C) is a convex combination of x and some point of B(x, ) a(C) Therefore, by the covexity of C, B(x , ) a(C) C, implying that x ri(C) . . . . .

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of Proposition 1.4.1(a)(cont)

(ii)The case in x C / Let xk C x

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of Proposition 1.4.1(a)(cont)

(ii)The case in x C / Let xk C x Let xk, = x + (1 )xk xk, x

( (0, 1])

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of Proposition 1.4.1(a)(cont)

(ii)The case in x C / Let xk C x Let xk, = x + (1 )xk xk, x As (i), we see that > 0 s.t.

( (0, 1])

B(x, ) a(C) C for allk 0

and B(xk, , ) a(C) C

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of Proposition 1.4.1(a)(cont)

(ii)The case in x C / Let xk C x Let xk, = x + (1 )xk xk, x As (i), we see that > 0 s.t.

( (0, 1])

B(x, ) a(C) C for allk 0

and B(xk, , ) a(C) C Since xk, x N 0, k N 2

.

s.t. B x ,

B(xk, , )

It follows B(x , ) a(C) C 2

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1(b)
Proposition 1.4.1 C : Nonempty convex set
b

(Nonemptiness of Relative interior) ri(C) is a nonempty convex set a(C)=a(ri(C)) Furthermore... dim(a(C)):= m m>0 x0 , x1 , ..., xm ri(C) = {subspace parallel to a(C)}
. . . . . .

s.t. span{x1 x0 , ..., xm x0 }

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)

Proof) (Convexity of ri(C)) Convexity of ri(C) follows from the Line Segment Principle. ri(C) C cl(C)

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

( Nonemptiness of ri(C) and a(C)=a(ri(C)) ) We assume without loss of generality that 0 C dim(a(C)) := m (i)The case in m = 0

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

( Nonemptiness of ri(C) and a(C)=a(ri(C)) ) We assume without loss of generality that 0 C dim(a(C)) := m (i)The case in m = 0 C = C = {0}

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

( Nonemptiness of ri(C) and a(C)=a(ri(C)) ) We assume without loss of generality that 0 C dim(a(C)) := m (i)The case in m = 0 C = C = {0} a(C) = {0}

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

( Nonemptiness of ri(C) and a(C)=a(ri(C)) ) We assume without loss of generality that 0 C dim(a(C)) := m (i)The case in m = 0 C = C = {0} a(C) = {0} ri(C) = {0}, thus, ri(C) =

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

( Nonemptiness of ri(C) and a(C)=a(ri(C)) ) We assume without loss of generality that 0 C dim(a(C)) := m (i)The case in m = 0 C = C = {0} a(C) = {0} ri(C) = {0}, thus, ri(C) = thus, a(C)=a(ri(C)) a(ri(C)) = {0}

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

(ii)The case in m > 0 We can take m linearly independent vectors z1 , ..., zm C that span a(C)

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

(ii)The case in m > 0 We can take m linearly independent vectors z1 , ..., zm C that span a(C) Consider the set X = {x|x = m i zi , i=1 ( X is open. X C)
m i=1 i

< 1, i > 0 (i = 1, ..., m)}

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

(ii)The case in m > 0 We can take m linearly independent vectors z1 , ..., zm C that span a(C) Consider the set X = {x|x = m i zi , i=1 ( X is open. X C) We will show X is open relative to a(C) X, > 0 x s.t. B(, ) a(C) X x
m i=1 i

< 1, i > 0 (i = 1, ..., m)}

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Fix x X and let x a(C) We have unique m-dimensional vectors , such that x = Z , x = Z (where Z := [z1 , ..., zm ])

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Fix x X and let x a(C) We have unique m-dimensional vectors , such that x = Z , x = Z (where Z := [z1 , ..., zm ]) Since Z Z is symmetric and positive denite, we have for some > 0, which is independent of x and x, xx
2

= ( ) Z Z( )

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Fix x X and let x a(C) We have unique m-dimensional vectors , such that x = Z , x = Z (where Z := [z1 , ..., zm ]) Since Z Z is symmetric and positive denite, we have for some > 0, which is independent of x and x, xx
2

= ( ) Z Z( )

Since x X, lies in the open set

m

A=

(1 , ..., m )|
i=1

i < 1, i > 0 (i = 1, ..., m)

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Such the can be constructed as below. Since A is open set, > 0 s.t. B(, ) A := 2 then, 2 < = 2

<

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Such the can be constructed as below. Since A is open set, > 0 s.t. B(, ) A := 2 then, 2 < = 2

<

...implying that x X

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Such the can be constructed as below. Since A is open set, > 0 s.t. B(, ) A := 2 then, 2 < = 2

<

...implying that x X Hence X contains B()a(C), so X is open relative to x a(C).

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Such the can be constructed as below. Since A is open set, > 0 s.t. B(, ) A := 2 then, 2 < = 2

<

...implying that x X Hence X contains B()a(C), so X is open relative to x a(C). It follows that X, x ri(C), so that ri(C) = . x

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

The proof of proposition 1.4.1(b)(cont)

Take the such that the where A. (i.e. x = Z belongs to X)
2

< belongs to

Such the can be constructed as below. Since A is open set, > 0 s.t. B(, ) A := 2 then, 2 < = 2

<

...implying that x X Hence X contains B()a(C), so X is open relative to x a(C). It follows that X, x ri(C), so that ri(C) = . x Also, a(X) = a(C) (since by construction), X ri(C)( C), we see that a(ri(C))=ri(C).
. . . . . .

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1(b) (written again)

m>0

x0 , x1 , ..., xm ri(C) = {subspace parallel to a(C)}

s.t. span{x1 x0 , ..., xm x0 }

Proof) consider vectors

m

x0 =
i=1

zi ,

xi = x0 + zi ,

i = 1, ..., m

where is positive scalar that (m + 1) < 1

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1(b) (written again)

m>0

x0 , x1 , ..., xm ri(C) = {subspace parallel to a(C)}

s.t. span{x1 x0 , ..., xm x0 }

Proof) consider vectors

m

x0 =
i=1

zi ,

xi = x0 + zi ,

i = 1, ..., m

where is positive scalar that (m + 1) < 1 xi X ri(C) (i = 0, 1, ..., m)

. . . . . .

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1(b) (written again)

m>0

x0 , x1 , ..., xm ri(C) = {subspace parallel to a(C)}

s.t. span{x1 x0 , ..., xm x0 }

Proof) consider vectors

m

x0 =
i=1

zi ,

xi = x0 + zi ,

i = 1, ..., m

where is positive scalar that (m + 1) < 1 xi X ri(C) (i = 0, 1, ..., m) xi x0 = zi (i = 0, 1, ..., m) span a(C). . .

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1 (c)

Proposition 1.4.1
c

x ri(C) C, > 1 x

s.t. x + ( 1)(x x) C

Proof) ) (trivial) ) Since ri(C) = , there exists some x ri(C)

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1 (c)

Proposition 1.4.1
c

x ri(C) C, > 1 x

s.t. x + ( 1)(x x) C

Proof) ) (trivial) ) Since ri(C) = , there exists some x ri(C) If x = x, we are done. So, we assume x = x.

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1 (c)

Proposition 1.4.1
c

x ri(C) C, > 1 x

s.t. x + ( 1)(x x) C

Proof) ) (trivial) ) Since ri(C) = , there exists some x ri(C) If x = x, we are done. So, we assume x = x. By the given condition, since x C, there exists a > 1 s.t. y = x + ( 1)(x x) C

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.1 (c)

Proposition 1.4.1
c

x ri(C) C, > 1 x

s.t. x + ( 1)(x x) C

Proof) ) (trivial) ) Since ri(C) = , there exists some x ri(C) If x = x, we are done. So, we assume x = x. By the given condition, since x C, there exists a > 1 s.t. y = x + ( 1)(x x) C
1 Thus, we have x = 1 x + y By using Line Segment Principle, we obtain x ri(C)
. . . . . .

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.2 X : Nonempty convex subset of Rn f : X R , concave X := {x X|f (x ) = inf xX f (x)} X ri(X) = f must be constant over X, i.e., X = X

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.3 C, C: Nonempty convex sets.

a b c

cl(C) = cl(ri(C)) ri(C) = ri(cl(C)) Following three conditions are equivalent.

i ii iii

ri(C) = ri(C) cl(C) = cl(C) cl(C) ri(C) C

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.4 C : Nonempty convex subset of Rn A : m n matrix

a b

A ri(C) = ri(A C) A cl(C) cl(A C) Furthermore, if C is bounded A cl(C) = cl(A C)

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.5 C1 , C2 : Nonempty convex sets

a

ri(C1 ) ri(C2 ) ri(C1 C2 ), cl(C1 C2 ) cl(C1 ) ri(C2 ) Furthermore, if ri(C1 ) ri(C2 ) = , then ri(C1 ) ri(C2 ) = ri(C1 C2 ), cl(C1 C2 ) = cl(C1 ) ri(C2 ) ri(C1 + C2 ) ri(C1 ) + ri(C2 ), cl(C1 ) + cl(C2 ) cl(C1 + C2 ) Furthermore, if at least one of the sets C1 and C2 is bounded, then cl(C1 ) + cl(C2 ) = cl(C1 + C2 )

Convex Analysis And Optimization Basic Convexity Concepts Relative Interior, Closure, and Continuity

Proposition 1.4.6 f : Rn R is convex f : Rn f is continuous.

(, ] is a proper convex function f is continuous over the ri(dom(f )).